To saturate or not to saturate? Questioning data saturation as a useful concept for thematic analysis and sample-size rationales

References

• Ando, H., R. Cousins, and C. Young. 2014. “Achieving Saturation in Thematic Analysis: Development and Refinement of a Codebook.” Comprehensive Psychology 3 (4). doi:10.2466/03.CP.3.4.
   Google Scholar
• Bowen, G. A. 2008. “Naturalistic Inquiry and the Saturation Concept: A Research Note.” Qualitative Research 8 (1): 137–152. doi:10.1177/1468794107085301.
   Web of Science ®Google Scholar
• Boyatzis, R. E. 1998. Transforming Qualitative Information: Thematic Analysis and Code Development. Thousand Oaks, CA: Sage.
   Google Scholar
• Bragaru, M., C. P. van Wilgen, J. H. B. Geertzen, S. G. J. B. Ruijs, P. U. Dijkstra, et al. 2013. “Barriers and Facilitators of Participation in Sports: A Qualitative Study on Dutch Individuals with Lower Limb Amputation.” PLoS ONE 8 (3): e59881. doi:10.1371/journal.pone.0059881.
   PubMed Web of Science ®Google Scholar
• Braun, V., and V. Clarke. 2012. “Thematic Analysis.” In APA Handbook of Research Methods in Psychology Vol. 2, edited by, H. Cooper, 57–71. Washington, DC: APA books. Research Designs.
   Google Scholar
• Braun, V., V. Clarke, and N. Rance. 2014. “How to Use Thematic Analysis with Interview Data.” In The Counselling & Psychotherapy Research Handbook, edited by A. Vossler and N. Moller, 183–197. London: Sage.
   Google Scholar
• Braun, V., V. Clarke, G. Terry, and N. Hayfield. 2019. “Thematic Analysis.” In Handbook of Research Methods in Health and Social Sciences, edited by P. Liamputtong, 843–860. Singapore: Springer.
   Google Scholar
• Braun, V., and V. Clarke. 2006. “Using Thematic Analysis in Psychology.” Qualitative Research in Psychology 3: 77. doi:10.1191/1478088706qp063oa.
   Google Scholar
• Braun, V., and V. Clarke. 2013. Successful Qualitative Research: A Practical Guide for Beginners. London: Sage.
   Google Scholar
• Braun, V., and V. Clarke. 2016. “(Mis)conceptualising Themes, Thematic Analysis, and Other Problems with Fugard and Potts’ (2015) Sample-size Tool for Thematic Analysis.” International Journal of Social Research Methodology 19 (6): 739–743. doi:10.1080/13645579.2016.1195588.
   Web of Science ®Google Scholar
• Braun, V., and V. Clarke. 2019. “Reflecting on Reflexive Thematic Analysis.” Qualitative Research in Sport, Exercise and Health 11 (4): 589–597. doi:10.1080/2159676X.2019.1628806.
   Web of Science ®Google Scholar
• Carlsen, B., and C. Glenton. 2011. “What about N? A Methodological Study of Sample-size Reporting in Focus Group Studies.” BMC Medical Research Methodology 11: 26. doi:10.1186/1471-2288-11-26.
   PubMed Web of Science ®Google Scholar
• Chamberlain, K. 2010. “Using Grounded Theory in Health Psychology.” In Qualitative Health Psychology: Theory and Methods, edited by M. Murray and K. Chamberlain, 183–201. London: Sage.
   Google Scholar
• Charmaz, K. 2006. Constructing Grounded Theory: A Practical Guide through Qualitative Analysis. Thousand Oaks, CA: Sage.
   Google Scholar
• Clarke, V., and V. Braun. 2019. “Feminist Qualitative Methods and Methodologies in Psychology: A Review and Reflection.” Psychology of Women and Equalities Review 2 (1): 13–28.
   Google Scholar
• Coenen, M., T. A. Stamm, G. Stucki, and A. Cieza. 2012. “Individual Interviews and Focus Groups with Patients with Rheumatoid Arthritis: A Comparison of Two Qualitative Methods.” Quality of Life Research 21 (2): 359–370. doi:10.1007/s11136-011-9943-2.
   PubMed Web of Science ®Google Scholar
• Constantinou, C. S., M. Georgiou, and M. Perdikogianni. 2017. “A Comparative Method for Themes Saturation (Comets) in Qualitative Research.” Qualitative Research 17 (5): 571–588. doi:10.1177/1468794116686650.
   Web of Science ®Google Scholar
• Critical Appraisal Skills Programme 2018. “CASP Qualitative Checklist. [Online].” Accessed 1 September 2019. https://casp-uk.net/casp-tools-checklists/
   Google Scholar
• Dey, I. 1999. Grounding Grounded Theory. San Francisco, CA: Academic Press.
   Google Scholar
• Eynon, M. J., C. O’Donnell, and L. Williams. 2018. “Gaining Qualitative Insight into the Subjective Experiences of Adherers to an Exercise Referral Scheme: A Thematic Analysis.” Journal of Health Psychology 23 (11): 1476–1487. doi:10.1177/1359105316656233.
   PubMed Web of Science ®Google Scholar
• Francis, J. J., M. Johnston, C. Robertson, L. Glidewell, V. Entwistle, M. P. Eccles, and J. M. Grimshaw. 2010. “What Is an Adequate Sample Size? Operationalising Data Saturation for Theory-based Interview Studies.” Psychology & Health 25 (10): 1229–1245. doi:10.1080/08870440903194015.
   PubMed Web of Science ®Google Scholar
• Fusch, P. I., and L. R. Ness. 2015. “Are We There Yet? Data Saturation in Qualitative Research.” The Qualitative Report 20 (9): 1408–1416.
   Web of Science ®Google Scholar
• Glaser, B. G., and A. L. Strauss. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Chicago: Aldine.
   Google Scholar
• Green, J., and N. Thorogood. 2004. Qualitative Methods for Health Research. London: Sage.
   Google Scholar
• Guest, G., E. Namey, and K. McKenna. 2017. “How Many Focus Groups are Enough? Building an Evidence Base for Nonprobability Sample Sizes.” Field Methods 29: 3–22. doi:10.1177/1525822X16639015.
   Google Scholar
• Guest, G., A. Bunce, and L. Johnson. 2006. “How Many Interviews are Enough? an Experiment with Data Saturation and Variability.” Field Methods 18 (1): 59–82. doi:10.1177/1525822X05279903.
   Web of Science ®Google Scholar
• Guest, G., K. MacQueen, and E. Namey. 2012. Applied Thematic Analysis. Thousand Oaks, CA: Sage.
   Google Scholar
• Hagaman, A. K., and A. Wutich. 2017. “How Many Interviews are Enough to Identify Metathemes in Multisited and Cross-cultural Research? Another Perspective on Guest, Bunce, and Johnson’s (2006) Landmark Study.” Field Methods 29 (1): 23–41. doi:10.1177/1525822X16640447.
   Web of Science ®Google Scholar
• Hancock, M. E., L. Amankwaa, M. A. Revell, and D. Mueller. 2016. “Focus Group Data Saturation: A New Approach to Data Analysis.” The Qualitative Report 21 (11): 2124–2130.
   Web of Science ®Google Scholar
• Hennink, M. M., B. N. Kaiser, and M. B. Weber. 2019. “What Influences Saturation? Estimating Sample Sizes in Focus Group Research.” Qualitative Health Research 29 (10): 1483–1496. doi:10.1177/1049732318821692.
   PubMed Web of Science ®Google Scholar
• Hennink, M. M., B. N. Kaiser, and V. C. Marconi. 2017. “Code Saturation versus Meaning Saturation: How Many Interviews are Enough?” Qualitative Health Research 27 (4): 591–608. doi:10.1177/1049732316665344.
   PubMed Web of Science ®Google Scholar
• Kerr, C., A. Nixon, and D. Wild. 2010. “Assessing and Demonstrating Data Saturation in Qualitative Inquiry Supporting Patient-reported Outcomes Research.” Expert Review of Pharmacoeconomics and Outcomes Research 10: 269–281. doi:10.1586/erp.10.30.
   PubMed Web of Science ®Google Scholar
• Levitt, H. M., M. Bamberg, J. W. Creswell, D. M. Frost, R. Josselson, and C. Suárez-Orozco. 2018. “Journal Article Reporting Standards for Qualitative Primary, Qualitative Meta-analytic, and Mixed Methods Research in Psychology: The APA Publications and Communications Task Force Report.” American Psychologist 73 (1): 26–46. doi:10.1037/amp0000151.
   PubMed Web of Science ®Google Scholar
• Lincoln, Y. S., and E. G. Guba. 1985. Naturalistic Inquiry. Newbury Park, CA: Sage.
   Google Scholar
• Low, J. 2019. “A Pragmatic Definition of the Concept of Theoretical Saturation.” Sociological Focus 52 (2): 131–139. doi:10.1080/00380237.2018.1544514.
   Google Scholar
• Malterud, K., V. K. Siersma, and A. D. Guassora. 2016. “Sample Size in Qualitative Interview Studies: Guided by Information Power.” Qualitative Health Research 26 (13): 1753–1760. doi:10.1177/1049732315617444.
   PubMed Web of Science ®Google Scholar
• Marshall, A., M. Donovan-Hall, and S. Ryall. 2012. “An Exploration of Athletes’ Views on Their Adherence to Physiotherapy Rehabilitation after Sport Injury.” Journal of Sport Rehabilitation 21 (1): 18–25. doi:10.1123/jsr.21.1.18.
   PubMed Web of Science ®Google Scholar
• Marshall, J. H., D. M. Baker, M. J. Lee, G. L. Jones, A. J. Lobo, et al. 2018. “The Assessment of Online Health Videos for Surgery in Crohn’s Disease”. Colorectal Disease 20: 606–613. doi:10.1111/codi.14045.
   PubMed Web of Science ®Google Scholar
• Mason, M. 2010. “Sample Size and Saturation in PhD Studies Using Qualitative Interviews.” Forum: Qualitative Social Research 11 (3). http://www.qualitativeresearch.net/index.php/fqs/article/view/1428/3027
   Google Scholar
• Morrow, S. L. 2005. “Quality and Trustworthiness in Qualitative Research in Counseling Psychology.” Journal of Counseling Psychology 52 (2): 250–260. doi:10.1037/0022-0167.52.2.250.
   Web of Science ®Google Scholar
• Morse, J. M. 1995. “The Significance of Saturation.” Qualitative Health Research 5 (2): 147–149. doi:10.1177/104973239500500201.
   Web of Science ®Google Scholar
• Morse, J. M. 1997. “Perfectly Healthy, but Dead: The Myth of Inter-rater Reliability. Qualitative Health Research 7: 445–447.
   Web of Science ®Google Scholar
• Morse, J. M. 2015. “Data Were Saturated … .” Qualitative Health Research 25 (5): 587–588. doi:10.1177/1049732315576699.
   PubMed Web of Science ®Google Scholar
• Namey, E., G. Guest, K. McKenna, and M. Chen. 2016. “Evaluating Bang for the Buck: A Cost-effectiveness Comparison between Individual Interviews and Focus Groups Based on Thematic Saturation Levels.” American Journal of Evaluation 37 (3): 425–440. doi:10.1177/1098214016630406.
   Web of Science ®Google Scholar
• Nelson, J. 2016. “Using Conceptual Depth Criteria: Addressing the Challenge of Reaching Saturation in Qualitative Research.” Qualitative Research 17 (5): 554–570. doi:10.1177/1468794116679873.
   Web of Science ®Google Scholar
• O’Reilly, M., and N. Parker. 2012. ““Unsatisfactory Saturation”: A Critical Exploration of the Notion of Saturated Sample Sizes in Qualitative Research.” Qualitative Research 13 (2): 190–197. doi:10.1177/1468794112446106.
   Web of Science ®Google Scholar
• Picariello, F., S. Ali, C. Foubister, and T. Chalder. 2017. “‘it Feels Sometimes like My House Has Burnt Down, but I Can See the Sky’: A Qualitative Study Exploring Patients’ Views of Cognitive Behavioural Therapy for Chronic Fatigue Syndrome.” British Journal of Health Psychology 22: 383–413. doi:10.1111/bjhp.2017.22.issue-3.
   PubMed Web of Science ®Google Scholar
• Reicher, S. 2000. “Against Methodolatry: Some Comments on Elliott, Fischer, and Rennie.” British Journal of Clinical Psychology 39 (1): 1–6. doi:10.1348/014466500163031.
   PubMed Web of Science ®Google Scholar
• Sandelowski, M. 1995. “Sample Size in Qualitative Research.” Research in Nursing & Health 18: 179–183. doi:10.1002/(ISSN)1098-240X.
   PubMed Web of Science ®Google Scholar
• Saunders, B., J. Sim, T. Kingstone, S. Baker, J. Waterfield, B. Bartlam, H. Burroughs, and C. Jinks. 2017. “Saturation in Qualitative Research: Exploring Its Conceptualization and Operationalization.” Quality & Quantity 52 (4): 1893–1907. doi:10.1007/s11135-017-0574-8.
   PubMedGoogle Scholar
• Schweitzer, R., S. van Wyk, and K. Murray. 2015. “Therapeutic Practice with Refugee Clients: A Qualitative Study of Therapist Experience.” Counselling and Psychotherapy Research 15 (2): 109–118. doi:10.1002/capr.12018.
   Web of Science ®Google Scholar
• Sim, J., B. Saunders, J. Waterfield, and T. Kingstone. 2018a. “Can Sample Size in Qualitative Research Be Determined Apriori?” International Journal of Social Research Methodology 21 (5): 619–634. doi:10.1080/13645579.2018.1454643.
   Web of Science ®Google Scholar
• Sim, J., B. Saunders, J. Waterfield, and T. Kingstone. 2018b. “The Sample Size Debate: Response to Norman Blaikie.” International Journal of Social Research Methodology 21 (5): 643–646. doi:10.1080/13645579.2018.1454642.
   Web of Science ®Google Scholar
• Tong, A., P. Sainsbury, and J. Craig. 2007. “Consolidated Criteria for Reporting Qualitative Research (COREQ): A 32-item Checklist for Interviews and Focus Groups.” International Journal for Quality in Health Care 19 (6): 349–357. doi:10.1093/intqhc/mzm042.
   PubMed Web of Science ®Google Scholar
• Underhill, K., K. M. Morrow, C. Colleran, R. Holcomb, S. K. Calabrese, D. Operario, O. Galárraga, et al. 2015. “A Qualitative Study of Medical Mistrust, Perceived Discrimination, and Risk Behavior Disclosure to Clinicians by U.S. Male Sex Workers and Other Men Who Have Sex with Men: Implications for Biomedical HIV Prevention.” Journal of Urban Health 92 (4): 667–686. doi:10.1007/s11524-015-9961-4.
   PubMed Web of Science ®Google Scholar
• van Dijk, T. A. 1992. “Discourse and the Denial of Racism.” Discourse & Society 3 (1): 87–118. doi:10.1177/0957926592003001005.
   Google Scholar
• Vasileiou, K., J. Barnett, S. Thorpe, and T. Young. 2018. “Characterising and Justifying Sample Size Sufficiency in Interview-based Studies: Systematic Analysis of Qualitative Health Research over a 15-year Period.” BMC Medical Research Methodology 18: 148. doi:10.1186/s12874-018-0594-7.
   PubMed Web of Science ®Google Scholar
• Yardley, L. 2008. “Demonstrating Validity in Qualitative Psychology.” In Qualitative Psychology: A Practical Guide to Research Methods, edited by J. A. Smith, 235–251. London: Sage.
   Google Scholar