Cognitive Interviewing for Item Development: Validity Evidence Based on Content and Response Processes

References

• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. ( 2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
   Google Scholar
• Beatty, P. C., & Willis, G. B. ( 2007). Research synthesis: The practice of cognitive interviewing. Public Opinion Quarterly, 71, 287–311. https://doi.org/10.1093/poq/nfm006
   Google Scholar
• Blair, J., & Conrad, F. G. ( 2011). Sample size for cognitive interview pretesting. Public Opinion Quarterly, 75, 636–658. https://doi.org/10.1093/poq/nfr035
   Google Scholar
• Buers, C., Triemstra, M., Bloemendal, E., Zwijnenberg, N. C., Hendriks, M., & Delnoij, D. M. ( 2014). The value of cognitive interviewing for optimizing a patient experience survey. International Journal of Social Research Methodology, 17, 325–340. https://doi.org/10.1080/13645579.2012.750830
   Google Scholar
• Castillo-Díaz, M., & Padilla, J. L. ( 2013). How cognitive interviewing can provide validity evidence of the response processes to scale items. Social Indicators Research, 114, 963–975. https://doi.org/10.1007/s11205-012-0184-8
   Google Scholar
• Conrad, F., & Blair, J. ( 1996). From impressions to data: Increasing the objectivity of cognitive interviews. Paper presented at the Section on Survey Research Methods Annual Meetings of the American Statistical Association, Alexandria, VA. Retrieved from: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.451.3389&rep=rep1&type=pdf
   Google Scholar
• Conrad, F. G., & Blair, J. ( 2004). Data quality in cognitive interviews: The case of verbal reports. In S. Presser et al. (Eds.), Methods for testing and evaluating survey questions (pp. 67–87). Hoboken, NJ: Wiley.
   Google Scholar
• Conrad, F. G., & Blair, J. ( 2009). Sources of error in cognitive interviews. Public Opinion Quarterly, 73, 32–55. https://doi.org/10.1093/poq/nfp013
   Google Scholar
• DeMaio, T. J., & Landreth, A. ( 2004). Do different cognitive interview techniques produce different results? In S. Presser, J. M. Rothgeb, M. P. Couper, J. T. Lessler, E. Martin, J. Martin, & E. Siniger (Eds.), Methods for testing and evaluating survey questionnaires (pp. 89–108). Hoboken, NJ: Wiley. https://doi.org/10.1002/0471654728.ch5
   Google Scholar
• Dietrich, H., & Ehrlenspiel, F. ( 2010). Cognitive interviewing: A qualitative tool for improving questionnaires in sport science. Measurement in Physical Education and Exercise Science, 14(1), 51–60. https://doi.org/10.1080/10913670903455025
   Google Scholar
• Dumas, H. M., Watson, K., Fragala-Pinkham, M. A., Haley, S. M., Bilodeau, N., Montpetit, K., & Tucker, C. A. ( 2008). Using cognitive interviewing for test items to assess physical function in children with cerebral palsy. Pediatric Physical Therapy, 20, 356–362. https://doi.org/10.1097/PEP.0b013e31818ac500
   Google Scholar
• Ericsson, K. A., & Simon, H. A. ( 1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
   Google Scholar
• Hill, C. E., Thompson, B. J., & Williams, E. N. ( 1997). A guide to conducting consensual qualitative research. The Counseling Psychologist, 25, 517–572. https://doi.org/10.1177/0011000097254001
   Google Scholar
• Housen, P., Shannon, G. R., Simon, B., Edelen, M. O., Cadogan, M. P., Sohn, L., & Saliba, D. ( 2008). What the resident meant to say: Use of cognitive interviewing techniques to develop questionnaires for nursing home residents. The Gerontologist, 48, 158–169. https://doi.org/10.1093/geront/48.2.158
   Google Scholar
• Hughes, A. K. ( 2004). Comparing pretesting methods: Cognitive interviews, respondent debriefing, and behavior coding. Paper presented at the Annual Meeting of the Federal Committee on Statistical Methodology, Washington, DC. Retrieved from http://www.census.gov/srd/papers/pdf/rsm2004-02.pdf
   Google Scholar
• Jabine, T. B., Straf, M. L., Tanur, J. M., & Tourangeau, R. ( 1984). Cognitive aspects of survey methodology: Building a bridge between disciplines. Washington, DC: National Academy Press.
   Google Scholar
• Karabenick, S. A., Woolley, M. E., Friedel, J. M., Ammon, B. V., Blazevski, J., Bonney, C. R., & Kelly, K. L. ( 2007). Cognitive processing of self-report items in educational research: Do they think what we mean? Educational Psychologist, 42, 139–151. https://doi.org/10.1080/00461520701416231
   Google Scholar
• McMillan, D. W., & Chavis, D. M. ( 1986). Sense of community: A definition and theory. Journal of Community Psychology, 14, 6–23. https://doi.org/10.1002/1520-6629(198601)14:1<6::AID-JCOP2290140103>3.0.CO;2-I
   Web of Science ®Google Scholar
• Peterson, C. H. ( 2012). The individual regulation component of group emotional intelligence: Measure development and validation. Journal for Specialists in Group Work, 37, 232–251. https://doi.org/10.1080/01933922.2012.686962
   Google Scholar
• Peterson, C. H., Gischlar, K., & Peterson, N. A. ( 2017). Item construction using reflective, formative, or Rasch measurement models: Implications for group work. Journal for Specialists in Group Work, 42(1), 17–32. https://doi.org/10.1080/01933922.2016.1264523
   Google Scholar
• Peterson, C. H., Hall, S. B., & Buser, J. K. ( 2016). Research training needs of scientist practitioners: Implications for counselor education. Counselor Education & Supervision, 55, 80–94. https://doi.org/10.1002/ceas.12034
   Google Scholar
• Presser, S., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., Rothgeb, J. M., & Singer, E. ( 2004). Methods for testing and evaluating survey questions. Public Opinion Quarterly, 68(1), 109–130. https://doi.org/10.1093/poq/nfh008
   Google Scholar
• Priede, C., & Farrall, S. ( 2011). Comparing results from different styles of cognitive interviewing: “Verbal probing” vs. “thinking aloud.” International Journal of Social Research Methodology, 14, 271–287. https://doi.org/10.1080/13645579.2010.523187
   Google Scholar
• Ryan, K., Gannon-Slater, N., & Culbertson, M. J. ( 2012). Improving survey methods with cognitive interviews in small-and medium-scale evaluations. American Journal of Evaluation, 33, 414–430. https://doi.org/10.1177/1098214012441499
   Google Scholar
• Schwarz, N. E., & Sudman, S. E. ( 1996). Answering questions: Methodology for determining cognitive and communicative processes in survey research. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Tourangeau, R. ( 1984). Cognitive science and survey methods: A cognitive perspective. In Cognitive aspects of survey design: Building a bridge between disciplines (pp. 73–100). Washington, DC: National Academy Press.
   Google Scholar
• Willis, G. B. ( 1994). Cognitive interviewing and questionnaire design: A training manual. Atlanta, GA: U.S. Department of Health and Human Services, Centers for Disease Control. Retrieved from http://www.srl.uic.edu/links/CMS_WP07_Willis_1994_CogIntTraining.pdf
   Google Scholar
• Willis, G. B. ( 2005). Cognitive interviewing: A tool for improving questionnaire design. Beverly Hills, CA: Sage.
   Google Scholar
• Woolley, M. E., Bowen, G. L., & Bowen, N. K. ( 2006). The development and evaluation of procedures to assess child self-report item validity. Educational and Psychological Measurement, 66, 687–700. https://doi.org/10.1177/0013164405282467
   Google Scholar