Justify Your Answer: The Role of Written Think Aloud in Script Concordance Testing

References

• Charlin B, Roy L, Brailovsky C, Goulet F, van der Vleuten C. The script concordance test: A tool to assess the reflective clinician. Teaching and Learning in Medicine 2000;12:189–95.
   PubMed Web of Science ®Google Scholar
• Groves M, Scott I, Alexander H. Assessing clinical reasoning: A method to monitor its development in a PBL curriculum. Medical Teacher 2002;24:507–15.
   PubMed Web of Science ®Google Scholar
• Ber R. The CIP (comprehensive integrative puzzle) assessment method. Medical Teacher 2003;25:171–6.
   PubMed Web of Science ®Google Scholar
• Norman G. Research in clinical reasoning: past history and current trends. Medical Education 2005;39:418–27.
   PubMed Web of Science ®Google Scholar
• Bordage G, Lemieux M. Semantic structures and diagnostic thinking of experts and novices. Academic Medicine 1991;66:S70–2.
   PubMed Web of Science ®Google Scholar
• Bordage G. Elaborated knowledge: A key to successful diagnostic thinking. Academic Medicine 1994;69:883–5.
   PubMed Web of Science ®Google Scholar
• Nendaz MR, Junod AF, Vu NV, Bordage G. Eliciting and displaying diagnostic reasoning during educational rounds in internal medicine: Who learns from whom? Academic Medicine 1998;73:S54–6.
   Google Scholar
• Cohen LJ, Fitzgerald SG, Lane S, Boninger ML. Development of the seating and mobility script concordance test for spinal cord injury: Obtaining content validity evidence. Assistive Technology: The Official Journal of RESNA 2005;17:122–32.
   PubMed Web of Science ®Google Scholar
• Sibert L, Darmoni SJ, Dahamna B, Hellot MF, Weber J, Charlin B. Online clinical reasoning assessment with script concordance test in urology: Results of a French pilot study. BMC Medical Education 2006;6:45–53.
   PubMedGoogle Scholar
• Lubarsky S, Chalk C, Kazitani D, Gagnon R, Charlin B. The script concordance test: A new tool assessing clinical judgment in neurology. Canadian Journal of Neurological Sciences 2009;36:326–31.
   PubMed Web of Science ®Google Scholar
• Ramaekers S, Kremer W, Pilot A, van Beukelen P, van Keulen H. Assessment of competence in clinical reasoning and decision-making under uncertainty: The script concordance test method. Assessment and Evaluation in Higher Education 2010;35:661–73.
   Web of Science ®Google Scholar
• Deschênes MF, Charlin B, Gagnon R, Goudreau J. Use of a script concordance test to assess development of clinical reasoning in nursing students. Journal of Nursing Education 2011;50:381–7.
   PubMed Web of Science ®Google Scholar
• Lubarsky S, Charlin B, Cook DA, Chalk C, van der Vleuten CP. Script concordance testing: a review of published validity evidence. Medical Education 2011;45:329–38.
   PubMed Web of Science ®Google Scholar
• Lubarsky S, Dory V, Duggan P, Gagnon R, Charlin B. Script concordance testing: From theory to practice: AMEE Guide No. 75. Medical Teacher 2013;35:184–93.
   PubMed Web of Science ®Google Scholar
• Charlin B, Boshuizen HPA, Custers EJFM, Feltovich PJ. Scripts and clinical reasoning. Medical Education 2007;41:1179–85.
   Web of Science ®Google Scholar
• Schmidt HG, Rikers MJP. How expertise develops in medicine: Knowledge encapsulation and illness script formation. Medical Education 2007;41:1133–9.
   PubMed Web of Science ®Google Scholar
• van Someren MW, Barnard YF, Sandberg JAC. Studying the content of cognitive processes. In: MW van Someren (Ed.), The Think Aloud Method: A practical guide to modelling cognitive processes (pp. 13–26). London, England: Academic Press, 1994.
   Google Scholar
• Coderre S, Mandin H, Harasym PH, Fick GH. Diagnostic reasoning strategies and diagnostic success. Medical Education 2003;37:695–703.
   PubMed Web of Science ®Google Scholar
• Heemskerk L, Norman G, Chou S, Mintz M, Mandin H, McLaughlin K. The effect of question format and task difficulty on reasoning strategies and diagnostic performance in internal medicine residents. Advances in Health Sciences Education: Theory and Practice 2008;13:453–62.
   PubMed Web of Science ®Google Scholar
• Pottier P, Hardouin JB, Hodges BD, Pistorius MA, Connault J, Durant C, et al. Exploring how students think: A new method combining think-aloud and concept mapping protocols. Medical Education 2010;44:926–35.
   PubMed Web of Science ®Google Scholar
• Durning S, Artino AR, Pangaro L, van der Vleuten CP, Shuwirth L. Context and clinical reasoning: Understanding the perspective of the expert's voice. Medical Education 2011;45:927–38.
   PubMed Web of Science ®Google Scholar
• Balslev T, Jarodzka H, Holmgvist K, de Grave W, Muijtjens AM, Eika B, et al. Visual expertise in pediatric neurology. European Journal of Paediatric Neurology 2012;16:161–6.
   PubMed Web of Science ®Google Scholar
• Siddiqui S. “Think-aloud” protocol for ICU rounds: An assessment of information assimilation and rational thinking among trainees. Medical Education Online 2014;19. Available at: http://doi.org/10.3402/meo.v19.25783. Accessed November 21, 2015.
   Google Scholar
• Zilbert NR, St-Martin L, Regehr G, Gallinger S, Moulton C. Planning to avoid trouble in the operating room: Experts' formulation of the preoperative plan. Journal of Surgical Education 2015;72:271–7.
   PubMed Web of Science ®Google Scholar
• Hoffman KA, Aitken LM, Duffield C. A comparison of novice and expert nurses' cue collection during clinical decision-making: Verbal protocol analysis. International Journal of Nursing Studies 2009;46:1335–44.
   PubMed Web of Science ®Google Scholar
• Lundgrén-Laine H, Salanterä S. Think-aloud technique and protocol analysis in clinical decision-making research. Qualitative Health Research 2010;20:565–75.
   PubMed Web of Science ®Google Scholar
• Aitken L, Marshall A, Elliott R, McKinley S. Comparison of ‘think aloud’ and observation as data collection methods in the study of decision-making regarding sedation in intensive care patients. International Journal of Nursing Studies 2011;48:318–25.
   PubMed Web of Science ®Google Scholar
• Fossum M, Alexander GL, Göransson KE, Ehnfors M, Ehrenberg A. Registered nurses' thinking strategies on malnutrition and pressure ulcers in nursing homes: A scenario-based think-aloud study. Journal of Clinical Nursing 2011;20:2425–35.
   PubMed Web of Science ®Google Scholar
• Connor LO. Critical care nurses' judgment of pain status: A case study design. Intensive and Critical Care Nursing 2012;28:215–23.
   PubMedGoogle Scholar
• Burbach B, Barnason S, Thompson SA. Using “think aloud” to capture clinical reasoning during patient simulation. International Journal of Nursing Education Scholarship 2015;12:1–7.
   Google Scholar
• Gerber A, Thevoz AL, Ramelet AS. Expert clinical reasoning and pain assessment in mechanically ventilated patients: A descriptive study. Australian Critical Care 2015;28:2–8.
   PubMed Web of Science ®Google Scholar
• Pirret AM, Neille SJ, La Grow SJ. Nurse practitioners' versus doctors' diagnostic reasoning in a complex care presentation to an acute tertiary hospital: A comparative study. International Journal of Nursing Studies 2015;52:716–26.
   PubMed Web of Science ®Google Scholar
• Durning SJ, Artino Jr AR, Beckman TJ, Grander J, van der Vleuten C, Holmboe E, et al. Does the think-aloud protocol reflect thinking? Exploring functional neuroimaging differences with thinking (answering multiple choice questions) versus thinking aloud. Medical Teacher 2013;35:720–6.
   PubMed Web of Science ®Google Scholar
• Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review. Medical Teacher 2005;27:10–28.
   PubMed Web of Science ®Google Scholar
• Fanning RM, Gaba DM. The role of debriefing in simulation-based learning. Simulation in Healthcare 2007;2:115–25.
   PubMedGoogle Scholar
• Rogers DA, Rehehr G, Howdieshell TR, Yeh KA, Palm E. The impact of external feedback on computer-assisted learning for surgical technical skill. The American Journal of Surgery 2000;179:341–3.
   PubMed Web of Science ®Google Scholar
• Mahmood T, Darzi A. The learning curve for a colonoscopy simulator in the absence of any feedback. Surgical Endoscopy 2004;18:1224–30.
   PubMed Web of Science ®Google Scholar
• Cooke S, Lemay JF, Beran T, Sandhu A, Amin H. Development of a method to measure clinical reasoning in pediatric residents: The Pediatric Script Concordance Test. Creative Education 2016;7:814–23.
   Google Scholar
• Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology 2006;3:77–101.
   Google Scholar
• Public Health Agency of Canada. Toxoid–Post-Exposure Prophylaxis. Canadian Immunization Guide. Available at: www.publichhealth.gc.ca. Accessed January 5, 2015.
   Google Scholar
• Williams RG, Klamen DL. Examining the diagnostic justification abilities of fourth-year medical students. Academic Medicine 2012;87:1008–14.
   PubMed Web of Science ®Google Scholar
• Lineberry M, Kreiter CD, Bordage G. Threats to validity in the use and interpretation of script concordance test scores. Medical Education 2013;47:1175–83.
   PubMed Web of Science ®Google Scholar
• See KC, Tan KL, Lim TK. The Script Concordance Test for Clinical Reasoning: Re-examining its utility and potential weakness. Medical Education 2014;48:1069–77.
   PubMed Web of Science ®Google Scholar
• Gagnon R, Lubarsky S, Lambert C, Charlin B. Optimization of answer keys for script concordance testing: Should we exclude deviant panelists, deviant responses, or neither? Advances in Health Sciences Education 2011;16:601–8.
   PubMed Web of Science ®Google Scholar
• Rushton A. Formative assessment: A key to deep learning? Medical Teacher 2005;27:509–13.
   PubMed Web of Science ®Google Scholar
• Yorke M. Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice. Higher Education 2003;45:477–501.
   Web of Science ®Google Scholar