Understanding and developing procedures for video-based assessment in medical education

References

• Amin Z, Boulet JR, Cook DA, Ellaway R, Fahal A, Kneebone R, Maley M, Ostergaard D, Ponnamperuma G, Wearn A, et al. 2011. Technology-enabled assessment of health professions education: Consensus statement and recommendations from the Ottawa 2010 conference. Med Teach. 33(5):364–369.
   PubMedGoogle Scholar
• Anderson T, Shattuck J. 2012. Design-based research: a decade of progress in education research? Educ Res. 41(1):16–25.
   Web of Science ®Google Scholar
• Bakker A, van Eerde D. 2015. An introduction to design-based research with an example from statistics education. In Bikner-Ahsbahs A, Knipping C, Presmeg N, editors. Approaches to qualitative research in mathematics education. Advances in mathematics education. Dordrecht: Springer; p. 429–466.
   Google Scholar
• Bargh JA, Chartrand TL. 1999. The unbearable automaticity of being. Am Psychol. 54(7):462–479.
   Web of Science ®Google Scholar
• Baumgartner E, Bell P, Brophy SP, Hoadley C. 2003. Design-based research: an emerging paradigm for educational inquiry. Educ Res. 32(1):5–8.
   Google Scholar
• Bryant K, Charmaz A. 2019. The SAGE handbook of current developments in grounded theory. London: SAGE Publications.
   Google Scholar
• Byrne A, Tweed N, Halligan C. 2014. A pilot study of the mental workload of objective structured clinical examination examiners. Med Educ. 48(3):262–267.
   PubMed Web of Science ®Google Scholar
• Charmaz K. 2006. Constructing grounded theory: a practical guide through qualitative analysis. London: SAGE Publications.
   Google Scholar
• Chen T-C, Lin M-C, Chiang Y-C, Monrouxe L, Chien S-J. 2019. Remote and onsite scoring of OSCEs using generalisability theory: a three-year cohort study. Med Teach. 41(5):578–583.
   PubMed Web of Science ®Google Scholar
• Cobb P, Confrey J, diSessa A, Lehrer R, Schauble L. 2003. Design experiments in educational research. Educ Res. 32(1):9–13.
   Google Scholar
• Eeckhout T, Gerits M, Bouquillon D, Schoenmakers B. 2016. Video training with peer feedback in real-time consultation: acceptability and feasibility in a general-practice setting. Postgrad Med J. 92(1090):431–435.
   PubMed Web of Science ®Google Scholar
• Engward H. 2013. Understanding grounded theory. Nurs Stand. 28(7):37–41.
   PubMedGoogle Scholar
• Eva KW. 2018. Cognitive influences on complex performance assessment: lessons from the interplay between medicine and psychology. J Appl Res Memory Cogn. 7(2):177–188.
   Web of Science ®Google Scholar
• Foulsham T, Walker E, Kingstone A. 2011. The where, what and when of gaze allocation in the lab and the natural environment. Vision Res. 51(17):1920–1931.
   PubMed Web of Science ®Google Scholar
• Galletta A. 2013. Mastering the semi-structured interview and beyond: From research design to analysis and publication. New York (NY): NYU press.
   Google Scholar
• Gauthier G, St-Onge C, Tavares W. 2016. Rater cognition: review and integration of research findings. Med Educ. 50(5):511–522.
   PubMed Web of Science ®Google Scholar
• Gill P, Stewart K, Treasure E, Chadwick B. 2008. Methods of data collection in qualitative research: interviews and focus groups. Br Dent J. 204(6):291–295.
   PubMed Web of Science ®Google Scholar
• Gingerich A, Regehr G, Eva KW. 2011. Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad Med. 86(10 Suppl):S1–S7.
   PubMed Web of Science ®Google Scholar
• Gingerich A, Schokking E, Yeates P. 2018. Comparatively salient: examining the influence of preceding performances on assessors’ focus and interpretations in written assessment comments. Adv Health Sci Educ Theory Pract. 23(5):937–959.
   PubMed Web of Science ®Google Scholar
• Govaerts MJB, Schuwirth LWT, Van der Vleuten CPM, Muijtjens AMM. 2011. Workplace-based assessment: effects of rater expertise. Adv Health Sci Educ Theory Pract. 16(2):151–165.
   PubMed Web of Science ®Google Scholar
• Guba EG, Lincoln YS. 1982. Epistemological and methodological bases of naturalistic inquiry. Educ Commun Technol. 30(4):233–252.
   Web of Science ®Google Scholar
• Gullberg M, Holmqvist K. 2006. What speakers do and what addressees look at: visual attention to gestures in human interaction live and on video. P&C. 14(1):53–82.
   Google Scholar
• Van Den Haak M, De Jong M, Schellens PJ. 2003. Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue. Behav Inf Technol. 22(5):339–351.
   Web of Science ®Google Scholar
• Hance J, Aggarwal R, Stanbridge R, Blauth C, Munz Y, Darzi A, Pepper J. 2005. Objective assessment of technical skills in cardiac surgery. Eur J Cardio-Thoracic Surg. 28(1):157–162.
   PubMed Web of Science ®Google Scholar
• Harrison CJ, Könings KD, Schuwirth L, Wass V, van der Vleuten C. 2015. Barriers to the uptake and use of feedback in the context of summative assessment. Adv Health Sci Educ Theory Pract. 20(1):229–245.
   PubMed Web of Science ®Google Scholar
• Harrison CJ, Könings KD, Schuwirth LWT, Wass V, van der Vleuten CPM. 2017. Changing the culture of assessment: the dominance of the summative assessment paradigm. BMC Med Educ. 17(1):1–14.
   PubMed Web of Science ®Google Scholar
• Holton JA. 2010. The coding process and its challenges. Ground Theory Rev. 9(1):21–40.
   Google Scholar
• Ihlebaek C, Løve T, Eilertsen DE, Magnussen S. 2003. Memory for a staged criminal event witnessed live and on video. Memory. 11(3):319–327.
   PubMed Web of Science ®Google Scholar
• Kogan JR, Conforti L, Bernabeo E, Iobst W, Holmboe E. 2011. Opening the black box of clinical skills assessment via observation: a conceptual model. Med Educ. 45(10):1048–1060.
   PubMed Web of Science ®Google Scholar
• Koivisto J-M, Haavisto E, Niemi H, Haho P, Nylund S, Multisilta J. 2018. Design principles for simulation games for learning clinical reasoning: a design-based research approach. Nurse Educ Today. 60:114–120.
   PubMed Web of Science ®Google Scholar
• Landström S, Granhag PA, Hartwig M. 2005. Witnesses appearing live versus on video: effects on observers’ perception, veracity assessments and memory. Appl Cognit Psychol. 19(7):913–933.
   Web of Science ®Google Scholar
• Lincoln YS, Guba EG. 1985. Naturalistic inquiry. Thousand Oaks (CA): Sage Publications.
   Google Scholar
• McManus B, Omer S. 2017. A tiered approach in mandatory assessment training. Med Educ. 51(5):548–549.
   PubMedGoogle Scholar
• Montgomery P, Bailey PH, Bailey PH. 2007. Field notes and theoretical memos in grounded theory. West J Nurs Res. 29(1):65–79.
   PubMed Web of Science ®Google Scholar
• Newble D. 2004. Techniques for measuring clinical competence: objective structured clinical examinations. Med Educ. 38(2):199–203.
   PubMed Web of Science ®Google Scholar
• Nguyen DT, Canny J. 2009. More than face-to-face: empathy effects of video framing. Proceedings of the 27th International Conference on Human Factors in Computing Systems - CHI ’09; Boston (MA), USA. p. 423.
   Google Scholar
• Papavlasopoulou S, Giannakos MN, Jaccheri L. 2019. Exploring children’s learning experience in constructionism-based coding activities through design-based research. Comput Hum Behav. 99(7491):415–427.
   Google Scholar
• Ryan AM, Daum D, Bauman T, Grisez M, Mattimore K, Nalodka T, McCormick S. 1995. Direct, Indirect, and Controlled Observation and Rating Accuracy from continual attention to the observation of others. J Appl Psychol. 80(6):664–670.
   Web of Science ®Google Scholar
• Scaffidi MA, Grover SC, Carnahan H, Yu JJ, Yong E, Nguyen GC, Ling SC, Khanna N, Walsh CM. 2018. A prospective comparison of live and video-based assessments of colonoscopy performance. Gastrointest Endosc. 87(3):766–775.
   PubMed Web of Science ®Google Scholar
• Scott DJ, Rege RV, Bergen PC, Guo WA, Laycock R, Tesfay ST, Valentine RJ, Jones DB. 2000. Measuring operative performance after laparoscopic skills training: edited videotape versus direct observation. J Laparoendosc Adv Surg Tech. 10(4):183–190.
   PubMed Web of Science ®Google Scholar
• Simons D. 2010. Selective attention test, YouTube. [accessed 2020 Mar 11]. https://www.youtube.com/watch?v=vJG698U2Mvo.
   Google Scholar
• Simons DJ, Chabris CF. 1999. Gorillas in our midst: sustained inattentional blindness for dynamic events. Perception. 28(9):1059–1074.
   PubMed Web of Science ®Google Scholar
• Strauss A, Corbin J. 1998. Basics of qualitative research techniques and procedures for developing grounded theory. 2nd ed. Thousand Oaks (CA): Sage.
   Google Scholar
• Tavares W, Eva KW. 2014. Impact of rating demands on rater-based assessments of clinical competence. Educ Prim Care. 25(6):308–318.
   PubMedGoogle Scholar
• Varpio L, Ajjawi R, Monrouxe LV, O’Brien BC, Rees CE. 2017. Shedding the cobra effect: problematising thematic emergence, triangulation, saturation and member checking. Med Educ. 51(1):40–50.
   PubMed Web of Science ®Google Scholar
• Vivekananda-Schmidt P, Lewis M, Coady D, Morley C, Kay L, Walker D, Hassell AB. 2007. Exploring the use of videotaped objective structured clinical examination in the assessment of joint examination skills of medical students. Arthritis Rheum. 57(5):869–876.
   PubMedGoogle Scholar
• Wang J, Marchant D, Morris T, Gibbs P. 2004. Self-consciousness and trait anxiety as predictors of choking in sport. J Sci Med Sport. 7(2):174–185.
   PubMed Web of Science ®Google Scholar
• Wood TJ. 2014. Exploring the role of first impressions in rater-based assessments. Adv Health Sci Educ Theory Pract. 19(3):409–427.
   PubMed Web of Science ®Google Scholar
• Yeates P, O’Neill P, Mann K, Eva KW. 2012. Effect of exposure to good vs poor medical trainee performance on attending physician ratings of subsequent performances. JAMA. 308(21):2226–2232.
   PubMed Web of Science ®Google Scholar
• Yeates P, O’Neill P, Mann K, Eva K. 2013a. Seeing the same thing differently: mechanisms that contribute to assessor differences in directly-observed performance assessments. Adv Health Sci Educ Theory Pract. 18(3):325–341.
   PubMed Web of Science ®Google Scholar
• Yeates P, O’Neill P, Mann K, Eva KW. 2013b. “You’re certainly relatively competent”: assessor bias due to recent experiences. Med Educ. 47(9):910–922.
   PubMed Web of Science ®Google Scholar
• Yeates P, Cope N, Hawarden A, Bradshaw H, McCray G, Homer M. 2019. Developing a video-based method to compare and adjust examiner effects in fully nested OSCEs. Med Educ. 53(3):250–263.
   PubMed Web of Science ®Google Scholar