Exploring the relationship between examiners’ memories for performances, domain separation and score variability

References

• Baddeley A. 1992. Working memory: the interface between memory and cognition. J Cogn Neurosci. 4:281–288.
   PubMed Web of Science ®Google Scholar
• Baddeley A, Eysenck M, Anderson M. 2015. Memory. 2nd ed. London and New York: Taylor Francis.
   Google Scholar
• Bäuml K. 1996. Revisiting an old issue: retroactive interference as a function of the degree of original and interpolated learning. Psychon Bull Rev. 3:380–384.
   PubMed Web of Science ®Google Scholar
• Brannick MT, Erol-Korkmaz HT, Prewett M. 2011. A systematic review of the reliability of objective structured clinical examination scores. Med Educ. 45:1181–1189.
   PubMed Web of Science ®Google Scholar
• Cook DA, Beckman TJ, Mandrekar JN, Pankratz VS. 2010. Internal structure of mini-CEX scores for internal medicine residents: factor analysis and generalizability. Adv Health Sci Educ Theory Pract. 15:633–645.
   PubMed Web of Science ®Google Scholar
• Cook DA, Dupras DM, Beckman TJ, Thomas KG, Pankratz VS. 2009. Effect of rater training on reliability and accuracy of mini-CEX scores: a randomized, controlled trial. J Gen Intern Med. 24:74–79.
   PubMed Web of Science ®Google Scholar
• Cooke M, Irby DM, Sullivan W, Ludmerer KM. 2006. American medical education 100 years after the Flexner report. N Engl J Med. 355:1339–1344.
   PubMed Web of Science ®Google Scholar
• Dickerson BC, Eichenbaum H. 2010. The episodic memory system: neurocircuitry and disorders. Neuropsychopharmacology. 35:86–104.
   PubMed Web of Science ®Google Scholar
• Donato AA, Pangaro L, Smith C, Rencic J, Diaz Y, Mensinger J, Holmboe E. 2008. Evaluation of a novel assessment form for observing medical residents: a randomised, controlled trial. Med Educ. 42:1234–1242.
   PubMed Web of Science ®Google Scholar
• Gauthier G, St-Onge C, Tavares W. 2016. Rater cognition: review and integration of research findings. Med Educ. 50:511–522.
   PubMed Web of Science ®Google Scholar
• General Medical Council. 2017. Outcomes for Graduates [Internet]. https://www.gmc-uk.org/education/undergraduate/undergrad_outcomes_overarching.asp
   Google Scholar
• Gingerich A, Kogan J, Yeates P, Govaerts M, Holmboe E. 2014. Seeing the “black box” differently: assessor cognition from three research perspectives. Med Educ. 48:1055–1068.
   PubMed Web of Science ®Google Scholar
• Gingerich A, Ramlo SE, van der Vleuten CPM, Eva KW, Regehr G. 2017. Inter-rater variability as mutual disagreement: identifying raters’ divergent points of view. Adv in Health Sci Educ. 22:819–838.
   PubMed Web of Science ®Google Scholar
• Grömping U. 2006. Relative importance for linear regression in R: the package relaimpo. J Stat Soft. 17(1):1–27. https://www.jstatsoft.org/article/view/v017i01
   Web of Science ®Google Scholar
• Harasym PH, Woloschuk W, Cunning L. 2008. Undesired variance due to examiner stringency/leniency effect in communication skill scores assessed in OSCEs. Adv Health Sci Educ Theory Pract. 13: 617–632.
   PubMed Web of Science ®Google Scholar
• Harrison CJ, Könings KD, Schuwirth L, Wass V, van der Vleuten C. 2014. Barriers to the uptake and use of feedback in the context of summative assessment. Adv Health Sci Educ Theory Pract. 20:229–245.
   PubMed Web of Science ®Google Scholar
• Herlitz A, Nilsson LG, Bäckman L. 1997. Gender differences in episodic memory. Mem Cognit. 25:801–811.
   PubMed Web of Science ®Google Scholar
• Junod Perron N, Louis-Simonet M, Cerutti B, Pfarrwaller E, Sommer J, Nendaz M. 2016. The quality of feedback during formative OSCEs depends on the tutors’ profile. BMC Med Educ. 16:293.
   PubMed Web of Science ®Google Scholar
• Lee V, Brain K, Martin J. 2017. Factors influencing mini-CEX rater judgments and their practical implications: a systematic literature review. Acad Med. 92:880–887.
   PubMed Web of Science ®Google Scholar
• Lefroy J, Watling C, Teunissen PW, Brand P. 2015. Guidelines: the do’s, don’ts and don’t knows of feedback for clinical education. Perspect Med Educ. 4:284–299.
   PubMed Web of Science ®Google Scholar
• McKinley DW, Boulet JR. 2005. Using factor analysis to evaluate checklist items. Acad Med. 80:S102–S105.
   PubMed Web of Science ®Google Scholar
• McManus IC, Thompson M, Mollon J. 2006. Assessment of examiner leniency and stringency (’hawk-dove effect’) in the MRCP(UK) clinical examination (PACES) using multi-facet Rasch modelling. BMC Med Educ. 6: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid =1569374&tool=pmcentrez&rendertype=abstract
   Google Scholar
• Newble D. 2004. Techniques for measuring clinical competence: objective structured clinical examinations. Med Educ. 38:199–203.
   PubMed Web of Science ®Google Scholar
• Norman G. 2009. Dual processing and diagnostic errors. Adv Health Sci Educ Theory Pract. 14 Suppl 1:37–49.
   PubMed Web of Science ®Google Scholar
• Pell G, Homer MS, Roberts TE. 2008. Assessor training: its effects on criterion‐based assessment in a medical context. Int J Res Method Educ. 31:143–154.
   Google Scholar
• R Development Core Team. (2017). R: a language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. https://www.r-project.org/
   Google Scholar
• Schacter DL, Chiao JY, Mitchell JP. 2003. The seven sins of memory implications for self. Ann N Y Acad Sci. 7:226–239.
   Google Scholar
• Sinclair L, Kunda Z. 1999. Reactions to a black professional: motivated inhibition and activation of conflicting stereotypes. J Pers Soc Psychol. 77:885–904.
   PubMed Web of Science ®Google Scholar
• Streiner D, Norman G. 2008. Health measurement scales. 4th ed. Oxford: Oxford University Press.
   Google Scholar
• Tavares W, Eva KW. 2014. Impact of rating demands on rater-based assessments of clinical competence. Educ Prim Care. 25:308–318.
   PubMedGoogle Scholar
• Tavares W, Ginsburg S, Eva KW. 2016. Selecting and Simplifying: rater performance and behavior when considering multiple competencies. Teach Learn Med. 28:41–51.
   PubMed Web of Science ®Google Scholar
• Tulving E. 2002. Episodic Memory: from mind to brain. Annu Rev Psychol. 53:1–25.
   PubMed Web of Science ®Google Scholar
• Volkan K, Simon SR, Baker H, Todres ID. 2004. Psychometric structure of a comprehensive objective structured clinical examination: a factor analytic approach. Adv Health Sci Educ Theory Pract. 9:83–92.
   PubMed Web of Science ®Google Scholar
• Walter SR, Li L, Dunsmuir WTM, Westbrook JI. 2014. Managing competing demands through task-switching and multitasking: a multi-setting observational study of 200 clinicians over 1000 hours. BMJ Qual Saf. 23:231–241.
   PubMed Web of Science ®Google Scholar
• Wang B. 2014. Effect of time delay on recognition memory for pictures: The modulatory role of emotion. PLoS One. 9:e100238.
   PubMed Web of Science ®Google Scholar
• Yeates P, O’Neill P, Mann K, Eva K. 2013. Seeing the same thing differently: mechanisms that contribute to assessor differences in directly-observed performance assessments. Adv in Health Sci Educ. 18:325–341.
   PubMed Web of Science ®Google Scholar
• Yeates P, Woolf K, Benbow E, Davies B, Boohan M, Eva K. 2017. A randomised trial of the influence of racial stereotype bias on examiners’ scores, feedback and recollections in undergraduate clinical exams. BMC Med. 15:179.
   PubMed Web of Science ®Google Scholar