Twelve tips for constructing a multiple mini-interview

References

• Albanese MA, Snow MH, Skochelak SE, Huggett KN, Farrell PM. 2003. Assessing personal qualities in medical school admissions. Acad Med. 78:313–321.
   PubMed Web of Science ®Google Scholar
• Axelson R, Kreiter C. 2009. Rater and occasion impacts on expected preadmission interview reliability. Med Educ. 43:1198–1202.
   PubMed Web of Science ®Google Scholar
• Bereiter C. 2002. Design research for sustained innovation. Cogn Stud Bull Jap Cogn Sci Soc. 9:321–327.
   Google Scholar
• Berner ES, Graber ML. 2008. Overconfidence as a cause of diagnostic error in medicine. Am J Med. 121:S2–S23.
   PubMed Web of Science ®Google Scholar
• Boelen C. 2018. Coordinating medical education and health care systems: the power of the social accountability approach. Med Educ. 52:96–102.
   PubMed Web of Science ®Google Scholar
• Cameron AJ, MacKeigan LD, Mitsakakis N, Pugsley JA. 2017. Multiple mini-interview predictive validity for performance on a pharmacy licensing examination. Med Educ. 51:379–389.
   PubMed Web of Science ®Google Scholar
• Carraccio C, Englander R, Van Melle E, Ten Cate O, Lockyer J, Chan MK, Frank JR, Snell LS; International Competency-Based Medical Education Collaborators. 2016. Advancing competency-based medical education: a charter for clinician-educators. Acad Med. 91:645–649.
   PubMed Web of Science ®Google Scholar
• Corelli RL, Muchnik MA, Beechinor RJ, Fong G, Vogt EM, Cocohoba JM, Tsourounis C, Hudmon KS. 2015. Perceptions and cost-analysis of a multiple mini-interview in a pharmacy school admissions process. Am J Pharm Educ. 79:135.
   PubMed Web of Science ®Google Scholar
• Crossley J, Jolly B. 2012. Making sense of work-based assessment: ask the right questions, in the right way, about the right things, of the right people. Med Educ. 46:28–37.
   PubMed Web of Science ®Google Scholar
• Cruess R, Cruess S. 2014. Updating the Hippocratic Oath to include medicine's social contract. Med Educ. 48:95–100.
   PubMed Web of Science ®Google Scholar
• Dudek NL, Marks MB, Regehr G. 2005. Failure to fail: the perspectives of clinical supervisors. Acad Med. 80:S84–S87.
   PubMed Web of Science ®Google Scholar
• Ellis APJ, West BJ, Ryan AM, DeShon RP. 2002. The use of impression management tactics in structured interviews: a function of question type? J Appl Psychol. 87:1200–1208.
   PubMed Web of Science ®Google Scholar
• Eva KW, Finkler JH. 2011. So you want to revert to a lottery? BCMJ. 53:517.
   Google Scholar
• Eva KW, Hodges BD. 2012. Scylla or Charybdis? Can we navigate between objectification and judgement in assessment? Med Educ. 46:914–919.
   PubMed Web of Science ®Google Scholar
• Eva KW, Macala C. 2014. Multiple mini-interview test characteristics: 'tis better to ask candidates to recall than to imagine. Med Educ. 48:604–613.
   PubMed Web of Science ®Google Scholar
• Eva KW, Reiter HI, Rosenfeld J, Norman GR. 2004. The relationship between interviewers' characteristics and ratings assigned during a multiple mini-interview. Acad Med. 79:602–609.
   PubMed Web of Science ®Google Scholar
• Eva KW, Reiter HI, Rosenfeld J, Trinh K, Wood TJ, Norman GR. 2012. Association between a medical school admission process using the multiple mini-interview and national licensing examination scores. JAMA. 308:2233–2240.
   PubMed Web of Science ®Google Scholar
• Eva KW, Reiter HI, Trinh K, Wasi P, Rosenfeld J, Norman GR. 2009. Predictive validity of the multiple mini-interview for selecting medical trainees. Med Educ. 43:767–775.
   PubMed Web of Science ®Google Scholar
• Eva KW, Reiter HI. 2004. Where judgement fails: pitfalls in the selection process for medical personnel. Adv Health Sci Educ Theory Pract. 9:161–174.
   PubMed Web of Science ®Google Scholar
• Eva KW, Rosenfeld J, Reiter HI, Norman GR. 2004. An admissions OSCE: the multiple mini-interview. Med Educ. 38:314–326.
   PubMed Web of Science ®Google Scholar
• Eva KW, Solomon P, Neville AJ, Ladouceur M, Kaufman K, Walsh A, Norman GR. 2007. Using a sampling strategy to address psychometric challenges in tutorial-based assessments. Adv Health Sci Educ Theory Pract. 12:19–33.
   PubMed Web of Science ®Google Scholar
• Eva KW. 2003. On the generality of specificity. Med Educ. 37:587–588.
   PubMed Web of Science ®Google Scholar
• Eva KW. 2009. Assessment strategies in medical education. In: Kennedy R, O’Flynn S, editors. Medical education: the state of the art. New York: Nova Science Publishers.
   Google Scholar
• Foo J, Rivers G, Ilic D, Evans DJ, Walsh K, Haines T, Paynter S, Morgan P, Lincke K, Lambrou H, et al. 2017. The economic cost of failure in clinical education: a multi-perspective analysis. Med Educ. 51:740–754.
   PubMed Web of Science ®Google Scholar
• Frank JR, Snell L, Sherbino J, editors. 2015. CanMEDS 2015 physician competency framework. Ottawa: Royal College of Physicians and Surgeons of Canada.
   Google Scholar
• Gingerich A, Regehr G, Eva KW. 2011. Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad Med. 86:S1–S7.
   PubMed Web of Science ®Google Scholar
• Girotti JA, Park YS, Tekian A. 2015. Ensuring a fair and equitable selection of students to serve society's health care needs. Med Educ. 49:84–92.
   PubMed Web of Science ®Google Scholar
• Gorman D. 2018. Matching the production of doctors with national needs. Med Educ. 52:103–113.
   PubMed Web of Science ®Google Scholar
• Griffin B, Harding DW, Wilson IG, Yeomans ND. 2008. Does practice make perfect? The effect of coaching and retesting on selection tests used for admission to an Australian medical school. Med J Aust. 189:270–273.
   PubMed Web of Science ®Google Scholar
• Griffin B, Hu W. 2015. The interaction of socio-economic status and gender in widening participation in medicine. Med Educ. 49:103–113.
   PubMed Web of Science ®Google Scholar
• Griffin B, Wilson IG. 2012. Faking good: self-enhancement in medical school applicants. Med Educ. 46:485–490.
   PubMed Web of Science ®Google Scholar
• Hecker K, Violato C. 2011. A generalizability analysis of a veterinary school multiple mini interview: effect of number of interviewers, type of interviewers, and number of stations. Teach Learn Med. 23:331–336.
   PubMed Web of Science ®Google Scholar
• Jerant A, Fancher T, Fenton JJ, Fiscella K, Sousa F, Franks P, Henderson M. 2015. How medical school applicant race, ethnicity, and socioeconomic status relate to multiple mini-interview-based admissions outcomes: findings from one medical school. Acad Med. 90:1667–1674.
   PubMed Web of Science ®Google Scholar
• Knorr M, Hissbach J. 2014. Multiple mini-interviews: same concept, different approaches. Med Educ. 48:1157–1175.
   PubMed Web of Science ®Google Scholar
• Kumwenda B, Dowell J, Husbands A. 2013. Is embellishing UCAS personal statements accepted practice in applications to medicine and dentistry? Med Teach. 35:599–603.
   PubMed Web of Science ®Google Scholar
• McManus IC, Smithers E, Partridge P, Keeling A, Fleming PR. 2003. A levels and intelligence as predictors of medical careers in UK doctors: 20 year prospective study. BMJ. 327:139–142.
   PubMed Web of Science ®Google Scholar
• Moreau K, Reiter H, Eva KW. 2006. Comparison of aboriginal and nonaboriginal applicants for admissions on the multiple mini-interview using aboriginal and nonaboriginal interviewers. Teach Learn Med. 18:58–61.
   PubMed Web of Science ®Google Scholar
• Nair M, Fellmeth G. 2018. Current efforts in medical education to incorporate national health priorities. Med Educ. 52:24–33.
   PubMed Web of Science ®Google Scholar
• Nisbett RE, Wilson TD. 1977. The halo effect: evidence for unconscious alteration of judgments. J Person Soc Psychol. 35:250–256.
   Web of Science ®Google Scholar
• Norman GR, Monteiro SD, Sherbino J, Ilgen JS, Schmidt HG, Mamede S. 2017. The causes of errors in clinical reasoning: cognitive biases, knowledge deficits, and dual process thinking. Acad Med. 92:23–30.
   PubMed Web of Science ®Google Scholar
• Oliver T, Hecker K, Hausdorf PA, Conlon P. 2014. Validating MMI scores: are we measuring multiple attributes? Adv Health Sci Educ Theory Pract. 19:379–392.
   PubMed Web of Science ®Google Scholar
• Patterson F, Knight A, Dowell J, Nicholson S, Cousans F, Cleland J. 2016. How effective are selection methods in medical education? A systematic review. Med Educ. 50:36–60.
   PubMed Web of Science ®Google Scholar
• Patterson F, Rowett E, Hale R, Grant M, Roberts C, Cousans F, Martin S. 2016. The predictive validity of a situational judgement test and multiple-mini interview for entry into postgraduate training in Australia. BMC Med Educ. 16:87.
   PubMed Web of Science ®Google Scholar
• Phillips AW, Garmel GM. 2014. Does the multiple mini-interview address stakeholder needs? An applicant's perspective. Ann Emerg Med. 64:316–319.
   PubMed Web of Science ®Google Scholar
• Prideaux D, Roberts C, Eva K, Centeno A, McCrorie P, McManus C, Patterson F, Powis D, Tekian A, Wilkinson D. 2011. Assessment for selection for the health care professions and specialty training: consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach. 33:215–223.
   PubMed Web of Science ®Google Scholar
• Regehr G. 2010. It's NOT rocket science: rethinking our metaphors for research in health professions education. Med Educ. 44:31–39.
   PubMed Web of Science ®Google Scholar
• Reiter HI, Eva KW, Rosenfeld J, Norman GR. 2007. Multiple mini-interviews predict clerkship and licensing examination performance. Med Educ. 41:378–384.
   PubMed Web of Science ®Google Scholar
• Reiter HI, Eva KW. 2005. Reflecting the relative values of community, faculty, and students in the admissions tools of medical school. Teach Learn Med. 17:4–8.
   PubMed Web of Science ®Google Scholar
• Reiter HI, Eva KW. 2017. Vive la difference: the freedom and inherent responsibilities when designing and implementing multiple mini-interviews. Acad Med. [accessed 2017 Oct 31]. DOI:10.1097/ACM.0000000000002042
   PubMed Web of Science ®Google Scholar
• Reiter HI, Lockyer J, Ziola B, Courneya CA, Eva K; Canadian Multiple Mini-Interview Research Alliance (CaMMIRA). 2012. Should efforts in favor of medical student diversity be focused during admissions or farther upstream? Acad Med. 87:443–448.
   PubMed Web of Science ®Google Scholar
• Reiter HI, Salvatori P, Rosenfeld J, Trinh K, Eva KW. 2006. The effect of defined violations of test security on admissions outcomes using multiple mini-interviews. Med Educ. 40:36–42.
   PubMed Web of Science ®Google Scholar
• Roberts C, Clark T, Burgess A, Frommer M, Grant M, Mossman K. 2014. The validity of a behavioural multiple-mini-interview within an assessment centre for selection into specialty training. BMC Med Educ. 14:169.
   PubMed Web of Science ®Google Scholar
• Rosenfeld JM, Reiter HI, Trinh K, Eva KW. 2008. A cost efficiency comparison between the multiple mini-interview and traditional admissions interviews. Adv Health Sci Educ Theory Pract. 13:43–58.
   PubMed Web of Science ®Google Scholar
• Salvatori P. 2001. Reliability and validity of admissions tools used to select students for the health professions. Adv Health Sci Educ Theory Pract. 6:159–175.
   PubMed Web of Science ®Google Scholar
• Siu E, Reiter HI. 2009. Overview: what's worked and what hasn't as a guide towards predictive admissions tool development. Adv Health Sci Educ Theory Pract. 14:759–775.
   PubMed Web of Science ®Google Scholar
• Southgate E, Kelly BJ, Symonds IM. 2015. Disadvantage and the 'capacity to aspire' to medical school. Med Educ. 49:73–83.
   PubMed Web of Science ®Google Scholar
• Streiner DL, Norman GR. 2009. Health measurement scales: a practical guide to their development and use. 4th ed. New York: Oxford University Press.
   Google Scholar
• Surowiecki J. 2004. The wisdom of crowds. New York: Doubleday.
   Google Scholar
• Tavares W, Ginsburg S, Eva KW. 2016. Selecting and simplifying: rater performance and behavior when considering multiple competencies. Teach Learn Med. 28:41–51.
   PubMed Web of Science ®Google Scholar
• Traynor M, Galanouli D, Roberts M, Leonard L, Gale T. 2017. Identifying applicants suitable to a career in nursing: a value-based approach to undergraduate selection. J Adv Nurs. 73:1443–1454.
   PubMed Web of Science ®Google Scholar
• Yeates P, O'Neill P, Mann K, Eva K. 2013. Seeing the same thing differently: mechanisms that contribute to assessor differences in directly-observed performance assessments. Adv Health Sci Educ Theory Pract. 18:325–341.
   PubMed Web of Science ®Google Scholar