Robust, defensible, and fair: The AMEE guide to selection into medical school: AMEE Guide No. 153

References

• Alexander K, Cleland JA. 2018. Social inclusion or social engineering? The politics and reality of widening access to medicine in the UK. In: ShahM, McKay J, editors. Achieving equity and academic excellence in higher education: global perspectives in an era of widening participation. Cham (Switzerland): Palgrave-McMillan.
   Google Scholar
• Australian Medical Council. 2012. Standards for Assessment and Accreditation of Primary Medical programmes. [Accessed 4 May 2022] https://www.amc.org.au/wp-content/uploads/2019/10/Standards-for-Assessment-and-Accreditation-of-Primary-Medical-Programs-by-the-Australian-Medical-Council-2012.pdf.
   Google Scholar
• Biggs J. 1996. Enhancing teaching through constructive alignment. High Educ. 32(3):347–364.
   Web of Science ®Google Scholar
• Brown C, Ross S, Cleland J, Walsh K. 2015. Money makes the (medical assessment) world go round: the cost of components of a summative final year objective structured clinical examination (OSCE). Med Teach. 37(7):653–659.
   PubMed Web of Science ®Google Scholar
• Burgess A, Roberts C, Clark T, Mossman K. 2014. The social validity of a national assessment centre for selection into general practice training. BMC Med Educ. 14:261.
   PubMed Web of Science ®Google Scholar
• Busche K, Elks ML, Hanson JT, Jackson-Williams L, Manuel RS, Parsons WL, Wofsy D, Yuan K. 2020. The validity of scores From the New MCAT Exam in predicting student performance: results from a multisite study. Acad Med. 95(3):387–395.
   Google Scholar
• Chesser A, Cameron H, Evans P, Cleland J, Boursicot K, Mires G. 2009. Mires G. Sources of variation in performance on a shared OSCE station across four UK medical schools. Med Educ. 43(6):526–532.
   PubMed Web of Science ®Google Scholar
• Chowdry H, Goodman A. 2013. Widening participation in higher education: analysis. Journal of Royal Statistical Society. 176:1–26.
   Google Scholar
• Cleland JA. 2018. The medical school admissions process and meeting the public’s health care needs: never the twain shall meet? Acad Med. 93(7):972–974.
   PubMed Web of Science ®Google Scholar
• Cleland J, Chu J, Lim S, Low J, Low-Beer N, Kwek TK. 2020. COVID 19: designing and conducting an online mini-multiple interview (MMI) in a dynamic landscape. Medical Teacher. 42(7):776–780.
   PubMed Web of Science ®Google Scholar
• Cleland JA, Kelly N, Moffat M, Nicholson S. 2015. Taking context seriously: explaining widening access policy enactments in UK medical schools. Med Educ. 49(1):25–35.
   PubMed Web of Science ®Google Scholar
• Cleland JA, Patterson F, Hanson MD. 2018. Thinking of selection and widening access as complex and wicked problems. Med Educ. 52(12):1228–1239.
   PubMed Web of Science ®Google Scholar
• Coyle M, Sandover S, Poobalan A, Bullen J, Cleland J. 2021. Meritocratic and fair? The discourse of UK and Australia’s widening participation policies. Med Educ. 55(7):825–839.
   PubMed Web of Science ®Google Scholar
• Davies DJ, Sam AH, Murphy KG, Khan SA, Choe R, Cleland J. 2022. BMAT’s predictive validity for medical school performance: a retrospective cohort study. Med Educ. 56(9):936–948.
   PubMed Web of Science ®Google Scholar
• Downing SM. 2003. Validity: on the meaningful interpretation of assessment data. Med Educ. 37(9):830–837.
   PubMed Web of Science ®Google Scholar
• Ellis R, Brennan PA, Scrimgeour DSG, Lee AJ, Cleland J. 2022. Performance at medical school selection correlates with success in Part A of the intercollegiate Membership of the Royal College of Surgeons (MRCS) examination. Postgrad Med J. 98(1161):e19.
   PubMed Web of Science ®Google Scholar
• Fielding S, Tiffin PA, Greatrix R, Lee AJ, Patterson F, Nicholson S, Cleland JA. 2018. Do changing medical admissions practices in the UK impact on who is admitted? An interrupted time series analysis. BMJ Open. 8(10):e023274.
   PubMed Web of Science ®Google Scholar
• Foo J, Rivers G, Allen L, Ilic D, Maloney S, Hay M. 2020. The economic costs of selecting medical students: an Australian case study. Med Educ. 54(7):643–651.
   PubMed Web of Science ®Google Scholar
• Frank JR, Snell L, Sherbino J, editors. CanMEDS 2015 physician competency framework. Ottawa: Royal College of Physicians and Surgeons of Canada.
   Google Scholar
• Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, Fineberg H, Garcia P, Ke Y, Kelley P, et al. 2010. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 376(9756):1923–1958.
   PubMed Web of Science ®Google Scholar
• Fyfe M, Horsburgh J, Blitz J, Chiavaroli N, Kumar S, Cleland J.. 2022. The do’s, don’ts and don’t knows of redressing differential attainment related to race/ethnicity in medical schools. Perspect Med Educ. 11(1):1–14.
   PubMed Web of Science ®Google Scholar
• (GMC) General Medical Council. 2018. Outcomes for graduates. [Accessed 4 May 2022] https://www.gmc-uk.org/education/standards-guidance-and-curricula/standards-and-outcomes/outcomes-for-graduates.
   Google Scholar
• Gingerich A, Kogan J, Yeates P, Govaerts M, Holmboe E. 2014. Seeing the ‘Black Box’ differently: assessor cognition from three research perspectives. Med Educ. 48(11):1055–1068.
   PubMed Web of Science ®Google Scholar
• Girotti JA, Chanatry JA, Clinchot DM, McClure SC, Sein A, Walker IW, Searcy CA. 2020. Investigating group differences in examinees. Acad Med. 95(3):365–374.
   PubMed Web of Science ®Google Scholar
• Gorman D. 2018. Matching the production of doctors with national needs. Med Educ. 52(1):103–113.
   PubMed Web of Science ®Google Scholar
• Griffin B. 2018. Selecting medical students: considering qualities other than academic ability. Med Educ. 52(1):9–11.
   PubMed Web of Science ®Google Scholar
• Grima-Murcia MD, Sanchez-Ferrer F, Ramos-Rincón JM, Fernández E. 2020. Use of eye-tracking technology by medical students taking the objective structured clinical examination: descriptive Study. J Med Internet Res. 22(8):e17719.
   PubMed Web of Science ®Google Scholar
• Haffery FW. 1998. Beyond curriculum reform: confronting medicine’s hidden curriculum. Acad Med. 73(4):403–407.
   PubMed Web of Science ®Google Scholar
• Hodges B. 2013. Assessment in the post-psychometric era: learning to love the subjective and collective. Med Teach. 35(7):564–568.
   PubMed Web of Science ®Google Scholar
• Kerrin M, Mossop L, Morley E, Fleming G, Flaxman C. 2018. Role analysis: the foundation for selection systems. In: Patterson F, Zibarras L, editors. Selection and Recruitment in the Healthcare Professions Research, Theory and Practice. Cham (Switzerland): Palgrave Macmillan; p. 139–166.
   Google Scholar
• Kumwenda B, Cleland JA, Walker K, Lee AJ, Greatrix R. 2017. The relationship between school type and academic performance at medical school: a national, multi-cohort study. BMJ Open. 7(8):e016291.
   PubMed Web of Science ®Google Scholar
• Lievens F, Ones DS, Dilchert S. 2009. Personality scale validities increase throughout medical school. J Appl Psychol. 94(6):1514–1535.
   PubMed Web of Science ®Google Scholar
• Lievens F, Patterson F, Corstjens J, Martin S, Nicholson S. 2016. Widening access in selection using situational judgement tests: evidence from the UKCAT. Med Educ. 50(6):624–636.
   PubMed Web of Science ®Google Scholar
• Lievens F, Sackett PR, De Corte W. 2022. Weighting admission scores to balance predictiveness-diversity: the Pareto-optimization approach. Med Educ. 56(2):151–158.
   PubMed Web of Science ®Google Scholar
• Lourinho I, Ferreira MA, Severo M. 2017. Personality and achievement along medical training: evidence from a cross-lagged analysis. PLoS ONE. 12(10):e0185860.
   PubMed Web of Science ®Google Scholar
• Marbin J, Hutchinson Y, Schaeffer S. 2021. Avoiding the virtual pitfall: identifying and mitigating biases in graduate medical education videoconference interviews. Acad Med. 96(8):1120–1124.
   PubMed Web of Science ®Google Scholar
• McManus ICC, Dewberry C, Nicholson S, Dowell JS, Woolf K, Potts HWW. 2013. Construct-level predictive validity of educational attainment and intellectual aptitude tests in medical student selection: meta-regression of six UK longitudinal studies. BMC Med. 11(1):1–21.
   PubMedGoogle Scholar
• McManus I, Dewberry C, Nicholson S, Dowell J. 2013. The UKCAT-12 Study: education attainment, aptitude test performance, demographic and socioeconomic contextual factors as predictors of first year outcome in a collaborative study of twelve UK medical schools. BMC Med. 11(1):244.
   PubMed Web of Science ®Google Scholar
• McGirr J, Seal A, Barnard A, Cheek C, Garne D, Greenhill J, Kondalsamy-Chennakesavan S, Luscombe GM, May J, McLeod J, et al. 2019. The Australian rural clinical school (RCS) program supports rural medical workforce: evidence from a cross-sectional study of 12 RCSs. Rural and Remote Health. 19(1):4971–4980.
   PubMed Web of Science ®Google Scholar
• MOE & MOH 2012. Ministry of education and ministry of health’s opinions on implementation of pilot programs for cultivating excellent doctors. Beijing, China. http://www.moe.gov.cn/srcsite/A08/moe_740/s7952/201205/t20120507_166950.html.
   Google Scholar
• Molenda M. 2003. In search of the elusive ADDIE model. Perf Improv. 42(5):34–36.
   Google Scholar
• Mountford-Zimdars A, Moore J, Graham J. 2016. Is contextualised admission the answer to the access challenge? Perspectives. Policy and Practice in Higher Education. 20(4):143–150.
   Google Scholar
• Nicholson S, Cleland JA. 2015. Reframing research on widening participation in medical education: using theory to inform practice. In Cleland JA and Durning S. 2015. Researching Medical Education (Edition 1). Wiley: Oxford, p. 231–243.
   Google Scholar
• Nicholson S, Alexander K, Coyle M, Cleland J. 2022. Widening access to medicine: using mid-range theory to extend knowledge and understanding. In Cleland JA and Durning S. 2015. Researching Medical Education (Edition 2). Wiley: Oxford, p. xxx-xxx.
   Google Scholar
• Patterson F, Roberts C, Hanson MD, Hampe W, Eva K, Ponnamperuma G, Magzoub M, Tekian A, Cleland J,. 2018. Ottawa consensus statement: selection and recruitment to the healthcare professions. Med Teach. 40(11):1091–1101.
   PubMed Web of Science ®Google Scholar
• Patterson F, Knight A, Dowell J, Nicholson S, Cousans F, Cleland J. 2016. How effective are selection methods in medical education? A systematic review. Med Educ. 50(1):36–60.
   PubMed Web of Science ®Google Scholar
• Prideaux D, Roberts C, Eva K, Centeno A, McCrorie P, McManus C, Patterson F, Powis D, Tekian A, Wilkinson D. 2011. Assessment for selection for the health care professions and specialty training: consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach. 33(3):215–223.
   PubMed Web of Science ®Google Scholar
• Raffoul M, Bartlett-Esquilant G, Phillips RL. Jr. 2019. Recruiting and training a health professions workforce to meet the needs of tomorrow’s health care system. Acad Med. 94(5):651–655.
   PubMed Web of Science ®Google Scholar
• Reinbold S. 2013. Using the ADDIE model in designing library instruction. Med Ref Serv Q. 32(3):244–256.
   PubMedGoogle Scholar
• Reiter H, Eva K. 2018. Vive la difference: the freedom and inherent responsibilities when designing and implementing multiple miniinterviews. Acad Med. 93(7):969–971.
   PubMed Web of Science ®Google Scholar
• Roberts C, Khanna P, Rigby L, Bartle E, Llewellyn A, Gustavs J, Newton L, Newcombe JP, Davies M, Thistlethwaite J, et al. 2018. Utility of selection methods for specialist medical training: a BEME (best evidence medical education) systematic review: BEME Guide No. 45. Med Teach. 40(1):3–19.
   PubMed Web of Science ®Google Scholar
• Robinett K, Kareem R, Reavis K, Quezada S. 2021. A multi‐pronged, antiracist approach to optimize equity in medical school admissions. Med Educ. 55(12):1376–1382.
   PubMed Web of Science ®Google Scholar
• Sacker A, Schoon I, Bartley M. 2002. Social inequality in educational achievement and psychosocial adjustment throughout childhood: magnitude and mechanisms. Soc Sci Med. 55(5):863–880.
   PubMed Web of Science ®Google Scholar
• Saha S, Guiton G, Wimmers PF, Wilkerson L. 2008. Student body racial and ethnic composition and diversity-related outcomes in US medical schools. JAMA. 300(10):1135–1145.
   PubMed Web of Science ®Google Scholar
• Schreurs S. 2020. Selection for medical school: the quest for validity. Maastricht University. https://books.ipskampprinting.nl/thesis/540443-schreurs/.
   Google Scholar
• Schreurs S, Cleland J, Muijtjens AMM, Oude Egbrink MGA, Cleutjens K. 2018. Does selection pay off? A cost–benefit comparison of medical school selection and lottery systems. Med Educ. 52(12):1240–1248.
   PubMed Web of Science ®Google Scholar
• Schreurs S, Cleutjens K, Cleland J, Muijtjens AMM, Oude Egbrink MGA. 2018. Selection into medicine: the predictive validity of an outcome-based procedure. BMC Med Educ. 18(1):214.
   PubMedGoogle Scholar
• Schreurs S, Cleutjens K, Cleland J, Oude Egbrink MGA. 2020. Outcomes-based selection into medical school: predicting excellence in multiple competencies during the clinical years. Acad Med. 95(9):1411–1420.
   PubMed Web of Science ®Google Scholar
• Schreurs S, Cleutjens K, Collares CF, Cleland J, Oude Egbrink MGA. 2020. Opening the black box of selection. Adv Health Sci Educ Theory Pract. 25(2):363–382.
   PubMed Web of Science ®Google Scholar
• Scott I, Yeld N, McMillan J, Hall M. 2005. Equity and excellence in higher education: the case of the University of Cape Town. In: Bowen W. Kurzweil M., Tobin E, editors, Equity and excellence in American higher education. University of Virginia Press, Charlottesville, VA, p. 261–284.
   Google Scholar
• Stegers-Jager KM. 2018. Lessons learned from 15 years of non-grades-based selection for medical school. Med Educ. 52(1):86–95.
   PubMed Web of Science ®Google Scholar
• Stegers-Jager KM, Steyerberg EW, Lucieer SM, Themmen AP. 2015. Ethnic and social disparities in performance on medical school selection criteria. Med Educ. 9(1):124–133.
   Google Scholar
• Siu E, Reiter HI. 2009. Overview: what’s worked and what hasn’t as a guide towards predictive admissions tool development. Adv Health Sci Educ Theory Pract. 14(5):759–775.
   PubMed Web of Science ®Google Scholar
• Ten Cate O. 2021. Rationales for a lottery among the qualified to select medical trainees: decades of Dutch experience. J Grad Med Educ. 13(5):612–615.
   PubMedGoogle Scholar
• Terregino CA, Saguil A, Price-Johnson T, Anachebe NF, Goodell K. 2020. The diversity and success of medical school applicants with scores in the middle third of the MCAT score scale. Acad Med. 95(3):344–350.
   PubMed Web of Science ®Google Scholar
• Tiffin PA, Dowell JS, McLachlan JC. 2012. Widening access to UK medical education for under-represented socioeconomic groups: modelling the impact of the UKCAT in the 2009 cohort. BMJ. 344(apr17 2):e1805–e1805.
   PubMedGoogle Scholar
• Tiffin PA, Mwandigha LM, Paton LW, Hesselgreaves H, McLachlan JC, Finn GM, Kasim AS. 2016. Predictive validity of the UKCAT for medical school undergraduate performance: a national prospective cohort study. BMC Med. 14(1):140.
   PubMed Web of Science ®Google Scholar
• Ungtrakul T, Lamlertthon W, Boonchoo B, Auewarakul C. 2020. Virtual multiple mini‐interview during a COVID-19 pandemic. Med Educ. 54(8):764–765.
   PubMed Web of Science ®Google Scholar
• van der Merwe L, van Zyl G, St Clair Gibson A, Viljoen M, Iputo J, Mammen M, Chitha W, Perez A, Hartman N, Fonn S, et al. 2015. South African medical schools: current state of selection criteria and medical students’ demographic profile. S Afr Med J. 106(1):76–81.
   PubMedGoogle Scholar
• Webster ES, Paton LW, Crampton PES, Tiffin PA. 2020. Situational judgement test validity for selection: a systematic review and meta-analysis. Med Educ. 54(10):888–902.
   PubMed Web of Science ®Google Scholar
• Witzburg RA, Sondheimer HM. 2013. Holistic review—Shaping the medical profession one applicant at a time. N Engl J Med. 368(17):1565–1567.
   PubMed Web of Science ®Google Scholar