2018 Ottawa consensus statement: Selection and recruitment to the healthcare professions

References

• Alexander K, Fahey Palma T, Nicholson S, Cleland J. 2017. ‘Why not you?’ Discourses of widening access on UK medical school websites? Med Educ. 51:598–611.
   PubMed Web of Science ®Google Scholar
• Bailey N, Mandeville K, Rhodes T, Mipando M, Muula AS. 2012. Postgraduate career intentions of medical students and recent graduates in Malawi: a qualitative interview study. BMC Med Educ. 12:87.
   PubMed Web of Science ®Google Scholar
• Bates J, Ellaway RH. 2016. Mapping the dark matter of context: a conceptual scoping review. Med Educ. 50:807–816.
   PubMed Web of Science ®Google Scholar
• Bowes L, Thomas L, Peck L, Nathwani T. 2013 International Research on the Effectiveness of Widening Participation. Report to HEFCE and OFFA by CFE and Edge Hill University. http://www.hefce.ac.uk/media/hefce/content/pubs/indirreports/2013/WP,international,research/2013_WPeffectiveness.pdf
   Google Scholar
• Burgess A, Roberts C, Clark T, Mossman K. 2014. The social validity of a national assessment centre for selection into general practice training. BMC Med Educ. 14:261.
   PubMed Web of Science ®Google Scholar
• Canada. 2010. Association of Faculties of Medicine. The future of medical education in Canada (FMEC): a collective vision for MD education. Association of Faculties of Medicine of Canada (AFMC).
   Google Scholar
• Cleland J, Dowell J, McLachlan J, Nicholson S, Patterson F. 2012. Identifying best practice in the selection of medical students (literature review and interview survey). London: General Medical Council.
   Google Scholar
• Cleland JA, Nicholson S, Kelly N, Moffat M. 2015. Taking context seriously: explaining widening access policy enactments in UK medical schools. Med Educ. 49:25–35.
   PubMed Web of Science ®Google Scholar
• Cleland JA, Patterson F, Hanson MD. 2018. Thinking of selection and widening access as complex and wicked problems. Med Educ.
   Google Scholar
• Colleges, American Association of Medical. 2018. AAMC holistic review project achieving improved learning and workforce outcomes through admissions.
   Google Scholar
• Cooke M, Irby DM, O’Brien B. 2010. Educating physicians: a call for reform of medical school and residency. San Francisco (CA): Jossey-Bass, Wiley.
   Google Scholar
• Cooksy LJ, Gill P, Kelly PA. 2001. The program logic model as an integrative framework for a multimethod evaluation. Eval Program Plan. 24:119–128.
   Web of Science ®Google Scholar
• Crosby FJ, Iyer A, Clayton S, Downing RA. 2003. Affirmative action. Psychological data and the policy debates. Am Psychol. 58:93–115.
   PubMed Web of Science ®Google Scholar
• Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. 2015. What’s in a mechanism? Development of a key concept in realist evaluation. Implementation Sci. 10:49.
   PubMed Web of Science ®Google Scholar
• Dalley B, Podawiltz A, Castro R, Fallon K, Kott M, Rabek J, Richardson J, Thomson W, Ferry P, Mabry B. 2009. The Joint Admissions Medical Program: a statewide approach to expanding medical education and career opportunities for disadvantaged students. Acad Med. 84:1373–1382.
   PubMed Web of Science ®Google Scholar
• DeLisa JA, Lindenthal JJ. 2016. Learning from physicians with disabilities and their patients. AMA J Ethics. 18:1003.
   PubMedGoogle Scholar
• Dore KL, Roberts C, Wright S. 2017. Widening perspectives: reframing the way we research selection. Adv in Health Sci Educ. 22:565–572.
   PubMed Web of Science ®Google Scholar
• The Edinburgh Declaration. 1988. The Edinburgh Declaration. Med Educ. 22:481–482.
   Google Scholar
• Edwards JC, Maldonado FG, Jr, Engelgau GR. 2000. Beyond affirmative action: one school’s experiences with a race-neutral admission process. Acad Med. 75:806–815.
   PubMed Web of Science ®Google Scholar
• Ellaway RH, Pusic MV, Galbraith RM, Cameron T. 2014. Developing the role of big data and analytics in health professional education. Med Teach. 36:216–222.
   PubMed Web of Science ®Google Scholar
• Eva KW. 2018. From old town to new town: the state of the science 30 years after the Edinburgh declaration. Med Educ. 52:1–2.
   PubMed Web of Science ®Google Scholar
• Farmer J, Kenny A, McKinstry C, Huysmans RD. 2015. A scoping review of the association between rural medical education and rural practice location. Hum Resour Health. 13:27.
   PubMed Web of Science ®Google Scholar
• Ferguson E, James D, Madeley L. 2002. Factors associated with success in medical school: systematic review of the literature. BMJ. 324:952–957.
   PubMed Web of Science ®Google Scholar
• Ferguson E, Lievens F. 2017. Future directions in personality, occupational and medical selection: myths, misunderstandings, measurement, and suggestions. Adv Health Sci Educ. 22:387–399.
   PubMed Web of Science ®Google Scholar
• Fernando N, Cleland J, McKenzie H, Cassar K. 2008. Identifying the factors that determine feedback given to undergraduate medical students following formative mini-CEX assessments. Med Educ. 42:89–95.
   PubMed Web of Science ®Google Scholar
• Finnerty EP, Chauvin S, Bonaminio G, Andrews M, Carroll RG, Pangaro LN. 2010. Flexner revisited: the role and value of the basic sciences in medical education. Acad Med. 85:349–355.
   PubMed Web of Science ®Google Scholar
• Flexner A, Pritchet H, Henry S. 1910. Medical education in the United States and Canada bulletin number four (The Flexner Report). New York (NY): The Carnegie Foundation for the Advancement of Teaching.
   Google Scholar
• Foo J, Rivers G, Ilic D, Evans DJR, Walsh K, Haines T, Paynter S, Morgan P, Lincke K, Lambrou H, et al. 2017. The economic cost of failure in clinical education: a multi-perspective analysis. Med Educ. 51:740–754.
   PubMed Web of Science ®Google Scholar
• Frazer RA. 2005. Affirmative action policy in medical school admissions. J Health Care Poor Underserved. 16:12–18.
   PubMed Web of Science ®Google Scholar
• Frank JR, Danoff D. 2007. The CanMEDS initiative: implementing an outcomes-based framework of physician competencies. Med Teach. 29:642
   PubMed Web of Science ®Google Scholar
• Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, Fineberg H, Garcia P, Ke Y, Kelley P, et al. 2010. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. The Lancet. 376:1923–1958.
   PubMed Web of Science ®Google Scholar
• Gale T, Parker S. 2013. Widening participation in Australian higher education. Report to the Higher Education Funding Council of England (HEFCE) and the Office for Fair Access (OFFA), England. Leicester, UK: CFE (Research and Consulting) Ltd.
   Google Scholar
• Garces LM, Mickey-Pabello D. 2015. Racial diversity in the medical profession: the impact of affirmative action bans on underrepresented student of color matriculation in medical schools. J High Educ. 86:264–294.
   PubMed Web of Science ®Google Scholar
• Girotti J, Park YS, Tekian A. 2015. Ensuring a fair and equitable selection of students to serve society’s healthcare needs. Med Educ. 49:84–92.
   PubMed Web of Science ®Google Scholar
• Gorard S, Smith E, May H, Thomas L, Adnett N, Slack K. 2006. Review of widening participation research: addressing barriers to participation in higher education. Bristol: HEFCE.
   Google Scholar
• Gorman D. 2018. Matching the production of doctors with national needs. Med Educ. 152:103–113.
   PubMed Web of Science ®Google Scholar
• Greenhalgh T, Russell J, Boynton P, Lefford F, Chopra N, Dunkley L. 2006. “We were treated like adults”-development of a pre-medicine summer school for 16 year olds from deprived socioeconomic backgrounds: action research study. BMJ. 332:762–767.
   PubMed Web of Science ®Google Scholar
• Greenhalgh T, Seyan K, Boynton PM. 2004. “Not a university type”: focus group study of social class, ethnic, and sex differences in school pupils’ perceptions about medical school. BMJ. 328:1541–1544.
   PubMed Web of Science ®Google Scholar
• Griffin B. 2018. Coaching issues. In: Patterson & Zibarras, editors. Selection and recruitment in the healthcare professions. Palgrave: UK.
   Google Scholar
• Griffin B, Harding DW, Wilson IG, Yeomans ND. 2008. Does practice make perfect? The effect of coaching and retesting on selection tests used for admission to an Australian medical school. Med J Aust. 189:270–273.
   PubMed Web of Science ®Google Scholar
• Griffin B, Hu W. 2015. The interaction of socio-economic status and gender in widening participation in medicine. Med Educ. 49:103–113.
   PubMed Web of Science ®Google Scholar
• Hanson MD, Pang C, McLeod J, Springall E, Kulasegaram K, Eva K. 2018. Engaging patients in health professions education admissions: a scoping review of best practices, policies and research. Proceedings of the 18^th Association for Medical Education (AMEE) conference; 2018 Aug 25–29; Basel, Switzerland.
   Google Scholar
• Hawthorne L. 2015. The impact of skilled migration on foreign qualification recognition reform in Australia. Can Public Pol. 41:S173–S187.
   Web of Science ®Google Scholar
• Hilton S, Lewis K. 2004. Opening doors to medicine - widening participation must sit alongside top up fees. Brit Med J. 328:1508–1509.
   PubMed Web of Science ®Google Scholar
• Hodges BD, Lingard L. 2012. The question of competence: reconsidering medical education in the twenty-first century (The culture and politics of health care work). Ithaca (NY): Cornell University Press.
   Google Scholar
• Hofstee WKB. 1983. The case for compromise in educational selection and grading. In: Anderson SB, Helmick JS, editors. On educational testing. San-Francisco: Josey-Bass; p. 109–127.
   Google Scholar
• Humphreys JS, Wakerman J, Wells R, Kuipers P, Jones JA, Entwhistle P. 2008. “Beyond workforce”: a systematic solution for health service provision in small rural and remote communities. MJA. 188:S77.
   PubMed Web of Science ®Google Scholar
• Jorm C, Roberts C. 2018. Using complexity theory to guide medical school evaluations. Acad Med. 93:399–405.
   Google Scholar
• Kehoe A, McLachlan J, Metcalf J, Forrest S, Carter M, Illing J. 2016. Supporting international medical graduates’ transition to their host-country: realist synthesis. Med Educ. 50:1015–1032.
   PubMed Web of Science ®Google Scholar
• Knorr M, Hissbach J. 2014. Multiple mini-interviews: same concept, different approaches. Med Educ. 48:1157–1175.
   PubMed Web of Science ®Google Scholar
• Kirch DG. 2012. Transforming admissions: the gateway to medicine. JAMA. 308:2250–2251.
   PubMed Web of Science ®Google Scholar
• Kizito S, Mukunya D, Nakitende J, Nambasa S, Nampogo A, Kalyesubula R, Katamba A, Sewankambo N. 2015. Career intentions of final year medical students in Uganda after graduating: the burden of brain drain. BMC Med Educ. 15:122.
   PubMed Web of Science ®Google Scholar
• Kreiter CD. 2002. The use of constrained optimization to facilitate admission decisions. Acad Med. 77:148–151.
   PubMed Web of Science ®Google Scholar
• Kumar K, Roberts C, Bartle E, Eley DS. 2018. Testing for medical school selection: what are prospective doctors’ experiences and perceptions of the GAMSAT and what are the consequences of testing? Adv Health Sci Educ. 23:533–546.
   Web of Science ®Google Scholar
• Kumwenda B, Cleland J, Greatrix R, MacKenzie RK, Prescott G. 2018. Are efforts to attract graduate applicants to UK medical schools effective in increasing the participation of under-represented socioeconomic groups? A national cohort study. BMJ Open. 8:e018946.
   Google Scholar
• Lievens F, Ones DS, Dilchert S. 2009. Personality scale validities increase throughout medical school. J Appl Psychol. 94:1514–1535.
   Google Scholar
• Lievens F, Patterson F, Corstjens J, Martin S, Nicholson S. 2016. Widening access in selection using situational judgement tests: evidence from the UKCAT. Med Educ. 50:624–636.
   PubMed Web of Science ®Google Scholar
• Mahon KE, Henderson MK, Kirch DG. 2013. Selecting tomorrow’s physicians: the key to the future health care workforce. Acad Med. 88:1806–1811.
   PubMed Web of Science ®Google Scholar
• Mathers J, Parry J. 2009. Why are there so few working-class applicants to medical schools? Learning from the success stories. Med Educ. 43:219–228.
   PubMed Web of Science ®Google Scholar
• Mathers J, Sitch A, Parry J. 2016. Population-based longitudinal analyses of offer likelihood in UK medical schools: 1996–2012. Med Educ. 50:612–623.
   PubMed Web of Science ®Google Scholar
• Mayer-Schonberger V, Cukier K. 2013. Big data: a revolution that will transform how we live, work and think. Boston, MA: Houghton Mifflin Harcourt.
   Google Scholar
• McHarg J, Mattick K, Knight LV. 2007. Why people apply to medical school: implications for widening participation activities. Med Educ. 41:815–821.
   PubMed Web of Science ®Google Scholar
• McGaghie WC. 2002. Assessing readiness for medical education: evolution of the medical college admission test. JAMA. 288:1085–1090.
   PubMed Web of Science ®Google Scholar
• McManus IC. 2002. Medical school applications-a critical situation. BMJ. 325:786–787.
   PubMed Web of Science ®Google Scholar
• McManus I, Dewberry C, Nicholson S, Dowell J. 2013. The UKCAT-12 Study: education attainment, aptitude test performance, demographic and socioeconomic contextual factors as predictors of first year outcome in a collaborative study of twelve UK medical schools. BMC Med. 11:244.
   PubMed Web of Science ®Google Scholar
• Moreau K, Reiter H, Eva KW. 2006. Comparison of aboriginal and nonaboriginal applicants for admissions on the Multiple Mini-Interview using aboriginal and nonaboriginal interviewers. Teach Learn Med. 18:58–61.
   PubMed Web of Science ®Google Scholar
• Nicholson S, Cleland J. 2015. Reframing research on widening participation in medical education. In: Cleland J, Durning S, editors. Researching Medical Education. 1st ed. Oxford: Wiley-Blackwell; p. 231–242.
   Google Scholar
• Nicholson S, Cleland J. 2017. “It’s making contacts”: notions of social capital and implications for widening access to medical education. Adv Health Sci Educ. 22:477–490.
   PubMed Web of Science ®Google Scholar
• Niessen ASM, Meijer RR. 2017. On the use of broadened admission criteria in higher education. Perspect Psychol Sci. 12:436–448.
   PubMedGoogle Scholar
• Patterson F, Cleland J, Cousans F. 2017. Selection methods in healthcare professions: where are we now and where next? Adv Health Sci Educ. 22:229–242.
   PubMed Web of Science ®Google Scholar
• Patterson F, Ferguson E, Thomas S. 2008. Using job analysis to identify core and specific competencies: implications for selection and recruitment. Med Educ. 42:1195–1204.
   PubMed Web of Science ®Google Scholar
• Patterson F, Knight A, Dowell J, Nicholson S, Cousans F, Cleland J. 2016. How effective are selection methods in medical education? A systematic review. Med Educ. 50:36–60.
   PubMed Web of Science ®Google Scholar
• Patterson F, Lievens F, Kerrin M, Zibarras L, Carette B. 2012. Designing selection systems for medicine: the importance of balancing predictive and political validity in high‐stakes selection contexts. Int J Select Assess. 20:486–496.
   Web of Science ®Google Scholar
• Patterson F, Prescott-Clements L, Zibarras L, Edwards H, Kerrin M, Cousans F. 2016. Recruiting for values in healthcare: a preliminary review of the evidence. Adv Health Sci Educ. 21:859–881.
   PubMed Web of Science ®Google Scholar
• Patterson R, Price J. 2017. Widening participation in medicine: what, why and how? MedEdPublish. 6:15. DOI:10.15694/mep.2017.000184
   PubMedGoogle Scholar
• Patterson F, Tavabie A, Denney M, Kerrin M, Ashworth V, Koczwara A, MacLeod S. 2013. A new competency model for general practice: implications for selection, training and careers. Br J Gen Pract. 63:331–338.
   PubMed Web of Science ®Google Scholar
• Pawson R, Tilley N. 1997. Realistic evaluation. London: Sage.
   Google Scholar
• Prideaux D, Roberts C, Eva K, Centeno A, McCrorie P, McManus C, Patterson F, Powis D, Tekian A, Wilkinson D. 2011. Assessment for selection for the health care professions and specialty training: consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach. 33:215–223.
   PubMed Web of Science ®Google Scholar
• Prober CG, Kolars JC, First LR, Melnick DE. 2016. A plea to reassess the role of United States Medical Licensing Examination Step 1 scores in residency selection. Acad Med. 91:12–15.
   PubMed Web of Science ®Google Scholar
• Razack S, Hodges B, Steinert Y, Maguire M. 2015. Seeking inclusion in an exclusive process: discourses of medical school student selection. Med Educ. 49:36–47.
   PubMed Web of Science ®Google Scholar
• Reiter H, Eva K. 2018. Vive la difference: the freedom and inherent responsibilities when designing and implementing multiple mini-interviews. Acad Med. 93:969–971.
   Google Scholar
• Reiter H, Roberts C. 2018. Situational judgement tests in assessment. In: Downing, SM, Yudkowsky R, editors. Assessment in Health Professions Education. New York (NY): Routledge.
   Google Scholar
• Reiter HI, Lockyer J, Ziola B, Courneya CA, Eva K. Canadian Multiple Mini-Interview Research Alliance (CaMMIRA). 2012. Should efforts in favor of medical student diversity be focused during admissions or farther upstream? Acad Med. 87:443–448.
   PubMed Web of Science ®Google Scholar
• Rittel HWJ, Webber MM. 1973. Dilemmas in a general theory of planning dilemmas in a general theory of planning. Policy Sci. 4:155–169.
   Web of Science ®Google Scholar
• Robb N, Dunkley L, Boynton P, Greenhalgh T. 2007. Looking for a better future: identity construction in socio-economically deprived 16-year olds considering a career in medicine. Soc Sci Med. 65:738–754.
   PubMed Web of Science ®Google Scholar
• Roberts C, Khanna P, Rigby L, Bartle E, Llewellyn A, Gustavs J, Newton L, Newcombe JP, Davies M, Thistlethwaite et al. 2018. Utility of selection methods for specialist medical training: a BEME (best evidence medical education) systematic review: BEME guide no. 45. Med Teach. 40:3–19.
   PubMed Web of Science ®Google Scholar
• Saha S, Guiton G, Wimmers PF, Wilkerson L. 2008. Student body racial and ethnic composition and diversity-related outcomes in US medical schools. J Am Med Assoc. 300:1135–1145.
   PubMed Web of Science ®Google Scholar
• Schuwirth LW, van der Vleuten CP. 2006. Challenges for educationalists. BMJ. 333:544–546.
   PubMed Web of Science ®Google Scholar
• Seyan K, Greenhalgh T, Dorling D. 2004. The standardized admission ratio for measuring widening participation in medical schools: analysis of UK medical school admissions by ethnicity, socioeconomic status, and sex. Brit Med J. 328:1545–1546.
   PubMed Web of Science ®Google Scholar
• Siu E, Reiter HI. 2009. Overview: what’s worked and what hasn’t as a guide towards predictive admissions tool development. Adv Health Sci Educ. 14:759.
   PubMed Web of Science ®Google Scholar
• Sianou-Kyrgiou E, Tsiplakides I. 2011. Similar performance, but different choices: social class and higher education choice in Greece. Stud Higher Edu. 36:89–102.
   Web of Science ®Google Scholar
• Siyam A, Zurn P, Rø OC, Gedik G, Ronquillo K, Co CJ, Vaillancourt-Laflamme C, dela Rosa J, Perfilieva G, Dal Poz MR. 2013. Monitoring the implementation of the WHO global code of practice on the international recruitment of health personnel. Bull World Health Organ. 91:816–823.
   PubMed Web of Science ®Google Scholar
• Smith SD. 2008. The global workforce shortages and the migration of medical professions: the Australian policy response. Aust New Zealand Health Policy. 5:7.
   PubMedGoogle Scholar
• Southgate E, Kelly BJ, Symonds IM. 2015. Disadvantage and the ‘capacity to aspire’ to medical school. Med Educ. 49:73–83.
   PubMed Web of Science ®Google Scholar
• Stegers-Jager KM. 2018. Lessons learned from 15 years of non-grades-based selection for medical school. Med Educ. 52:86–95.
   PubMed Web of Science ®Google Scholar
• Stevens FCJ. 2009. Innovations in medical education: European convergence politics and culture. In: Brosnan C, Turner BS, editors. Handbook of the Sociology of Medical Education. London: Routledge; p. 177–184.
   Google Scholar
• Stevens FCJ, Simmonds Goulbourne JC. 2012. Globalization and the modernization of medical education. Med Teach. 34:e684–e689.
   PubMed Web of Science ®Google Scholar
• Suciu ŞM, Popescu CA, Ciumageanu MD, Buzoianu AD. 2017. Physician migration at its roots: a study on the emigration preferences and plans among medical students in Romania. Hum Resour Health. 15:6.
   PubMed Web of Science ®Google Scholar
• Tekian A. 1998. Minority students, affirmative action, and the admission process: a survey of 15 medical schools. Acad Med. 73:986–992.
   PubMed Web of Science ®Google Scholar
• Tekian A, Boulet J. 2015. A longitudinal study of the characteristics and performances of medical students and graduates from the Arab countries. BMC Med Educ. 15:200.
   PubMed Web of Science ®Google Scholar
• Tiffin PA, Dowell JS, McLachlan JC. 2012. Widening access to UK medical education for under-represented socioeconomic groups: modelling the impact of the UKCAT in the 2009 cohort. BMJ. 344:e1805.
   PubMed Web of Science ®Google Scholar
• Tiffin PA, Mwandigha LM, Paton LW, Hesselgreaves H, McLachlan JC, Finn GM, Kasim AS. 2016. Predictive validity of the UKCAT for medical school undergraduate performance: a national prospective cohort study. BMC Med. 14:140.
   PubMed Web of Science ®Google Scholar
• UK Clinical Aptitude Test (UKCAT). https://www.ukcat.ac.uk/
   Google Scholar
• Undergraduate Medicine and Health Sciences Admissions Test (UMAT). ACER; Australia. https://umat.acer.edu.au/
   Google Scholar
• Whitla DK, Orfield G, Silen W, Teperow C, Howard C, Reede J. 2003. Educational benefits of diversity in medical school: a survey of students. Acad Med. 78:460–466.
   PubMed Web of Science ®Google Scholar
• Wong G, Greenhalgh T, Westhorp G, Pawson R. 2012. Realist methods in medical education research: what are they and what can they contribute? Med Educ. 46:89–96.
   PubMed Web of Science ®Google Scholar
• Woolf K, Potts HW, McManus IC. 2011. Ethnicity and academic performance in UK trained doctors and medical students: systematic review and meta-analysis. BMJ. 342:d901.
   PubMed Web of Science ®Google Scholar
• Wouters A. 2018. Effects of medical school selection on student motivation: a PhD thesis report. Perspect Med Educ. 7:54–57.
   PubMed Web of Science ®Google Scholar
• Wouters A, Croiset G, Isik U, Kusurkar RA. 2017. Motivation of Dutch high school students from various backgrounds for applying to study medicine: a qualitative study. BMJ. 7:e014779.
   PubMed Web of Science ®Google Scholar
• Wouters A, Croiset G, Schripsema NR, Cohen-Schotanus J, Spaai GWG, Hulsman RL, Kusurkar RA. 2017. A multi-site study on medical school selection, performance, motivation and engagement. Adv Health Sci Educ. 22:447–462.
   PubMed Web of Science ®Google Scholar
• The World Health Organization: The World Health Report 2006 – Working together for health. Geneva. 2006.
   Google Scholar
• Xu G, Fields SK, Laine C, Veloski JJ, Barzansky B, Martini CJM. 1997. The relationship between the race/ethnicity of generalist physicians and their care for underserved populations. Am J Public Health. 87:817–822.
   PubMed Web of Science ®Google Scholar
• Young ME, Razack S, Hanson MD, Slade S, Varpio L, Dore KL, McKnight D. 2012. Calling for a broader conceptualisation of diversity: surface and deep diversity in four Canadian medical schools. Acad Med. 87:1501–1510.
   PubMed Web of Science ®Google Scholar