Utility of selection methods for specialist medical training: A BEME (best evidence medical education) systematic review: BEME guide no. 45

References

• Adusumilli S, Cohan RH, Marshall KW, Fitzgerald JT, Oh MS, Gross BH, Ellis JH. 2000. How well does applicant rank order predict subsequent performance during radiology residency? Acad Radiol. 7:635–640.
   PubMed Web of Science ®Google Scholar
• Ahmed A, Abid MA, Bhatti NI. 2017. Balancing standardized testing with personalized training in surgery. Adv Med Educ Pract. 8:25.
   PubMed Web of Science ®Google Scholar
• Ahmed A, Qayed KI, Abdulrahman M, Tavares W, Rosenfeld J. 2014. The multiple mini-interview for selecting medical residents: first experience in the Middle East region. Med Teach. 36:703–709.
   PubMed Web of Science ®Google Scholar
• Ahmed H, Rhydderch M, Matthews P. 2012a. Can knowledge tests and situational judgement tests predict selection centre performance? Med Educ. 46:777–784.
   PubMed Web of Science ®Google Scholar
• Ahmed H, Rhydderch M, Matthews P. 2012b. Do general practice selection scores predict success at MRCGP? An exploratory study. Educ Primary Care. 23:95–100.
   PubMedGoogle Scholar
• Al Khalili K, Chalouhi N, Tjoumakaris S, Gonzalez LF, Starke RM, Rosenwasser R, Jabbour P. 2014. Programs selection criteria for neurological surgery applicants in the United States: a national survey for neurological surgery program directors. World Neurosurg. 81:473–477.
   PubMed Web of Science ®Google Scholar
• Alterman DM, Jones TM, Heidel RE, Daley BJ, Goldman MH. 2011. The predictive value of general surgery application data for future resident performance. J Surg Educ. 68:513–518.
   PubMed Web of Science ®Google Scholar
• Andrades M, Bhanji S, Kausar S, Majeed F, Pinjani S. 2014. Multiple mini-interviews (MMI) and semistructured interviews for the selection of family medicine residents: a comparative analysis. Int Sch Res Notices. 2014:1.
   Google Scholar
• Baldwin K, Weidner Z, Ahn J, Mehta S. 2009. Are away rotations critical for a successful match in orthopaedic surgery?. Clin Orthop Relat Res. 467:3340–3345.
   PubMed Web of Science ®Google Scholar
• Bandiera G, Regehr G. 2004. Reliability of a structured interview scoring instrument for a Canadian postgraduate emergency medicine training program. Acad Emerg Med. 11:27–32.
   Google Scholar
• Barrett A, Galvin R, Steinert Y, Scherpbier A, O’Shaughnessy A, Horgan M, Horsley T. 2016. A BEME (Best Evidence in Medical Education) review of the use of workplace-based assessment in identifying and remediating underperformance among postgraduate medical trainees: BEME Guide No. 43. Med Teach. 38:1188–1198.
   PubMed Web of Science ®Google Scholar
• Bell JG, Kanellitsas I, Shaffer L. 2002. Selection of obstetrics and gynecology residents on the basis of medical school performance. Am J Obstet Gynecol. 186:1091–1094.
   PubMed Web of Science ®Google Scholar
• Bernstein AD, Jazrawi LM, Elbeshbeshy B, Valle CJD, Zuckerman JD. 2003. An analysis of orthopaedic residency selection criteria. Bull Hosp Jt Dis. 61:49–57.
   Google Scholar
• Beskind DL, Hiller KM, Stolz U, Bradshaw H, Berkman M, Stoneking LR, Fiorello A, Min A, Viscusi C, Grall KJ. 2014. Does the experience of the writer affect the evaluative components on the standardized letter of recommendation in emergency medicine? J Emerg Med. 46:544–550.
   PubMed Web of Science ®Google Scholar
• Betancourt JR, Green AR, Carrillo JE, Ananeh-Firempong O II, 2003. Defining cultural competence: a practical framework for addressing racial/ethnic disparities in health and health care. Public Health Rep. 118:293.
   PubMed Web of Science ®Google Scholar
• Bohm KC, Heest TV, Gioe TJ, Agel J, Johnson TC, Heest AV. 2014. Assessment of moral reasoning skills in the orthopaedic surgery resident applicant. J Bone Joint Surg Am. 96:e151.
   PubMed Web of Science ®Google Scholar
• Bolman LG, Deal TE. 1991. Leadership and management effectiveness: a multi‐frame, multi‐sector analysis. Hum Resour Manage. 30:509–534.
   Web of Science ®Google Scholar
• Boyse TD, Patterson SK, Cohan RH, Korobkin M, Fitzgerald JT, Oh MS, Gross BH, Quint DJ. 2002. Does medical school performance predict radiology resident performance? Acad Radiol. 9:437–445.
   PubMed Web of Science ®Google Scholar
• Brothers TE, Wetherholt S. 2007. Importance of the faculty interview during the resident application process. J Surg Educ. 64:378–385.
   PubMedGoogle Scholar
• Burgess A, Roberts C, Clark T, Mossman K. 2014. The social validity of a national assessment centre for selection into general practice training. BMC Med Educ. 14:1.
   PubMed Web of Science ®Google Scholar
• Cameron AJ, Mackeigan LD, Mitsakakis N, Pugsley JA. 2017. Multiple mini‐interview predictive validity for performance on a pharmacy licensing examination. Med Educ. 51:379–389.
   PubMed Web of Science ®Google Scholar
• Campagna‐Vaillancourt M, Manoukian J, Razack S, Nguyen LH. 2014. Acceptability and reliability of multiple mini interviews for admission to otolaryngology residency. Laryngoscope. 124:91–96.
   PubMed Web of Science ®Google Scholar
• Carroll SM, Kennedy A, Traynor O, Gallagher AG. 2009. Objective assessment of surgical performance and its impact on a national selection programme of candidates for higher surgical training in plastic surgery. J Plast Reconstr Aesthet Surg. 62:1543–1549.
   PubMed Web of Science ®Google Scholar
• Chew FS, Ochoa ER, Relyea-Chew A. 2005. Spreadsheet application for radiology resident match rank list 1. Acad Radiol. 12:379–384.
   PubMed Web of Science ®Google Scholar
• Clegg SR, Matos J. 2017. Sustainability and organizational change management. Routledge.
   Google Scholar
• Colquitt JA, Conlon DE, Wesson MJ, Porter CO, Ng KY. 2001. Justice at the millennium: a meta-analytic review of 25 years of organizational justice research. J Appl Psychol. 86:425.
   PubMed Web of Science ®Google Scholar
• Cook DA, Beckman TJ. 2006. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 119:166e7–166e16.
   Google Scholar
• Cook DA, Brydges R, Ginsburg S, Hatala R. 2015. A contemporary approach to validity arguments: a practical guide to Kane's framework. Med Educ. 49:560–575.
   PubMed Web of Science ®Google Scholar
• Crane JT, Ferraro CM. 2000. Selection criteria for emergency medicine residency applicants. Acad Emerg Med. 7:54–60.
   PubMed Web of Science ®Google Scholar
• Crossingham G, Gale T, Roberts M, Carr A, Langton J, Anderson I. 2011. Content validity of a clinical problem solving test for use in recruitment to the acute specialties. Clin Med. 11:22–25.
   Web of Science ®Google Scholar
• Davison I, Burke S, Bedward J, Kelly S. 2006. Do selection scores for general practice registrars correlate with end of training assessments? Educ Prim Care. 17:473.
   Google Scholar
• Dawkins K, Ekstrom RD, Maltbie A, Golden RN. 2005. The relationship between psychiatry residency applicant evaluations and subsequent residency performance. Acad Psychiatr. 29:69–75.
   PubMed Web of Science ®Google Scholar
• De Virgilio C, Yaghoubian A, Kaji A, Collins JC, Deveney K, Dolich M, Easter D, Hines OJ, Katz S, Liu T. 2010. Predicting performance on the American Board of Surgery qualifying and certifying examinations: a multi-institutional study. Arch Surg. 145:852–856.
   PubMedGoogle Scholar
• Dirschl DR, Dahners LE, Adams GL, Crouch JH, Wilson FC. 2002. Correlating selection criteria with subsequent performance as residents. Clin Orthop Relat Res. 399:265–274.
   Google Scholar
• Dore KL, Kreuger S, Ladhani M, Rolfson D, Kurtz D, Kulasegaram K. 2010. The reliability and acceptability of the multiple mini-interview as a selection instrument for postgraduate admissions. Acad Med. 85:S60–S63.
   PubMed Web of Science ®Google Scholar
• Dougherty PJ, Walter N, Schilling P, Najibi S, Herkowitz H. 2010. Do scores of the USMLE Step 1 and OITE correlate with the ABOS Part I certifying examination?: a multicenter study. Clin Orthop Relat Res. 468:2797–2802.
   PubMed Web of Science ®Google Scholar
• Egol KA, Collins J, Zuckerman JD. 2011. Success in orthopaedic training: resident selection and predictors of quality performance. J Am Acad Orthop Surg. 19:72–80.
   PubMed Web of Science ®Google Scholar
• Eva KW, Macala C. 2014. Multiple mini‐interview test characteristics:‘tis better to ask candidates to recall than to imagine. Med Educ. 48:604–613.
   PubMed Web of Science ®Google Scholar
• Eva KW, Reiter HI, Trinh K, Wasi P, Rosenfeld J, Norman GR. 2009. Predictive validity of the multiple mini-interview for selecting medical trainees. Med Educ. 43:767–775.
   PubMed Web of Science ®Google Scholar
• Eva KW, Rosenfeld J, Reiter HI, Norman GR. 2004. An admissions OSCE: the multiple mini-interview. Med Educ. 38:314–326.
   PubMed Web of Science ®Google Scholar
• Farkas DT, Nagpal K, Curras E, Shah AK, Cosgrove JM. 2012. The use of a surgery-specific written examination in the selection process of surgical residents. J Surg Educ. 69:807–812.
   PubMed Web of Science ®Google Scholar
• Ferguson E, James D, Madeley L. 2002. Factors associated with success in medical school: systematic review of the literature. BMJ. 324:952–957.
   PubMed Web of Science ®Google Scholar
• Frank JR, Danoff D. 2007. The CanMEDS initiative: implementing an outcomes-based framework of physician competencies. Med Teach. 29:642–647.
   PubMed Web of Science ®Google Scholar
• Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, Harris P, Glasgow NJ, Campbell C, Dath D, et al. 2010. Competency-based medical education: theory to practice. Med Teach. 32:638–645.
   PubMed Web of Science ®Google Scholar
• Fraser JD, Aguayo P, Peter SS, Ostlie DJ, Holcomb GW, III, Andrews WA, Murphy JP, Sharp RJ, Snyder CL. 2011. Analysis of the pediatric surgery match: factors predicting outcome. Pediatr Surg Int. 27:1239–1244.
   PubMed Web of Science ®Google Scholar
• Gale T, Roberts M, Sice P, Langton J, Patterson F, Carr A, Anderson I, Lam W, Davies P. 2010. Predictive validity of a selection centre testing non-technical skills for recruitment to training in anaesthesia. Br J Anaesth. 105:603–609.
   PubMed Web of Science ®Google Scholar
• Gallagher AG, Neary P, Gillen P, Lane B, Whelan A, Tanner WA, Traynor O. 2008. Novel method for assessment and selection of trainees for higher surgical training in general surgery. ANZ J Surg. 78:282–290.
   PubMed Web of Science ®Google Scholar
• Glouberman S, Zimmerman B. 2002. Complicated and complex systems: what would successful reform of Medicare look like? Romanow Papers. 2:21–53.
   Google Scholar
• Go PH, Klaassen Z, Chamberlain RS. 2012. Attitudes and practices of surgery residency program directors toward the use of social networking profiles to select residency candidates: a nationwide survey analysis. J Surg Educ. 69:292–300.
   PubMed Web of Science ®Google Scholar
• Gunderman RB, Jackson VP. 2000. Are NBME examination scores useful in selecting radiology residency candidates? Acad Radiol. 7:603–606.
   PubMed Web of Science ®Google Scholar
• Haig A, Dozier M. 2003. BEME Guide no 3: systematic searching for evidence in medical education–Part 1: Sources of information. Med Teach. 25:352–363.
   PubMed Web of Science ®Google Scholar
• Hamdy H, Prasad K, Anderson MB, Scherpbier A, Williams R, Zwierstra R, Cuddihy H. 2006. BEME systematic review: predictive values of measurements obtained in medical schools and future performance in medical practice. Med Teach. 28:103–116.
   PubMed Web of Science ®Google Scholar
• Hayden SR, Hayden M, Gamst A. 2005. What characteristics of applicants to emergency medicine residency programs predict future success as an emergency medicine resident? Acad Emerg Med. 12:206–210.
   PubMed Web of Science ®Google Scholar
• Hissbach JC, Sehner S, Harendza S, Hampe W. 2014. Cutting costs of multiple mini-interviews–changes in reliability and efficiency of the Hamburg medical school admission test between two applications. BMC Med Educ. 14:54.
   PubMed Web of Science ®Google Scholar
• Hofmeister M, Lockyer J, Crutcher R. 2008. The acceptability of the multiple mini interview for resident selection. Fam Med. 40:734–740.
   PubMed Web of Science ®Google Scholar
• Hofmeister M, Lockyer J, Crutcher R. 2009. The multiple mini-interview for selection of international medical graduates into family medicine residency education. Med Educ. 43:573–579.
   Google Scholar
• Hopson LR, Burkhardt JC, Stansfield RB, Vohra T, Turner-Lawrence D, Losman ED. 2014. The multiple mini-interview for emergency medicine resident selection. J Emerg Med. 46:537–543.
   PubMed Web of Science ®Google Scholar
• Isaksen JH, Hertel NT, Kjaer NK. 2013. Semi-structured interview is a reliable and feasible tool for selection of doctors for general practice specialist training. Danish Med J. 60:A4692–A4692.
   PubMed Web of Science ®Google Scholar
• Janis JE, Hatef DA. 2008. Resident selection protocols in plastic surgery: a national survey of plastic surgery program directors. Plas Reconstr Surg. 122:1929–1939.
   PubMed Web of Science ®Google Scholar
• Katsufrakis PJ, Uhler TA, Jones LD. 2016. The residency application process: Pursuing improved outcomes through better understanding of the issues. Acad Med. 91:1483–1487.
   PubMed Web of Science ®Google Scholar
• Khongphatthanayothin A, Chongsrisawat V, Wananukul S, Sanpavat S. 2002. Resident recruitment: what are good predictors for performance during pediatric residency training? J Med Assoc Thai. 85Suppl 1:S302–S311.
   Google Scholar
• Koczwara A, Patterson F, Zibarras L, Kerrin M, Irish B, Wilkinson M. 2012. Evaluating cognitive ability, knowledge tests and situational judgement tests for postgraduate selection. Med Educ. 46:399–408.
   PubMed Web of Science ®Google Scholar
• Krauss E, Bezuhly M, Williams J. 2015. Selecting the best and brightest: a comparison of residency match processes in the United States and Canada. Plast Surg (Oakv). 23:225.
   PubMedGoogle Scholar
• Lansford CD, Fisher SR, Ossoff RH, Chole RA. 2004. Otolaryngology–head and neck surgery residency match: applicant survey. Arch Otolaryngol Head Neck Surg. 130:1017–1023.
   PubMedGoogle Scholar
• Lillis S. 2010. Do scores in the selection process for vocational general practice training predict scores in vocational examinations? Prim Health Care. 1:114–118.
   Google Scholar
• Lin DT, Kannappan A, Lau JN. 2013. The assessment of emotional intelligence among candidates interviewing for general surgery residency. J Surg Educ. 70:514–521.
   PubMed Web of Science ®Google Scholar
• Love JN, DeIorio NM, Ronan-Bentle S, Howell JM, Doty CI, Lane DR, Hegarty C, Burton J. 2013. Characterization of the Council of Emergency Medicine Residency Directors' standardized letter of recommendation in 2011–2012. Acad Emerg Med. 20:926–932.
   PubMed Web of Science ®Google Scholar
• Macan T. 2009. The employment interview: a review of current studies and directions for future research. Hum Resour Manage Rev. 19:203–218.
   Web of Science ®Google Scholar
• Makdisi G, Takeuchi T, Rodriguez J, Rucinski J, Wise L. 2011. How we select our residents—a survey of selection criteria in general surgery residents. J Surg Educ. 68:67–72.
   PubMed Web of Science ®Google Scholar
• Maverakis E, Li CS, Alikhan A, Lin TC, Idriss N, Armstrong AW. 2012. The effect of academic “misrepresentation” on residency match outcomes. Dermatol Online J. 18.
   PubMedGoogle Scholar
• Max BA, Gelfand B, Brooks MR, Beckerly R, Segal S. 2010. Have personal statements become impersonal? An evaluation of personal statements in anesthesiology residency applications. J Clin Anesth. 22:346–351.
   PubMed Web of Science ®Google Scholar
• McGaghie WC, Cohen ER, Wayne DB. 2011. Are United States medical licensing exam step 1 and 2 scores valid measures for postgraduate medical residency selection decisions? Acad Med. 86:48–52.
   PubMed Web of Science ®Google Scholar
• Melendez MM, Xu X, Sexton TR, Shapiro MJ, Mohan EP. 2008. The importance of basic science and clinical research as a selection criterion for general surgery residency programs. J Surg Educ. 65:151–154.
   PubMed Web of Science ®Google Scholar
• Mitchison H. 2009. Assessment centres for core medical training: how do the assessors feel this compares with the traditional interview? Clin Med. 9:147–150.
   PubMed Web of Science ®Google Scholar
• Moore EJ, Price DL, Abel KMV, Carlson ML. 2015. Still under the microscope: Can a surgical aptitude test predict otolaryngology resident performance? Laryngoscope. 125:E57–E61.
   PubMed Web of Science ®Google Scholar
• Nguyen AT, Janis JE. 2012. Resident selection protocols in plastic surgery: a national survey of plastic surgery independent program directors. Plast Reconstr Surg. 130:459–469.
   PubMed Web of Science ®Google Scholar
• Nikolaou I. 2014. Social networking web sites in job search and employee recruitment. Int J Select Assess. 22:179–189.
   Web of Science ®Google Scholar
• Olawaiye A, Yeh J, Withiam-Leitch M. 2006. Resident selection process and prediction of clinical performance in an obstetrics and gynecology program. Teach Learn Med. 18:310–315.
   PubMed Web of Science ®Google Scholar
• Oldfield Z, Beasley SW, Smith J, Anthony A, Watt A. 2013. Correlation of selection scores with subsequent assessment scores during surgical training. ANZ J Surg. 83:412–416.
   PubMed Web of Science ®Google Scholar
• Ozuah PO. 2002. Predicting residents' performance: a prospective study. BMC Med Educ. 2:1.
   PubMedGoogle Scholar
• Pashayan N, Gray S, Duff C, Parkes J, Williams D, Patterson F, Koczwara A, Fisher G, Mason B. 2016. Evaluation of recruitment and selection for specialty training in public health: interim results of a prospective cohort study to measure the predictive validity of the selection process. J Public Health. 38:e194.
   Web of Science ®Google Scholar
• Patterson F, Baron H, Carr V, Plint S, Lane P. 2009. Evaluation of three short‐listing methodologies for selection into postgraduate training in general practice. Med Educ. 43:50–57.
   PubMed Web of Science ®Google Scholar
• Patterson F, Carr V, Zibarras L, Burr B, Berkin L, Plint S, Irish B, Gregory S. 2009. New machine-marked tests for selection into core medical training: evidence from two validation studies. Clin Med. 9:417–420.
   PubMed Web of Science ®Google Scholar
• Patterson F, Ferguson E. 2010. Selection for medical education and training. Wiley-Blackwell.
   Google Scholar
• Patterson F, Ferguson E. 2012. Testing non‐cognitive attributes in selection centres: how to avoid being reliably wrong. Med Educ. 46:240.
   Google Scholar
• Patterson F, Ferguson E, Thomas S. 2008. Using job analysis to identify core and specific competencies: implications for selection and recruitment. Med Educ. 42:1195–1204.
   PubMed Web of Science ®Google Scholar
• Patterson F, Knight A, Dowell J, Nicholson S, Cousans F, Cleland J. 2016. How effective are selection methods in medical education? A systematic review. Med Educ. 50:36–60.
   PubMed Web of Science ®Google Scholar
• Patterson F, Lievens F, Kerrin M, Munro N, Irish B. 2013. The predictive validity of selection for entry into postgraduate training in general practice: evidence from three longitudinal studies. Br J Gen Pract. 63:e734–e741.
   PubMed Web of Science ®Google Scholar
• Patterson F, Lievens F, Kerrin M, Zibarras L, Carette B. 2012. Designing selection systems for medicine: the importance of balancing predictive and political validity in high‐stakes selection contexts. Int J Select Assess. 20:486–496.
   Web of Science ®Google Scholar
• Patterson F, Rowett E, Hale R, Grant M, Roberts C, Cousans F, Martin S. 2016. The predictive validity of a situational judgement test and multiple-mini interview for entry into postgraduate training in Australia. BMC Med Educ. 16:1–8.
   PubMed Web of Science ®Google Scholar
• Patterson F, Tavabie A, Denney M, Kerrin M, Ashworth V, Koczwara A, Macleod S. 2013. A new competency model for general practice: implications for selection, training, and careers. Br J Gen Pract. 63:e331–e338.
   PubMed Web of Science ®Google Scholar
• Patterson F, Zibarras L, Ashworth V. 2016. Situational judgement tests in medical education and training: Research, theory and practice: AMEE Guide No. 100. Med Teach. 38:3–17.
   PubMed Web of Science ®Google Scholar
• Patterson F, Zibarras L, Carr V, Irish B, Gregory S. 2011. Evaluating candidate reactions to selection practices using organisational justice theory. Med Educ. 45:289–297.
   PubMed Web of Science ®Google Scholar
• Patterson F, Zibarras L, Kerrin M, Lopes S, Price R. 2014. Development of competency models for assessors and simulators in high-stakes selection processes. Med Teach. 36:1082–1085.
   PubMed Web of Science ®Google Scholar
• Pau A, Jeevaratnam K, Chen YS, Fall AA, Khoo C, Nadarajah VD. 2013. The Multiple mini-interview (MMI) for student selection in health professions training–a systematic review. Med Teach. 35:1027.
   PubMed Web of Science ®Google Scholar
• Perkins JN, Liang C, McFann K, Abaza MM, Streubel SO, Prager JD. 2013. Standardized letter of recommendation for otolaryngology residency selection. Laryngoscope. 123:123–133.
   PubMed Web of Science ®Google Scholar
• Prager JD, Perkins JN, McFann K, Myer CM, Pensak ML, Chan KH. 2012. Standardized letter of recommendation for pediatric fellowship selection. Laryngoscope. 122:415–424.
   PubMed Web of Science ®Google Scholar
• Prideaux D, Roberts C, Eva K, Centeno A, McCrorie P, McManus C, Patterson F, Powis D, Tekian A, Wilkinson D. 2011. Assessment for selection for the health care professions and specialty training: consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach. 33:215–223.
   PubMed Web of Science ®Google Scholar
• Prober CG, Kolars JC, First LR, Melnick DE. 2016. A plea to reassess the role of United States Medical Licensing Examination Step 1 scores in residency selection. Acad Med. 91:12–15.
   PubMed Web of Science ®Google Scholar
• Quintero AJ, Segal LS, King TS, Black KP. 2009. The personal interview: assessing the potential for personality similarity to bias the selection of orthopaedic residents. Acad Med. 84:1364–1372.
   PubMed Web of Science ®Google Scholar
• Roberts C, Clark T, Burgess A, Frommer M, Grant M, Mossman K. 2014. The validity of a behavioural multiple-mini-interview within an assessment centre for selection into specialty training. BMC Med Educ. 14:1.
   PubMed Web of Science ®Google Scholar
• Roberts C, Togno JM. 2011. Selection into specialist training programs: an approach from general practice. Med J Aust. 194:93–95.
   PubMed Web of Science ®Google Scholar
• Roberts C, Walton M, Rothnie I, Crossley J, Lyon P, Kumar K, Tiller D. 2008. Factors affecting the utility of the multiple mini‐interview in selecting candidates for graduate‐entry medical school. Med Educ. 42:396–404.
   PubMed Web of Science ®Google Scholar
• Roberts M, Gale T, Sice P, Anderson I. 2013. The relative reliability of actively participating and passively observing raters in a simulation‐based assessment for selection to specialty training in anaesthesia. Anaesthesia. 68:591–599.
   PubMed Web of Science ®Google Scholar
• Robinson SW, Roberts N, Dzara K. 2013. Residency-coordinator perceptions of psychiatry residency candidates: a pilot study. Acad Psychiatry. 37:265–267.
   PubMed Web of Science ®Google Scholar
• Rogers CR, Gutowski KA, Munoz DEL, Rio A, Larson DL, Edwards M, Hansen JE, Lawrence WT, Stevenson TR, Bentz ML. 2009. Integrated plastic surgery residency applicant survey: characteristics of successful applicants and feedback about the interview process. Plast Reconstr Surg. 123:1607–1617.
   PubMed Web of Science ®Google Scholar
• Sbicca JA, Gorell ES, Kanzler MH, Lane AT. 2010. The integrity of the dermatology National Resident Matching Program: results of a national study. J Am Acad Dermatol. 63:594–601.
   PubMed Web of Science ®Google Scholar
• Schaverien MV. 2016. Selection for surgical training: an evidence-based review. J Surg Educ. 73:721–729.
   PubMed Web of Science ®Google Scholar
• Scherl SA, Lively N, Simon MA. 2001. Initial review of electronic residency application service charts by orthopaedic residency faculty members. J Bone Joint Surg Am. 83:65-65.
   Web of Science ®Google Scholar
• Schuwirth LW, Van Der Vleuten CP. 2011. Programmatic assessment: from assessment of learning to assessment for learning. Med Teach. 33:478–485.
   PubMed Web of Science ®Google Scholar
• Selber JC, Tong W, Koshy J, Ibrahim A, Liu J, Butler C. 2014. Correlation between trainee candidate selection criteria and subsequent performance. J Am Coll Surg. 219:951–957.
   PubMed Web of Science ®Google Scholar
• Shellito JL, Osland JS, Helmer SD, Chang FC. 2010. American Board of Surgery examinations: can we identify surgery residency applicants and residents who will pass the examinations on the first attempt? Am J Surg. 199:216–222.
   PubMed Web of Science ®Google Scholar
• Shin NC, Ramoska EA, Garg M, Rowh A, Nyce D, Deroos F, Carter M, Hall RV, Lopez BL, Directors DVERP. 2013. Google Internet searches on residency applicants do not facilitate the ranking process. J Emerg Med. 44:995–998.
   PubMed Web of Science ®Google Scholar
• Shiroma PR, Alarcon RD. 2010. Selection factors among international medical graduates and psychiatric residency performance. Acad Psychiatr. 34:128–131.
   PubMed Web of Science ®Google Scholar
• Sklar DP. 2016. Who’s the fairest of them all? Meeting the challenges of medical student and resident selection. Acad Med. 91:1465–1467.
   PubMed Web of Science ®Google Scholar
• Soares WE, III, Sohoni A, Hern HG, Wills CP, Alter HJ, Simon BC. 2015. Comparison of the multiple mini-interview with the traditional interview for US emergency medicine residency applicants: a single-institution experience. Acad Med. 90:76–81.
   PubMed Web of Science ®Google Scholar
• Spurlock DR, Holden C, Hartranft T. 2010. Using United States Medical Licensing Examination®(USMLE) examination results to predict later in-training examination performance among general surgery residents. J Surg Educ. 67:452–456.
   PubMed Web of Science ®Google Scholar
• Stacey RD. 1996. Complexity and creativity in organizations. San Francisco (CA): Berrett-Koehler Publishers.
   Google Scholar
• Stohl HE, Hueppchen NA, Bienstock JL. 2010. Can medical school performance predict residency performance? Resident selection and predictors of successful performance in obstetrics and gynecology. J Grad Med Educ. 2:322–326.
   PubMedGoogle Scholar
• Stratman EJ, Ness RM. 2011. Factors associated with successful matching to dermatology residency programs by reapplicants and other applicants who previously graduated from Medical School. Arch Dermatol. 147:196–202.
   PubMedGoogle Scholar
• Sullivan LW. 2004. Missing persons: minorities in the health professions, a report of the Sullivan Commission on Diversity in the Healthcare Workforce.
   Google Scholar
• Sureshkumar P, Roberts C, Clark T, Jones M, Hale R, Grant M. 2017. Factors related to doctors’ choice of rural pathway in general practice specialty training. Australian J Rural Health. 25:148–154.
   PubMed Web of Science ®Google Scholar
• Thomas H, Taylor CA, Davison I, Field S, Gee H, Grant J, Malins A, Pendleton L, Spencer E. 2012. National Evaluation of Specialty Selection: final report.
   Google Scholar
• Thundiyil JG, Modica RF, Silvestri S, Papa L. 2010. Do United States Medical Licensing Examination (USMLE) scores predict in-training test performance for emergency medicine residents? J Emerg Med. 38:65–69.
   PubMed Web of Science ®Google Scholar
• Tiller D, O'Mara D, Rothnie I, Dunn S, Lee L, Roberts C. 2013. Internet‐based multiple mini‐interviews for candidate selection for graduate entry programmes. Med Educ. 47:801–810.
   PubMed Web of Science ®Google Scholar
• Tolan AM, Kaji AH, Quach C, Hines OJ, De Virgilio C. 2010. The electronic residency application service application can predict Accreditation Council for Graduate Medical Education competency-based surgical resident performance. J Surg Educ. 67:444–448.
   PubMed Web of Science ®Google Scholar
• Turner NS, Shaughnessy WJ, Berg EJ, Larson DR, Hanssen AD. 2006. A quantitative composite scoring tool for orthopaedic residency screening and selection. Clin Orthopaed Related Res. 449:50–55.
   PubMed Web of Science ®Google Scholar
• Van Der Vleuten CP. 1996. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ. 1:41–67.
   PubMed Web of Science ®Google Scholar
• Vermeulen MI, Tromp F, Zuithoff NP, Pieters RH, Damoiseaux RA, Kuyvenhoven MM. 2014. A competency based selection procedure for Dutch postgraduate GP training: a pilot study on validity and reliability. Eur J Gen Pract. 20:307–313.
   PubMed Web of Science ®Google Scholar
• Wakeford R. 2014. Predictive validity of selection for entry into postgraduate training in general practice. Br J Gen Pract. 64:71–71.
   PubMed Web of Science ®Google Scholar
• Yoshimura H, Kitazono H, Fujitani S, Machi J, Saiki T, Suzuki Y, Ponnamperuma G. 2015. Past-behavioural versus situational questions in a postgraduate admissions multiple mini-interview: a reliability and acceptability comparison. BMC Med Educ. 15:75.
   PubMed Web of Science ®Google Scholar