Does Masked Interviewing Encourage Holistic Review in Residency Selection? A Mixed-Methods Study

References

• American Association of Medical Colleges. Holistic Review. AAMC.
   Google Scholar
• Witzburg RA, Sondheimer HM. Holistic review—shaping the medical profession one applicant at a time. N Engl J Med. 2013;368(17):1565–1567. doi:10.1056/NEJMp1300411.
   PubMed Web of Science ®Google Scholar
• Grabowski CJ. Impact of holistic review on student interview pool diversity. Adv Health Sci Educ Theory Pract. 2018;23(3):487–498. doi:10.1007/s10459-017-9807-9.
   PubMed Web of Science ®Google Scholar
• National Resident Matching Program. Results of the 2020 NRMP Program Director Survey. 2020; https://mk0nrmp3oyqui6wqfm.kinstacdn.com/wp-content/uploads/2020/08/2020-PD-Survey.pdf
   Google Scholar
• Williams M, Kim EJ, Pappas K, et al. The impact of United States Medical Licensing Exam (USMLE) Step 1 cutoff scores on recruitment of underrepresented minorities in medicine: a retrospective cross-sectional study. Health Sci Rep. 2020;3(2):e2161. doi:10.1002/hsr2.161.
   PubMedGoogle Scholar
• Rubright JD, Jodoin M, Barone MA. Examining demographics, prior academic performance, and United States medical licensing examination scores. Acad Med. 2019;94(3):364–370. doi:10.1097/ACM.0000000000002366.
   PubMed Web of Science ®Google Scholar
• Edmond MB, Deschenes JL, Eckler M, Wenzel RP. Racial bias in using USMLE Step 1 scores to grant internal medicine residency interviews. Acad Med. 2001;76(12):1253–1256. doi:10.1097/00001888-200112000-00021.
   PubMed Web of Science ®Google Scholar
• Crane MA, Chang HA, Azamfirei R. Medical education takes a step in the right direction: where does that leave students? JAMA. 2020;323(20):2013–2014. doi:10.1001/jama.2020.2950.
   PubMed Web of Science ®Google Scholar
• Lin GL, Nwora C, Warton LD. Pass/fail score reporting for USMLE Step 1: an opportunity to redefine the transition to residency together. Acad Med. 2020;95(9):1308–1311. doi:10.1097/ACM.0000000000003495.
   PubMed Web of Science ®Google Scholar
• McGaghie WC, Cohen ER, Wayne DB. Are United States Medical licensing exam Step 1 and 2 scores valid measures for postgraduate medical residency selection decisions? Acad Med. 2011;86(1):48–52. doi:10.1097/ACM.0b013e3181ffacdb.
   PubMed Web of Science ®Google Scholar
• Rozenshtein A, Mullins ME, Marx MV. The USMLE Step 1 pass/fail reporting proposal: the APDR position. Acad Radiol. 2019;26(10):1400–1402. doi:10.1016/j.acra.2019.06.004.
   PubMed Web of Science ®Google Scholar
• Makhoul AT, Pontell ME, Ganesh Kumar N, Drolet BC. Objective measures needed - program directors’ perspectives on a pass/fail USMLE Step 1. N Engl J Med. 2020;382(25):2389–2392. doi:10.1056/NEJMp2006148.
   PubMed Web of Science ®Google Scholar
• Choudhary A, Makhoul AT, Ganesh Kumar N, Drolet BC. Impact of pass/fail USMLE Step 1 scoring on the internal medicine residency application process: a program director survey. J Gen Intern Med. 2021;36(8):2509–2510. doi:10.1007/s11606-020-05984-y.
   PubMed Web of Science ®Google Scholar
• Huq S, Khalafallah AM, Botros D, et al. Perceived impact of USMLE Step 1 pass/fail scoring change on neurosurgery: program director survey. J Neurosurg. 2020;133(3):928–935. doi:10.3171/2020.4.JNS20748.
   PubMed Web of Science ®Google Scholar
• Pontell ME, Makhoul AT, Ganesh Kumar N, Drolet BC. The change of USMLE Step 1 to pass/fail: perspectives of the surgery program director. J Surg Educ. 2021;78(1):91–98. doi:10.1016/j.jsurg.2020.06.034.
   PubMed Web of Science ®Google Scholar
• Gruppuso PA, Adashi EY. Residency placement fever: is it time for a reevaluation? Acad Med. 2017;92(7):923–926. doi:10.1097/ACM.0000000000001468.
   PubMed Web of Science ®Google Scholar
• Kim RH, Gilbert T, Suh S, Miller JK, Eggerstedt JM. General surgery residency interviews: are we following best practices? Am J Surg. 2016;211(2):476–481.e3. doi:10.1016/j.amjsurg.2015.10.003.
   PubMed Web of Science ®Google Scholar
• Pershing SM, Co JPTM, Katznelson L. The new USMLE Step 1 paradigm: an opportunity to cultivate diversity of excellence [Editorial]. Acad Med. 2020;95(9):1325–1328. doi:10.1097/ACM.0000000000003512.
   PubMed Web of Science ®Google Scholar
• Sharma A, Schauer DP, Kelleher M, Kinnear B, Sall D, Warm E. USMLE Step 2 CK: best predictor of multimodal performance in an internal medicine residency. J Grad Med Educ. 2019;11(4):412–419. doi:10.4300/JGME-D-19-00099.1.
   PubMedGoogle Scholar
• Carmody JB. On residency selection and the quantitative fallacy. J Grad Med Educ. 2019;11(4):420–421. doi:10.4300/JGME-D-19-00453.1.
   PubMedGoogle Scholar
• Katsufrakis PJ, Uhler TA, Jones LD. The residency application process: pursuing improved outcomes through better understanding of the issues. Acad Med. 2016;91(11):1483–1487. doi:10.1097/ACM.0000000000001411.
   PubMed Web of Science ®Google Scholar
• Puscas L. Viewpoint from a program director they can’t all walk on water. J Grad Med Educ. 2016;8(3):314–316. doi:10.4300/JGME-D-16-00237.1.
   PubMedGoogle Scholar
• Stephenson-Famy A, Houmard BS, Oberoi S, Manyak A, Chiang S, Kim S. Use of the interview in resident candidate selection: a review of the literature. J Grad Med Educ. 2015;7(4):539–548. doi:10.4300/JGME-D-14-00236.1.
   PubMedGoogle Scholar
• Makdisi G, Takeuchi T, Rodriguez J, Rucinski J, Wise L. How we select our residents—a survey of selection criteria in general surgery residents. J Surg Educ. 2011;68(1):67–72. doi:10.1016/j.jsurg.2010.10.003.
   PubMed Web of Science ®Google Scholar
• Gordon EKB, Clapp JT, Heins SJ, et al. The role of the interview in residency selection: a mixed-methods study. Med Educ. 2020;54(11):1029–1039. doi:10.1111/medu.14248.
   PubMed Web of Science ®Google Scholar
• Smilen SW, Funai EF, Bianco AT. Residency selection: should interviewers be given applicants’ board scores? Am J Obstet Gynecol. 2001;184(3):508–513. doi:10.1067/mob.2001.109868.
   PubMed Web of Science ®Google Scholar
• Robin AP, Bombeck CT, Pollak R, Nyhus LM. Introduction of bias in residency-candidate interviews. Surgery. 1991;110(2):253–258.
   PubMed Web of Science ®Google Scholar
• Miles WS, Shaw V, Risucci D. The role of blinded interviews in the assessment of surgical residency candidates. Am J Surg. 2001;182(2):143–146. doi:10.1016/s0002-9610(01)00668-7.
   PubMed Web of Science ®Google Scholar
• Brustman LE, Williams FL, Carroll K, Lurie H, Ganz E, Langer O. The effect of blinded versus nonblinded interviews in the resident selection process. J Grad Med Educ. 2010;2(3):349–353. doi:10.4300/JGME-D-10-00051.1.
   PubMedGoogle Scholar
• Gennissen LM, Stegers-Jager KM, de Graaf J, Fluit CRMG, de Hoog M. Unraveling the medical residency selection game. Adv Health Sci Educ Theory Pract. 2021;26(1):237–252. doi:10.1007/s10459-020-09982-x.
   PubMed Web of Science ®Google Scholar
• Gennissen LM, Croix Adl, Stegers-Jager K, Graaf Jd, Fluit CRMG, Hoog Md. Organic or organised: an interaction analysis to identify how interactional practices influence participation in group decision meetings for residency selection. BMJ Open. 2019;9(12):e026424. doi:10.1136/bmjopen-2018-026424.
   PubMed Web of Science ®Google Scholar
• Leech NL, Onwuegbuzie AJ. A typology of mixed methods research designs. Qual Quant. 2009;43(2):265–275. doi:10.1007/s11135-007-9105-3.
   Web of Science ®Google Scholar
• Peirce CS. How to make our ideas clear. Pop Sci Mon. 1878;12:286–302.
   Google Scholar
• Dipboye RL. Self-fulfilling prophecies in the selection-recruitment interview. Acad Manage Rev. 1982;7(4):579–586. doi:10.2307/257224.
   Google Scholar
• U.S. News & World Report. The Best Medical Schools for Research, Ranked.
   Google Scholar
• Charmaz K. Constructing Grounded Theory. 2nd ed. London: SAGE Publications Ltd; 2014.
   Google Scholar
• MacQueen KM, McLellan E, Kay K, Milstein B. Codebook development for team-based qualitative analysis. Cam J. 1998;10(2):31–36. doi:10.1177/1525822X980100020301.
   Google Scholar
• Tavory I, Timmermans S. Abductive Analysis: Theorizing Qualitative Research. Chicago: University of Chicago Press; 2014.
   Google Scholar
• Alvesson M, Kärreman D. Constructing mystery: empirical matters in theory development. AMR. 2007;32(4):1265–1281. doi:10.5465/amr.2007.26586822.
   Google Scholar
• Cochran WG, Rubin DB. Controlling bias in observational studies: a review. Sankhyā Indian J Stat Ser 1961–2002. 1973;35(4):417–446.
   Google Scholar
• Sadler DR. The futility of attempting to codify academic achievement standards. High Educ. 2014;67(3):273–288.
   Web of Science ®Google Scholar
• Coplan B, Evans BC. How organizational culture influences holistic review: a qualitative multiple case study. Adv Health Sci Educ Theory Pract. 2021;26(5):1491–1517. doi:10.1007/s10459-021-10055-w.
   PubMed Web of Science ®Google Scholar
• Shappell E, Schnapp B. The F word: how “fit” threatens the validity of resident recruitment. J Grad Med Educ. 2019;11(6):635–636. doi:10.4300/JGME-D-19-00400.1.
   PubMedGoogle Scholar
• Stark L. Behind Closed Doors: IRBs and the Making of Ethical Research. Chicago: University of Chicago Press; 2012.
   Google Scholar
• Thorndike EL. A constant error in psychological ratings. J Appl Psychol. 1920;4(1):25–29. doi:10.1037/h0071663.
   Google Scholar
• Symonds PM. Notes on rating. J Appl Psychol. 1925;9(2):188–195. doi:10.1037/h0069901.
   Google Scholar
• Urciuoli B. Excellence, leadership, skills, diversity: marketing liberal arts education. Lang Commun. 2003;23(3–4):385–408. doi:10.1016/S0271-5309(03)00014-4.
   Web of Science ®Google Scholar
• Urciuoli B. Skills and selves in the new workplace. Am Ethnol. 2008;35(2):211–228. doi:10.1111/j.1548-1425.2008.00031.x.
   Web of Science ®Google Scholar
• Alexis DA, Kearney MD, Williams JC, Xu C, Higginbotham EJ, Aysola J. Assessment of perceptions of professionalism among faculty, trainees, staff, and students in a large university-based health system. JAMA Netw Open. 2020;3(11):e2021452. doi:10.1001/jamanetworkopen.2020.21452.
   PubMed Web of Science ®Google Scholar