References
- Veloski JJ, Fields SK, Boex JR, Blank LL. Measuring professionalism: a review of studies with instruments reported in the literature between 1982 and 2002. Acad Med. 2005;80(4):366–370. doi:https://doi.org/10.1097/00001888-200504000-00014.
- Wilkinson TJ, Wade WB, Knock LD. A blueprint to assess professionalism: results of a systematic review. Acad Med. 2009;84(5):551–558. doi:https://doi.org/10.1097/ACM.0b013e31819fbaa2.
- Grumbach K, Bodenheimer T. Can health care teams improve primary care practice? JAMA. 2004;291(10):1246–1251. doi:https://doi.org/10.1001/jama.291.10.1246.
- Beach MC, Sugarman J, Johnson RL, Arbelaez JJ, Duggan PS, Cooper LA. Do patients treated with dignity report higher satisfaction, adherence, and receipt of preventive care? Ann Fam Med. 2005;3(4):331–338. doi:https://doi.org/10.1370/afm.328.
- Stern DT, Frohna AZ, Gruppen LD. The prediction of professional behaviour. Med Educ. 2005;39(1):75–82. doi:https://doi.org/10.1111/j.1365-2929.2004.02035.x.
- Papadakis MA, Teherani A, Banach MA, et al. Disciplinary action by medical boards and prior behavior in medical school. N Engl J Med. 2005;353(25):2673–2682. doi:https://doi.org/10.1056/NEJMsa052596.
- Englander R, Cameron T, Ballard AJ, Dodge J, Bull J, Aschenbrener CA. Toward a common taxonomy of competency domains for the health professions and competencies for physicians. Acad Med. 2013;88(8):1088–1094. doi:https://doi.org/10.1097/ACM.0b013e31829a3b2b.
- Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system: rationale and benefits. N Engl J Med. 2012;366(11):1051–1056. doi:https://doi.org/10.1056/NEJMsr1200117.
- Kirch DG. Transforming admissions: the gateway to medicine. JAMA. 2012;308(21):2250–2251. doi:https://doi.org/10.1001/jama.2012.74126.
- Mahon KE, Henderson MK, Kirch DG. Selecting tomorrow’s physicians: the key to the future health care workforce. Acad Med. 2013;88(12):1806–1811. doi:https://doi.org/10.1097/ACM.0000000000000023.
- Cusimano C, Cusimano D. An analysis of attrition from Canadian neurosurgery residency programs. Acad Med. 1999;74(8):925–931.
- Marcus-Blank B, Dahlke JA, Braman JP, et al. Predicting performance of first-year residents: correlations between structured interview, licensure exam, and competency scores in a multi-institutional study. Acad Med. 2019;94(3):378–387. doi:https://doi.org/10.1097/ACM.0000000000002429.
- Cohen J. A power primer. Psychol Bull. 1992;112(1):155–159. doi:https://doi.org/10.1037/0033-2909.112.1.155.
- McDaniel MA, Nguyen NT. Situational judgment tests: a review of practice and constructs assessed. Int J Select Assess. 2001;9(1&2):103–113. doi:https://doi.org/10.1111/1468-2389.00167.
- Reiter H, Roberts C. Situational judgment tests. In: Assessment in Health Professions Education. 2nd ed. New York: Routledge; 2020.
- Patterson F, Zibarras L, Ashworth V. Situational judgement tests in medical education and training: research, theory and practice: AMEE Guide No. 100. Med Teacher. 2016;38(1):3–17. doi:https://doi.org/10.3109/0142159X.2015.1072619.
- Lievens L, Sackett PR. The validity of interpersonal skills assessment via situational judgment tests for predicting academic success and job performance. J Appl Psychol. 2012;97(2):460–468. doi:https://doi.org/10.1037/a0025741.
- Patterson F, Lievens F, Kerrin M, Munro N, Irish B. The predictive validity of selection for entry into postgraduate training in general practice: evidence from three longitudinal studies. Br J Gen Pract. 2013;63(616):e734–e741. doi:https://doi.org/10.3399/bjgp13X674413.
- Lievens F, Patterson F. The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced-level high-stakes selection. J Appl Psychol. 2011;96(5):927–940. doi:https://doi.org/10.1037/a0023496.
- Patterson F, Lievens F, Kerrin M, Zibarras L, Carette B. Designing selection systems for medicine: the importance of balancing predictive and political validity in high-stakes selection contexts. Int J Select Assess. 2012;20(4):486–496. doi:https://doi.org/10.1111/ijsa.12011.
- Sozener CB, Lypson ML, House JB, et al. Reporting achievement of medical student milestones to residency program directors: an educational handover. Acad Med. 2016;91(5):676–684. doi:https://doi.org/10.1097/ACM.0000000000000953.
- Wancata LM, Morgan H, Sandhu G, Santen S, Hughes DT. Using the ACMGE milestones as a handover tool from medical school to surgery residency. J Surg Educ. 2017;74(3):519–529. doi:https://doi.org/10.1016/j.jsurg.2016.10.016.
- Langenau EE, Pugliano G, Roberts WL. Relationships between high-stakes clinical skills exam scores and program director global competency ratings of first-year pediatric residents. Med Educ Online. 2011;16(1):7362. doi:https://doi.org/10.3402/meo.v16i0.7362.
- McGaghie WC, Cohen ER, Wayne DB. Are United States medical licensing exam step 1 and 2 scores valid measures for postgraduate medical residency selection decisions? Acad Med. 2011;86(1):48–52. doi:https://doi.org/10.1097/ACM.0b013e3181ffacdb.
- Stephenson-Famy A, Houmard BS, Oberoi S, Manyak A, Chiang S, Kim S. Use of the interview in resident candidate selection: a review of the literature. J Grad Med Educ. 2015;7(4):539–548. doi:https://doi.org/10.4300/JGME-D-14-00236.1.
- Cullen MJ, Konia MR, Borman-Shoap EC, et al. Not all unprofessional behaviors are equal: The creation of a checklist of bad behaviors. Med Teacher. 2017;39(1):85–91. doi:https://doi.org/10.1080/0142159X.2016.1231917.
- Flanagan JC. The critical incident technique. Psychol Bull. 1954;51(4):327–358. doi:https://doi.org/10.1037/h0061470.
- Ployhart RE, Ehrhart MG. Be careful what you ask for: effects of response instructions on the construct validity and reliability of situational judgment tests. Int J Select Assess. 2003;11(1):1–16. doi:https://doi.org/10.1111/1468-2389.00222.
- Weekley JA, Ployhart RE. Situational Judgment Tests: Theory, Measurement and Application. Mahwah, NJ: Lawrence Erlbaum Associates; 2006.
- Anastasi A, Anastasi A. Psychological Testing. New York: Macmillan; 1976.
- Chan D, Schmitt N. Situational judgment and job performance. Human Perform. 2002;15(3):233–254. doi:https://doi.org/10.1207/S15327043HUP1503_01.
- Heidemeier H, Moser K. Self–other agreement in job performance ratings: a meta-analytic test of a process model. J Appl Psychol. 2009;94(2):353–370. doi:https://doi.org/10.1037/0021-9010.94.2.353.
- Mabe PA, West SG. Validity of self-evaluation of ability: a review and meta-analysis. J Appl Psychol. 1982;67(3):280–296. doi:https://doi.org/10.1037/0021-9010.67.3.280.
- Beatty AS, Barratt CL, Berry CM, Sackett PR. Testing the generalizability of indirect range restriction corrections. J Appl Psychol. 2014;99(4):587–598. doi:https://doi.org/10.1037/a0036361.
- Dunleavy D, Fraser RL. Predicting Student Professionalism in Medical School: A Situational Judgment Test. Phoenix, AZ: AAMC; 2019.
- Whetzel DL, McDaniel MA, Nguyen NT. Subgroup differences in situational judgment test performance: a meta-analysis. Hum Perform. 2008;21(3):291–309. doi:https://doi.org/10.1080/08959280802137820.
- Lie D, Encinas J, Stephens F, Prislin M. Do faculty show the ‘halo effect’ in rating students compared with standardized patients during a clinical examination? Internet J Family Pract. 2009;8(2):8726. http://ispub.com/IJFP/8/2/8726.
- Margolis MJ, Clauser BE, Cuddy MM, et al. Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station clinical skills examination: a validity study. Acad Med. 2006;81(10 Suppl):S56–S60. doi:https://doi.org/10.1097/01.ACM.0000236514.53194.f4.
- Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull. 1959;56(2):81–105. doi:https://doi.org/10.1037/h0046016.
- Lievens F, Buyse T, Sackett PR. The operational validity of a video-based situational judgment test for medical college admissions: illustrating the importance of matching predictor and criterion construct domains. J Appl Psychol. 2005;90(3):442–452. doi:https://doi.org/10.1037/0021-9010.90.3.442.
- Patterson F, Baron H, Carr V, Plint S, Lane P. Evaluation of three short-listing methodologies for selection into postgraduate training in general practice. Med Educat. 2009;43(1):50–57. doi:https://doi.org/10.1111/j.1365-2923.2008.03238.x.
- McDaniel MA, Morgeson FP, Finnegan EB, Campion MA, Braverman EP. Use of situational judgment tests to predict job performance: a clarification of the literature. J Appl Psychol. 2001;86(4):730–740. doi:https://doi.org/10.1037/0021-9010.86.4.730.
- McLachlan J. Measuring conscientiousness and professionalism in undergraduate medical students. Clin Teacher. 2010;7(1):37–40. doi:https://doi.org/10.1111/j.1743-498X.2009.00338.x.
- American Educational Research Association, American Psychological Association, and National Council for Measurement in Education. The Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association; 2013.
- Schmitt N, Chan D. Situational judgment tests: method or construct. In: Situational Judgment Tests: Theory, Measurement, and Application. Mahewh, NJ: Erlbaum; 2006:135–155.
- Guenole N, Chernyshenko OS, Weekly J. On designing construct driven situational judgment tests: some preliminary recommendations. Int J Test. 2017;17(3):234–252. doi:https://doi.org/10.1080/15305058.2017.1297817.
- Lievens F. Construct-driven SJTs: toward an agenda for future research. Int J Test. 2017;17(3):269–276. doi:https://doi.org/10.1080/15305058.2017.1309857.
- McDaniel MA, List SK, Kepes S. The “hot mess” of situational judgment test construct validity and other issues. Ind Organ Psychol. 2016;9(1):47–51. doi:https://doi.org/10.1017/iop.2015.115.
- Cullen MJ, Sackett PR, Lievens F. Threats to the operational use of situational judgment tests in the college admission process. Int J Select Assess. 2006;14(2):142–155. doi:https://doi.org/10.1111/j.1468-2389.2006.00340.x.
- Patterson F, Ashworth V, Mehra S, Falcon H. Could situational judgement tests be used for selection into dental foundation training? Br Dent J. 2012;213(1):23–26. doi:https://doi.org/10.1038/sj.bdj.2012.560.