The educational value of situational judgement tests (SJTs) when used during undergraduate medical training: A systematic review and narrative synthesis

References

• Antes AL, Dineen KK, Bakanas E, Zahrli T, Keune JD, Schuelke MJ, DuBois JM. 2020. Professional decision-making in medicine: development of a new measure and preliminary evidence of validity. PLoS One. 15(2):e0228450.
   Web of Science ®Google Scholar
• Cousans F, Patterson F, Edwards H, Walker K, McLachlan JC, Good D. 2017. Evaluating the complementary roles of an SJT and academic assessment for entry into clinical practice. Adv Health Sci Educ Theory Pract. 22(2):401–413.
   PubMed Web of Science ®Google Scholar
• Curtis S, Smith D. 2020. A comparison of undergraduate outcomes for students from gateway courses and standard entry medicine courses. BMC Med Educ. 20(1):4.
   PubMed Web of Science ®Google Scholar
• De Champlain AF. 2018. Standard Setting Methods in Medical Education. Understanding Medical Education. p. 347–359.
   Google Scholar
• Devine OP, Harborne AC, McManus IC. 2015. Assessment at UK medical schools varies substantially in volume, type and intensity and correlates with postgraduate attainment. BMC Med Educ. 15(1):1–35.
   PubMed Web of Science ®Google Scholar
• Ellis R, Scrimgeour DSG, Brennan PA, Lee AJ, Cleland J. 2021. Does performance at medical school predict success at the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination? A retrospective cohort study. BMJ Open. 11(8):e046615.
   PubMed Web of Science ®Google Scholar
• Foucault A, Dubé S, Fernandez N, Gagnon R, Charlin B. 2015. Learning medical professionalism with the online concordance-of-judgment learning tool (CJLT): a pilot study. Med Teach. 37(10):955–960.
   PubMed Web of Science ®Google Scholar
• Frohlich M, Kahmann J, Kadmon M. 2017. Development and psychometric examination of a German video-based situational judgment test for social competencies in medical school applicants. Int J Sel Assess. 25(1):94–110.
   Web of Science ®Google Scholar
• Garrud P, McManus IC. 2018. Impact of accelerated, graduate-entry medicine courses: a comparison of profile, success, and specialty destination between graduate entrants to accelerated or standard medicine courses in UK. BMC Med Educ. 18(1):250.
   PubMed Web of Science ®Google Scholar
• Goss BD, Ryan AT, Waring J, Judd T, Chiavaroli NG, O'Brien RC, Trumble SC, McColl GJ. 2017. Beyond selection: the use of situational judgement tests in the teaching and assessment of professionalism. Acad Med. 92(6):780–784.
   PubMed Web of Science ®Google Scholar
• Graupe T, Fischer MR, Strijbos JW, Kiessling C. 2020. Development and piloting of a Situational Judgement Test for emotion-handling skills using the Verona Coding Definitions of Emotional Sequences (VR-CoDES). Patient Educ Couns. 103:1839–1845.
   PubMed Web of Science ®Google Scholar
• Hayden JA, Côté P, Bombardier C. 2006. Evaluation of the quality of prognosis studies in systematic reviews. Ann Intern Med. 144:427–437.
   PubMed Web of Science ®Google Scholar
• Hayden JA, van der Windt DA, Cartwright JL, Côté P, Bombardier C. 2013. Assessing bias in studies of prognostic factors. Ann Intern Med. 158(4):280–286.
   PubMed Web of Science ®Google Scholar
• Husbands A, Rodgerson MJ, Dowell J, Patterson F. 2015. Evaluating the validity of an integrity-based situational judgement test for medical school admissions. BMC Med Educ. DOI:10.1186/s12909-015-0424-0.
   PubMed Web of Science ®Google Scholar
• Kiessling C, Bauer J, Gartmeier M, Iblher P, Karsten G, Kiesewetter J, Moeller GE, Wiesbeck A, Zupanic M, Fischer MR. 2016. Development and validation of a computer-based situational judgement test to assess medical students’ communication skills in the field of shared decision making. Patient Educ Couns. 99(11):1858–1864.
   PubMed Web of Science ®Google Scholar
• Koczwara A, Patterson F, Zibarras L, Kerrin M, Irish B, Wilkinson M. 2012. Evaluating cognitive ability, knowledge tests and situational judgement tests for postgraduate selection. Med Educ. 46(4):399–408.
   PubMed Web of Science ®Google Scholar
• Lievens F, Patterson F. 2011. The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced-level high-stakes selection. J Appl Psychol. 96(5):927–940.
   PubMed Web of Science ®Google Scholar
• Ludwig S, Behling L, Schmidt U, Fischbeck S. 2021. Development and testing of a summative video-based e-examination in relation to an OSCE for measuring communication-related factual and procedural knowledge of medical students. GMS J Med Educ. 38(3):Doc70.
   PubMed Web of Science ®Google Scholar
• MacKenzie R, Dowell J, Ayansina D, Cleland J, MacKenzie RK, Cleland JA. 2017. Do personality traits assessed on medical school admission predict exit performance? A UK-wide longitudinal cohort study. Adv Health Sci Educ Theory Pract. 22(2):365–385.
   PubMed Web of Science ®Google Scholar
• MacKenzie RK, Cleland JA, Ayansina D, Nicholson S. 2016. Does the UKCAT predict performance on exit from medical school? A national cohort study. BMJ Open. 6(10):e011313.
   PubMed Web of Science ®Google Scholar
• McLachlan J, Illing J. 2013. Health Education England report: An independent review of events relating to the use of situational judgement tests in the selection for foundation process 201; [accessed 2018 Jan 01]. https://www.medschools.ac.uk/media/1932/hee-independent-review-of-the-sjt.pdf.
   Google Scholar
• McManus IC, Harborne AC, Horsfall HL, Joseph T, Smith DT, Marshall-Andon T, Samuels R, Kearsley JW, Abbas N, Baig H, et al. 2020. Exploring UK medical school differences: the MedDifs study of selection, teaching, student and F1 perceptions, postgraduate outcomes and fitness to practise. BMC Med. 18(1):1–35.
   PubMed Web of Science ®Google Scholar
• Murphy MJ, Dowell JS, Smith DT. 2022. Factors associated with declaration of disability in medical students and junior doctors, and the association of declared disability with academic performance: observational study using data from the UK Medical Education Database, 2002–2018 (UKMED54). BMJ Open. 12(4):1–11.
   Web of Science ®Google Scholar
• Paton LW, Tiffin PA, Smith D, Dowell JS, Mwandigha LM. 2018. Predictors of fitness to practise declarations in UK medical undergraduates. BMC Med Educ. 18(1):1–14.
   PubMed Web of Science ®Google Scholar
• Patterson F, Ashworth V, Baron H, Thomas S, Smith D. 2017. The contribution of "Value-add" methodology to understanding medical school outcomes. UKMED: Work Psychology Group, General Medical Council. UK: University of Bristol.
   Google Scholar
• Patterson F, Baron H, Carr V, Plint S, Lane P. 2009. Evaluation of three short-listing methodologies for selection into postgraduate training in general practice. Med Educ. 43(1):50–57.
   PubMed Web of Science ®Google Scholar
• Patterson F, Zibarras L, Ashworth V. 2016. Situational judgement tests in medical education and training: research, theory and practice: AMEE Guide No. 100. Med Teach. 38(1):3–17.
   PubMed Web of Science ®Google Scholar
• Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. 2015. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 13(3):141–146.
   PubMed Web of Science ®Google Scholar
• Reiser S, Schacht L, Thomm E, Bauer J, Figalist C, Janssen L, Schick K, Berberat PO, Gartmeier M, Dorfler E. 2021. A video-based situational judgement test of medical students’ communication competence in patient encounters: development and first evaluation. Patient Educ Couns. 105:1283–1289
   Google Scholar
• Sahota GS, Taggar JS. 2020. The association between Situational Judgement Test (SJT) scores and professionalism concerns in undergraduate medical education. Med Teach. 42(8):937–943.
   PubMed Web of Science ®Google Scholar
• Sam AH, Bala L, Westacott RJ, Brown C. 2021. Is academic attainment or situational judgment test performance in medical school associated with the likelihood of disciplinary action? A national retrospective cohort study. Acad Med. 96(10):1467–1475.
   PubMed Web of Science ®Google Scholar
• Sawdon M, McLachlan JC. 2020. ‘10% of your medical students will cause 90% of your problems’: a prospective correlational study. BMJ Open. 10(11):e038472.
   PubMed Web of Science ®Google Scholar
• Smith DT, Tiffin PA. 2018. Evaluating the validity of the selection measures used for the UK's foundation medical training programme: a national cohort study. BMJ Open. 8(7):e021918.
   PubMed Web of Science ®Google Scholar
• Tiffin PA, Finn GM, McLachlan JC. 2011. Evaluating professionalism in medical undergraduates using selected response questions: findings from an item response modelling study. BMC Med Educ. 11:43.
   PubMed Web of Science ®Google Scholar
• [UKFP] United Kingdom Foundation Programme. 2021. Situational Judgement Test (SJT) FAQs; [accessed 2021 Dec 15]. https://foundationprogramme.nhs.uk/faqs/situational-judgement-test-sjt-faqs/.
   Google Scholar
• Webster ES, Paton LW, Crampton PES, Tiffin PA. 2020. Situational judgement test validity for selection: a systematic review and meta-analysis. Med Educ. 54(10):888–902.
   PubMed Web of Science ®Google Scholar