Entrustment within an objective structured clinical examination (OSCE) progress test: Bridging the gap towards competency-based medical education

References

• Blake JM, Norman GR, Keane DR, Mueller CB, Cunnington J, Didyk N. 1996. Introducing progress testing in McMaster University's problem-based medical curriculum: psychometric properties and effect on learning. Acad Med. 71(9):1002–1007.
   PubMed Web of Science ®Google Scholar
• Blake JM, Norman GR, Smith EKM. 1995. Report card from McMaster: student evaluation at a problem-based medical school. Lancet. 345(8954):899–902.
   PubMed Web of Science ®Google Scholar
• Cohen J. 1988. Statistical power analysis for the behavioral sciences. 2nd ed. New York (NY): Routledge.
   Google Scholar
• Coombes L, Ricketts C, Freeman A, Stratford J. 2010. Beyond assessment: feedback for individuals and institutions based on the progress test. Med Teach. 32(6):486–490.
   PubMed Web of Science ®Google Scholar
• Crossley J, Johnson G, Booth J, Wade W. 2011. Good questions, good answers: construct alignment improves the performance of workplace-based assessment scales. Med Educ. 45(6):560–569.
   PubMed Web of Science ®Google Scholar
• Crossley J, Jolly B. 2012. Making Sense of Work-based Assessment: ask the right questions, in the right way, about the right things, of the right people. Med Educ. 46(1):28–37.
   PubMed Web of Science ®Google Scholar
• Dauphinee WD, Blackmore D, Smee S, Rothman A, Reznick R. 1997. Using the judgements of physician examiners in setting the standards for a national multicentre high-stakes OSCE. Adv Health Sci Educ. 2(3):201–211.
   PubMed Web of Science ®Google Scholar
• Friedman Ben-David M. 2000. AMEE Guide No. 18: standard setting in student assessment. Med Teach. 22(2):120–130.
   Web of Science ®Google Scholar
• Gingerich A, Regehr G, Eva KE. 2011. Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad Med. 86(10 Suppl):S1–S7.
   PubMed Web of Science ®Google Scholar
• Gofton W, Dudek N, Barton G, Bhanji F. 2017. Workplace-based assessment implementation guide: formative tips for medical teaching practice. 1st ed. (PDF) Ottawa: The Royal College of Physicians and Surgeons of Canada; p. 1–12. [accessed 2019 Dec 30]. http://www.royalcollege.ca/rcsite/documents/cbd/work-based-assessment-practical-implications-implementation-guide-e.pdf.
   Google Scholar
• Gofton WT, Dudek NL, Wood TJ, Balaa F, Hamstra SJ. 2012. The Ottawa surgical competency operating room evaluation (O-SCORE): a tool to assess surgical competence. Acad Med. 87(10):1401–1407.
   PubMed Web of Science ®Google Scholar
• Halman S, Rekman J, Wood T, Baird A, Gofton W, Dudek N. 2018. Avoid reinventing the wheel: implementation of the Ottawa Clinic Assessment Tool (OCAT) in Internal Medicine. BMC Med Educ. 18(1):218.
   PubMed Web of Science ®Google Scholar
• Hemann BA, Durning SJ, Kelly WF, Dong T, Pangaro LN, Hemmer PA. 2015. The association of students requiring remediation in the internal medicine clerkship with poor performance during internship. Mil Med. 180(4 Suppl):47–53.
   PubMed Web of Science ®Google Scholar
• Holzhausen Y, Maaz A, März M, Sehy V, Peters H. 2019. Exploring the introduction of entrustment rating scales in an existing objective structured clinical examination. BMC Med Educ. 19(1):319.
   PubMed Web of Science ®Google Scholar
• Kogan JR, Hatala R, Hauer KE, Holmboe E. 2017. Guidelines: the do's, don'ts and don't knows of direct observation of clinical skills in medical education. Perspect Med Educ. 6(5):286–305.
   PubMed Web of Science ®Google Scholar
• Larsen DP, Butler AC, Roediger HL. 2009. Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial. Med Educ. 43(12):1174–1181.
   PubMed Web of Science ®Google Scholar
• Lurie SJ. 2012. History and practice of competency-based assessment. Med Educ. 46(1):49–57.
   PubMed Web of Science ®Google Scholar
• Macrae CN, Bodenhausen GV. 2000. Social cognition: thinking categorically about others. Annu Rev Psychol. 51:93–120.
   PubMed Web of Science ®Google Scholar
• Muijtjens AMM, Timmermans I, Donkers J, Peperkamp R, Medema H, Cohen-Schotanus J, Thoben A, Wenink AC, van der Vleuten CP. 2010. Flexible electronic feedback using the virtues of progress testing. Med Teach. 32(6):491–495.
   PubMed Web of Science ®Google Scholar
• Norman G, Neville A, Blake J, Mueller B. 2010. Assessment steers learning down the right road: impact of progress testing on licensing examination performance. Med Teach. 32(6):496–499.
   PubMed Web of Science ®Google Scholar
• Papadakis MA, Hodgson CS, Teherani A, Kohatsu ND. 2004. Unprofessional behavior in medical school is associated with subsequent disciplinary action by a state medical board. Acad Med. 79(3):244–249.
   PubMed Web of Science ®Google Scholar
• Pugh D, Bhanji F, Cole G, Dupre J, Hatala R, Humphrey-Murto S, Touchie C, Wood TJ. 2016. Do OSCE progress test scores predict performance in a national high-stakes examination? Med Educ. 50(3):351–358.
   PubMed Web of Science ®Google Scholar
• Pugh D, Regehr G. 2016. Taking the sting out of assessment: is there a role for progress testing? Med Educ. 50(7):721–729.
   PubMed Web of Science ®Google Scholar
• Pugh D, Touchie C, Wood TJ, Humphrey-Murto S. 2014. Progress testing: is there a role for the OSCE? Med Educ. 48(6):623–631.
   PubMed Web of Science ®Google Scholar
• Rekman J, Gofton W, Dudek N, Gofton T, Hamstra SJ. 2016. Entrustability Scales: outlining their usefulness for competency-based clinical assessment. Acad Med. 91(2):186–190.
   PubMed Web of Science ®Google Scholar
• Ross S, Binczyk NM, Hamza DM, Schipper S, Humphries P, Nichols D, Donoff MG. 2018. Association of a competency-based assessment system with identification of and support for medical residents in difficulty. JAMA Netw Open. 1(7):e184581.
   PubMed Web of Science ®Google Scholar
• Royal College of Physicians and Surgeons of Canada. 2011. Objectives of training in the specialty of internal medicine; [accessed 2019 Dec 30]. http://www.royalcollege.ca/rcsite/documents/ibd/internal_medicine_otr_e.pdf.
   Google Scholar
• Royal College of Physicians and Surgeons of Canada. 2019. CBD assessment templates. [accessed 2019 Dec 30]. http://www.royalcollege.ca/rcsite/cbd/assessment/wbas/cbd-assessment-templates-e.
   Google Scholar
• Royal College of Physicians and Surgeons of Canada. 2020. CBD and assessment; [accessed 2020 Jan 2]. http://www.royalcollege.ca/rcsite/cbd/cbd-assessment-e.
   Google Scholar
• Ryan A, McColl GJ, O'Brien R, Chiavaroli N, Judd T, Finch S, Swanson D. 2017. Tensions in post-examination feedback: information for learning versus potential for harm. Med Educ. 51(9):963–973.
   PubMed Web of Science ®Google Scholar
• Schuwirth LWT, van der Vleuten CPM. 2011a. Programmatic assessment: from assessment of learning to assessment for learning. Med Teach. 33(6):478–485.
   PubMed Web of Science ®Google Scholar
• Schuwirth LWT, van der Vleuten CPM. 2011b. General overview of the theories used in assessment: AMEE guide no. 57. Med Teach. 33(10):783–797.
   PubMed Web of Science ®Google Scholar
• Schuwirth LWT, van der Vleuten CPM. 2012. The use of progress testing. Perspect Med Educ. 1(1):24–30.
   PubMedGoogle Scholar
• Snell L, Frank JR, Stoneham G, De Rossi S, Fletcher W, Gillis K, Stewart J, Waserman S, Wing-Yun Yiu V, Harris K. 2014. Competency-based medical education. Chapter 7 within e-Book: competence by design: reshaping Canadian Medical Education; [accessed 2020 Feb 2]. http://www.royalcollege.ca/rcsite/documents/educational-strategy-accreditation/royal-college-competency-by-design-ebook-e.pdf.
   Google Scholar
• Ten Cate O. 2013. Nuts and bolts of entrustable professional activities. J Grad Med Educ. 5(1):157–158.
   PubMedGoogle Scholar
• Ten Cate O, Scheele F. 2007. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 82(6):542–547.
   PubMed Web of Science ®Google Scholar
• van der Vleuten C, Verhoeven B. 2013. In-training assessment developments in postgraduate education in Europe. ANZ J Surg. 83(6):454–459.
   PubMed Web of Science ®Google Scholar
• Veale P, Busche K, Touchie C, Coderre S, McLaughlin K. 2019. Choosing our own pathway to competency-based undergraduate medical education. Acad Med. 94(1):25–30.
   PubMed Web of Science ®Google Scholar
• Wade L, Harrison C, Hollands J, Mattick K, Ricketts C, Wass V. 2012. Student perceptions of the progress test in two settings and the implications for test deployment. Adv Health Sci Educ Theory Pract. 17(4):573–583.
   PubMed Web of Science ®Google Scholar
• Weller JM, Castanelli DJ, Chen Y, Jolly B. 2017. Making robust assessments of specialist trainees' workplace performance. Br J Anaesth. 118(2):207–214.
   PubMed Web of Science ®Google Scholar
• Weller JM, Misur M, Nicolson S, Morris J, Ure S, Crossley J, Jolly B. 2014. Can I leave the theatre? A key to more reliable workplace-based assessment. Br J Anaesth. 112(6):1083–1091.
   PubMed Web of Science ®Google Scholar
• Wilkinson TJ, Newble DI, Frampton CM. 2001. Standard setting in an objective structured clinical examination: use of global ratings of borderline performance to determine the passing score. Med Educ. 35(11):1043–1049.
   PubMed Web of Science ®Google Scholar