Feasibility, and validity aspects of Entrustable Professional Activity (EPA)-based assessment in general practice training

References

• Dornan T, Boshuizen H, King N, et al. Experience-based learning: a model linking the processes and outcomes of medical students’ workplace learning. Med Educ. 2007 Jan;41(1):84–91.
   PubMed Web of Science ®Google Scholar
• Van der Zwet J, Zwietering PJ, Teunissen PW, et al. Workplace learning from a socio-cultural perspective: creating developmental space during the general practice clerkship. Adv in Health Sci Educ. 2011;16:359–373.
   PubMed Web of Science ®Google Scholar
• Hirsh DA, Holmboe ES, Ten Cate O. Time to trust: longitudinal integrated clerkships and entrustable professional activities. Acad Med. 2014 Feb;89(2):201–204.
   PubMed Web of Science ®Google Scholar
• Ten Cate OTJ, Hart D, Ankel F, et al. Entrustment decision making in clinical training. Acad Med. 2016;91(2).
   Web of Science ®Google Scholar
• Ten Cate OTJ. Entrustability of professional activities and competency-based training. Med Educ. 2005 Dec;39(12):1176–1177.
   PubMed Web of Science ®Google Scholar
• Ten Cate OTJ. Nuts and bolts of entrustable professional activities. J Graduate Med Educ. 2013 Mar;5(1):157–158.
   PubMedGoogle Scholar
• Ten Cate OTJ, Scheele F. Viewpoint: competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82(6):542–547.
   PubMed Web of Science ®Google Scholar
• Ten Cate OTJ, Chen HC, Hoff RG, et al. Curriculum development for the workplace using Entrustable Professional Activities (EPAs): AMEE guide No. 99. Med Teach. 2015 Nov;37(11):983–1002.
   PubMed Web of Science ®Google Scholar
• Peters H, Holzhausen Y, Boscardin C, et al. Twelve tips for the implementation of EPAs for assessment and entrustment decisions. Med Teach. 2017;39(8):802–807.
   PubMed Web of Science ®Google Scholar
• O’Dowd E, Lydon S, O’Connor P, et al. A systematic review of 7 years of research on entrustable professional activities in graduate medical education, 2011–2018. Med Educ. 2019;53:234–249.
   PubMed Web of Science ®Google Scholar
• Shorey S, Ching Lau T, Tiang Lau S, et al. Entrustable professional activities in health care education: a scoping review. Med Educ. 2019;53:766–777.
   PubMed Web of Science ®Google Scholar
• Shaughnessy AF, Sparks J, Cohen-Osher M, et al. Entrustable professional activities in family medicine. J Graduate Med Educ. 2013 Mar;5(1):112–118.
   PubMedGoogle Scholar
• Huisartsopleiding Nederland. Nationwide assessment plan. (Available in Dutch: Landelijk Toetsplan 2016). Huisartsopleiding Nederland; 2016.
   Google Scholar
• Competentieprofiel en eindtermen van de huisarts. The Netherlands: werkgroep actualiseren Eindtermen en Competenties.
   Google Scholar
• Huisartsopleiding Nederland. What is a theme, and what is an Entrustable Professional Activity (EPA)? (Available in Dutch: Wat is een thema en wat is een Kenmerkende Beroepsactiviteit (KBA)?). 2016 [cited 2016 Dec 13]. Available from: https://www.huisartsopleiding.nl/regelgeving/landelijk-opleidingsplan/thema-s-en-kba-s/19-regelgeving/98-1-wat-is-een-thema-en-wat-is-een-kenmerkende-beroepsactiviteit-kba
   Google Scholar
• Huisartsopleiding Nederland. Towards a new national training plan for general practice. (Available in Dutch: Naar een Nieuw Landelijk Opleidingsplan Huisartsgeneeskunde) [ cited 2016 Apr 26]. Available from: http://www.huisartsopleiding.nl/regelgeving/landelijk-opleidingsplan
   Google Scholar
• Huisartsopleiding Nederland. Themes and EPA’s. (Available in Dutch: Thema’s en KBA’s) 2016 [cited 2017 Jan 27]. Available from: https://www.huisartsopleiding.nl/opleiding/thema-s-en-kba-s
   Google Scholar
• Huisartsopleiding Nederland. National training plan for the General Practice training program. (Available in Dutch: Landelijk Opleidingsplan voor de opleiding tot huisarts). 2017. Utrecht: Huisartsopleiding Nederland.
   Google Scholar
• Publiek Z. General practice care (Available in Dutch: Huisartsenzorg). 2015. [cited 2018 Aug 20]. Available from: https://www.zorgprismapubliek.nl/informatie-over/huisartsenzorg/huisartsenzorg/
   Google Scholar
• Huisartsopleiding Nederland. Trainees at the out-of-hours GP center. (Available in Dutch: AIOS op de huisartsenpost. Leidraad voor het leren dienstdoen.). Utrecht: Huisartsopleiding Nederland; 2016.
   Google Scholar
• EDC C. Castor electronic data capture. 2019.
   Google Scholar
• IBM Corp. IBM SPSS statistics for windows. 24.0. Armonk, NY: IBM CORP; 2016.
   Google Scholar
• MAXQDA, software for qualitative data analysis. Berling, Germany: VERBI Software - Consult - Socialforschung GmbH; 1989–2016.
   Google Scholar
• Tavakol M, Sandars J. Quantitative and qualitative methods in medical education research: AMEE Guide No 90: part 1. Med Teach. 2014;36(9):746–756.
   PubMed Web of Science ®Google Scholar
• Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–1288.
   PubMed Web of Science ®Google Scholar
• Pope C, Ziebland S, Mays N. Qualitative research in health care. Analysing qualitative data. BMJ. 2000;320:114–116.
   PubMed Web of Science ®Google Scholar
• Boeije H Analysis in qualitative research. (Available in Dutch: Analyseren in kwalitatief onderzoek. Denken en doen). Vol. Tweede druk. Den Haag: Boom Lemma uitgevers; 2014.
   Google Scholar
• Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006;119:166.
   PubMedGoogle Scholar
• Cook DA, Zendejas B, Hamstra SJ, et al. What counts as validity evidence? Examples and prevalence in a systematic review of simulation-based assessment. Adv Health Sci Educ Theory Pract. 2014;19:233–250.
   PubMed Web of Science ®Google Scholar
• Downing SM. Validity: on the meaningful interpretation of assessment data. Med Educ. 2003;39:830–837.
   Google Scholar
• Cohen J. Statistical power analysis for the behavioural scenes. Mahwah, USA: Lawrence Erlbaum Associates, Inc; 1977.
   Google Scholar
• Lawlor KB, Hornyak MJ. SMART goals: how the application of SMART goals can contribute to achievement of student learning outcomes. Dev Bus Simul Experiental Learn. 2012;39:259–267.
   Google Scholar
• Morrison M. History of SMART objectives. Rapid Bus Improv. 2010. [cited 2020 Nov 03]. Available from: https://rapidbi.com/history-of-smart-objectives/
   Google Scholar
• Lockspeiser TM, Schmitter PA, Lane L, et al. A validated rubric for scoring learning goals. J Teach Learn Resour MedEdPORTAL. 2013. DOI:10.15766/mep_2374-8265.9369.
   Google Scholar
• Dijksterhuis MG, Voorhuis M, Teunissen PW, et al. Assessment of competence and progressive independence in postgraduate clinical training. Med Educ. 2009 Dec;43(12):1156–1165.
   PubMed Web of Science ®Google Scholar
• Sterkenburg A, Barach P, Kalkman C, et al. When do supervising physicians decide to entrust residents with unsupervised tasks? Acad Med. 2010;85(9):1408–1417.
   PubMed Web of Science ®Google Scholar
• Choo KJ, Arora VM, Barach P, et al. How do supervising physicians decide to entrust residents with unsupervised tasks? A qualitative analysis. J Hosp Med. 2014 Mar;9(3):169–175.
   PubMed Web of Science ®Google Scholar
• Warm EJ, Mathis BR, Held JD, et al. Entrustment and mapping of observable practice activities for resident assessment. J Gen Intern Med. 2014 Aug;29(8):1177–1182.
   PubMed Web of Science ®Google Scholar
• Ten Cate OTJ. Entrustment as assessment: recognizing the ability, the right, and the duty to act. J Grad Med Educ. 2016;8(2):261–262.
   PubMedGoogle Scholar
• Sagasser MH, Fluit CRMG, van Weel C, et al. How entrustment is informed by holistic judgements across time in a family medicine residency program: an ethnographic nonparticipant observational study. Acad Med. 2017;92(6):792–799.
   PubMed Web of Science ®Google Scholar
• Hauer KE, Ten Cate O, Boscardin C, et al. Understanding trust as an essential element of trainee supervision and learning in the workplace. Adv Health Sci Educ Theory Pract. 2014 Aug;19(3):435–456.
   PubMed Web of Science ®Google Scholar
• Ten Cate OTJ. Entrustment decision: bringing the patient into the equation. Acad Med. 2017;92(6):736–738.
   PubMed Web of Science ®Google Scholar
• Ten Cate OTJ, Chen HC. The ingredients of a rich entrustment decision. Med Teach. 2020;42(12):1413–1420. Epub.
   Web of Science ®Google Scholar
• Bonnie LHA, Visser MRM, Kramer AWM, et al. The mutual trust relationship between trainers and trainees in a workplace-based medical training program. BMJ Open. 2020;10:e:036593.
   PubMed Web of Science ®Google Scholar
• Hauer KE, Oza SK, Kogan JR, et al. How clinical supervisors develop trust in their trainees: a qualitative study. Med Educ. 2015 Aug;49(8):783–795.
   PubMed Web of Science ®Google Scholar
• Sebok-Syer SS, Chahine S, Watling CJ, et al. Considering the interdependence of clinical performance: implications for assessment and entrustment. Med Educ. 2018;52(9):970–980.
   PubMed Web of Science ®Google Scholar
• Touchie C, Ten Cate OTJ. The promise, perils, problems and progress of competency-based medical education. Med Educ. 2016;50(1):93–100.
   PubMed Web of Science ®Google Scholar