Linking Workplace-Based Assessment to ACGME Milestones: A Comparison of Mapping Strategies in Two Specialties

References

• Nasca TJ, Philibert I, Brigham T, et al. The next GME accreditation system-rationale and benefits. N Engl J Med. 2012;366(11):1051–1056. doi: 10.1056/NEJMsr1200117.
   PubMed Web of Science ®Google Scholar
• (ACGME) ACfGME. Frequently asked questions: Milestones: 2015. http://www.acgme.org/Portals/0/MilestonesFAQ.pdf. Accessed July 11, 2018.
   Google Scholar
• van Loon KA, Driessen EW, Teunissen PW, et al. Experiences with EPAs, potential benefits and pitfalls. Med Teach. 2014;36(8):698–702. doi: 10.3109/0142159X.2014.909588.
   PubMed Web of Science ®Google Scholar
• Witteles RM, Verghese A. Accreditation council for graduate medical education (ACGME) milestones-time for a revolt?. JAMA Intern Med. 2016;176(11):1599–1600. doi: 10.1001/jamainternmed.2016.5552.
   PubMed Web of Science ®Google Scholar
• Carter WA. Jr. Milestone myths and misperceptions. J Grad Med Educ. 2014;6(1):18–20. doi: 10.4300/JGME-D-13-00438.1.
   PubMedGoogle Scholar
• Holmboe ES. Realizing the promise of competency-based medical education. Acad Med. 2015;90(4):411–413. doi: 10.1097/ACM.0000000000000515.
   PubMed Web of Science ®Google Scholar
• Crossley J, Johnson G, Booth J, et al. Good questions, good answers: Construct alignment improves the performance of workplace-based assessment scales. Med Educ.. 2011;45(6):560–569. doi: 10.1111/j.1365-2923.2010.03913.x.
   PubMed Web of Science ®Google Scholar
• Crossley J, Jolly B. Making sense of work-based assessment: ask the right questions, in the right way, about the right things, of the right people. Medical education. 2012;46(1):28–37. doi: 10.1111/j.1365-2923.2011.04166.x.
   PubMed Web of Science ®Google Scholar
• Bindal N, Goodyear H, Bindal T, et al. DOPS assessment: A study to evaluate the experience and opinions of trainees and assessors. Med Teach. 2013;35(6):e1230–1234. doi: 10.3109/0142159X.2012.746447.
   PubMed Web of Science ®Google Scholar
• Yousuf Guraya S. Workplace-based assessment; Applications and educational impact. Malays J Med Sci. 2015;22(6):5–10.
   PubMed Web of Science ®Google Scholar
• Rekman J, Hamstra SJ, Dudek N, et al. A new instrument for assessing resident competence in surgical clinic: The Ottawa clinic assessment tool. J Surg Educ. 2016;73(4):575–582. doi: 10.1016/j.jsurg.2016.02.003.
   PubMed Web of Science ®Google Scholar
• Choe JH, Knight CL, Stiling R, et al. Shortening the miles to the milestones: connecting EPA-based evaluations to ACGME milestone reports for internal medicine residency programs. Academic Medicine: Journal of the Association of American Medical Colleges. 2016;91(7):943–950. doi: 10.1097/ACM.0000000000001161.
   PubMed Web of Science ®Google Scholar
• Gardner AK, Scott DJ, Choti MA, et al. Developing a comprehensive resident education evaluation system in the era of milestone assessment. J Surg Educ. 2015;72(4):618–624. doi: 10.1016/j.jsurg.2014.12.007.
   PubMed Web of Science ®Google Scholar
• ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice?. Acad Med. 2007;82(6):542–547. doi: 10.1097/ACM.0b013e31805559c7.
   PubMed Web of Science ®Google Scholar
• Li ST. The promise of milestones: Are they living up to our expectations?. J Grad Med Educ. 2017;9(1):54–57. doi: 10.4300/JGME-D-16-00694.1.
   PubMedGoogle Scholar
• Carraccio C, Englander R, Gilhooly J, et al. Building a framework of entrustable professional activities, supported by competencies and milestones, to bridge the educational continuum. Acad Med. 2017;92(3):324–330. doi: 10.1097/ACM.0000000000001141.
   PubMed Web of Science ®Google Scholar
• Warm EJ, Held JD, Hellmann M, et al. Entrusting observable practice activities and milestones over the 36 months of an internal medicine residency. Acad Med. 2016;91(10):1398–1405. doi: 10.1097/ACM.0000000000001292.
   PubMed Web of Science ®Google Scholar
• Warm EJ, Mathis BR, Held JD, et al. Entrustment and mapping of observable practice activities for resident assessment. J Gen Intern Med. 2014;29(8):1177–1182. doi: 10.1007/s11606-014-2801-5.
   PubMed Web of Science ®Google Scholar
• Tanaka P, Bereknyei Merrell S, Walker K, et al. Implementation of a needs-based, online feedback tool for anesthesia residents with subsequent mapping of the feedback to the ACGME milestones. Anesth Analg. 2017;124(2):627–635. doi: 10.1213/ANE.0000000000001647.
   PubMed Web of Science ®Google Scholar
• Carraccio C, Englander R, Holmboe ES, et al. Driving care quality: Aligning trainee assessment and supervision through practical application of entrustable professional activities, competencies, and milestones. Acad Med. 2016;91(2):199–203. doi: 10.1097/ACM.0000000000000985.
   PubMed Web of Science ®Google Scholar
• Hauer KE, Cate OT, Boscardin CK, et al. Ensuring resident competence: A narrative review of the literature on group decision making to inform the work of clinical competency committees. J Grad Med Educ. 2016;8(2):156–164. doi: 10.4300/JGME-D-15-00144.1.
   PubMedGoogle Scholar
• Kinnear B, Warm EJ, Hauer KE. Twelve tips to maximize the value of a clinical competency committee in postgraduate medical education. Med Teach. 2018:1–6.
   Web of Science ®Google Scholar
• Warm EJ, Kinnear B, Kelleher M, et al. Transforming resident assessment: An analysis using Deming's system of profound knowledge. Acad Med. 2018; 94(2):195–201.
   Web of Science ®Google Scholar
• Cook DA, Beckman TJ. Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med. 2006;119(2):e167–116.
   Google Scholar
• Warm E. University of Cincinnati internal medicine residency education curriculum 2017-2018; http://intmed.uc.edu/education/residency/curriculum/milestonesEval.aspx. Accessed July 11, 2018.
   Google Scholar
• Medicine TACfGMEaTABoI. The internal medicine milestone project. 2015. https://www.acgme.org/acgmeweb/Portals/0/PDFs/Milestones/InternalMedicineMilestones.pdf. Accessed July 11, 2018.
   Google Scholar
• Pediatrics TACfGMEaTABo. The pediatrics milestone project. 2017. https://www.acgme.org/acgmeweb/Portals/0/PDFs/Milestones/PediatricsMilestones.pdf. Accessed July 11, 2018.
   Google Scholar
• Lowry BN, Vansaghi LM, Rigler SK, et al. Applying the milestones in an internal medicine residency program curriculum: A foundation for outcomes-based learner assessment under the next accreditation system. Acad Med. 2013;88(11):1665–1669. doi: 10.1097/ACM.0b013e3182a8c756.
   PubMed Web of Science ®Google Scholar
• Carraccio C, Burke AE. Beyond competencies and milestones: Adding meaning through context. J Grad Med Educ. 2010;2(3):419–422. doi: 10.4300/JGME-D-10-00127.1.
   PubMedGoogle Scholar
• van der Vleuten CP, Schuwirth LW, Driessen EW, et al. 12 tips for programmatic assessment. Med Teacher. 2014:1–6. doi: 10.3109/0142159X.2014.973388.
   Google Scholar
• Jones LK, Jr., Dimberg EL, Boes CJ, et al. Milestone-compatible neurology resident assessments: A role for observable practice activities. Neurology. 2015;84(22):2279–2283. doi: 10.1212/WNL.0000000000001641.
   PubMed Web of Science ®Google Scholar