Milestone Learning Trajectories of Residents at Five Anesthesiology Residency Programs

References

• Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system-rationale and benefits. N Engl J Med. 2012;366(11):1051–1056. doi:10.1056/NEJMsr1200117.
   PubMed Web of Science ®Google Scholar
• Accreditation Council for Graduate Medical Education Annual Report. Available at: https://www.acgme.org/Portals/0/PDFs/Milestones/2019MilestonesNationalReportFinal.pdf. Accessed July 30, 2020.
   Google Scholar
• Conforti LN, Yaghmour NA, Hamstra SJ, et al. The effect and use of milestones in the assessment of neurological surgery residents and residency programs. J Surg Educ. 2018;75(1):147–155. doi:10.1016/j.jsurg.2017.06.001.
   PubMed Web of Science ®Google Scholar
• Hamstra SJ, Yamazaki K, Barton MA, Santen SA, Beeson MS, Holmboe EA. A national study of longitudinal consistency in acgme milestone ratings by clinical competency committees: exploring an aspect of validity in the assessment of residents' competence. Acad Med. 2019;94(10):1522–1531. doi:10.1097/ACM.0000000000002820.
   PubMed Web of Science ®Google Scholar
• Hauer KE, Clauser J, Lipner RS, et al. The internal medicine reporting milestones: cross-sectional description of initial implementation in US residency programs. Ann Intern Med. 2016;165(5):356–362. doi:10.7326/M15-2411.
   PubMed Web of Science ®Google Scholar
• Hauer KE, Vandergrift J, Hess B, et al. Correlations between ratings on the resident annual evaluation summary and the internal medicine milestones and association with ABIM certification examination scores among US internal medicine residents, 2013-2014. JAMA. 2016;316(21):2253–2262.
   PubMed Web of Science ®Google Scholar
• Beeson MS, Holmboe ES, Korte RC, et al. Initial validity analysis of the emergency medicine milestones. Acad Emerg Med. 2015;22(7):838–844. doi:10.1111/acem.12697.
   PubMed Web of Science ®Google Scholar
• Ross FJ, Metro DG, Beaman ST, et al. A first look at the Accreditation Council for Graduate Medical Education anesthesiology milestones: implementation of self-evaluation in a large residency program. J Clin Anesth. 2016;32:17–24. doi:10.1016/j.jclinane.2015.12.026.
   PubMed Web of Science ®Google Scholar
• Hauer KE, Vandergrift J, Lipner RS, Holmboe ES, Hood S, McDonald FS. National internal medicine milestone ratings: validity evidence from longitudinal three-year follow-up. Acad Med. 2018;93(8):1189–1204.
   PubMed Web of Science ®Google Scholar
• Park YS, Zar F, Tekian A. Synthesizing and reporting milestones-based learner analytics: validity evidence from a longitudinal cohort of internal medicine residents. Acad Med. 2020;95(4):599–608. doi:10.1097/ACM.0000000000002959.
   PubMed Web of Science ®Google Scholar
• Downing SM, Haladyna TM. Validity and its threats. Assess Health Professions Educ. 2009;1:21–56.
   Google Scholar
• Cook DA, Lineberry M. Consequences validity evidence: evaluating the impact of educational assessments. Acad Med. 2016;91(6):785–795. doi:10.1097/ACM.0000000000001114.
   PubMed Web of Science ®Google Scholar
• Norman G. Likert scales, levels of measurement and the "laws" of statistics. Adv Health Sci Educ Theory Pract. 2010;15(5):625–632. doi:10.1007/s10459-010-9222-y.
   PubMed Web of Science ®Google Scholar
• Mema B, Mylopoulos M, Tekian A, Park YS. Using learning curves to identify and explain growth patterns of learners in bronchoscopy simulation: a mixed methods study. Acad Med. 2020;95(12):1921–1928. doi:10.1097/ACM.0000000000003595.
   PubMed Web of Science ®Google Scholar
• Beeson MS, Hamstra SJ, Barton MA, et al. Straight line scoring by clinical competency committees using emergency medicine milestones. J Grad Med Edu. 2017;9(6):716–720.
   PubMedGoogle Scholar
• Tekian A, Hodges BD, Roberts TE, Schuwirth L, Norcini J. Assessing competencies using milestones along the way. Med Teach. 2015;7(4):399–402.
   Google Scholar
• Carraccio C, Englander R, Van Melle E, et al. Advancing competency-based medical education: a charter for clinician-educators. Acad Med. 2016;91(5):645–649. doi:10.1097/ACM.0000000000001048.
   PubMed Web of Science ®Google Scholar
• Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE guide no. 31. Med Teach. 2007;29(9):855–871. doi:10.1080/01421590701775453.
   PubMed Web of Science ®Google Scholar
• Hawkins RE, Holmboe ES. Constructing an evaluation system for an educational program. In: Holmboe ES, Hawkins RE, eds, Practical guide to the evaluation of clinical competence. Philadelphia, PA: Mosby/Elsevier 2008:216–238.
   Google Scholar
• Gingerich A, Kogan J, Yeates P, Govaerts M, Holmboe E. Seeing the 'black box' differently: assessor cognition from three research perspectives. Med Educ. 2014;48(11):1055–1068. doi:10.1111/medu.12546.
   PubMed Web of Science ®Google Scholar
• Li S-TT, Tancredi DJ, Schwartz A, et al. Competent for unsupervised practice: use of pediatric residency training milestones to assess readiness. Acad Med. 2017;92(3):385–393., doi:10.1097/ACM.0000000000001322.
   PubMed Web of Science ®Google Scholar
• Holmboe ES, Yamazaki K, Nasca TJ, Hamstra SJ. Using longitudinal milestones data and learning analytics to facilitate the professional development of residents: early lessons from three specialties. Acad Med. 2020;95(1):97–103. doi:10.1097/ACM.0000000000002899.
   PubMed Web of Science ®Google Scholar
• Park YS, Riddle J, Tekian A. Validity evidence of resident competency ratings and the identification of problem residents. Med Educ. 2014;48(6):614–622.
   PubMed Web of Science ®Google Scholar
• Accreditation Council for Graduate Medical Education Annual Report. Available at: https://www.acgme.org/Portals/0/PDFs/2016-2017-ACGMEAnnualReport.pdf. Accessed July 26, 2018.
   Google Scholar
• Schumacher DJ, Michelson C, Poynter S, et al. Thresholds and interpretations: How clinical competency committees identify pediatric residents with performance concerns. Med Teach. 2018;40(1):70–79., doi:10.1080/0142159X.2017.1394576.
   PubMed Web of Science ®Google Scholar
• Chemtob CM, Tanaka P, Keil M, et al. Analysis of milestone-based end-of-rotation evaluations for ten residents completing a three-year anesthesiology residency. Cureus. 2018;10(8):e3200. doi:10.7759/cureus.3200.
   PubMed Web of Science ®Google Scholar
• Ekpenyong A, Baker E, Harris I, et al. How do clinical competency committees use different sources of data to assess residents' performance on the internal medicine milestones? A mixed methods pilot study. Med Teach. 2017;39(10):1074–1083. doi:10.1080/0142159X.2017.1353070.
   PubMed Web of Science ®Google Scholar
• Dor V, Gomez‐Garibello C, Cruess R, Cruess S, Cummings B, Young M. The challenges of detecting progress in generic competencies in the clinical setting. Med Educ. 2018;52(12):1259–1270.
   PubMed Web of Science ®Google Scholar
• Holmboe ES, Edgar L, Hamstra S. The milestones guidebook, version 2016. http://www.acgme.org/Portals/0/MilestonesGuidebook.pdf?ver=2016-05-31-113245-103. Accessed July 1, 2019.
   Google Scholar