Thresholds and interpretations: How clinical competency committees identify pediatric residents with performance concerns

References

• Aagaard E, Kane GC, Conforti L, Hood S, Caverzagie KJ, Smith C, Chick DA, Holmboe ES, Iobst WF. 2013. Early feedback on the use of the internal medicine reporting milestones in assessment of resident performance. J Grad Med Educ. 5:433–438.
   PubMedGoogle Scholar
• Braun V, Clarke V. 2006. Using thematic analysis in pychology. Qual Res Psychol. 3:77–101.
   Google Scholar
• Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. 2002. Shifting paradigms: from flexner to competencies. Acad Med. 77:361–367.
   PubMed Web of Science ®Google Scholar
• Cooney CM, Cooney DS, Bello RJ, Bojovic B, Redett RJ, Lifchez SD. 2016. Comprehensive observations of resident evolution: a novel method for assessing procedure-based residency training. Plast Reconstr Surg. 137:673–678.
   PubMed Web of Science ®Google Scholar
• Dehon E, Jones J, Puskarich M, Sandifer JP, Sikes K. 2015. Use of emergency medicine milestones as items on end-of-shift evaluations results in overestimates of residents’ proficiency level. J Grad Med Educ. 7:192–196.
   PubMedGoogle Scholar
• Donato AA, Alweis R, Wenderoth S. 2016. Design of a clinical competency committee to maximize formative feedback. J Community Hosp Intern Med Perspect. 6:33533.
   PubMed Web of Science ®Google Scholar
• Doty CI, Roppolo LP, Asher S, Seamon JP, Bhat R, Taft S, Graham A, Willis J. 2015. How do emergency medicine residency programs structure their clinical competency committees? a survey. Acad Emerg Med. 22:1351–1354.
   PubMed Web of Science ®Google Scholar
• Englander R, Cameron T, Ballard AJ, Dodge J, Bull J, Aschenbrener CA. 2013. Toward a common taxonomy of competency domains for the health professions and competencies for physicians. Acad Med. 88:1088–1094.
   PubMed Web of Science ®Google Scholar
• French JC, Dannefer EF, Colbert CY. 2014. A systematic approach toward building a fully operational clinical competency committee. J Surg Educ. 71:e22–e27.
   PubMedGoogle Scholar
• Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, Fineberg H, Garcia P, Ke Y, Kelley P, et al. 2010. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 376:1923–1958.
   PubMed Web of Science ®Google Scholar
• Friedman KA, Raimo J, Spielmann K, Chaudhry S. 2016. Resident dashboards: helping your clinical competency committee visualize trainees’ key performance indicators. Med Educ Online. 21:29838.
   PubMed Web of Science ®Google Scholar
• Govaerts M, Schuwirth LWT, van der vleuten CPM, Muijtjens AMM. 2011. Workplace-based assessment: effects of rater expertise. Adv in Health Sci Educ. 16:151–165.
   PubMed Web of Science ®Google Scholar
• Govaerts MJ, van der Vleuten CPM, Schuwirth LWT, Muijtjens AMM. 2007. Broadening perspectives on clinical performance assessment: rethinking the nature of in-training assessment. Adv Health Sci Educ Theory Pract. 12:239–260.
   PubMed Web of Science ®Google Scholar
• Hanson JL, Rosenberg AA, Lane JL. 2013. Narrative descriptions should replace grades and numerical ratings for clinical performance in medical education in the United States. Front Psychol. 4:668.
   PubMed Web of Science ®Google Scholar
• Hauer KE, Cate OT, Boscardin CK, Iobst W, Holmboe ES, Chesluk B, Baron RB, O’Sullivan PS. 2016. Ensuring resident competence: a narrative review of the literature on group decision making to inform the work of clinical competency committees. J Grad Med Educ. 8:156–164.
   PubMedGoogle Scholar
• Hauer KE, Chesluk B, Iobst W, Holmboe E, Baron RB, Boscardin CK, ten Cate O, O’Sullivan PS. 2015. Resident competence review in graduate medical education: a qualitative study. Acad Med. 90:1084–1092.
   Google Scholar
• Hicks PJ, Schumacher D, Guralnick S, Carraccio C, Burke AE. 2014. Domain of competence: personal and professional development. Acad Pediatr. 14:S80–S97.
   PubMed Web of Science ®Google Scholar
• Hicks PJ, Schumacher DJ, Benson B, Burke A, Englander R, Guralnick S, Ludwig S, Carraccio C. 2010. The pediatrics milestones: conceptual framework, guiding principles, and approach to development. J Grad Med Educ. 2:410–418.
   PubMedGoogle Scholar
• Hodges B. 2013. Assessment in the post-psychometric era: learning to love the subjective and collective. Med Teach. 35:564–568.
   PubMed Web of Science ®Google Scholar
• Holmboe ES, Call S, Ficalora RD. 2016. Milestones and competency-based medical education in internal medicine. JAMA Intern Med. 176:1601–1602.
   PubMed Web of Science ®Google Scholar
• Hong R. 2015. Observations: we need to stop drowning-a proposal for change in the evaluation process and the role of the clinical competency committee. J Grad Med Educ. 7:496–497.
   PubMedGoogle Scholar
• Johna S, Woodward B. 2015. Navigating the next accreditation system: a dashboard for the milestones. Perm J. 19:61–63.
   PubMedGoogle Scholar
• Ketteler ER, Auyang ED, Beard KE, McBride EL, McKee R, Russell JC, Szoka NL, Nelson MT. 2014. Competency champions in the clinical competency committee: a successful strategy to implement milestone evaluations and competency coaching. J Surg Educ. 71:36–38.
   PubMed Web of Science ®Google Scholar
• Kogan JR, Conforti L, Bernabeo E, Iobst W, Holmboe E. 2011. Opening the black box of clinical skills assessment via observation: a conceptual model. Med Educ. 45:1048–1060.
   PubMed Web of Science ®Google Scholar
• Meier AH, Gruessner A, Cooney RN. 2016. Using the ACGME milestones for resident self-evaluation and faculty engagement. J Surg Educ. 73:e150–e157.
   PubMedGoogle Scholar
• Mount CA, Short PA, Mount GR, Schofield CM. 2014. An end-of-year oral examination for internal medicine residents: an assessment tool for the clinical competency committee. J Grad Med Educ. 6:551–554.
   PubMedGoogle Scholar
• Nadeau MT, Tysinger J, Wiemers M. 2016. A case-based approach for teaching professionalism to residents with online discussions. J Adv Med Educ Prof. 4:1–7.
   PubMedGoogle Scholar
• Pangaro L. 1999. A new vocabulary and other innovations for improving descriptive in-training evaluations. Acad Med. 74:1203–1207.
   PubMed Web of Science ®Google Scholar
• Promes SB, Wagner MJ. 2014. Starting a clinical competency committee. J Grad Med Educ. 6:163–164.
   PubMedGoogle Scholar
• Ross FJ, Metro DG, Beaman ST, Cain JG, Dowdy MM, Apfel A, Jeong JH, Ibinson JW. 2016. A first look at the Accreditation Council for Graduate Medical Education anesthesiology milestones: implementation of self-evaluation in a large residency program. J Clin Anesth. 32:17–24.
   PubMed Web of Science ®Google Scholar
• Schumacher DJ, Sectish TC, Vinci RJ. 2014. Optimizing clinical competency committee work through taking advantage of overlap across milestones. Acad Pediatr. 14:436–438.
   PubMed Web of Science ®Google Scholar
• Schumacher DJ, Lewis KO, Burke AE, Smith ML, Schumacher JB, Pitman MA, Ludwig S, Hicks PJ, Guralnick S, Englander R, et al. 2013. The pediatrics milestones: initial evidence for their use as learning road maps for residents. Acad Pediatr. 13:40–47.
   PubMed Web of Science ®Google Scholar
• Shumway NM, Dacus JJ, Lathrop KI, Hernandez EP, Miller M, Karnad AB. 2015. Use of milestones and development of entrustable professional activities in 2 hematology/oncology training Programs. J Grad Med Educ. 7:101–104.
   PubMedGoogle Scholar
• Sklansky DJ, Frohna JG, Schumacher DJ. 2017. Learner-driven synthesis of assessment data: engaging and motivating residents in their milestone-based assessments. Med Sci Educ. 27:417–421.
   Google Scholar
• Van der Vleuten CPM, Schuwirth LWT, Scheele F, Driessen EW, Hodges B. 2010. The assessment of professional competence: building blocks for theory development. Best Pract Res Clin Obstet Gynaecol. 24:703–719.
   PubMed Web of Science ®Google Scholar