Does Student Promotions Committee Appearance Predict Below-Average Performance During Internship? A Seven-Year Study

Abstract

Background: Medical educators grapple with predicting performance of graduates identified as struggling during medical school. Students appear before student promotions committees (SPCs) for multiple cognitive and noncognitive reasons and performance outcomes for this cohort have not been well defined in the literature. Purpose: To determine the predictive validity of SPC appearance with respect to performance on a Program Director's (PD's) Evaluation Form completed at the end of internship (PGY-1). Method: Residents were classified as “below average,” “average,” or “above average” based on PD Evaluation Form ratings. This PD instrument has been shown to be feasible, reliable, and valid. Below-average residents were defined as having a below-average rating on any question on the PD Evaluation Form. We compared SPC and non-SPC cohorts with respect to these PD Evaluation Form ratings. The t test was used for statistical analysis. Results: Seven years of graduating classes from our institution were included. Of students who graduated from our institution, 119 of 856 students (14%) were presented at our SPC during medical school during our study period. There were 196 residents (23%) identified as below average. The PD Evaluation Form response rate for this period was 77%. Students who appeared at our SPC were significantly more likely to have below-average scores for almost all PD Evaluation Form questions with small to moderate effect sizes. Conclusions: Students who appear before SPCs are at higher risk of below-average performance as rated by a PD Evaluation Form at the end of PGY-1. However, only a minority of trainees that appeared before our SPC received below-average ratings during internship. These data provide predictive validity evidence that SPC appearance during medical school does identify below average performance during internship. Our data support that SPC appearance during medical school, regardless of cause, is a risk for below average performance during internship.

Acknowledgments

The opinions expressed in this paper are solely those of the authors and do not reflect the official policies of the Department of Defense, the United States Air Force, or other federal agencies.