BACKGROUND: Medical educators grapple with predicting performance of graduates identified as struggling during medical school. Students appear before student promotions committees (SPCs) for multiple cognitive and noncognitive reasons and performance outcomes for this cohort have not been well defined in the literature. PURPOSE: To determine the predictive validity of SPC appearance with respect to performance on a Program Director's (PD's) Evaluation Form completed at the end of internship (PGY-1). METHOD: Residents were classified as "below average," "average," or "above average" based on PD Evaluation Form ratings. This PD instrument has been shown to be feasible, reliable, and valid. Below-average residents were defined as having a below-average rating on any question on the PD Evaluation Form. We compared SPC and non-SPC cohorts with respect to these PD Evaluation Form ratings. The t test was used for statistical analysis. RESULTS: Seven years of graduating classes from our institution were included. Of students who graduated from our institution, 119 of 856 students (14%) were presented at our SPC during medical school during our study period. There were 196 residents (23%) identified as below average. The PD Evaluation Form response rate for this period was 77%. Students who appeared at our SPC were significantly more likely to have below-average scores for almost all PD Evaluation Form questions with small to moderate effect sizes. CONCLUSIONS: Students who appear before SPCs are at higher risk of below-average performance as rated by a PD Evaluation Form at the end of PGY-1. However, only a minority of trainees that appeared before our SPC received below-average ratings during internship. These data provide predictive validity evidence that SPC appearance during medical school does identify below average performance during internship. Our data support that SPC appearance during medical school, regardless of cause, is a risk for below average performance during internship.
BACKGROUND: Medical educators grapple with predicting performance of graduates identified as struggling during medical school. Students appear before student promotions committees (SPCs) for multiple cognitive and noncognitive reasons and performance outcomes for this cohort have not been well defined in the literature. PURPOSE: To determine the predictive validity of SPC appearance with respect to performance on a Program Director's (PD's) Evaluation Form completed at the end of internship (PGY-1). METHOD: Residents were classified as "below average," "average," or "above average" based on PD Evaluation Form ratings. This PD instrument has been shown to be feasible, reliable, and valid. Below-average residents were defined as having a below-average rating on any question on the PD Evaluation Form. We compared SPC and non-SPC cohorts with respect to these PD Evaluation Form ratings. The t test was used for statistical analysis. RESULTS: Seven years of graduating classes from our institution were included. Of students who graduated from our institution, 119 of 856 students (14%) were presented at our SPC during medical school during our study period. There were 196 residents (23%) identified as below average. The PD Evaluation Form response rate for this period was 77%. Students who appeared at our SPC were significantly more likely to have below-average scores for almost all PD Evaluation Form questions with small to moderate effect sizes. CONCLUSIONS: Students who appear before SPCs are at higher risk of below-average performance as rated by a PD Evaluation Form at the end of PGY-1. However, only a minority of trainees that appeared before our SPC received below-average ratings during internship. These data provide predictive validity evidence that SPC appearance during medical school does identify below average performance during internship. Our data support that SPC appearance during medical school, regardless of cause, is a risk for below average performance during internship.
Authors: Layne D Bennion; Dario Torre; Steven J Durning; David Mears; Deanna Schreiber-Gregory; Jessica T Servey; David F Cruess; Michelle Yoon; Ting Dong Journal: Perspect Med Educ Date: 2019-10