Thomas R Welch1, Brad G Olson2, Elizabeth Nelsen2, Gary L Beck Dallaghan3, Gloria A Kennedy2, Ann Botash2. 1. Department of Pediatrics, State University of New York Upstate Medical University, Syracuse, NY. Electronic address: welcht@upstate.edu. 2. Department of Pediatrics, State University of New York Upstate Medical University, Syracuse, NY. 3. Office of Medical Education, University of Nebraska Medical Center, Omaha, NE.
Abstract
OBJECTIVE: To determine whether training site or prior examinee performance on the US Medical Licensing Examination (USMLE) step 1 and step 2 might predict pass rates on the American Board of Pediatrics (ABP) certifying examination. STUDY DESIGN: Data from graduates of pediatric residency programs completing the ABP certifying examination between 2009 and 2013 were obtained. For each, results of the initial ABP certifying examination were obtained, as well as results on National Board of Medical Examiners (NBME) step 1 and step 2 examinations. Hierarchical linear modeling was used to nest first-time ABP results within training programs to isolate program contribution to ABP results while controlling for USMLE step 1 and step 2 scores. Stepwise linear regression was then used to determine which of these examinations was a better predictor of ABP results. RESULTS: A total of 1110 graduates of 15 programs had complete testing results and were subject to analysis. Mean ABP scores for these programs ranged from 186.13 to 214.32. The hierarchical linear model suggested that the interaction of step 1 and 2 scores predicted ABP performance (F[1,1007.70] = 6.44, P = .011). By conducting a multilevel model by training program, both USMLE step examinations predicted first-time ABP results (b = .002, t = 2.54, P = .011). Linear regression analyses indicated that step 2 results were a better predictor of ABP performance than step 1 or a combination of the two USMLE scores. CONCLUSIONS: Performance on the USMLE examinations, especially step 2, predicts performance on the ABP certifying examination. The contribution of training site to ABP performance was statistically significant, though contributed modestly to the effect compared with prior USMLE scores.
OBJECTIVE: To determine whether training site or prior examinee performance on the US Medical Licensing Examination (USMLE) step 1 and step 2 might predict pass rates on the American Board of Pediatrics (ABP) certifying examination. STUDY DESIGN: Data from graduates of pediatric residency programs completing the ABP certifying examination between 2009 and 2013 were obtained. For each, results of the initial ABP certifying examination were obtained, as well as results on National Board of Medical Examiners (NBME) step 1 and step 2 examinations. Hierarchical linear modeling was used to nest first-time ABP results within training programs to isolate program contribution to ABP results while controlling for USMLE step 1 and step 2 scores. Stepwise linear regression was then used to determine which of these examinations was a better predictor of ABP results. RESULTS: A total of 1110 graduates of 15 programs had complete testing results and were subject to analysis. Mean ABP scores for these programs ranged from 186.13 to 214.32. The hierarchical linear model suggested that the interaction of step 1 and 2 scores predicted ABP performance (F[1,1007.70] = 6.44, P = .011). By conducting a multilevel model by training program, both USMLE step examinations predicted first-time ABP results (b = .002, t = 2.54, P = .011). Linear regression analyses indicated that step 2 results were a better predictor of ABP performance than step 1 or a combination of the two USMLE scores. CONCLUSIONS: Performance on the USMLE examinations, especially step 2, predicts performance on the ABP certifying examination. The contribution of training site to ABP performance was statistically significant, though contributed modestly to the effect compared with prior USMLE scores.
Authors: Elaine R Cohen; Joshua L Goldstein; Clara J Schroedl; Nancy Parlapiano; William C McGaghie; Diane B Wayne Journal: J Grad Med Educ Date: 2020-08
Authors: Ali Rahil; Tahseen Hamamyh; Ahmed Al-Mohammed; Antoun Kamel; Ibrahim Abubeker; Laith Abu-Raddad; Soha Dargham; Shireen Suliman; Dabia Al Mohanadi; Abdulatif Al Khal Journal: Qatar Med J Date: 2021-06-21