Kathleen D Holt1, Rebecca S Miller, Jerry Vasilias, Lauren M Byrne, Christian Cable, Louis Grosso, Lisa M Bellini, Furman S McDonald. 1. K.D. Holt is special projects analyst, Accreditation Council for Graduate Medical Education (ACGME), Chicago, Illinois, and staff scientist, University of Rochester Medical Center, Rochester, New York. R.S. Miller is senior vice president of applications and data analysis, ACGME, Chicago, Illinois. J. Vasilias is executive director, Review Committee for Internal Medicine, ACGME, Chicago, Illinois. L.M. Byrne is director of data analytics, quality, and reporting, ACGME, Chicago, Illinois. C. Cable is chair, Review Committee for Internal Medicine, ACGME, Chicago, Illinois, and faculty member, Hematology-Oncology Program, Scott and White Memorial Hospital, Temple, Texas. L. Grosso is vice president of psychometrics, American Board of Internal Medicine (ABIM), Philadelphia, Pennsylvania. L.M. Bellini is vice dean for academic affairs, University of Pennsylvania, Philadelphia, Pennsylvania. F.S. McDonald is senior vice president of academic and medical affairs, ABIM, Philadelphia, Pennsylvania.
Abstract
PURPOSE: The Accreditation Council for Graduate Medical Education (ACGME) has surveyed residents since 2003, and faculty since 2012. Surveys are designed to assess program functioning and specify areas for improvement. The purpose of this study was to assess the association of the ACGME's resident and faculty surveys with residency-program-specific performance on the American Board of Internal Medicine (ABIM) certification exam. METHOD: Data were available from residents and faculty in 375 U.S. ACGME-accredited internal medicine programs from the 2012-2013, 2013-2014, and 2014-2015 academic years. Analysis of variance and correlations were used to examine the relationship between noncompliance with ACGME program requirements as assessed by the resident and faculty surveys, and ABIM program pass rates. RESULTS: Noncompliance reported on the resident and faculty surveys was highest for programs not meeting the ACGME program requirement of an 80% pass rate on the ABIM certification examination. This relationship was significant for overall noncompliance, both within the resident (P < .001) and faculty (P < .05) surveys, for many areas within the two surveys (correlations ranged between -.07 and -.25, and P values ranged between .20 and < .001), and for the highest levels of noncompliance across areas of the resident (P < .001) and faculty (P < .04) surveys. CONCLUSIONS: ACGME resident and faculty surveys were significantly associated with ABIM program pass rates, supporting the importance of these surveys within the ACGME's Next Accreditation System.
PURPOSE: The Accreditation Council for Graduate Medical Education (ACGME) has surveyed residents since 2003, and faculty since 2012. Surveys are designed to assess program functioning and specify areas for improvement. The purpose of this study was to assess the association of the ACGME's resident and faculty surveys with residency-program-specific performance on the American Board of Internal Medicine (ABIM) certification exam. METHOD: Data were available from residents and faculty in 375 U.S. ACGME-accredited internal medicine programs from the 2012-2013, 2013-2014, and 2014-2015 academic years. Analysis of variance and correlations were used to examine the relationship between noncompliance with ACGME program requirements as assessed by the resident and faculty surveys, and ABIM program pass rates. RESULTS: Noncompliance reported on the resident and faculty surveys was highest for programs not meeting the ACGME program requirement of an 80% pass rate on the ABIM certification examination. This relationship was significant for overall noncompliance, both within the resident (P < .001) and faculty (P < .05) surveys, for many areas within the two surveys (correlations ranged between -.07 and -.25, and P values ranged between .20 and < .001), and for the highest levels of noncompliance across areas of the resident (P < .001) and faculty (P < .04) surveys. CONCLUSIONS:ACGME resident and faculty surveys were significantly associated with ABIM program pass rates, supporting the importance of these surveys within the ACGME's Next Accreditation System.