Benjamin Kinnear1, Rachel Bensman, Justin Held, Jennifer O'Toole, Daniel Schauer, Eric Warm. 1. B. Kinnear is assistant professor and residency assistant program director, Medicine-Pediatrics, Department of Internal Medicine, University of Cincinnati College of Medicine, and Department of Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio. R. Bensman is clinical fellow, Department of Pediatrics, Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio. J. Held is assistant professor and residency associate program director, Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, Ohio. J. O'Toole is associate professor and residency associate program director, Medicine-Pediatrics, Department of Internal Medicine, University of Cincinnati College of Medicine, and Department of Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio. D. Schauer is associate professor and residency associate program director, Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, Ohio. E. Warm is Richard W. Vilter Professor of Medicine and residency program director, Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, Ohio.
Abstract
PURPOSE: The Accreditation Council for Graduate Medical Education (ACGME) requires programs to report learner progress using specialty-specific milestones. It is unclear how milestones can best identify critical deficiencies (CDs) in trainee performance. Specialties developed milestones independently of one another; not every specialty included CDs within milestones ratings. This study examined the proportion of ACGME milestone sets that include CD ratings, and describes one residency program's experiences using CD ratings in assessment. METHOD: The authors reviewed ACGME milestones for all 99 specialties in November 2015, determining which rating scales contained CDs. The authors also reviewed three years of data (July 2012-June 2015) from the University of Cincinnati Medical Center (UCMC) internal medicine residency assessment system based on observable practice activities mapped to ACGME milestones. Data were analyzed by postgraduate year, assessor type, rotation, academic year, and core competency. The Mantel-Haenszel chi-square test was used to test for changes over time. RESULTS: Specialties demonstrated heterogeneity in accounting for CDs in ACGME milestones, with 22% (22/99) of specialties having no language describing CDs in milestones assessment. Thirty-three percent (63/189) of UCMC internal medicine residents received at least one CD rating, with CDs accounting for 0.18% (668/364,728) of all assessment ratings. The authors identified CDs across multiple core competencies and rotations. CONCLUSIONS: Despite some specialties not accounting for CDs in milestone assessment, UCMC's experience demonstrates that a significant proportion of residents may be rated as having a CD during training. Identification of CDs may allow programs to develop remediation and improvement plans.
PURPOSE: The Accreditation Council for Graduate Medical Education (ACGME) requires programs to report learner progress using specialty-specific milestones. It is unclear how milestones can best identify critical deficiencies (CDs) in trainee performance. Specialties developed milestones independently of one another; not every specialty included CDs within milestones ratings. This study examined the proportion of ACGME milestone sets that include CD ratings, and describes one residency program's experiences using CD ratings in assessment. METHOD: The authors reviewed ACGME milestones for all 99 specialties in November 2015, determining which rating scales contained CDs. The authors also reviewed three years of data (July 2012-June 2015) from the University of Cincinnati Medical Center (UCMC) internal medicine residency assessment system based on observable practice activities mapped to ACGME milestones. Data were analyzed by postgraduate year, assessor type, rotation, academic year, and core competency. The Mantel-Haenszel chi-square test was used to test for changes over time. RESULTS: Specialties demonstrated heterogeneity in accounting for CDs in ACGME milestones, with 22% (22/99) of specialties having no language describing CDs in milestones assessment. Thirty-three percent (63/189) of UCMC internal medicine residents received at least one CD rating, with CDs accounting for 0.18% (668/364,728) of all assessment ratings. The authors identified CDs across multiple core competencies and rotations. CONCLUSIONS: Despite some specialties not accounting for CDs in milestone assessment, UCMC's experience demonstrates that a significant proportion of residents may be rated as having a CD during training. Identification of CDs may allow programs to develop remediation and improvement plans.
Authors: Danielle E Weber; Justin D Held; Roman A Jandarov; Matthew Kelleher; Ben Kinnear; Dana Sall; Jennifer K O'Toole Journal: J Gen Intern Med Date: 2020-01-28 Impact factor: 5.128
Authors: Mary Ellen J Goldhamer; Maria Martinez-Lage; W Stephen Black-Schaffer; Jennifer T Huang; John Patrick T Co; Debra F Weinstein; Martin V Pusic Journal: J Gen Intern Med Date: 2022-04-20 Impact factor: 6.473
Authors: Shelley Ross; Natalia M Binczyk; Deena M Hamza; Shirley Schipper; Paul Humphries; Darren Nichols; Michel G Donoff Journal: JAMA Netw Open Date: 2018-11-02