BACKGROUND: In competency-based medical education, subcompetency milestones represent a theoretical stepwise description for a resident to move from the level of novice to expert. Despite their ubiquitous use in the assessment of residents, they were not designed for that purpose. Because entrustable professional activities (EPAs) require observable behaviors, they could serve as a potential link between clinical observation of residents and competency-based assessment. OBJECTIVE: We hypothesized that global faculty-of-resident entrustment ratings would correlate with concurrent subcompetency milestones-based assessments. METHODS: This prospective study evaluated the correlation between concurrent entrustment assessments and subcompetency milestones ratings. Pediatric residents were assessed in 4 core rotations (pediatric intensive care unit, neonatal intensive care unit, general inpatient, and continuity clinic) at 3 different residency training programs during the 2014-2015 academic year. Subcompetencies were mapped to rotation-specific EPAs, and shared assessments were utilized across the 3 programs. RESULTS: We compared 29 143 pairs of entrustment levels and corresponding subcompetency levels from 630 completed assessments. Pearson correlation coefficients demonstrated statistical significance for all pairs (P < .001). Multivariate linear regression models produced R-squared values that demonstrated strong correlation between mapped EPA levels and corresponding subcompetency milestones ratings (median R 2 = 0.81; interquartile range 0.73-0.83; P < .001). CONCLUSIONS: This study demonstrates a strong association between assessment of EPAs and subcompetency milestones assessment, providing a link between entrustment decisions and assessment of competence. Our data support creating resident assessment tools where multiple subcompetencies can be mapped and assessed by a smaller set of rotation-specific EPAs. Accreditation Council for Graduate Medical Education 2020.
BACKGROUND: In competency-based medical education, subcompetency milestones represent a theoretical stepwise description for a resident to move from the level of novice to expert. Despite their ubiquitous use in the assessment of residents, they were not designed for that purpose. Because entrustable professional activities (EPAs) require observable behaviors, they could serve as a potential link between clinical observation of residents and competency-based assessment. OBJECTIVE: We hypothesized that global faculty-of-resident entrustment ratings would correlate with concurrent subcompetency milestones-based assessments. METHODS: This prospective study evaluated the correlation between concurrent entrustment assessments and subcompetency milestones ratings. Pediatric residents were assessed in 4 core rotations (pediatric intensive care unit, neonatal intensive care unit, general inpatient, and continuity clinic) at 3 different residency training programs during the 2014-2015 academic year. Subcompetencies were mapped to rotation-specific EPAs, and shared assessments were utilized across the 3 programs. RESULTS: We compared 29 143 pairs of entrustment levels and corresponding subcompetency levels from 630 completed assessments. Pearson correlation coefficients demonstrated statistical significance for all pairs (P < .001). Multivariate linear regression models produced R-squared values that demonstrated strong correlation between mapped EPA levels and corresponding subcompetency milestones ratings (median R 2 = 0.81; interquartile range 0.73-0.83; P < .001). CONCLUSIONS: This study demonstrates a strong association between assessment of EPAs and subcompetency milestones assessment, providing a link between entrustment decisions and assessment of competence. Our data support creating resident assessment tools where multiple subcompetencies can be mapped and assessed by a smaller set of rotation-specific EPAs. Accreditation Council for Graduate Medical Education 2020.
Authors: Jason R Frank; Linda S Snell; Olle Ten Cate; Eric S Holmboe; Carol Carraccio; Susan R Swing; Peter Harris; Nicholas J Glasgow; Craig Campbell; Deepak Dath; Ronald M Harden; William Iobst; Donlin M Long; Rani Mungroo; Denyse L Richardson; Jonathan Sherbino; Ivan Silver; Sarah Taber; Martin Talbot; Kenneth A Harris Journal: Med Teach Date: 2010 Impact factor: 3.650
Authors: Patricia J Hicks; Melissa Margolis; Sue E Poynter; Christa Chaffinch; Rebecca Tenney-Soeiro; Teri L Turner; Linda Waggoner-Fountain; Robin Lockridge; Stephen G Clyman; Alan Schwartz Journal: Acad Med Date: 2016-05 Impact factor: 6.893
Authors: Eric J Warm; Justin D Held; Michael Hellmann; Matthew Kelleher; Benjamin Kinnear; Caroline Lee; Jennifer K O'Toole; Bradley Mathis; Caroline Mueller; Dana Sall; Jonathan Tolentino; Daniel P Schauer Journal: Acad Med Date: 2016-10 Impact factor: 6.893
Authors: Adam Watson; Timothy Leroux; Darrell Ogilvie-Harris; Markku Nousiainen; Peter C Ferguson; Lucas Murnahan; Tim Dwyer Journal: JB JS Open Access Date: 2021-04-09