BACKGROUND: Clinical Competency Committees (CCCs) are charged with making summative assessment decisions about residents. OBJECTIVE: We explored how review processes CCC members utilize influence their decisions regarding residents' milestone levels and supervisory roles. METHODS: We conducted a multisite longitudinal prospective observational cohort study at 14 pediatrics residency programs during academic year 2015-2016. Individual CCC members biannually reported characteristics of their review process and Accreditation Council for Graduate Medical Education milestone levels and recommended supervisory role categorizations assigned to residents. Relationships among characteristics of CCC member reviews, mean milestone levels, and supervisory role categorizations were analyzed using mixed-effects linear regression, reported as mean differences with 95% confidence intervals (CIs), and Bayesian mixed-effects ordinal regression, reported as odds ratios (ORs) and 95% credible intervals (CrIs). RESULTS: A total of 155 CCC members participated. Members who provided milestones or other professional development feedback after CCC meetings assigned significantly lower mean milestone levels (mean 1.4 points; CI -2.2 to -0.6; P < .001) and were significantly less likely to recommend supervisory responsibility in any setting (OR = 0.23, CrI 0.05-0.83) compared with CCC members who did not. Members recommended less supervisory responsibility when they reviewed more residents (OR = 0.96, 95% CrI 0.94-0.99) and participated in more review cycles (OR = 0.22, 95% CrI 0.07-0.63). CONCLUSIONS: This study explored the association between characteristics of individual CCC member reviews and their summative assessment decisions about residents. Further study is needed to gain deeper understanding of factors influencing CCC members' summative assessment decisions.
BACKGROUND: Clinical Competency Committees (CCCs) are charged with making summative assessment decisions about residents. OBJECTIVE: We explored how review processes CCC members utilize influence their decisions regarding residents' milestone levels and supervisory roles. METHODS: We conducted a multisite longitudinal prospective observational cohort study at 14 pediatrics residency programs during academic year 2015-2016. Individual CCC members biannually reported characteristics of their review process and Accreditation Council for Graduate Medical Education milestone levels and recommended supervisory role categorizations assigned to residents. Relationships among characteristics of CCC member reviews, mean milestone levels, and supervisory role categorizations were analyzed using mixed-effects linear regression, reported as mean differences with 95% confidence intervals (CIs), and Bayesian mixed-effects ordinal regression, reported as odds ratios (ORs) and 95% credible intervals (CrIs). RESULTS: A total of 155 CCC members participated. Members who provided milestones or other professional development feedback after CCC meetings assigned significantly lower mean milestone levels (mean 1.4 points; CI -2.2 to -0.6; P < .001) and were significantly less likely to recommend supervisory responsibility in any setting (OR = 0.23, CrI 0.05-0.83) compared with CCC members who did not. Members recommended less supervisory responsibility when they reviewed more residents (OR = 0.96, 95% CrI 0.94-0.99) and participated in more review cycles (OR = 0.22, 95% CrI 0.07-0.63). CONCLUSIONS: This study explored the association between characteristics of individual CCC member reviews and their summative assessment decisions about residents. Further study is needed to gain deeper understanding of factors influencing CCC members' summative assessment decisions.
Authors: Karen E Hauer; Olle Ten Cate; Christy Boscardin; David M Irby; William Iobst; Patricia S O'Sullivan Journal: Adv Health Sci Educ Theory Pract Date: 2013-07-27 Impact factor: 3.853
Authors: Teri L Turner; Vasudha L Bhavaraju; Ulana A Luciw-Dubas; Patricia J Hicks; Sara Multerer; Amanda Osta; Jennifer McDonnell; Sue Poynter; Daniel J Schumacher; Rebecca Tenney-Soeiro; Linda Waggoner-Fountain; Alan Schwartz Journal: Acad Med Date: 2017-06 Impact factor: 6.893
Authors: Kimberly Lomis; Jonathan M Amiel; Michael S Ryan; Karin Esposito; Michael Green; Alex Stagnaro-Green; Janet Bull; George C Mejicano Journal: Acad Med Date: 2017-06 Impact factor: 6.893
Authors: Faith J Ross; David G Metro; Shawn T Beaman; James G Cain; Monique M Dowdy; Abraham Apfel; Jong-Hyeon Jeong; James W Ibinson Journal: J Clin Anesth Date: 2016-03-22 Impact factor: 9.452
Authors: Nathan M Shumway; Jennifer J Dacus; Kate I Lathrop; Elizabeth P Hernandez; Maria Miller; Anand B Karnad Journal: J Grad Med Educ Date: 2015-03
Authors: Annabel K Frank; Patricia O'Sullivan; Lynnea M Mills; Virginie Muller-Juge; Karen E Hauer Journal: J Gen Intern Med Date: 2019-05 Impact factor: 5.128
Authors: Stanley J Hamstra; Kenji Yamazaki; Melissa A Barton; Sally A Santen; Michael S Beeson; Eric S Holmboe Journal: Acad Med Date: 2019-10 Impact factor: 6.893