Daniel J Schumacher1, Sue Poynter2, Natalie Burman3, Sean P Elliott4, Michelle Barnes5, Caren Gellin6, Javier Gonzalez Del Rey2, Daniel Sklansky7, Lynn Thoreson8, Beth King9, Alan Schwartz10. 1. Department of Pediatrics (DJ Schumacher, S Poynter, and J Gonzalez del Rey), Cincinnati Children's Hospital Medical Center/University of Cincinnati, Ohio. Electronic address: daniel.schumacher@cchmc.org. 2. Department of Pediatrics (DJ Schumacher, S Poynter, and J Gonzalez del Rey), Cincinnati Children's Hospital Medical Center/University of Cincinnati, Ohio. 3. Department of Pediatrics (N Burman), Naval Medical Center San Diego, Calif. 4. Department of Pediatrics and College of Medicine (SP Elliott), University of Arizona, Tucson. 5. Department of Pediatrics (M Barnes and A Schwartz), University of Illinois at Chicago. 6. Department of Pediatrics (C Gellin), University of Rochester, New York. 7. Department of Pediatrics (D Sklansky), University of Wisconsin School of Medicine and Public Health, Madison. 8. Department of Pediatrics (L Thoreson), The University of Texas at Austin Dell Medical School. 9. Association of Pediatric Program Directors (APPD) Longitudinal Educational Assessment Research Network (LEARN) (B King and A Schwartz), McLean, Va. 10. Department of Pediatrics (M Barnes and A Schwartz), University of Illinois at Chicago; Department of Medical Education (A Schwartz), University of Illinois at Chicago; Association of Pediatric Program Directors (APPD) Longitudinal Educational Assessment Research Network (LEARN) (B King and A Schwartz), McLean, Va.
Abstract
OBJECTIVE: To explore justifications for differences between summative entrustment decisions made about pediatric residents by individuals who are charged with the review of residents (clinical competency committee, or CCC, members) and those who ultimately make final summative decisions about resident performance (program directors, or PDs). METHODS: Individual CCC member and PD supervisory role categorizations were made in the 2015 to 2016 academic year at 14 pediatric residency programs, placing residents into 1 of 5 progressive supervisory roles. When PD recommendations differed from CCC members, a free-text justification was requested. Free-text responses were analyzed using manifest content analysis. RESULTS: In total, 801 supervisory role categorizations were made by both CCC members and PDs, with the same recommendations made in 685 cases. In the 116 instances of discrepancy, PDs assigned a lower level of supervisory responsibility (n = 73) more often than a greater one (n = 43). When moving residents to a greater supervisory role category, PDs had more justifications anchored in resident performance than experience. When moving residents to a lower supervisory role categorization, PDs conversely noted experience more than performance. CONCLUSIONS: PDs provide more justifications anchored in resident performance when moving residents to a greater supervisory role category compared with CCC members. However, when moving residents to a lower supervisory role categorization, they note experience more than performance. These patterns may or may not be entirely consistent with a competency-based approach and should be explored further.
OBJECTIVE: To explore justifications for differences between summative entrustment decisions made about pediatric residents by individuals who are charged with the review of residents (clinical competency committee, or CCC, members) and those who ultimately make final summative decisions about resident performance (program directors, or PDs). METHODS: Individual CCC member and PD supervisory role categorizations were made in the 2015 to 2016 academic year at 14 pediatric residency programs, placing residents into 1 of 5 progressive supervisory roles. When PD recommendations differed from CCC members, a free-text justification was requested. Free-text responses were analyzed using manifest content analysis. RESULTS: In total, 801 supervisory role categorizations were made by both CCC members and PDs, with the same recommendations made in 685 cases. In the 116 instances of discrepancy, PDs assigned a lower level of supervisory responsibility (n = 73) more often than a greater one (n = 43). When moving residents to a greater supervisory role category, PDs had more justifications anchored in resident performance than experience. When moving residents to a lower supervisory role categorization, PDs conversely noted experience more than performance. CONCLUSIONS:PDs provide more justifications anchored in resident performance when moving residents to a greater supervisory role category compared with CCC members. However, when moving residents to a lower supervisory role categorization, they note experience more than performance. These patterns may or may not be entirely consistent with a competency-based approach and should be explored further.