Daniel J Schumacher1, Abigail Martini2, Benjamin Kinnear3, Matthew Kelleher3, Dorene F Balmer4, Victoria Wurster-Ovalle2, Carol Carraccio5. 1. Department of Pediatrics, Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine (DJ Schumacher, A Martini, and V Wurster-Ovalle), Cincinnati, Ohio. Electronic address: daniel.schumacher@cchmc.org. 2. Department of Pediatrics, Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine (DJ Schumacher, A Martini, and V Wurster-Ovalle), Cincinnati, Ohio. 3. Departments of Pediatrics and Medicine, Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine (B Kinnear and M Kelleher), Cincinnati, Ohio. 4. Children's Hospital of Philadelphia and University of Pennsylvania Perelman School of Medicine (DF Balmer), Philadelphia, Pa. 5. American Board of Pediatrics (C Carraccio), Chapel Hill, NC.
Abstract
OBJECTIVE: Research on entrustable professional activities (EPAs) has focused on EPA development with little attention paid to implementation experiences. This constructivist grounded theory study sought to begin filling this gap by exploring the experiences of pediatric residency programs with implementing EPA-based assessment. METHODS: Interviews with 19 program leader and clinical competency committee participants from 13 sites were held between January and July 2019. Participants were asked about their experiences with implementing EPA-based assessment. Data collection and analysis were iterative. RESULTS: Participants described a range of facilitators and inhibitors that influenced their efforts to implement EPA-based assessment. These fell into 4 thematic areas: 1) alignment of EPA construct with local views of performance and assessment, 2) assessing EPAs illuminates holes in the residency curriculum, 3) clinical competency committee structure and process impacts EPA-based assessment, and 4) faculty engagement and development drives ability to assess EPAs. Areas described as facilitators by some participants were noted to be inhibitors for others. The sum of a program's facilitators and inhibitors led to more or less ability to assess EPAs on the whole. Finally, the first area functions differently from the others; it can shift the entire balance toward or away from the ability to assess EPAs overall. CONCLUSION: This study helps fill a void in implementation evidence for EPA-based assessment through better understanding of facilitators and inhibitors to such efforts.
OBJECTIVE: Research on entrustable professional activities (EPAs) has focused on EPA development with little attention paid to implementation experiences. This constructivist grounded theory study sought to begin filling this gap by exploring the experiences of pediatric residency programs with implementing EPA-based assessment. METHODS: Interviews with 19 program leader and clinical competency committee participants from 13 sites were held between January and July 2019. Participants were asked about their experiences with implementing EPA-based assessment. Data collection and analysis were iterative. RESULTS:Participants described a range of facilitators and inhibitors that influenced their efforts to implement EPA-based assessment. These fell into 4 thematic areas: 1) alignment of EPA construct with local views of performance and assessment, 2) assessing EPAs illuminates holes in the residency curriculum, 3) clinical competency committee structure and process impacts EPA-based assessment, and 4) faculty engagement and development drives ability to assess EPAs. Areas described as facilitators by some participants were noted to be inhibitors for others. The sum of a program's facilitators and inhibitors led to more or less ability to assess EPAs on the whole. Finally, the first area functions differently from the others; it can shift the entire balance toward or away from the ability to assess EPAs overall. CONCLUSION: This study helps fill a void in implementation evidence for EPA-based assessment through better understanding of facilitators and inhibitors to such efforts.