Lisa N Conforti1, Nicholas A Yaghmour2, Stanley J Hamstra2, Eric S Holmboe2, Benjamin Kennedy3, Jesse J Liu4, Heidi Waldo4, Nathan R Selden4. 1. Milestone Research and Evaluation, Accreditation Council for Graduate Medical Education, Chicago, Illinois. Electronic address: Lconforti@acgme.org. 2. Milestone Research and Evaluation, Accreditation Council for Graduate Medical Education, Chicago, Illinois. 3. Department of Pediatric Neurosurgery, Children׳s Hospital of Philadelphia, Philadelphia, Pennsylvania. 4. Department of Neurological Surgery, Oregon Health & Science University, Portland, Oregon.
Abstract
OBJECTIVES: The purpose of this study was to determine the effect of the Accreditation Council for Graduate Medical Education Milestones on the assessment of neurological surgery residents. The authors sought to determine the feasibility, acceptability, and utility of this new framework in making judgments of progressive competence, its implementation within programs, and the influence on curricula. Residents were also surveyed to elicit the effect of Milestones on their educational experience and professional development. DESIGN, SETTING, AND PARTICIPANTS: In 2015, program leadership and residents from 21 neurological surgery residency programs participated in an online survey and telephone interview in which they reflected on their experiences with the Milestones. Survey data were analyzed using descriptive statistics. Interview transcripts were analyzed using grounded theory. RESULTS: Response themes were categorized into 2 groups: outcomes of the Milestones implementation process, and facilitators and barriers. Because of Milestones implementation, participants reported changes to the quality of the assessment process, including the ability to identify struggling residents earlier and design individualized improvement plans. Some programs revised their curricula based on training gaps identified using the Milestones. Barriers to implementation included limitations to the adoption of a developmental progression model in the context of rotation block schedules and misalignment between progression targets and clinical experience. The shift from time-based to competency-based evaluation presented an ongoing adjustment for many programs. Organized preparation before clinical competency committee meetings and diverse clinical competency committee composition led to more productive meetings and perceived improvement in promotion decisions. CONCLUSIONS: The results of this study can be used by program leadership to help guide further implementation of the Milestones and program improvement. These results also help to guide the evolution of Milestones language and their implementation across specialties.
OBJECTIVES: The purpose of this study was to determine the effect of the Accreditation Council for Graduate Medical Education Milestones on the assessment of neurological surgery residents. The authors sought to determine the feasibility, acceptability, and utility of this new framework in making judgments of progressive competence, its implementation within programs, and the influence on curricula. Residents were also surveyed to elicit the effect of Milestones on their educational experience and professional development. DESIGN, SETTING, AND PARTICIPANTS: In 2015, program leadership and residents from 21 neurological surgery residency programs participated in an online survey and telephone interview in which they reflected on their experiences with the Milestones. Survey data were analyzed using descriptive statistics. Interview transcripts were analyzed using grounded theory. RESULTS: Response themes were categorized into 2 groups: outcomes of the Milestones implementation process, and facilitators and barriers. Because of Milestones implementation, participants reported changes to the quality of the assessment process, including the ability to identify struggling residents earlier and design individualized improvement plans. Some programs revised their curricula based on training gaps identified using the Milestones. Barriers to implementation included limitations to the adoption of a developmental progression model in the context of rotation block schedules and misalignment between progression targets and clinical experience. The shift from time-based to competency-based evaluation presented an ongoing adjustment for many programs. Organized preparation before clinical competency committee meetings and diverse clinical competency committee composition led to more productive meetings and perceived improvement in promotion decisions. CONCLUSIONS: The results of this study can be used by program leadership to help guide further implementation of the Milestones and program improvement. These results also help to guide the evolution of Milestones language and their implementation across specialties.
Keywords:
ACGME competencies; Assessment and evaluation in graduate medical education; Competency-based assessment; Interpersonal and Communication Skills; Medical Knowledge; Neurosurgery; Patient Care; Practice-Based Learning and Improvement; Professionalism; Systems-Based Practice
Authors: Brent Thoma; Andrew K Hall; Kevin Clark; Nazanin Meshkat; Warren J Cheung; Pierre Desaulniers; Cheryl Ffrench; Allison Meiwald; Christine Meyers; Catherine Patocka; Lorri Beatty; Teresa M Chan Journal: J Grad Med Educ Date: 2020-08
Authors: Nicholas A Yaghmour; Lauren J Poulin; Elizabeth C Bernabeo; Andem Ekpenyong; Su-Ting T Li; Aimee R Eden; Karen E Hauer; Aleksandr M Tichter; Stanley J Hamstra; Eric S Holmboe Journal: J Grad Med Educ Date: 2021-04-23
Authors: Stanley J Hamstra; Kenji Yamazaki; Melissa A Barton; Sally A Santen; Michael S Beeson; Eric S Holmboe Journal: Acad Med Date: 2019-10 Impact factor: 6.893
Authors: Stanley J Hamstra; Monica M Cuddy; Daniel Jurich; Kenji Yamazaki; John Burkhardt; Eric S Holmboe; Michael A Barone; Sally A Santen Journal: Acad Med Date: 2021-09-01 Impact factor: 7.840