BACKGROUND: In July 2013, emergency medicine residency programs implemented the Milestone assessment as part of the Next Accreditation System. OBJECTIVE: We hypothesized that applying the Milestone framework to real-time feedback in the emergency department (ED) could affect current feedback processes and culture. We describe the development and implementation of a Milestone-based, learner-centered intervention designed to prompt real-time feedback in the ED. METHODS: We developed and implemented the Milestones Passport, a feedback intervention incorporating subcompetencies, in our residency program in July 2013. Our primary outcomes were feasibility, including faculty and staff time and costs, number of documented feedback encounters in the first 2 months of implementation, and user-reported time required to complete the intervention. We also assessed learner and faculty acceptability. RESULTS: Development and implementation of the Milestones Passport required 10 hours of program coordinator time, 120 hours of software developer time, and 20 hours of faculty time. Twenty-eight residents and 34 faculty members generated 257 Milestones Passport feedback encounters. Most residents and faculty reported that the encounters required fewer than 5 minutes to complete, and 48% (12 of 25) of the residents and 68% (19 of 28) of faculty reported satisfaction with the Milestones Passport intervention. Faculty satisfaction with overall feedback in the ED improved after the intervention (93% versus 54%, P = .003), whereas resident satisfaction with feedback did not change significantly. CONCLUSIONS: The Milestones Passport feedback intervention was feasible and acceptable to users; however, learner satisfaction with the Milestone assessment in the ED was modest.
BACKGROUND: In July 2013, emergency medicine residency programs implemented the Milestone assessment as part of the Next Accreditation System. OBJECTIVE: We hypothesized that applying the Milestone framework to real-time feedback in the emergency department (ED) could affect current feedback processes and culture. We describe the development and implementation of a Milestone-based, learner-centered intervention designed to prompt real-time feedback in the ED. METHODS: We developed and implemented the Milestones Passport, a feedback intervention incorporating subcompetencies, in our residency program in July 2013. Our primary outcomes were feasibility, including faculty and staff time and costs, number of documented feedback encounters in the first 2 months of implementation, and user-reported time required to complete the intervention. We also assessed learner and faculty acceptability. RESULTS: Development and implementation of the Milestones Passport required 10 hours of program coordinator time, 120 hours of software developer time, and 20 hours of faculty time. Twenty-eight residents and 34 faculty members generated 257 Milestones Passport feedback encounters. Most residents and faculty reported that the encounters required fewer than 5 minutes to complete, and 48% (12 of 25) of the residents and 68% (19 of 28) of faculty reported satisfaction with the Milestones Passport intervention. Faculty satisfaction with overall feedback in the ED improved after the intervention (93% versus 54%, P = .003), whereas resident satisfaction with feedback did not change significantly. CONCLUSIONS: The Milestones Passport feedback intervention was feasible and acceptable to users; however, learner satisfaction with the Milestone assessment in the ED was modest.
Authors: Resa E Lewiss; Michelle Pearl; Jason T Nomura; Gillian Baty; Rimon Bengiamin; Kael Duprey; Michael Stone; Daniel Theodoro; Saadia Akhtar Journal: Acad Emerg Med Date: 2013-07 Impact factor: 3.451
Authors: Michael S Beeson; Wallace A Carter; Theodore A Christopher; Jonathan W Heidt; James H Jones; Lynne E Meyer; Susan B Promes; Kevin G Rodgers; Philip H Shayne; Susan R Swing; Mary Jo Wagner Journal: Acad Emerg Med Date: 2013-06-19 Impact factor: 3.451
Authors: Harold G J Bok; Pim W Teunissen; Annemarie Spruijt; Joanne P I Fokkema; Peter van Beukelen; Debbie A D C Jaarsma; Cees P M van der Vleuten Journal: Med Educ Date: 2013-03 Impact factor: 6.251
Authors: Michael S Beeson; Wallace A Carter; Theodore A Christopher; Jonathan W Heidt; James H Jones; Lynne E Meyer; Susan B Promes; Kevin G Rodgers; Philip H Shayne; Mary Jo Wagner; Susan R Swing Journal: J Grad Med Educ Date: 2013-03
Authors: Kevin W Eva; Heather Armson; Eric Holmboe; Jocelyn Lockyer; Elaine Loney; Karen Mann; Joan Sargeant Journal: Adv Health Sci Educ Theory Pract Date: 2011-04-06 Impact factor: 3.853
Authors: Eric S Holmboe; Kenji Yamazaki; Laura Edgar; Lisa Conforti; Nicholas Yaghmour; Rebecca S Miller; Stanley J Hamstra Journal: J Grad Med Educ Date: 2015-09
Authors: Neil Arnstead; Paolo Campisi; Susan Glover Takahashi; Chris J Hong; Florence Mok; Christopher W Noel; Jennifer Siu; Brian M Wong; Eric Monteiro Journal: J Grad Med Educ Date: 2020-02
Authors: AnnaMarie Connolly; Alice Goepfert; Anita Blanchard; Elizabeth Buys; Nicole Donnellan; Cindy L Amundsen; Shelley L Galvin; Kimberly Kenton Journal: J Grad Med Educ Date: 2018-02
Authors: Cristen P Page; Alfred Reid; Catherine L Coe; Martha Carlough; Daryl Rosenbaum; Janalynn Beste; Blake Fagan; Erika Steinbacher; Geoffrey Jones; Warren P Newton Journal: J Grad Med Educ Date: 2016-10
Authors: Suzanne Bentley; Kevin Hu; Anne Messman; Tiffany Moadel; Sorabh Khandelwal; Heather Streich; Joan Noelker Journal: West J Emerg Med Date: 2016-12-15