Michael Meguerdichian1, Komal Bajaj, Nelson Wong, Suzanne Bentley, Katie Walker, Adam Cheng, Rami A Ahmed. 1. From the Department of Emergency Medicine (M.M.), NYC Health + Hospitals/Harlem; Columbia University (M.M.); Department of Obstetrics and Gynecology (K.B.), Albert Einstein College of Medicine; NYC Health +Hospitals/Jacobi (K.B.), New York, NY; Department of Emergency Medicine (N.W.), Veterans Health Administration, Stanford University School of Medicine, Stanford; SimLEARN (N.W.), Palo Alto, CA; Department of Emergency Medicine and Medical Education (S.B.), NYC Health + Hospitals/Elmhurst, Icahn School of Medicine; NYC Health + Hospitals Simulation Center (K.W.), New York, NY; Departments of Pediatrics and Emergency Medicine (A.C.), University of Calgary, Calgary, Alberta, Canada; and Department of Emergency Medicine (R.A.A.), Indiana University School of Medicine, Indianapolis, IN.
Abstract
INTRODUCTION: The simulation fellowship training community has commenced efforts toward the development of core curricular elements for healthcare simulation fellowships but has not deployed the same effort to create evaluation strategies to monitor fellows' progress. The authors present a current view of simulation fellowship assessment strategies, their relative validity evidence using Kane's theoretical framework, and consider new approaches for defining expertise after training. METHODS: Fellowship directors in North America were surveyed to identify what competencies are being used by the simulation fellowship community to monitor fellows' progress. A follow-up survey was sent to further clarify which tools with published validity evidence were being applied by current programs. RESULTS: Of the 61 programs contacted, 44 (72.1%) responded and completed the first survey. Of the 44 programs, 32 (72.7%) reported using some formal assessment of their fellows. The most commonly assessed skill was debriefing. Twenty-three (37.7%) of the 61 programs contacted responded to the secondary survey. These reported that the most common published tool used was the Debriefing Assessment for Simulation in Healthcare, with only a few other tools mentioned. CONCLUSIONS: There is a paucity of tools with published validity evidence being used to monitor a fellow's progression. The authors agree that further research needs to focus on creating validated assessment tools to assist in refining fellowship training.
INTRODUCTION: The simulation fellowship training community has commenced efforts toward the development of core curricular elements for healthcare simulation fellowships but has not deployed the same effort to create evaluation strategies to monitor fellows' progress. The authors present a current view of simulation fellowship assessment strategies, their relative validity evidence using Kane's theoretical framework, and consider new approaches for defining expertise after training. METHODS: Fellowship directors in North America were surveyed to identify what competencies are being used by the simulation fellowship community to monitor fellows' progress. A follow-up survey was sent to further clarify which tools with published validity evidence were being applied by current programs. RESULTS: Of the 61 programs contacted, 44 (72.1%) responded and completed the first survey. Of the 44 programs, 32 (72.7%) reported using some formal assessment of their fellows. The most commonly assessed skill was debriefing. Twenty-three (37.7%) of the 61 programs contacted responded to the secondary survey. These reported that the most common published tool used was the Debriefing Assessment for Simulation in Healthcare, with only a few other tools mentioned. CONCLUSIONS: There is a paucity of tools with published validity evidence being used to monitor a fellow's progression. The authors agree that further research needs to focus on creating validated assessment tools to assist in refining fellowship training.
Authors: Rami A Ahmed; Dylan Cooper; Chassity L Mays; Chris M Weidman; Julie A Poore; Anna M Bona; Lauren E Falvo; Malia J Moore; Sally A Mitchell; Tanna J Boyer; S Scott Atkinson; Johnny F Cartwright Journal: Adv Simul (Lond) Date: 2022-08-09