Matthew R Klein1, Zachary P Schmitz1, Mark D Adler2,3, David H Salzman1,3. 1. Department of Emergency Medicine Northwestern University Feinberg School of Medicine Chicago IL USA. 2. the Department of Pediatrics Northwestern University Feinberg School of Medicine Chicago IL USA. 3. and the Department of Medical Education Northwestern University Feinberg School of Medicine Chicago IL USA.
Abstract
OBJECTIVES: Temporary transvenous cardiac pacing (TVP) is a potentially lifesaving intervention included in the list of essential core procedures for emergency medicine (EM) training; however, opportunities to perform TVP during residency cannot be guaranteed. EM graduates report feeling subjectively underprepared for this procedure, but objective performance data are lacking. Checklist-based simulated assessment is an increasing focus of competency-based medical education, particularly for invasive procedures like TVP. The objectives of this paper were as follows: first, to enlist a multidisciplinary team of experts to create an assessment tool for TVP using best practices in checklist development; second, to determine the reliability of checklist scoring; and third, to assess EM residents' baseline ability to perform TVP using a dedicated task trainer. METHODS: This study was conducted at a single 4-year EM residency. A panel of emergency physicians and cardiologists designed a TVP checklist using a modified Delphi approach. After consensus was achieved on a final checklist, EM residents were assessed using a dedicated TVP task trainer. Inter-rater reliability was determined using Cohen's kappa coefficient. Resident performance was determined by number of correctly performed checklist items. RESULTS: The expert panel achieved consensus on a 30-item checklist after three rounds of revisions. The Cohen's kappa coefficient for the overall checklist score was 0.87, with individual checklist items ranging from 0.63 to 1.00. In total, 58 residents were assessed with a mean score of 13.5 of 30 checklist items. Scores increased with each year of training. CONCLUSIONS: This study details the rigorous development of a TVP checklist designed by a multidisciplinary team of experts. Checklist scores demonstrated strong inter-rater reliability. The overall poor performance of this cohort suggests the current approach to TVP training does not provide sufficient preparation for EM residents. Competency-based techniques, such as simulation-based mastery learning, should be explored.
OBJECTIVES: Temporary transvenous cardiac pacing (TVP) is a potentially lifesaving intervention included in the list of essential core procedures for emergency medicine (EM) training; however, opportunities to perform TVP during residency cannot be guaranteed. EM graduates report feeling subjectively underprepared for this procedure, but objective performance data are lacking. Checklist-based simulated assessment is an increasing focus of competency-based medical education, particularly for invasive procedures like TVP. The objectives of this paper were as follows: first, to enlist a multidisciplinary team of experts to create an assessment tool for TVP using best practices in checklist development; second, to determine the reliability of checklist scoring; and third, to assess EM residents' baseline ability to perform TVP using a dedicated task trainer. METHODS: This study was conducted at a single 4-year EM residency. A panel of emergency physicians and cardiologists designed a TVP checklist using a modified Delphi approach. After consensus was achieved on a final checklist, EM residents were assessed using a dedicated TVP task trainer. Inter-rater reliability was determined using Cohen's kappa coefficient. Resident performance was determined by number of correctly performed checklist items. RESULTS: The expert panel achieved consensus on a 30-item checklist after three rounds of revisions. The Cohen's kappa coefficient for the overall checklist score was 0.87, with individual checklist items ranging from 0.63 to 1.00. In total, 58 residents were assessed with a mean score of 13.5 of 30 checklist items. Scores increased with each year of training. CONCLUSIONS: This study details the rigorous development of a TVP checklist designed by a multidisciplinary team of experts. Checklist scores demonstrated strong inter-rater reliability. The overall poor performance of this cohort suggests the current approach to TVP training does not provide sufficient preparation for EM residents. Competency-based techniques, such as simulation-based mastery learning, should be explored.
Authors: Grace C Huang; Lori R Newman; Richard M Schwartzstein; Peter F Clardy; David Feller-Kopman; Julie T Irish; C Christopher Smith Journal: Acad Med Date: 2009-08 Impact factor: 6.893
Authors: G H Sodeck; H Domanovits; G Meron; F Rauscha; H Losert; M Thalmann; M Vlcek; A N Laggner Journal: Resuscitation Date: 2007-01-08 Impact factor: 5.262
Authors: Jeremy B Branzetti; Adeyinka A Adedipe; Matthew J Gittinger; Elizabeth D Rosenman; Sarah Brolliar; Anne K Chipman; James A Grand; Rosemarie Fernandez Journal: BMJ Qual Saf Date: 2017-09-02 Impact factor: 7.035
Authors: Richard L Lammers; Moira Davenport; Frederick Korley; Sharon Griswold-Theodorson; Michael T Fitch; Aneesh T Narang; Leigh V Evans; Amy Gross; Elliot Rodriguez; Kelly L Dodge; Cara J Hamann; Walter C Robey Journal: Acad Emerg Med Date: 2008-09-26 Impact factor: 3.451