Angela M Feraco1, Amy J Starmer2, Theodore C Sectish2, Nancy D Spector3, Daniel C West4, Christopher P Landrigan5. 1. Department of Medicine, Boston Children's Hospital, Boston, Mass; Department of Pediatric Hematology/Oncology, Dana-Farber/Boston Children's Cancer and Blood Disorders Center, Boston, Mass; Department of Pediatrics, Harvard Medical School, Boston, Mass. Electronic address: Angela_Feraco@dfci.harvard.edu. 2. Department of Medicine, Boston Children's Hospital, Boston, Mass; Department of Pediatrics, Harvard Medical School, Boston, Mass. 3. St. Christopher's Hospital for Children, Philadelphia, Penn; Department of Pediatrics, Drexel University College of Medicine, Philadelphia, Penn. 4. UCSF Benioff Children's Hospital and Department of Pediatrics, University of California, San Francisco, Calif. 5. Department of Medicine, Boston Children's Hospital, Boston, Mass; Department of Pediatrics, Harvard Medical School, Boston, Mass; Sleep and Patient Safety Program, Brigham and Women's Hospital, Boston, Mass.
Abstract
OBJECTIVE: 1) To develop validity evidence for the use of the Verbal Handoff Assessment Tool (VHAT) and examine the reliability of VHAT scores, and 2) to determine whether implementation of a resident handoff bundle (RHB) was associated with improved verbal patient handoffs among pediatric resident physicians. METHODS: In a pre-post design, prospectively audio recorded verbal patient handoffs conducted at Boston Children's Hospital before and after implementation of the RHB were rated using the VHAT, which was developed for this study (primary outcome). Using generalizability theory, we evaluated the reliability of VHAT scores. RESULTS: Overall, VHAT scores increased after RHB implementation (mean 142 vs 191, possible score 0-500; P < .0001). When accounting for clustering according to resident physician, hospital unit, unit census, and patient complexity, implementation of the RHB was associated with a 63-point increase in VHAT score. Using generalizability theory, we determined that a resident's mean VHAT score on the basis of a handoff of 15 patients assessed by a single observer was sufficiently reliable for relative ranking decisions (ie, norm-based; generalizability coefficient, 0.81), whereas a VHAT score on the basis of a handoff of 21 patients would be sufficiently reliable for high-stakes, standard-based decisions (Phi, 0.80). CONCLUSIONS: Verbal handoffs improved after implementation of a RHB, although gains were variable across the 2 clinical units. The VHAT shows promise as an assessment tool for resident handoff skills. If used for competency or entrustment decisions, a resident's mean VHAT score should be on the basis of observation of verbal handoff of ≥21 patients.
OBJECTIVE: 1) To develop validity evidence for the use of the Verbal Handoff Assessment Tool (VHAT) and examine the reliability of VHAT scores, and 2) to determine whether implementation of a resident handoff bundle (RHB) was associated with improved verbal patient handoffs among pediatric resident physicians. METHODS: In a pre-post design, prospectively audio recorded verbal patient handoffs conducted at Boston Children's Hospital before and after implementation of the RHB were rated using the VHAT, which was developed for this study (primary outcome). Using generalizability theory, we evaluated the reliability of VHAT scores. RESULTS: Overall, VHAT scores increased after RHB implementation (mean 142 vs 191, possible score 0-500; P < .0001). When accounting for clustering according to resident physician, hospital unit, unit census, and patient complexity, implementation of the RHB was associated with a 63-point increase in VHAT score. Using generalizability theory, we determined that a resident's mean VHAT score on the basis of a handoff of 15 patients assessed by a single observer was sufficiently reliable for relative ranking decisions (ie, norm-based; generalizability coefficient, 0.81), whereas a VHAT score on the basis of a handoff of 21 patients would be sufficiently reliable for high-stakes, standard-based decisions (Phi, 0.80). CONCLUSIONS: Verbal handoffs improved after implementation of a RHB, although gains were variable across the 2 clinical units. The VHAT shows promise as an assessment tool for resident handoff skills. If used for competency or entrustment decisions, a resident's mean VHAT score should be on the basis of observation of verbal handoff of ≥21 patients.
Authors: Jennifer K O'Toole; Daniel C West; Amy J Starmer; Clifton E Yu; Sharon Calaman; Glenn Rosenbluth; Jennifer H Hepps; Joseph O Lopreiato; Christopher P Landrigan; Theodore C Sectish; Nancy D Spector Journal: Acad Pediatr Date: 2014 May-Jun Impact factor: 3.107
Authors: Lee Ann Riesenberg; Jessica Leitzsch; Jaime L Massucci; Joseph Jaeger; Joel C Rosenfeld; Carl Patow; Jamie S Padmore; Kelly P Karpovich Journal: Acad Med Date: 2009-12 Impact factor: 6.893
Authors: Daniel J Schumacher; Nancy D Spector; Sharon Calaman; Daniel C West; Mario Cruz; John G Frohna; Javier Gonzalez Del Rey; Kristina K Gustafson; Sue Ellen Poynter; Glenn Rosenbluth; W Michael Southgate; Robert J Vinci; Theodore C Sectish Journal: Pediatrics Date: 2014-04-14 Impact factor: 7.124
Authors: Amy J Starmer; Theodore C Sectish; Dennis W Simon; Carol Keohane; Maireade E McSweeney; Erica Y Chung; Catherine S Yoon; Stuart R Lipsitz; Ari J Wassner; Marvin B Harper; Christopher P Landrigan Journal: JAMA Date: 2013-12-04 Impact factor: 56.272
Authors: Peter Pronovost; Sean Berenholtz; Todd Dorman; Pam A Lipsett; Terri Simmonds; Carol Haraden Journal: J Crit Care Date: 2003-06 Impact factor: 3.425