Christopher P Landrigan1, David Stockwell2, Sara L Toomey3, Samuel Loren4, Michaela Tracy4, Jisun Jang4, Jessica A Quinn4, Sepideh Ashrafzadeh4, Michelle Wang4, Paul J Sharek5, Gareth Parry6, Mark A Schuster3. 1. Division of General Pediatrics, Department of Medicine, Boston Children's Hospital, Boston, Massachusetts; Department of Pediatrics, Harvard Medical School, Boston, Massachusetts; Division of Sleep Medicine, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachussets; clandrigan@partners.org. 2. Division of Critical Care Medicine, Children's National Medical Center, Washington, District of Columbia; Division of Critical Care Medicine, Department of Pediatrics, School of Medicine, George Washington University, Washington, District of Columbia; 3. Division of General Pediatrics, Department of Medicine, Boston Children's Hospital, Boston, Massachusetts; Department of Pediatrics, Harvard Medical School, Boston, Massachusetts; 4. Division of General Pediatrics, Department of Medicine, Boston Children's Hospital, Boston, Massachusetts; 5. Division of Pediatric Hospitalist Medicine, Department of Pediatrics, Stanford University School of Medicine; and. 6. Institute for Healthcare Improvement, Cambridge, MA.
Abstract
BACKGROUND AND OBJECTIVE: Efforts to advance patient safety have been hampered by the lack of high quality measures of adverse events (AEs). This study's objective was to develop and test the Global Assessment of Pediatric Patient Safety (GAPPS) trigger tool, which measures hospital-wide rates of AEs and preventable AEs. METHODS: Through a literature review and expert panel process, we developed a draft trigger tool. Tool performance was tested in 16 academic and community hospitals across the United States. At each site, a primary reviewer (nurse) reviewed ∼240 randomly selected medical records; 10% of records underwent an additional primary review. Suspected AEs were subsequently evaluated by 2 secondary reviewers (physicians). Ten percent of records were also reviewed by external expert reviewers. Each trigger's incidence and positivity rates were assessed to refine GAPPS. RESULTS: In total, 3814 medical records were reviewed. Primary reviewers agreed 92% of the time on presence or absence of a suspected AE (κ = 0.69). Secondary reviewers verifying AE presence or absence agreed 92% of the time (κ = 0.81). Using expert reviews as a standard for comparison, hospital-based primary reviewers had a sensitivity and specificity of 40% and 91%, respectively. As primary reviewers gained experience, their agreement with expert reviewers improved significantly. After removing low-yield triggers, 27 and 30 (of 54) triggers met inclusion criteria to form final manual and automated trigger lists, respectively. CONCLUSIONS: GAPPS reliably identifies AEs and can be used to guide and monitor quality improvement efforts. Ongoing refinement may facilitate future interhospital comparisons.
BACKGROUND AND OBJECTIVE: Efforts to advance patient safety have been hampered by the lack of high quality measures of adverse events (AEs). This study's objective was to develop and test the Global Assessment of Pediatric Patient Safety (GAPPS) trigger tool, which measures hospital-wide rates of AEs and preventable AEs. METHODS: Through a literature review and expert panel process, we developed a draft trigger tool. Tool performance was tested in 16 academic and community hospitals across the United States. At each site, a primary reviewer (nurse) reviewed ∼240 randomly selected medical records; 10% of records underwent an additional primary review. Suspected AEs were subsequently evaluated by 2 secondary reviewers (physicians). Ten percent of records were also reviewed by external expert reviewers. Each trigger's incidence and positivity rates were assessed to refine GAPPS. RESULTS: In total, 3814 medical records were reviewed. Primary reviewers agreed 92% of the time on presence or absence of a suspected AE (κ = 0.69). Secondary reviewers verifying AE presence or absence agreed 92% of the time (κ = 0.81). Using expert reviews as a standard for comparison, hospital-based primary reviewers had a sensitivity and specificity of 40% and 91%, respectively. As primary reviewers gained experience, their agreement with expert reviewers improved significantly. After removing low-yield triggers, 27 and 30 (of 54) triggers met inclusion criteria to form final manual and automated trigger lists, respectively. CONCLUSIONS: GAPPS reliably identifies AEs and can be used to guide and monitor quality improvement efforts. Ongoing refinement may facilitate future interhospital comparisons.
Authors: David C Stockwell; Christopher P Landrigan; Sara L Toomey; Matthew Y Westfall; Shanshan Liu; Gareth Parry; Ari S Coopersmith; Mark A Schuster Journal: Hosp Pediatr Date: 2018-12-03
Authors: James M Hoffman; Nicholas J Keeling; Christopher B Forrest; Heather L Tubbs-Cooley; Erin Moore; Emily Oehler; Stephanie Wilson; Elisabeth Schainker; Kathleen E Walsh Journal: Pediatrics Date: 2019-02 Impact factor: 7.124
Authors: Alisa Khan; Maitreya Coffey; Katherine P Litterer; Jennifer D Baird; Stephannie L Furtak; Briana M Garcia; Michele A Ashland; Sharon Calaman; Nicholas C Kuzma; Jennifer K O'Toole; Aarti Patel; Glenn Rosenbluth; Lauren A Destino; Jennifer L Everhart; Brian P Good; Jennifer H Hepps; Anuj K Dalal; Stuart R Lipsitz; Catherine S Yoon; Katherine R Zigmont; Rajendu Srivastava; Amy J Starmer; Theodore C Sectish; Nancy D Spector; Daniel C West; Christopher P Landrigan; Brenda K Allair; Claire Alminde; Wilma Alvarado-Little; Marisa Atsatt; Megan E Aylor; James F Bale; Dorene Balmer; Kevin T Barton; Carolyn Beck; Zia Bismilla; Rebecca L Blankenburg; Debra Chandler; Amanda Choudhary; Eileen Christensen; Sally Coghlan-McDonald; F Sessions Cole; Elizabeth Corless; Sharon Cray; Roxi Da Silva; Devesh Dahale; Benard Dreyer; Amanda S Growdon; LeAnn Gubler; Amy Guiot; Roben Harris; Helen Haskell; Irene Kocolas; Elizabeth Kruvand; Michele Marie Lane; Kathleen Langrish; Christy J W Ledford; Kheyandra Lewis; Joseph O Lopreiato; Christopher G Maloney; Amanda Mangan; Peggy Markle; Fernando Mendoza; Dale Ann Micalizzi; Vineeta Mittal; Maria Obermeyer; Katherine A O'Donnell; Mary Ottolini; Shilpa J Patel; Rita Pickler; Jayne Elizabeth Rogers; Lee M Sanders; Kimberly Sauder; Samir S Shah; Meesha Sharma; Arabella Simpkin; Anupama Subramony; E Douglas Thompson; Laura Trueman; Tanner Trujillo; Michael P Turmelle; Cindy Warnick; Chelsea Welch; Andrew J White; Matthew F Wien; Ariel S Winn; Stephanie Wintch; Michael Wolf; H Shonna Yin; Clifton E Yu Journal: JAMA Pediatr Date: 2017-04-01 Impact factor: 16.193
Authors: Elizabeth Eby Halvorson; Danielle P Thurtle; Ashley Easter; James Lovato; David Stockwell Journal: J Patient Saf Date: 2022-07-07 Impact factor: 2.243
Authors: Christopher P Bonafide; Rui Xiao; Amanda C Schondelmeyer; Amy R Pettit; Patrick W Brady; Christopher P Landrigan; Courtney Benjamin Wolk; Zuleyha Cidav; Halley Ruppel; Naveen Muthu; Nathaniel J Williams; Enrique Schisterman; Canita R Brent; Kimberly Albanowski; Rinad S Beidas Journal: Implement Sci Date: 2022-10-21 Impact factor: 7.960
Authors: Christina L Cifra; Patrick Ten Eyck; Jeffrey D Dawson; Heather Schacht Reisinger; Hardeep Singh; Loreen A Herwaldt Journal: Pediatr Crit Care Med Date: 2020-05 Impact factor: 3.624
Authors: David C Stockwell; Christopher P Landrigan; Sara L Toomey; Samuel S Loren; Jisun Jang; Jessica A Quinn; Sepideh Ashrafzadeh; Michelle J Wang; Melody Wu; Paul J Sharek; David C Classen; Rajendu Srivastava; Gareth Parry; Mark A Schuster Journal: Pediatrics Date: 2018-07-13 Impact factor: 7.124