Evan W Orenstein1,2, Swaminathan Kandaswamy1, Naveen Muthu3,4, Juan D Chaparro5,6, Philip A Hagedorn7,8, Adam C Dziorny9,10, Adam Moses11, Sean Hernandez11,12, Amina Khan4, Hannah B Huth11, Jonathan M Beus3,4, Eric S Kirkendall11,13. 1. Department of Pediatrics, Emory University School of Medicine, Atlanta, Georgia, USA. 2. Division of Hospital Medicine, Children's Healthcare of Atlanta, Atlanta, Georgia, USA. 3. Department of Pediatrics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA. 4. Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA. 5. Division of Clinical Informatics, Nationwide Children's Hospital, Columbus, Ohio, USA. 6. Department of Pediatrics, The Ohio State University, Columbus, Ohio, USA. 7. Department of Pediatrics, University of Cincinnati, Cincinnati, Ohio, USA. 8. Division of Hospital Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA. 9. Department of Pediatrics, University of Rochester School of Medicine, Rochester, New York, USA. 10. Division of Critical Care Medicine, Golisano Children's Hospital at Strong, Rochester, New York, USA. 11. Center for Healthcare Innovation, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA. 12. Department of General Internal Medicine, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA. 13. Department of Pediatrics, Wake Forest School of Medicine, Winston-Salem, North Carolina, USA.
Abstract
BACKGROUND: Excessive electronic health record (EHR) alerts reduce the salience of actionable alerts. Little is known about the frequency of interruptive alerts across health systems and how the choice of metric affects which users appear to have the highest alert burden. OBJECTIVE: (1) Analyze alert burden by alert type, care setting, provider type, and individual provider across 6 pediatric health systems. (2) Compare alert burden using different metrics. MATERIALS AND METHODS: We analyzed interruptive alert firings logged in EHR databases at 6 pediatric health systems from 2016-2019 using 4 metrics: (1) alerts per patient encounter, (2) alerts per inpatient-day, (3) alerts per 100 orders, and (4) alerts per unique clinician days (calendar days with at least 1 EHR log in the system). We assessed intra- and interinstitutional variation and how alert burden rankings differed based on the chosen metric. RESULTS: Alert burden varied widely across institutions, ranging from 0.06 to 0.76 firings per encounter, 0.22 to 1.06 firings per inpatient-day, 0.98 to 17.42 per 100 orders, and 0.08 to 3.34 firings per clinician day logged in the EHR. Custom alerts accounted for the greatest burden at all 6 sites. The rank order of institutions by alert burden was similar regardless of which alert burden metric was chosen. Within institutions, the alert burden metric choice substantially affected which provider types and care settings appeared to experience the highest alert burden. CONCLUSION: Estimates of the clinical areas with highest alert burden varied substantially by institution and based on the metric used.
BACKGROUND: Excessive electronic health record (EHR) alerts reduce the salience of actionable alerts. Little is known about the frequency of interruptive alerts across health systems and how the choice of metric affects which users appear to have the highest alert burden. OBJECTIVE: (1) Analyze alert burden by alert type, care setting, provider type, and individual provider across 6 pediatric health systems. (2) Compare alert burden using different metrics. MATERIALS AND METHODS: We analyzed interruptive alert firings logged in EHR databases at 6 pediatric health systems from 2016-2019 using 4 metrics: (1) alerts per patient encounter, (2) alerts per inpatient-day, (3) alerts per 100 orders, and (4) alerts per unique clinician days (calendar days with at least 1 EHR log in the system). We assessed intra- and interinstitutional variation and how alert burden rankings differed based on the chosen metric. RESULTS: Alert burden varied widely across institutions, ranging from 0.06 to 0.76 firings per encounter, 0.22 to 1.06 firings per inpatient-day, 0.98 to 17.42 per 100 orders, and 0.08 to 3.34 firings per clinician day logged in the EHR. Custom alerts accounted for the greatest burden at all 6 sites. The rank order of institutions by alert burden was similar regardless of which alert burden metric was chosen. Within institutions, the alert burden metric choice substantially affected which provider types and care settings appeared to experience the highest alert burden. CONCLUSION: Estimates of the clinical areas with highest alert burden varied substantially by institution and based on the metric used.
Authors: Allan F Simpao; Luis M Ahumada; Bimal R Desai; Christopher P Bonafide; Jorge A Gálvez; Mohamed A Rehman; Abbas F Jawad; Krisha L Palma; Eric D Shelov Journal: J Am Med Inform Assoc Date: 2014-10-15 Impact factor: 4.497
Authors: R D Kush; D Warzel; M A Kush; A Sherman; E A Navarro; R Fitzmartin; F Pétavy; J Galvez; L B Becnel; F L Zhou; N Harmon; B Jauregui; T Jackson; L Hudson Journal: J Biomed Inform Date: 2020-05-12 Impact factor: 6.317
Authors: Allison B McCoy; Lemuel R Waitman; Julia B Lewis; Julie A Wright; David P Choma; Randolph A Miller; Josh F Peterson Journal: J Am Med Inform Assoc Date: 2011-08-17 Impact factor: 4.497
Authors: Tiffani J Bright; Anthony Wong; Ravi Dhurjati; Erin Bristow; Lori Bastian; Remy R Coeytaux; Gregory Samsa; Vic Hasselblad; John W Williams; Michael D Musty; Liz Wing; Amy S Kendrick; Gillian D Sanders; David Lobach Journal: Ann Intern Med Date: 2012-07-03 Impact factor: 25.391
Authors: John D Kugler; Robert H Beekman Iii; Geoffrey L Rosenthal; Kathy J Jenkins; Thomas S Klitzner; Gerard R Martin; Steven R Neish; Carole Lannon Journal: Congenit Heart Dis Date: 2009 Sep-Oct Impact factor: 2.007
Authors: Xiaojuan Li; Bruce H Fireman; Jeffrey R Curtis; David E Arterburn; David P Fisher; Érick Moyneur; Mia Gallagher; Marsha A Raebel; W Benjamin Nowell; Lindsay Lagreid; Sengwee Toh Journal: Am J Epidemiol Date: 2019-04-01 Impact factor: 4.897
Authors: Christopher B Forrest; Peter A Margolis; L Charles Bailey; Keith Marsolo; Mark A Del Beccaro; Jonathan A Finkelstein; David E Milov; Veronica J Vieland; Bryan A Wolf; Feliciano B Yu; Michael G Kahn Journal: J Am Med Inform Assoc Date: 2014-05-12 Impact factor: 4.497
Authors: Gabriel A Brat; Griffin M Weber; Nils Gehlenborg; Paul Avillach; Nathan P Palmer; Luca Chiovato; James Cimino; Lemuel R Waitman; Gilbert S Omenn; Alberto Malovini; Jason H Moore; Brett K Beaulieu-Jones; Valentina Tibollo; Shawn N Murphy; Sehi L' Yi; Mark S Keller; Riccardo Bellazzi; David A Hanauer; Arnaud Serret-Larmande; Alba Gutierrez-Sacristan; John J Holmes; Douglas S Bell; Kenneth D Mandl; Robert W Follett; Jeffrey G Klann; Douglas A Murad; Luigia Scudeller; Mauro Bucalo; Katie Kirchoff; Jean Craig; Jihad Obeid; Vianney Jouhet; Romain Griffier; Sebastien Cossin; Bertrand Moal; Lav P Patel; Antonio Bellasi; Hans U Prokosch; Detlef Kraska; Piotr Sliz; Amelia L M Tan; Kee Yuan Ngiam; Alberto Zambelli; Danielle L Mowery; Emily Schiver; Batsal Devkota; Robert L Bradford; Mohamad Daniar; Christel Daniel; Vincent Benoit; Romain Bey; Nicolas Paris; Patricia Serre; Nina Orlova; Julien Dubiel; Martin Hilka; Anne Sophie Jannot; Stephane Breant; Judith Leblanc; Nicolas Griffon; Anita Burgun; Melodie Bernaux; Arnaud Sandrin; Elisa Salamanca; Sylvie Cormont; Thomas Ganslandt; Tobias Gradinger; Julien Champ; Martin Boeker; Patricia Martel; Loic Esteve; Alexandre Gramfort; Olivier Grisel; Damien Leprovost; Thomas Moreau; Gael Varoquaux; Jill-Jênn Vie; Demian Wassermann; Arthur Mensch; Charlotte Caucheteux; Christian Haverkamp; Guillaume Lemaitre; Silvano Bosari; Ian D Krantz; Andrew South; Tianxi Cai; Isaac S Kohane Journal: NPJ Digit Med Date: 2020-08-19
Authors: Juan D Chaparro; Jonathan M Beus; Adam C Dziorny; Philip A Hagedorn; Sean Hernandez; Swaminathan Kandaswamy; Eric S Kirkendall; Allison B McCoy; Naveen Muthu; Evan W Orenstein Journal: Appl Clin Inform Date: 2022-05-25 Impact factor: 2.762