Adam Wright1,2,3, Skye Aaron4, Diane L Seger4,5, Lipika Samal4,6,5, Gordon D Schiff4,6,5, David W Bates4,6,5. 1. Division of General Internal Medicine and Primary Care, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA. awright@bwh.harvard.edu. 2. Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA. awright@bwh.harvard.edu. 3. Information Systems Department, Partners HealthCare, Boston, MA, USA. awright@bwh.harvard.edu. 4. Division of General Internal Medicine and Primary Care, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA. 5. Information Systems Department, Partners HealthCare, Boston, MA, USA. 6. Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
Abstract
BACKGROUND: Drug-drug interaction (DDI) alerts in electronic health records (EHRs) can help prevent adverse drug events, but such alerts are frequently overridden, raising concerns about their clinical usefulness and contribution to alert fatigue. OBJECTIVE: To study the effect of conversion to a commercial EHR on DDI alert and acceptance rates. DESIGN: Two before-and-after studies. PARTICIPANTS: 3277 clinicians who received a DDI alert in the outpatient setting. INTERVENTION: Introduction of a new, commercial EHR and subsequent adjustment of DDI alerting criteria. MAIN MEASURES: Alert burden and proportion of alerts accepted. KEY RESULTS: Overall interruptive DDI alert burden increased by a factor of 6 from the legacy EHR to the commercial EHR. The acceptance rate for the most severe alerts fell from 100 to 8.4%, and from 29.3 to 7.5% for medium severity alerts (P < 0.001). After disabling the least severe alerts, total DDI alert burden fell by 50.5%, and acceptance of Tier 1 alerts rose from 9.1 to 12.7% (P < 0.01). CONCLUSIONS: Changing from a highly tailored DDI alerting system to a more general one as part of an EHR conversion decreased acceptance of DDI alerts and increased alert burden on users. The decrease in acceptance rates cannot be fully explained by differences in the clinical knowledge base, nor can it be fully explained by alert fatigue associated with increased alert burden. Instead, workflow factors probably predominate, including timing of alerts in the prescribing process, lack of differentiation of more and less severe alerts, and features of how users interact with alerts.
BACKGROUND:Drug-drug interaction (DDI) alerts in electronic health records (EHRs) can help prevent adverse drug events, but such alerts are frequently overridden, raising concerns about their clinical usefulness and contribution to alert fatigue. OBJECTIVE: To study the effect of conversion to a commercial EHR on DDI alert and acceptance rates. DESIGN: Two before-and-after studies. PARTICIPANTS: 3277 clinicians who received a DDI alert in the outpatient setting. INTERVENTION: Introduction of a new, commercial EHR and subsequent adjustment of DDI alerting criteria. MAIN MEASURES: Alert burden and proportion of alerts accepted. KEY RESULTS: Overall interruptive DDI alert burden increased by a factor of 6 from the legacy EHR to the commercial EHR. The acceptance rate for the most severe alerts fell from 100 to 8.4%, and from 29.3 to 7.5% for medium severity alerts (P < 0.001). After disabling the least severe alerts, total DDI alert burden fell by 50.5%, and acceptance of Tier 1 alerts rose from 9.1 to 12.7% (P < 0.01). CONCLUSIONS: Changing from a highly tailored DDI alerting system to a more general one as part of an EHR conversion decreased acceptance of DDI alerts and increased alert burden on users. The decrease in acceptance rates cannot be fully explained by differences in the clinical knowledge base, nor can it be fully explained by alert fatigue associated with increased alert burden. Instead, workflow factors probably predominate, including timing of alerts in the prescribing process, lack of differentiation of more and less severe alerts, and features of how users interact with alerts.
Entities:
Keywords:
adverse drug events; clinical decision support; drug-drug interactions; electronic health records; safety
Authors: Nidhi R Shah; Andrew C Seger; Diane L Seger; Julie M Fiskio; Gilad J Kuperman; Barry Blumenfeld; Elaine G Recklet; David W Bates; Tejal K Gandhi Journal: J Am Med Inform Assoc Date: 2005-10-12 Impact factor: 4.497
Authors: Shobha Phansalkar; Heleen van der Sijs; Alisha D Tucker; Amrita A Desai; Douglas S Bell; Jonathan M Teich; Blackford Middleton; David W Bates Journal: J Am Med Inform Assoc Date: 2012-09-25 Impact factor: 4.497
Authors: David N Juurlink; Muhammad Mamdani; Alexander Kopp; Andreas Laupacis; Donald A Redelmeier Journal: JAMA Date: 2003-04-02 Impact factor: 56.272
Authors: Marilyn D Paterno; Saverio M Maviglia; Paul N Gorman; Diane L Seger; Eileen Yoshida; Andrew C Seger; David W Bates; Tejal K Gandhi Journal: J Am Med Inform Assoc Date: 2008-10-24 Impact factor: 4.497
Authors: Maxim Topaz; Diane L Seger; Sarah P Slight; Foster Goss; Kenneth Lai; Paige G Wickner; Kimberly Blumenthal; Neil Dhopeshwarkar; Frank Chang; David W Bates; Li Zhou Journal: J Am Med Inform Assoc Date: 2015-11-17 Impact factor: 4.497
Authors: Amit M Patel; Salimah Shariff; David G Bailey; David N Juurlink; Sonja Gandhi; Muhammad Mamdani; Tara Gomes; Jamie Fleet; Y Joseph Hwang; Amit X Garg Journal: Ann Intern Med Date: 2013-06-18 Impact factor: 25.391
Authors: Siobhan Dumbreck; Angela Flynn; Moray Nairn; Martin Wilson; Shaun Treweek; Stewart W Mercer; Phil Alderson; Alex Thompson; Katherine Payne; Bruce Guthrie Journal: BMJ Date: 2015-03-11
Authors: Chunya Huang; Ross Koppel; John D McGreevey; Catherine K Craven; Richard Schreiber Journal: Appl Clin Inform Date: 2020-11-11 Impact factor: 2.342
Authors: Adam Wright; Dustin S McEvoy; Skye Aaron; Allison B McCoy; Mary G Amato; Hyun Kim; Angela Ai; James J Cimino; Bimal R Desai; Robert El-Kareh; William Galanter; Christopher A Longhurst; Sameer Malhotra; Ryan P Radecki; Lipika Samal; Richard Schreiber; Eric Shelov; Anwar Mohammad Sirajuddin; Dean F Sittig Journal: J Am Med Inform Assoc Date: 2019-10-01 Impact factor: 4.497