Natasha N Joglekar1, Yatindra Patel2, Michelle S Keller2,3,4. 1. Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Boston, Massachusetts, United Sates. 2. Division of General Internal Medicine, Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, California, United Sates. 3. Division of Informatics, Department of Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, California, United Sates. 4. Department of Health Policy and Management, Fielding School of Public Health, University of California-Los Angeles, Los Angeles, California, United Sates.
Abstract
OBJECTIVE: We sought to characterize the performance of inpatient and outpatient computerized clinical decision support (CDS) alerts aimed at reducing inappropriate benzodiazepine and nonbenzodiazepine sedative medication prescribing in older adults 18 months after implementation. METHODS: We reviewed the performance of two CDS alerts in the outpatient and inpatient settings in 2019. To examine the alerts' effectiveness, we analyzed metrics including overall alert adherence, provider-level adherence, and reasons for alert trigger and override. RESULTS: In 2019, we identified a total of 14,534 and 4,834 alerts triggered in the outpatient and inpatient settings, respectively. Providers followed only 1% of outpatient and 3% of inpatient alerts. Most alerts were ignored (68% outpatient and 60% inpatient), while providers selected to override the remaining alerts. In each setting, the top 2% of clinicians were responsible for approximately 25% of all ignored or overridden alerts. However, a small proportion of clinicians (2% outpatient and 4% inpatient) followed the alert at least half of the time and accounted for a disproportionally large fraction of the total followed alerts. Our analysis of the free-text comments revealed that many alerts were to continue outpatient prescriptions or for situational anxiety. CONCLUSION: Our findings highlight the importance of evaluation of CDS performance after implementation. We found large variation in response to the inpatient and outpatient alerts, both with respect to follow and ignore rates. Reevaluating the alert design by providing decision support by indication may be more helpful and may reduce alert fatigue. Thieme. All rights reserved.
OBJECTIVE: We sought to characterize the performance of inpatient and outpatient computerized clinical decision support (CDS) alerts aimed at reducing inappropriate benzodiazepine and nonbenzodiazepine sedative medication prescribing in older adults 18 months after implementation. METHODS: We reviewed the performance of two CDS alerts in the outpatient and inpatient settings in 2019. To examine the alerts' effectiveness, we analyzed metrics including overall alert adherence, provider-level adherence, and reasons for alert trigger and override. RESULTS: In 2019, we identified a total of 14,534 and 4,834 alerts triggered in the outpatient and inpatient settings, respectively. Providers followed only 1% of outpatient and 3% of inpatient alerts. Most alerts were ignored (68% outpatient and 60% inpatient), while providers selected to override the remaining alerts. In each setting, the top 2% of clinicians were responsible for approximately 25% of all ignored or overridden alerts. However, a small proportion of clinicians (2% outpatient and 4% inpatient) followed the alert at least half of the time and accounted for a disproportionally large fraction of the total followed alerts. Our analysis of the free-text comments revealed that many alerts were to continue outpatient prescriptions or for situational anxiety. CONCLUSION: Our findings highlight the importance of evaluation of CDS performance after implementation. We found large variation in response to the inpatient and outpatient alerts, both with respect to follow and ignore rates. Reevaluating the alert design by providing decision support by indication may be more helpful and may reduce alert fatigue. Thieme. All rights reserved.
Authors: Emily M Campbell; Dean F Sittig; Joan S Ash; Kenneth P Guappone; Richard H Dykstra Journal: J Am Med Inform Assoc Date: 2006-06-23 Impact factor: 4.497
Authors: Jason N Doctor; Andy Nguyen; Roneet Lev; Jonathan Lucas; Tara Knight; Henu Zhao; Michael Menchine Journal: Science Date: 2018-08-10 Impact factor: 47.728
Authors: Yvonne C Lee; Bing Lu; Hongshu Guan; Jeffrey D Greenberg; Joel Kremer; Daniel H Solomon Journal: Arthritis Rheumatol Date: 2020-07 Impact factor: 10.995
Authors: Jeffrey A Linder; Daniella Meeker; Craig R Fox; Mark W Friedberg; Stephen D Persell; Noah J Goldstein; Jason N Doctor Journal: JAMA Date: 2017-10-10 Impact factor: 56.272
Authors: Tiffany Brown; Brittany Zelch; Ji Young Lee; Jason N Doctor; Jeffrey A Linder; Mark D Sullivan; Noah J Goldstein; Theresa A Rowe; Daniella Meeker; Tara Knight; Mark W Friedberg; Stephen D Persell Journal: Appl Clin Inform Date: 2022-09-07 Impact factor: 2.762