G Segal1, A Segev1, A Brom1, Y Lifshitz1, Y Wasserstrum1, E Zimlichman2. 1. Internal Medicine "T," Chaim Sheba Medical Center, Tel-Hashomer, Ramat Gan, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel. 2. Management Wing, Chaim Sheba Medical Center, Tel-Hashomer, Ramat Gan, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
Abstract
BACKGROUND: Drug prescription errors are made, worldwide, on a daily basis, resulting in a high burden of morbidity and mortality. Existing rule-based systems for prevention of such errors are unsuccessful and associated with substantial burden of false alerts. OBJECTIVE: In this prospective study, we evaluated the accuracy, validity, and clinical usefulness of medication error alerts generated by a novel system using outlier detection screening algorithms, used on top of a legacy standard system, in a real-life inpatient setting. MATERIALS AND METHODS: We integrated a novel outlier system into an existing electronic medical record system, in a single medical ward in a tertiary medical center. The system monitored all drug prescriptions written during 16 months. The department's staff assessed all alerts for accuracy, clinical validity, and usefulness. We recorded all physician's real-time responses to alerts generated. RESULTS: The alert burden generated by the system was low, with alerts generated for 0.4% of all medication orders. Sixty percent of the alerts were flagged after the medication was already dispensed following changes in patients' status which necessitated medication changes (eg, changes in vital signs). Eighty-five percent of the alerts were confirmed clinically valid, and 80% were considered clinically useful. Forty-three percent of the alerts caused changes in subsequent medical orders. CONCLUSION: A clinical decision support system that used a probabilistic, machine-learning approach based on statistically derived outliers to detect medication errors generated clinically useful alerts. The system had high accuracy, low alert burden and low false-positive rate, and led to changes in subsequent orders.
BACKGROUND: Drug prescription errors are made, worldwide, on a daily basis, resulting in a high burden of morbidity and mortality. Existing rule-based systems for prevention of such errors are unsuccessful and associated with substantial burden of false alerts. OBJECTIVE: In this prospective study, we evaluated the accuracy, validity, and clinical usefulness of medication error alerts generated by a novel system using outlier detection screening algorithms, used on top of a legacy standard system, in a real-life inpatient setting. MATERIALS AND METHODS: We integrated a novel outlier system into an existing electronic medical record system, in a single medical ward in a tertiary medical center. The system monitored all drug prescriptions written during 16 months. The department's staff assessed all alerts for accuracy, clinical validity, and usefulness. We recorded all physician's real-time responses to alerts generated. RESULTS: The alert burden generated by the system was low, with alerts generated for 0.4% of all medication orders. Sixty percent of the alerts were flagged after the medication was already dispensed following changes in patients' status which necessitated medication changes (eg, changes in vital signs). Eighty-five percent of the alerts were confirmed clinically valid, and 80% were considered clinically useful. Forty-three percent of the alerts caused changes in subsequent medical orders. CONCLUSION: A clinical decision support system that used a probabilistic, machine-learning approach based on statistically derived outliers to detect medication errors generated clinically useful alerts. The system had high accuracy, low alert burden and low false-positive rate, and led to changes in subsequent orders.
Authors: Eyal Zimlichman; Carol Keohane; Calvin Franz; Wendy L Everett; Diane L Seger; Catherine Yoon; Alexander A Leung; Bismarck Cadet; Michael Coffey; Nathan E Kaufman; David W Bates Journal: Jt Comm J Qual Patient Saf Date: 2013-07
Authors: Clare L Tolley; Sarah P Slight; Andrew K Husband; Neil Watson; David W Bates Journal: Am J Health Syst Pharm Date: 2018-02-15 Impact factor: 2.637
Authors: Seunghee Lee; Jeongwon Shin; Hyeon Seong Kim; Min Je Lee; Jung Min Yoon; Sohee Lee; Yongsuk Kim; Jong-Yeup Kim; Suehyun Lee Journal: Drug Saf Date: 2021-11-12 Impact factor: 5.606