Jeff L Bubp1, Michelle A Park2, Joan Kapusnik-Uner1, Thong Dang2, Karl Matuszewski3, Don Ly4, Kevin Chiang2, Sek Shia4, Brian Hoberman5. 1. Clinical Editorial, First Databank Inc, South San Francisco, California, USA. 2. National Pharmacy Informatics and Analytical Services, Kaiser Permanente, Downey, California, USA. 3. Vizient University Health System Consortium, AMC Networks-Pharmacy, Supply and Clinical, Chicago, Illinois, USA. 4. National Pharmacy Informatics and Analytical Services, Kaiser Permanente, Pleasanton, California, USA. 5. Technology Leadership, The Permanente Medical Group, Oakland, California, USA.
Abstract
OBJECTIVE: The study sought to develop a criteria-based scoring tool for assessing drug-disease knowledge base content and creation of a subset and to implement the subset across multiple Kaiser Permanente (KP) regions. MATERIALS AND METHODS: In Phase I, the scoring tool was developed, used to create a drug-disease alert subset, and validated by surveying physicians and pharmacists from KP Northern California. In Phase II, KP enabled the alert subset in July 2015 in silent mode to collect alert firing rates and confirmed that alert burden was adequately reduced. The alert subset was subsequently rolled out to users in KP Northern California. Alert data was collected September 2015 to August 2016 to monitor relevancy and override rates. RESULTS: Drug-disease alert scoring identified 1211 of 4111 contraindicated drug-disease pairs for inclusion in the subset. The survey results showed clinician agreement with subset examples 92.3%-98.5% of the time. Postsurvey adjustments to the subset resulted in KP implementation of 1189 drug-disease alerts. The subset resulted in a decrease in monthly alerts from 32 045 to 1168. Postimplementation monthly physician alert acceptance rates ranged from 20.2% to 29.8%. DISCUSSION: Our study shows that drug-disease alert scoring resulted in an alert subset that generated acceptable interruptive alerts while decreasing overall potential alert burden. Following the initial testing and implementation in its Northern California region, KP successfully implemented the disease interaction subset in 4 regions with additional regions planned. CONCLUSIONS: Our approach could prevent undue alert burden when new alert categories are implemented, circumventing the need for trial live activations of full alert category knowledge bases.
OBJECTIVE: The study sought to develop a criteria-based scoring tool for assessing drug-disease knowledge base content and creation of a subset and to implement the subset across multiple Kaiser Permanente (KP) regions. MATERIALS AND METHODS: In Phase I, the scoring tool was developed, used to create a drug-disease alert subset, and validated by surveying physicians and pharmacists from KP Northern California. In Phase II, KP enabled the alert subset in July 2015 in silent mode to collect alert firing rates and confirmed that alert burden was adequately reduced. The alert subset was subsequently rolled out to users in KP Northern California. Alert data was collected September 2015 to August 2016 to monitor relevancy and override rates. RESULTS: Drug-disease alert scoring identified 1211 of 4111 contraindicated drug-disease pairs for inclusion in the subset. The survey results showed clinician agreement with subset examples 92.3%-98.5% of the time. Postsurvey adjustments to the subset resulted in KP implementation of 1189 drug-disease alerts. The subset resulted in a decrease in monthly alerts from 32 045 to 1168. Postimplementation monthly physician alert acceptance rates ranged from 20.2% to 29.8%. DISCUSSION: Our study shows that drug-disease alert scoring resulted in an alert subset that generated acceptable interruptive alerts while decreasing overall potential alert burden. Following the initial testing and implementation in its Northern California region, KP successfully implemented the disease interaction subset in 4 regions with additional regions planned. CONCLUSIONS: Our approach could prevent undue alert burden when new alert categories are implemented, circumventing the need for trial live activations of full alert category knowledge bases.
Authors: Shobha Phansalkar; Amrita A Desai; Douglas Bell; Eileen Yoshida; John Doole; Melissa Czochanski; Blackford Middleton; David W Bates Journal: J Am Med Inform Assoc Date: 2012-04-26 Impact factor: 4.497
Authors: Nidhi R Shah; Andrew C Seger; Diane L Seger; Julie M Fiskio; Gilad J Kuperman; Barry Blumenfeld; Elaine G Recklet; David W Bates; Tejal K Gandhi Journal: J Am Med Inform Assoc Date: 2005-10-12 Impact factor: 4.497
Authors: Benjamin R Kummer; Joshua Z Willey; Michael J Zelenetz; Yiping Hu; Soumitra Sengupta; Mitchell S V Elkind; George Hripcsak Journal: Appl Clin Inform Date: 2019-11-06 Impact factor: 2.342