BACKGROUND: Clinical decision support systems can prevent knowledge-based prescription errors and improve patient outcomes. The clinical effectiveness of these systems, however, is substantially limited by poor user acceptance of presented warnings. To enhance alert acceptance it may be useful to quantify the impact of potential modulators of acceptance. METHODS: We built a logistic regression model to predict alert acceptance of drug-drug interaction (DDI) alerts in three different settings. Ten variables from the clinical and human factors literature were evaluated as potential modulators of provider alert acceptance. ORs were calculated for the impact of knowledge quality, alert display, textual information, prioritization, setting, patient age, dose-dependent toxicity, alert frequency, alert level, and required acknowledgment on acceptance of the DDI alert. RESULTS: 50,788 DDI alerts were analyzed. Providers accepted only 1.4% of non-interruptive alerts. For interruptive alerts, user acceptance positively correlated with frequency of the alert (OR 1.30, 95% CI 1.23 to 1.38), quality of display (4.75, 3.87 to 5.84), and alert level (1.74, 1.63 to 1.86). Alert acceptance was higher in inpatients (2.63, 2.32 to 2.97) and for drugs with dose-dependent toxicity (1.13, 1.07 to 1.21). The textual information influenced the mode of reaction and providers were more likely to modify the prescription if the message contained detailed advice on how to manage the DDI. CONCLUSION: We evaluated potential modulators of alert acceptance by assessing content and human factors issues, and quantified the impact of a number of specific factors which influence alert acceptance. This information may help improve clinical decision support systems design.
BACKGROUND: Clinical decision support systems can prevent knowledge-based prescription errors and improve patient outcomes. The clinical effectiveness of these systems, however, is substantially limited by poor user acceptance of presented warnings. To enhance alert acceptance it may be useful to quantify the impact of potential modulators of acceptance. METHODS: We built a logistic regression model to predict alert acceptance of drug-drug interaction (DDI) alerts in three different settings. Ten variables from the clinical and human factors literature were evaluated as potential modulators of provider alert acceptance. ORs were calculated for the impact of knowledge quality, alert display, textual information, prioritization, setting, patient age, dose-dependent toxicity, alert frequency, alert level, and required acknowledgment on acceptance of the DDI alert. RESULTS: 50,788 DDI alerts were analyzed. Providers accepted only 1.4% of non-interruptive alerts. For interruptive alerts, user acceptance positively correlated with frequency of the alert (OR 1.30, 95% CI 1.23 to 1.38), quality of display (4.75, 3.87 to 5.84), and alert level (1.74, 1.63 to 1.86). Alert acceptance was higher in inpatients (2.63, 2.32 to 2.97) and for drugs with dose-dependent toxicity (1.13, 1.07 to 1.21). The textual information influenced the mode of reaction and providers were more likely to modify the prescription if the message contained detailed advice on how to manage the DDI. CONCLUSION: We evaluated potential modulators of alert acceptance by assessing content and human factors issues, and quantified the impact of a number of specific factors which influence alert acceptance. This information may help improve clinical decision support systems design.
Authors: Shobha Phansalkar; Judy Edworthy; Elizabeth Hellier; Diane L Seger; Angela Schedlbauer; Anthony J Avery; David W Bates Journal: J Am Med Inform Assoc Date: 2010 Sep-Oct Impact factor: 4.497
Authors: Heleen van der Sijs; Laureen Lammers; Annemieke van den Tweel; Jos Aarts; Marc Berg; Arnold Vulto; Teun van Gelder Journal: J Am Med Inform Assoc Date: 2009-08-28 Impact factor: 4.497
Authors: H M Seidling; S P W Schmitt; T Bruckner; J Kaltschmidt; M G Pruszydlo; C Senger; T Bertsche; I Walter-Sack; W E Haefeli Journal: Qual Saf Health Care Date: 2010-04-27
Authors: Ashly D Black; Josip Car; Claudia Pagliari; Chantelle Anandan; Kathrin Cresswell; Tomislav Bokun; Brian McKinstry; Rob Procter; Azeem Majeed; Aziz Sheikh Journal: PLoS Med Date: 2011-01-18 Impact factor: 11.069
Authors: Marianne Zachariah; Shobha Phansalkar; Hanna M Seidling; Pamela M Neri; Kathrin M Cresswell; Jon Duke; Meryl Bloomrosen; Lynn A Volk; David W Bates Journal: J Am Med Inform Assoc Date: 2011-09-21 Impact factor: 4.497
Authors: Gregory P T Scott; Priya Shah; Jeremy C Wyatt; Boikanyo Makubate; Frank W Cross Journal: J Am Med Inform Assoc Date: 2011-08-11 Impact factor: 4.497
Authors: Patrick E Beeler; E John Orav; Diane L Seger; Patricia C Dykes; David W Bates Journal: J Am Med Inform Assoc Date: 2015-10-24 Impact factor: 4.497
Authors: Alissa L Russ; Alan J Zillich; Brittany L Melton; Scott A Russell; Siying Chen; Jeffrey R Spina; Michael Weiner; Elizabette G Johnson; Joanne K Daggy; M Sue McManus; Jason M Hawsey; Anthony G Puleo; Bradley N Doebbeling; Jason J Saleem Journal: J Am Med Inform Assoc Date: 2014-03-25 Impact factor: 4.497
Authors: Shobha Phansalkar; Marianne Zachariah; Hanna M Seidling; Chantal Mendes; Lynn Volk; David W Bates Journal: J Am Med Inform Assoc Date: 2014-04-29 Impact factor: 4.497
Authors: Katherine N Cahill; Christina B Johns; Jing Cui; Paige Wickner; David W Bates; Tanya M Laidlaw; Patrick E Beeler Journal: J Allergy Clin Immunol Date: 2016-07-25 Impact factor: 10.793