OBJECTIVE: Expert authorities recommend clinical decision support systems to reduce prescribing error rates, yet large numbers of insignificant on-screen alerts presented in modal dialog boxes persistently interrupt clinicians, limiting the effectiveness of these systems. This study compared the impact of modal and non-modal electronic (e-) prescribing alerts on prescribing error rates, to help inform the design of clinical decision support systems. DESIGN: A randomized study of 24 junior doctors each performing 30 simulated prescribing tasks in random order with a prototype e-prescribing system. Using a within-participant design, doctors were randomized to be shown one of three types of e-prescribing alert (modal, non-modal, no alert) during each prescribing task. MEASUREMENTS: The main outcome measure was prescribing error rate. Structured interviews were performed to elicit participants' preferences for the prescribing alerts and their views on clinical decision support systems. RESULTS: Participants exposed to modal alerts were 11.6 times less likely to make a prescribing error than those not shown an alert (OR 11.56, 95% CI 6.00 to 22.26). Those shown a non-modal alert were 3.2 times less likely to make a prescribing error (OR 3.18, 95% CI 1.91 to 5.30) than those not shown an alert. The error rate with non-modal alerts was 3.6 times higher than with modal alerts (95% CI 1.88 to 7.04). CONCLUSIONS: Both kinds of e-prescribing alerts significantly reduced prescribing error rates, but modal alerts were over three times more effective than non-modal alerts. This study provides new evidence about the relative effects of modal and non-modal alerts on prescribing outcomes.
RCT Entities:
OBJECTIVE: Expert authorities recommend clinical decision support systems to reduce prescribing error rates, yet large numbers of insignificant on-screen alerts presented in modal dialog boxes persistently interrupt clinicians, limiting the effectiveness of these systems. This study compared the impact of modal and non-modal electronic (e-) prescribing alerts on prescribing error rates, to help inform the design of clinical decision support systems. DESIGN: A randomized study of 24 junior doctors each performing 30 simulated prescribing tasks in random order with a prototype e-prescribing system. Using a within-participant design, doctors were randomized to be shown one of three types of e-prescribing alert (modal, non-modal, no alert) during each prescribing task. MEASUREMENTS: The main outcome measure was prescribing error rate. Structured interviews were performed to elicit participants' preferences for the prescribing alerts and their views on clinical decision support systems. RESULTS:Participants exposed to modal alerts were 11.6 times less likely to make a prescribing error than those not shown an alert (OR 11.56, 95% CI 6.00 to 22.26). Those shown a non-modal alert were 3.2 times less likely to make a prescribing error (OR 3.18, 95% CI 1.91 to 5.30) than those not shown an alert. The error rate with non-modal alerts was 3.6 times higher than with modal alerts (95% CI 1.88 to 7.04). CONCLUSIONS: Both kinds of e-prescribing alerts significantly reduced prescribing error rates, but modal alerts were over three times more effective than non-modal alerts. This study provides new evidence about the relative effects of modal and non-modal alerts on prescribing outcomes.
Authors: Hanna M Seidling; Shobha Phansalkar; Diane L Seger; Marilyn D Paterno; Shimon Shaykevich; Walter E Haefeli; David W Bates Journal: J Am Med Inform Assoc Date: 2011-05-12 Impact factor: 4.497
Authors: D W Bates; J M Teich; J Lee; D Seger; G J Kuperman; N Ma'Luf; D Boyle; L Leape Journal: J Am Med Inform Assoc Date: 1999 Jul-Aug Impact factor: 4.497
Authors: Alissa L Russ; Alan J Zillich; Brittany L Melton; Scott A Russell; Siying Chen; Jeffrey R Spina; Michael Weiner; Elizabette G Johnson; Joanne K Daggy; M Sue McManus; Jason M Hawsey; Anthony G Puleo; Bradley N Doebbeling; Jason J Saleem Journal: J Am Med Inform Assoc Date: 2014-03-25 Impact factor: 4.497
Authors: Magaly Ramirez; Richard Maranon; Jeffery Fu; Janet S Chon; Kimberly Chen; Carol M Mangione; Gerardo Moreno; Douglas S Bell Journal: J Am Med Inform Assoc Date: 2018-09-01 Impact factor: 4.497
Authors: Pamala A Pawloski; Gabriel A Brooks; Matthew E Nielsen; Barbara A Olson-Bullis Journal: J Natl Compr Canc Netw Date: 2019-04-01 Impact factor: 11.908
Authors: Emily Beth Devine; Chia-Ju Lee; Casey L Overby; Neil Abernethy; Jeannine McCune; Joe W Smith; Peter Tarczy-Hornoch Journal: Int J Med Inform Date: 2014-05-09 Impact factor: 4.046