Alissa L Russ1, Alan J Zillich1, Brittany L Melton2, Scott A Russell3, Siying Chen3, Jeffrey R Spina4, Michael Weiner5, Elizabette G Johnson6, Joanne K Daggy7, M Sue McManus8, Jason M Hawsey9, Anthony G Puleo10, Bradley N Doebbeling11, Jason J Saleem12. 1. Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA Indiana University Center for Health Services and Outcomes Research and Regenstrief Institute, Inc., Indianapolis, Indiana, USA College of Pharmacy, Purdue University, West Lafayette, Indiana, USA. 2. School of Pharmacy, University of Kansas, Lawrence, Kansas, USA. 3. Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA. 4. Department of Veterans Affairs, VA Greater Los Angeles Healthcare System, Los Angeles, California, USA David Geffen School of Medicine, University of California, Los Angeles, California, USA. 5. Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA Indiana University Center for Health Services and Outcomes Research and Regenstrief Institute, Inc., Indianapolis, Indiana, USA Department of Medicine, Indiana University School of Medicine, Indianapolis, Indiana, USA. 6. Department of Psychology, Purdue University, West Lafayette, Indiana, USA. 7. Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA Department of Biostatistics, Indiana University School of Medicine, Indianapolis, Indiana, USA. 8. Department of Nephrology Services, Department of Veterans Affairs, Temple, Texas, USA. 9. Department of Veterans Affairs, Office of Information, Bay Pines, Florida, USA. 10. Department of Veterans Affairs, Office of Information, Salt Lake City, Utah, USA. 11. Center for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA Indiana University Center for Health Services and Outcomes Research and Regenstrief Institute, Inc., Indianapolis, Indiana, USA Department of BioHealth Informatics, School of Informatics and Computing, Indiana University-Purdue University, Indianapolis, Indiana, USA. 12. Human Factors Engineering, Office of Informatics and Analytics, Veterans Health Administration, Louisville, Kentucky, USA.
Abstract
OBJECTIVE: To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. MATERIALS AND METHODS: We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. RESULTS: Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). DISCUSSION: Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. CONCLUSIONS: This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
OBJECTIVE: To apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. MATERIALS AND METHODS: We performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors. RESULTS: Although prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). DISCUSSION: Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts. CONCLUSIONS: This simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
Authors: Marilyn D Paterno; Saverio M Maviglia; Paul N Gorman; Diane L Seger; Eileen Yoshida; Andrew C Seger; David W Bates; Tejal K Gandhi Journal: J Am Med Inform Assoc Date: 2008-10-24 Impact factor: 4.497
Authors: Helen G Lo; Michael E Matheny; Diane L Seger; David W Bates; Tejal K Gandhi Journal: J Am Med Inform Assoc Date: 2008-10-24 Impact factor: 4.497
Authors: Pascale Carayon; Peter Hoonakker; Ann Schoofs Hundt; Megan Salwei; Douglas Wiegmann; Roger L Brown; Peter Kleinschmidt; Clair Novak; Michael Pulia; Yudi Wang; Emily Wirkus; Brian Patterson Journal: BMJ Qual Saf Date: 2019-11-27 Impact factor: 7.035
Authors: Robert P Pierce; Bernie R Eskridge; LeAnn Rehard; Brandi Ross; Margaret A Day; Jeffery L Belden Journal: Appl Clin Inform Date: 2020-09-09 Impact factor: 2.342
Authors: Julian Brunner; Emmeline Chuang; Caroline Goldzweig; Cindy L Cain; Catherine Sugar; Elizabeth M Yano Journal: Int J Med Inform Date: 2017-05-10 Impact factor: 4.046
Authors: Mustafa I Hussain; Ariana M Nelson; Brent G Yeung; Lauren Sukumar; Kai Zheng Journal: J Am Med Inform Assoc Date: 2020-04-01 Impact factor: 4.497
Authors: Lukasz M Mazur; Prithima R Mosaly; Carlton Moore; Elizabeth Comitz; Fei Yu; Aaron D Falchook; Michael J Eblan; Lesley M Hoyle; Gregg Tracton; Bhishamjit S Chera; Lawrence B Marks Journal: J Am Med Inform Assoc Date: 2016-03-28 Impact factor: 4.497