Kristen Miller1, Muge Capan2, Danielle Weldon3, Yaman Noaiseh4, Rebecca Kowalski3, Rachel Kraft5, Sanford Schwartz6, William S Weintraub7, Ryan Arnold8. 1. National Center for Human Factors in Healthcare, MedStar Health, Washington, DC, USA. Electronic address: Kristen.E.Miller@medstar.net. 2. Decision Sciences & MIS Department, LeBow College of Business, Drexel University, Philadelphia, PA, USA. 3. National Center for Human Factors in Healthcare, MedStar Health, Washington, DC, USA. 4. College of Computing and Informatics, Drexel University, Philadelphia, PA, USA. 5. College of Engineering, University of Delaware, Newark, DE, USA. 6. Health Care Management, University of Pennsylvania, Wharton, Philadelphia, PA, USA. 7. MedStar Washington Hospital Center, MedStar Health, Washington, DC, USA. 8. Department of Emergency Medicine, Drexel University School of Medicine, Philadelphia, PA, USA.
Abstract
OBJECTIVE: While general design heuristics exist for graphic user interfaces, it remains a challenge to facilitate the implementation of these heuristics for the design of clinical decision support. Our goals were to map a set of recommendations for clinical decision support design found in current literature to Jakob Nielsen's traditional usability heuristics and to suggest usability areas that need more investigation. MATERIALS AND METHODS: Using a modified nominal group process, the research team discussed, classified, and mapped recommendations, organized as interface, information, and interaction, to design heuristics. A previous narrative review identified 42 recommendations from the literature to define the design and functional characteristics that impact the performance of CDS in terms of provider preference, process of care, and patient outcomes. MAIN FINDINGS: We matched 20 out of 42 recommendations to heuristics. The mapping reveals gaps in both heuristics and recommendations, identifying a set of Nielsen's heuristics that are underrepresented in the literature and subsets of recommendations important to design not covered in Nielsen's heuristics. We attributed this, in part, to the evolution of technology since the inception of Nielsen's heuristics. The team created a new interaction heuristic: Integration into real-time workflow to consider the needs of the end-user in the clinical space. DISCUSSION: Clinical decision support has enabled clinicians to better address arising information needs; however there remains a lack of evidence-based guidelines in terms of functional and design requirements. CONCLUSION: Results from this review suggest that interaction design principles were not fully satisfied by the current literature of clinical decision support.
OBJECTIVE: While general design heuristics exist for graphic user interfaces, it remains a challenge to facilitate the implementation of these heuristics for the design of clinical decision support. Our goals were to map a set of recommendations for clinical decision support design found in current literature to Jakob Nielsen's traditional usability heuristics and to suggest usability areas that need more investigation. MATERIALS AND METHODS: Using a modified nominal group process, the research team discussed, classified, and mapped recommendations, organized as interface, information, and interaction, to design heuristics. A previous narrative review identified 42 recommendations from the literature to define the design and functional characteristics that impact the performance of CDS in terms of provider preference, process of care, and patient outcomes. MAIN FINDINGS: We matched 20 out of 42 recommendations to heuristics. The mapping reveals gaps in both heuristics and recommendations, identifying a set of Nielsen's heuristics that are underrepresented in the literature and subsets of recommendations important to design not covered in Nielsen's heuristics. We attributed this, in part, to the evolution of technology since the inception of Nielsen's heuristics. The team created a new interaction heuristic: Integration into real-time workflow to consider the needs of the end-user in the clinical space. DISCUSSION: Clinical decision support has enabled clinicians to better address arising information needs; however there remains a lack of evidence-based guidelines in terms of functional and design requirements. CONCLUSION: Results from this review suggest that interaction design principles were not fully satisfied by the current literature of clinical decision support.
Authors: Shobha Phansalkar; Judy Edworthy; Elizabeth Hellier; Diane L Seger; Angela Schedlbauer; Anthony J Avery; David W Bates Journal: J Am Med Inform Assoc Date: 2010 Sep-Oct Impact factor: 4.497
Authors: Anne Miller; Brian Moon; Shilo Anders; Rachel Walden; Steven Brown; Diane Montella Journal: Int J Med Inform Date: 2015-09-14 Impact factor: 4.046
Authors: Saverio M Maviglia; Rita D Zielstorff; Marilyn Paterno; Jonathan M Teich; David W Bates; Gilad J Kuperman Journal: J Am Med Inform Assoc Date: 2003 Mar-Apr Impact factor: 4.497
Authors: M H Trivedi; J K Kern; A Marcee; B Grannemann; B Kleiber; T Bettinger; K Z Altshuler; A McClelland Journal: Methods Inf Med Date: 2002 Impact factor: 2.176
Authors: Jessica M Ray; Raj M Ratwani; Christine A Sinsky; Richard M Frankel; Mark W Friedberg; Seth M Powsner; David I Rosenthal; Robert M Wachter; Edward R Melnick Journal: J Am Med Inform Assoc Date: 2019-10-01 Impact factor: 4.497
Authors: Pascale Carayon; Peter Hoonakker; Ann Schoofs Hundt; Megan Salwei; Douglas Wiegmann; Roger L Brown; Peter Kleinschmidt; Clair Novak; Michael Pulia; Yudi Wang; Emily Wirkus; Brian Patterson Journal: BMJ Qual Saf Date: 2019-11-27 Impact factor: 7.035
Authors: Olivia Nelson; Brian Sturgis; Keri Gilbert; Elizabeth Henry; Kelly Clegg; Jonathan M Tan; Jack O Wasey; Allan F Simpao; Jorge A Gálvez Journal: Appl Clin Inform Date: 2019-08-07 Impact factor: 2.342
Authors: Juan D Chaparro; Jonathan M Beus; Adam C Dziorny; Philip A Hagedorn; Sean Hernandez; Swaminathan Kandaswamy; Eric S Kirkendall; Allison B McCoy; Naveen Muthu; Evan W Orenstein Journal: Appl Clin Inform Date: 2022-05-25 Impact factor: 2.762
Authors: Alanna Kulchak Rahm; Nephi A Walton; Lynn K Feldman; Conner Jenkins; Troy Jenkins; Thomas N Person; Joeseph Peterson; Jonathon C Reynolds; Peter N Robinson; Makenzie A Woltz; Marc S Williams; Michael M Segal Journal: BMJ Health Care Inform Date: 2021-05
Authors: Margie E Snyder; Omolola A Adeoye-Olatunde; Stephanie A Gernant; Julie DiIulio; Heather A Jaynes; William R Doucette; Alissa L Russ-Jara Journal: Res Social Adm Pharm Date: 2020-11-04
Authors: Jasmeet S Dhaliwal; Foster Goss; Melanie D Whittington; Kelly Bookman; P Michael Ho; Richard Zane; Jennifer Wiler Journal: J Am Coll Emerg Physicians Open Date: 2020-11-17