April Savoy1, Laura G Militello2, Himalaya Patel3, Mindy E Flanagan4, Alissa L Russ5, Joanne K Daggy4, Michael Weiner6, Jason J Saleem7. 1. Center for Health Information and Communication (CIN 13-416), U.S Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service, Richard L. Roudebush VA Medical Center, Indianapolis, IN, USA; Regenstrief Institute, Inc., Indianapolis, IN, USA; Department of Computer Information and Graphics Technology, Purdue School of Engineering and Technology, Indianapolis University-Purdue University, Indianapolis, IN, USA. Electronic address: april.savoy@va.gov. 2. Applied Decision Science, LLC, Dayton, OH, USA. 3. Center for Health Information and Communication (CIN 13-416), U.S Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service, Richard L. Roudebush VA Medical Center, Indianapolis, IN, USA. 4. Indiana University School of Medicine, Indianapolis, IN, USA. 5. Center for Health Information and Communication (CIN 13-416), U.S Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service, Richard L. Roudebush VA Medical Center, Indianapolis, IN, USA; Department of Pharmacy Practice, College of Pharmacy, Purdue University, West Lafayette, IN, USA. 6. Center for Health Information and Communication (CIN 13-416), U.S Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service, Richard L. Roudebush VA Medical Center, Indianapolis, IN, USA; Regenstrief Institute, Inc., Indianapolis, IN, USA; Indiana University School of Medicine, Indianapolis, IN, USA. 7. Department of Industrial Engineering, J.B. Speed School of Engineering, University of Louisville, Louisville, KY, USA.
Abstract
BACKGROUND: During medical referrals, communication barriers between referring and consulting outpatient clinics delay patients' access to health care. One notable opportunity for reducing these barriers is improved usefulness and usability of electronic medical consultation order forms. The cognitive systems engineering (CSE) design approach focuses on supporting humans in managing cognitive complexity in sociotechnical systems. Cognitive complexity includes communication, decision-making, problem solving, and planning. OBJECTIVE: The objective of this research was to implement a CSE design approach to develop a template that supports the cognitive needs of referring clinicians and improves referral communication. METHODS: We conducted interviews and observations with primary care providers and specialists at two major tertiary, urban medical facilities. Using qualitative analysis, we identified cognitive requirements and design guidelines. Next, we designed user interface (UI) prototypes and compared their usability with that of a currently implemented UI at a major Midwestern medical facility. RESULTS: Physicians' cognitive challenges were summarized in four cognitive requirements and 13 design guidelines. As a result, two UI prototypes were developed to support order template search and completion. To compare UIs, 30 clinicians (referrers) participated in a consultation ordering simulation complemented with the think-aloud elicitation method. Oral comments about the UIs were coded for both content and valence (i.e., positive, neutral, or negative). Across 619 comments, the odds ratio for the UI prototype to elicit higher-valenced comments than the implemented UI was 13.5 (95% CI = [9.2, 19.8]), p < .001. CONCLUSION: This study reinforced the significance of applying a CSE design approach to inform the design of health information technology. In addition, knowledge elicitation methods enabled identification of physicians' cognitive requirements and challenges when completing electronic medical consultation orders. The resultant knowledge was used to derive design guidelines and UI prototypes that were more useful and usable for referring physicians. Our results support the implementation of a CSE design approach for electronic medical consultation orders. Published by Elsevier Inc.
BACKGROUND: During medical referrals, communication barriers between referring and consulting outpatient clinics delay patients' access to health care. One notable opportunity for reducing these barriers is improved usefulness and usability of electronic medical consultation order forms. The cognitive systems engineering (CSE) design approach focuses on supporting humans in managing cognitive complexity in sociotechnical systems. Cognitive complexity includes communication, decision-making, problem solving, and planning. OBJECTIVE: The objective of this research was to implement a CSE design approach to develop a template that supports the cognitive needs of referring clinicians and improves referral communication. METHODS: We conducted interviews and observations with primary care providers and specialists at two major tertiary, urban medical facilities. Using qualitative analysis, we identified cognitive requirements and design guidelines. Next, we designed user interface (UI) prototypes and compared their usability with that of a currently implemented UI at a major Midwestern medical facility. RESULTS: Physicians' cognitive challenges were summarized in four cognitive requirements and 13 design guidelines. As a result, two UI prototypes were developed to support order template search and completion. To compare UIs, 30 clinicians (referrers) participated in a consultation ordering simulation complemented with the think-aloud elicitation method. Oral comments about the UIs were coded for both content and valence (i.e., positive, neutral, or negative). Across 619 comments, the odds ratio for the UI prototype to elicit higher-valenced comments than the implemented UI was 13.5 (95% CI = [9.2, 19.8]), p < .001. CONCLUSION: This study reinforced the significance of applying a CSE design approach to inform the design of health information technology. In addition, knowledge elicitation methods enabled identification of physicians' cognitive requirements and challenges when completing electronic medical consultation orders. The resultant knowledge was used to derive design guidelines and UI prototypes that were more useful and usable for referring physicians. Our results support the implementation of a CSE design approach for electronic medical consultation orders. Published by Elsevier Inc.
Entities:
Keywords:
Cognitive systems engineering; Human factors; Medical order entry systems; Referral and consultation; Usability evaluation
Authors: Christopher A Harle; Julie DiIulio; Sarah M Downs; Elizabeth C Danielson; Shilo Anders; Robert L Cook; Robert W Hurley; Burke W Mamlin; Laura G Militello Journal: Appl Clin Inform Date: 2019-09-25 Impact factor: 2.342
Authors: Priya H Marathe; Hao Zhang; Liz Blackler; Peter D Stetson; Louis P Voigt; Danielle Novetsky Friedman Journal: JCO Oncol Pract Date: 2022-06-24
Authors: Christina L Cifra; Cody R Tigges; Sarah L Miller; Nathaniel Curl; Christopher D Monson; Kimberly C Dukes; Heather S Reisinger; Priyadarshini R Pennathur; Dean F Sittig; Hardeep Singh Journal: Appl Clin Inform Date: 2022-05-11 Impact factor: 2.762