Jason J Saleem1, William R Plew2, Ross C Speir2, Jennifer Herout2, Nancy R Wilck2, Dale Marie Ryan3, Theresa A Cullen4, Jean M Scott5, Murielle S Beene3, Toni Phillips3. 1. Human Factors Engineering, Health Informatics, Office of Informatics and Analytics, Veterans Health Administration, Washington, DC, USA; Department of Industrial Engineering, University of Louisville, Louisville, KY, USA. Electronic address: jason.saleem@louisville.edu. 2. Human Factors Engineering, Health Informatics, Office of Informatics and Analytics, Veterans Health Administration, Washington, DC, USA. 3. Office of the Chief of Nursing Informatics, Health Informatics, Office of Informatics and Analytics, Veterans Health Administration, Washington, DC, USA. 4. Health Informatics, Office of Informatics and Analytics, Veterans Health Administration, Washington, DC, USA. 5. Informatics Patient Safety, Health Informatics, Office of Informatics and Analytics, Veterans Health Administration, Washington, DC, USA.
Abstract
OBJECTIVE: This study evaluated the current use of commercial-off-the-shelf Clinical Information Systems (CIS) for intensive care units (ICUs) and Anesthesia Record Keeping (ARK) for operating rooms and post-anesthesia care recovery settings at three Veterans Affairs Medical Centers (VAMCs). Clinicians and administrative staff use these applications at bedside workstations, in operating rooms, at nursing stations, in physician's rooms, and in other various settings. The intention of a CIS or an ARK system is to facilitate creation of electronic records of data, assessments, and procedures from multiple medical devices. The US Department of Veterans Affairs (VA) Office of the Chief of Nursing Informatics sought to understand usage barriers and facilitators to optimize these systems in the future. Therefore, a human factors study was carried out to observe the CIS and ARK systems in use at three VAMCs in order to identify best practices and suggested improvements to currently implemented CIS and ARK systems. METHODS: We conducted a rapid ethnographic study of clinical end-users interacting with the CIS and ARK systems in the critical care and anesthesia care areas in each of three geographically distributed VAMCs. Two observers recorded interactions and/or interview responses from 88 CIS and ARK end-users. We coded and sorted into logical categories field notes from 69 shadowed participants. The team transcribed and combined data from key informant interviews with 19 additional participants with the observation data. We then integrated findings across observations into meaningful patterns and abstracted the data into themes, which translated directly to barriers to effective adoption and optimization of the CIS and ARK systems. RESULTS: Effective optimization of the CIS and ARK systems was impeded by: (1) integration issues with other software systems; (2) poor usability; (3) software challenges; (4) hardware challenges; (5) training concerns; (6) unclear roles and lack of coordination among stakeholders; and (7) insufficient technical support. Many of these barriers are multi-faceted and have associated sub-barriers, which are described in detail along with relevant quotes from participants. In addition, regionalized purchases of different CIS and ARK systems, as opposed to enterprise level purchases, contributed to some of the identified barriers. Facilitators to system use included (1) automation and (2) a dedicated facility-level CIS-ARK Coordinator. CONCLUSIONS: We identified barriers that explain some of the challenges with the optimization of the CIS and ARK commercial systems across the Veterans Health Administration (VHA). To help address these barriers, and evolve them into facilitators, we categorized report findings as (1) interface and system-level changes that vendors or VA healthcare systems can implement; (2) implementation factors under VA control and not under VA control; and (3) factors that may be used to inform future application purchases. We outline several recommendations for improved adoption of CIS and ARK systems and further recommend that human factors engineering and usability requirements become an integral part of VA health information technology (HIT) application procurement, customization, and implementation in order to help eliminate or mitigate some of the barriers of use identified in this study. Human factors engineering methods can be utilized to apply a user-centered approach to application requirements specification, application evaluation, system integration, and application implementation. Published by Elsevier Ireland Ltd.
OBJECTIVE: This study evaluated the current use of commercial-off-the-shelf Clinical Information Systems (CIS) for intensive care units (ICUs) and Anesthesia Record Keeping (ARK) for operating rooms and post-anesthesia care recovery settings at three Veterans Affairs Medical Centers (VAMCs). Clinicians and administrative staff use these applications at bedside workstations, in operating rooms, at nursing stations, in physician's rooms, and in other various settings. The intention of a CIS or an ARK system is to facilitate creation of electronic records of data, assessments, and procedures from multiple medical devices. The US Department of Veterans Affairs (VA) Office of the Chief of Nursing Informatics sought to understand usage barriers and facilitators to optimize these systems in the future. Therefore, a human factors study was carried out to observe the CIS and ARK systems in use at three VAMCs in order to identify best practices and suggested improvements to currently implemented CIS and ARK systems. METHODS: We conducted a rapid ethnographic study of clinical end-users interacting with the CIS and ARK systems in the critical care and anesthesia care areas in each of three geographically distributed VAMCs. Two observers recorded interactions and/or interview responses from 88 CIS and ARK end-users. We coded and sorted into logical categories field notes from 69 shadowed participants. The team transcribed and combined data from key informant interviews with 19 additional participants with the observation data. We then integrated findings across observations into meaningful patterns and abstracted the data into themes, which translated directly to barriers to effective adoption and optimization of the CIS and ARK systems. RESULTS: Effective optimization of the CIS and ARK systems was impeded by: (1) integration issues with other software systems; (2) poor usability; (3) software challenges; (4) hardware challenges; (5) training concerns; (6) unclear roles and lack of coordination among stakeholders; and (7) insufficient technical support. Many of these barriers are multi-faceted and have associated sub-barriers, which are described in detail along with relevant quotes from participants. In addition, regionalized purchases of different CIS and ARK systems, as opposed to enterprise level purchases, contributed to some of the identified barriers. Facilitators to system use included (1) automation and (2) a dedicated facility-level CIS-ARK Coordinator. CONCLUSIONS: We identified barriers that explain some of the challenges with the optimization of the CIS and ARK commercial systems across the Veterans Health Administration (VHA). To help address these barriers, and evolve them into facilitators, we categorized report findings as (1) interface and system-level changes that vendors or VA healthcare systems can implement; (2) implementation factors under VA control and not under VA control; and (3) factors that may be used to inform future application purchases. We outline several recommendations for improved adoption of CIS and ARK systems and further recommend that human factors engineering and usability requirements become an integral part of VA health information technology (HIT) application procurement, customization, and implementation in order to help eliminate or mitigate some of the barriers of use identified in this study. Human factors engineering methods can be utilized to apply a user-centered approach to application requirements specification, application evaluation, system integration, and application implementation. Published by Elsevier Ireland Ltd.
Entities:
Keywords:
Anesthesia Record Keeping (ARK); Clinical Information Systems (CIS); Human factors engineering; Intensive care units (ICUs); Sociotechnical systems; Usability; User centered design
Authors: Joan S Ash; Dean F Sittig; Richard H Dykstra; Kenneth Guappone; James D Carpenter; Veena Seshadri Journal: Int J Med Inform Date: 2006-06-21 Impact factor: 4.046
Authors: Johanna I Westbrook; Jeffrey Braithwaite; Andrew Georgiou; Amanda Ampt; Nerida Creswick; Enrico Coiera; Rick Iedema Journal: J Am Med Inform Assoc Date: 2007-08-21 Impact factor: 4.497
Authors: Pascale Carayon; Randi Cartmill; Mary Ann Blosky; Roger Brown; Matthew Hackenberg; Peter Hoonakker; Ann Schoofs Hundt; Evan Norfolk; Tosha B Wetterneck; James M Walker Journal: J Am Med Inform Assoc Date: 2011-06-22 Impact factor: 4.497
Authors: Alissa L Russ; Rollin J Fairbanks; Ben-Tzion Karsh; Laura G Militello; Jason J Saleem; Robert L Wears Journal: BMJ Qual Saf Date: 2013-04-16 Impact factor: 7.035
Authors: Rubina F Rizvi; Kathleen A Harder; Gretchen M Hultman; Terrence J Adam; Michael Kim; Serguei V S Pakhomov; Genevieve B Melton Journal: Int J Med Inform Date: 2016-03-02 Impact factor: 4.046
Authors: Chelsea Leonard; Heather Gilmartin; Marina McCreight; Lynette Kelley; Brandi Lippmann; Ashlea Mayberry; Andrew Coy; Emily Lawrence; Robert E Burke Journal: J Gen Intern Med Date: 2019-05 Impact factor: 5.128
Authors: Luisa Flohr; Shaylene Beaudry; K Taneille Johnson; Nicholas West; Catherine M Burns; J Mark Ansermino; Guy A Dumont; David Wensley; Peter Skippen; Matthias Gorges Journal: IEEE J Transl Eng Health Med Date: 2018-03-05 Impact factor: 3.316
Authors: Johanna L van Gaalen; Leti van Bodegom-Vos; Moira J Bakker; Jiska B Snoeck-Stroband; Jacob K Sont Journal: BMJ Open Date: 2016-08-26 Impact factor: 2.692
Authors: Gillian Strudwick; Richard G Booth; Ragnhildur I Bjarnadottir; Sarah Collins; Rani Srivastava Journal: BMJ Open Date: 2017-10-12 Impact factor: 2.692