Kai Zheng1, Rema Padman, Michael P Johnson, Herbert S Diamond. 1. School of Public Health, Department of Health Management and Policy, The University of Michigan, M3531 SPH II, 109 Observatory Street, Ann Arbor, MI 48109-2029, USA. kzheng@umich.edu
Abstract
OBJECTIVES: This study sought to investigate user interactions with an electronic health records (EHR) system by uncovering hidden navigational patterns in the EHR usage data automatically recorded as clinicians navigated through the system's software user interface (UI) to perform different clinical tasks. DESIGN: A homegrown EHR was adapted to allow real-time capture of comprehensive UI interaction events. These events, constituting time-stamped event sequences, were used to replay how the EHR was used in actual patient care settings. The study site is an ambulatory primary care clinic at an urban teaching hospital. Internal medicine residents were the primary EHR users. MEASUREMENTS: Computer-recorded event sequences reflecting the order in which different EHR features were sequentially accessed. METHODS: We apply sequential pattern analysis (SPA) and a first-order Markov chain model to uncover recurring UI navigational patterns. RESULTS: Of 17 main EHR features provided in the system, SPA identified 3 bundled features: "Assessment and Plan" and "Diagnosis," "Order" and "Medication," and "Order" and "Laboratory Test." Clinicians often accessed these paired features in a bundle together in a continuous sequence. The Markov chain analysis revealed a global navigational pathway, suggesting an overall sequential order of EHR feature accesses. "History of Present Illness" followed by "Social History" and then "Assessment and Plan" was identified as an example of such global navigational pathways commonly traversed by the EHR users. CONCLUSION: Users showed consistent UI navigational patterns, some of which were not anticipated by system designers or the clinic management. Awareness of such unanticipated patterns may help identify undesirable user behavior as well as reengineering opportunities for improving the system's usability.
OBJECTIVES: This study sought to investigate user interactions with an electronic health records (EHR) system by uncovering hidden navigational patterns in the EHR usage data automatically recorded as clinicians navigated through the system's software user interface (UI) to perform different clinical tasks. DESIGN: A homegrown EHR was adapted to allow real-time capture of comprehensive UI interaction events. These events, constituting time-stamped event sequences, were used to replay how the EHR was used in actual patient care settings. The study site is an ambulatory primary care clinic at an urban teaching hospital. Internal medicine residents were the primary EHR users. MEASUREMENTS: Computer-recorded event sequences reflecting the order in which different EHR features were sequentially accessed. METHODS: We apply sequential pattern analysis (SPA) and a first-order Markov chain model to uncover recurring UI navigational patterns. RESULTS: Of 17 main EHR features provided in the system, SPA identified 3 bundled features: "Assessment and Plan" and "Diagnosis," "Order" and "Medication," and "Order" and "Laboratory Test." Clinicians often accessed these paired features in a bundle together in a continuous sequence. The Markov chain analysis revealed a global navigational pathway, suggesting an overall sequential order of EHR feature accesses. "History of Present Illness" followed by "Social History" and then "Assessment and Plan" was identified as an example of such global navigational pathways commonly traversed by the EHR users. CONCLUSION: Users showed consistent UI navigational patterns, some of which were not anticipated by system designers or the clinic management. Awareness of such unanticipated patterns may help identify undesirable user behavior as well as reengineering opportunities for improving the system's usability.
Authors: Alan F Rose; Jeffrey L Schnipper; Elyse R Park; Eric G Poon; Qi Li; Blackford Middleton Journal: J Biomed Inform Date: 2005-02 Impact factor: 6.317
Authors: Kai Zheng; Hilary M Haftel; Ronald B Hirschl; Michael O'Reilly; David A Hanauer Journal: J Am Med Inform Assoc Date: 2010 Jul-Aug Impact factor: 4.497
Authors: Mary Regina Boland; Alexander Rusanov; Yat So; Carlos Lopez-Jimenez; Linda Busacca; Richard C Steinman; Suzanne Bakken; J Thomas Bigger; Chunhua Weng Journal: J Biomed Inform Date: 2013-12-12 Impact factor: 6.317
Authors: Logan Kendall; Predrag Klasnja; Justin Iwasaki; Jennifer A Best; Andrew A White; Sahar Khalaj; Chris Amdahl; Katherine Blondon Journal: AMIA Annu Symp Proc Date: 2013-11-16