Amrita Sinha1, Lindsay A Stevens2, Felice Su1, Natalie M Pageler1,3, Daniel S Tawfik1. 1. Division of Pediatric Critical Care Medicine, Department of Pediatrics, Stanford University School of Medicine, Stanford, California, United States. 2. Division of General Pediatrics, Department of Pediatrics, Stanford University School of Medicine, Stanford, California, United States. 3. Division of Biomedical Informatics Research, Department of Medicine, Stanford University School of Medicine, Stanford, California, United States.
Abstract
BACKGROUND: Time spent in the electronic health record (EHR) has been identified as an important unit of measure for health care provider clinical activity. The lack of validation of audit-log based inpatient EHR time may have resulted in underuse of this data in studies focusing on inpatient patient outcomes, provider efficiency, provider satisfaction, etc. This has also led to a dearth of clinically relevant EHR usage metrics consistent with inpatient provider clinical activity. OBJECTIVE: The aim of our study was to validate audit-log based EHR times using observed EHR-times extracted from screen recordings of EHR usage in the inpatient setting. METHODS: This study was conducted in a 36-bed pediatric intensive care unit (PICU) at Lucile Packard Children's Hospital Stanford between June 11 and July 14, 2020. Attending physicians, fellow physicians, hospitalists, and advanced practice providers with ≥0.5 full-time equivalent (FTE) for the prior four consecutive weeks and at least one EHR session recording were included in the study. Citrix session recording player was used to retrospectively review EHR session recordings that were captured as the provider interacted with the EHR. RESULTS: EHR use patterns varied by provider type. Audit-log based total EHR time correlated strongly with both observed total EHR time (r = 0.98, p < 0.001) and observed active EHR time (r = 0.95, p < 0.001). Each minute of audit-log based total EHR time corresponded to 0.95 (0.87-1.02) minutes of observed total EHR time and 0.75 (0.67-0.83) minutes of observed active EHR time. Results were similar when stratified by provider role. CONCLUSION: Our study found inpatient audit-log based EHR time to correlate strongly with observed EHR time among pediatric critical care providers. These findings support the use of audit-log based EHR-time as a surrogate measure for inpatient provider EHR use, providing an opportunity for researchers and other stakeholders to leverage EHR audit-log data in measuring clinical activity and tracking outcomes of workflow improvement efforts longitudinally and across provider groups. Thieme. All rights reserved.
BACKGROUND: Time spent in the electronic health record (EHR) has been identified as an important unit of measure for health care provider clinical activity. The lack of validation of audit-log based inpatient EHR time may have resulted in underuse of this data in studies focusing on inpatient patient outcomes, provider efficiency, provider satisfaction, etc. This has also led to a dearth of clinically relevant EHR usage metrics consistent with inpatient provider clinical activity. OBJECTIVE: The aim of our study was to validate audit-log based EHR times using observed EHR-times extracted from screen recordings of EHR usage in the inpatient setting. METHODS: This study was conducted in a 36-bed pediatric intensive care unit (PICU) at Lucile Packard Children's Hospital Stanford between June 11 and July 14, 2020. Attending physicians, fellow physicians, hospitalists, and advanced practice providers with ≥0.5 full-time equivalent (FTE) for the prior four consecutive weeks and at least one EHR session recording were included in the study. Citrix session recording player was used to retrospectively review EHR session recordings that were captured as the provider interacted with the EHR. RESULTS: EHR use patterns varied by provider type. Audit-log based total EHR time correlated strongly with both observed total EHR time (r = 0.98, p < 0.001) and observed active EHR time (r = 0.95, p < 0.001). Each minute of audit-log based total EHR time corresponded to 0.95 (0.87-1.02) minutes of observed total EHR time and 0.75 (0.67-0.83) minutes of observed active EHR time. Results were similar when stratified by provider role. CONCLUSION: Our study found inpatient audit-log based EHR time to correlate strongly with observed EHR time among pediatric critical care providers. These findings support the use of audit-log based EHR-time as a surrogate measure for inpatient provider EHR use, providing an opportunity for researchers and other stakeholders to leverage EHR audit-log data in measuring clinical activity and tracking outcomes of workflow improvement efforts longitudinally and across provider groups. Thieme. All rights reserved.
Authors: Michelle R Hribar; Sarah Read-Brown; Leah Reznick; Lorinna Lombardi; Mansi Parikh; Thomas R Yackel; Michael F Chiang Journal: AMIA Annu Symp Proc Date: 2015-11-05
Authors: Brian G Arndt; John W Beasley; Michelle D Watkinson; Jonathan L Temte; Wen-Jan Tuan; Christine A Sinsky; Valerie J Gilchrist Journal: Ann Fam Med Date: 2017-09 Impact factor: 5.166
Authors: Michelle R Hribar; Sarah Read-Brown; Isaac H Goldstein; Leah G Reznick; Lorinna Lombardi; Mansi Parikh; Winston Chamberlain; Michael F Chiang Journal: J Am Med Inform Assoc Date: 2018-01-01 Impact factor: 4.497
Authors: Ming Tai-Seale; Cliff W Olson; Jinnan Li; Albert S Chan; Criss Morikawa; Meg Durbin; Wei Wang; Harold S Luft Journal: Health Aff (Millwood) Date: 2017-04-01 Impact factor: 6.301
Authors: Christine A Sinsky; Adam Rule; Genna Cohen; Brian G Arndt; Tait D Shanafelt; Christopher D Sharp; Sally L Baxter; Ming Tai-Seale; Sherry Yan; You Chen; Julia Adler-Milstein; Michelle Hribar Journal: J Am Med Inform Assoc Date: 2020-04-01 Impact factor: 4.497
Authors: Sally L Baxter; Nate C Apathy; Dori A Cross; Christine Sinsky; Michelle R Hribar Journal: J Am Med Inform Assoc Date: 2021-04-23 Impact factor: 4.497
Authors: Juan D Chaparro; Jonathan M Beus; Adam C Dziorny; Philip A Hagedorn; Sean Hernandez; Swaminathan Kandaswamy; Eric S Kirkendall; Allison B McCoy; Naveen Muthu; Evan W Orenstein Journal: Appl Clin Inform Date: 2022-05-25 Impact factor: 2.762
Authors: Jared A Shenson; Ivana Jankovic; Hyo Jung Hong; Benjamin Weia; Lee White; Jonathan H Chen; Matthew Eisenberg Journal: Appl Clin Inform Date: 2021-12-08 Impact factor: 2.342