Ying Chen1, Shih Ling Kao2, Maudrene Tan3, Yilin Ning4, Mark Salloway1, Hwee Lin Wee5, Kavita Venkataraman1, Eric Yin Hao Khoo2, Yeow Leng Chow6, E-Shyong Tai2, Chuen Seng Tan7. 1. Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore. 2. Department of Medicine, National University Hospital and National University Health System, Singapore; Department of Medicine, Yong Loo Lin School of Medicine, National University of Singapore and National University Health System, Singapore. 3. Department of Medicine, National University Hospital and National University Health System, Singapore. 4. NUS Graduate School for Integrative Sciences and Engineering, National University of Singapore, Singapore; Department of Surgery, Yong Loo Lin School of Medicine, National University of Singapore and National University Health System, Singapore. 5. Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore; Department of Pharmacy, National University of Singapore, Singapore. 6. Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore and National University Health System, Singapore. 7. Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore. Electronic address: chuen_seng_tan@nuhs.edu.sg.
Abstract
BACKGROUND: Measuring adherence to processes is one of the established ways to quantify the quality of healthcare. Providing timely feedback to healthcare workers on the level of adherence can improve process measures. However, it is challenging to present data on adherence to repetitive time-sensitive tasks in a clear manner. OBJECTIVES: We used inpatient glucose monitoring as a test case to explore the feasibility of using visualizations to communicate adherence to repetitive scheduled tasks to healthcare workers. METHODS: We selected four candidate plots that represented distribution across time: histogram, probability density function plot (pdf plot), violin plot and cumulative density function plot (cdf plot). Doctors and nurses involved in inpatient diabetes care in a tertiary hospital were invited to complete a self-administered questionnaire that measured self-reported baseline knowledge, performance, and perception towards the visualizations. Performance was assessed by determining if a participant was able to correctly identify visualizations representing protocol adherence. We also assessed the perception of usability of these visualizations for monitoring protocol adherence. Binomial regression models were used to identify factors associated with overall performance and perception. Logistic regression models with generalized estimating equation were used to compare performance and perception between visualizations, and identify effect modifiers. RESULTS: A total of 57 doctors and nurses completed the questionnaire. Participants were most familiar with histogram (87.7%), followed by cdf plot (61.4%), pdf plot (40.4%), and violin plot (7%). However, the percentages of participants who identified non-adherence using these plots were generally lower, ranging from 29.8% to 40.4%. Participants' perception of usability ranged from 14% to 17.5% across these visualizations. More favorable perceptions were found among participants with baseline knowledge for two or more visualizations (adjusted odds ratio: 3.21; 95%CI: 1.29, 7.96; p-value: 0.012) and having identified two or more non-adherent visualizations (adjusted odds ratio: 4.23; 95%CI: 1.95, 9.16; p-value: < 0.001). CONCLUSIONS: Adherence to repetitive time-sensitive tasks can be presented in the form of visualizations. However, nurses' and doctors' knowledge and understanding of these visualizations are generally poor. This may influence their perception of usability of these plots. Therefore, these visualizations need to be implemented in tandem with training on their interpretation, to enhance the usefulness of these plots in motivating quality improvement.
BACKGROUND: Measuring adherence to processes is one of the established ways to quantify the quality of healthcare. Providing timely feedback to healthcare workers on the level of adherence can improve process measures. However, it is challenging to present data on adherence to repetitive time-sensitive tasks in a clear manner. OBJECTIVES: We used inpatient glucose monitoring as a test case to explore the feasibility of using visualizations to communicate adherence to repetitive scheduled tasks to healthcare workers. METHODS: We selected four candidate plots that represented distribution across time: histogram, probability density function plot (pdf plot), violin plot and cumulative density function plot (cdf plot). Doctors and nurses involved in inpatient diabetes care in a tertiary hospital were invited to complete a self-administered questionnaire that measured self-reported baseline knowledge, performance, and perception towards the visualizations. Performance was assessed by determining if a participant was able to correctly identify visualizations representing protocol adherence. We also assessed the perception of usability of these visualizations for monitoring protocol adherence. Binomial regression models were used to identify factors associated with overall performance and perception. Logistic regression models with generalized estimating equation were used to compare performance and perception between visualizations, and identify effect modifiers. RESULTS: A total of 57 doctors and nurses completed the questionnaire. Participants were most familiar with histogram (87.7%), followed by cdf plot (61.4%), pdf plot (40.4%), and violin plot (7%). However, the percentages of participants who identified non-adherence using these plots were generally lower, ranging from 29.8% to 40.4%. Participants' perception of usability ranged from 14% to 17.5% across these visualizations. More favorable perceptions were found among participants with baseline knowledge for two or more visualizations (adjusted odds ratio: 3.21; 95%CI: 1.29, 7.96; p-value: 0.012) and having identified two or more non-adherent visualizations (adjusted odds ratio: 4.23; 95%CI: 1.95, 9.16; p-value: < 0.001). CONCLUSIONS: Adherence to repetitive time-sensitive tasks can be presented in the form of visualizations. However, nurses' and doctors' knowledge and understanding of these visualizations are generally poor. This may influence their perception of usability of these plots. Therefore, these visualizations need to be implemented in tandem with training on their interpretation, to enhance the usefulness of these plots in motivating quality improvement.
Authors: Raheleh Salari; Sharareh R Niakan Kalhori; Marjan GhaziSaeedi; Marjan Jeddi; Mahin Nazari; Farhad Fatehi Journal: J Med Internet Res Date: 2021-06-02 Impact factor: 5.428