D W Tscholl1, L Handschin2, P Neubauer3, M Weiss4, B Seifert5, D R Spahn2, C B Noethiger2. 1. Institute of Anaesthesiology, University and University Hospital Zurich, Zurich, Switzerland. Electronic address: davidtscholl@me.com. 2. Institute of Anaesthesiology, University and University Hospital Zurich, Zurich, Switzerland. 3. Department of Computer Science, University of York, York, UK. 4. Leonard N. Stern School of Business, Department of Management and Organizations, New York University, New York, NY, USA. 5. Department of Biostatistics, Epidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland.
Abstract
BACKGROUND: Maintaining situation awareness of monitored patients can be challenging because care providers must continually read and integrate multiple waveforms and numerical vital sign values into a mental model of the patient's situation. We developed and evaluated a technology designed to improve perception of vital sign information by presenting patient status as an animated patient avatar. METHODS: After step-wise improvement of the avatar, anaesthesia professionals from two hospitals participated in a comparative study of conventional monitoring. Participants observed identical monitoring scenarios via the two technologies for brief time intervals and afterwards recalled patient status. RESULTS: Overall, 150 anaesthesia professionals participated in the validation process and 32 participated in the comparative study, completing 128 scenarios, which allowed for 64 direct comparisons. The avatar's inter-rater reliability was high, with Fleiss' kappa of 0.98 (95% confidence interval 0.96-0.99, P<0.001). With the avatar, participants recalled almost twice as many vital signs correctly as with conventional monitoring (9 vs 5, P<0.001). Perceived confidence was improved (2=certain vs 1=uncertain, P<0.001) and perceived workload lowered (task load index 60 vs 76, P<0.001). Participants obtained these results only after watching an educational video explaining the avatar and suggesting quick learnability and potential for real-life usability. CONCLUSIONS: This study provides empirical evidence that an animated avatar offers the opportunity to transmit vital sign information significantly more quickly than conventional monitoring and with improved confidence and reduced cognitive effort. This could help care providers gain situation awareness more efficiently.
BACKGROUND: Maintaining situation awareness of monitored patients can be challenging because care providers must continually read and integrate multiple waveforms and numerical vital sign values into a mental model of the patient's situation. We developed and evaluated a technology designed to improve perception of vital sign information by presenting patient status as an animated patient avatar. METHODS: After step-wise improvement of the avatar, anaesthesia professionals from two hospitals participated in a comparative study of conventional monitoring. Participants observed identical monitoring scenarios via the two technologies for brief time intervals and afterwards recalled patient status. RESULTS: Overall, 150 anaesthesia professionals participated in the validation process and 32 participated in the comparative study, completing 128 scenarios, which allowed for 64 direct comparisons. The avatar's inter-rater reliability was high, with Fleiss' kappa of 0.98 (95% confidence interval 0.96-0.99, P<0.001). With the avatar, participants recalled almost twice as many vital signs correctly as with conventional monitoring (9 vs 5, P<0.001). Perceived confidence was improved (2=certain vs 1=uncertain, P<0.001) and perceived workload lowered (task load index 60 vs 76, P<0.001). Participants obtained these results only after watching an educational video explaining the avatar and suggesting quick learnability and potential for real-life usability. CONCLUSIONS: This study provides empirical evidence that an animated avatar offers the opportunity to transmit vital sign information significantly more quickly than conventional monitoring and with improved confidence and reduced cognitive effort. This could help care providers gain situation awareness more efficiently.
Authors: Olivia Nelson; Brian Sturgis; Keri Gilbert; Elizabeth Henry; Kelly Clegg; Jonathan M Tan; Jack O Wasey; Allan F Simpao; Jorge A Gálvez Journal: Appl Clin Inform Date: 2019-08-07 Impact factor: 2.342
Authors: David W Tscholl; Mona Weiss; Lucas Handschin; Donat R Spahn; Christoph B Nöthiger Journal: BMC Anesthesiol Date: 2018-12-11 Impact factor: 2.217
Authors: Juliane Pfarr; David W Tscholl; Michael T Ganter; Donat R Spahn; Christoph B Noethiger Journal: J Med Internet Res Date: 2019-07-17 Impact factor: 5.428
Authors: Doreen J Wetli; Lisa Bergauer; Christoph B Nöthiger; Tadzio R Roche; Donat R Spahn; David W Tscholl; Sadiq Said Journal: Diagnostics (Basel) Date: 2022-02-21
Authors: Arsène Ljubenovic; Sadiq Said; Julia Braun; Bastian Grande; Michaela Kolbe; Donat R Spahn; Christoph B Nöthiger; David W Tscholl; Tadzio R Roche Journal: JMIR Serious Games Date: 2022-03-22 Impact factor: 3.364
Authors: Olivier Garot; Julian Rössler; Juliane Pfarr; Michael T Ganter; Donat R Spahn; Christoph B Nöthiger; David W Tscholl Journal: BMC Med Inform Decis Mak Date: 2020-02-10 Impact factor: 2.796
Authors: David Werner Tscholl; Julian Rössler; Sadiq Said; Alexander Kaserer; Donat Rudolf Spahn; Christoph Beat Nöthiger Journal: Sensors (Basel) Date: 2020-04-09 Impact factor: 3.576
Authors: Sadiq Said; Malgorzata Gozdzik; Tadzio Raoul Roche; Julia Braun; Julian Rössler; Alexander Kaserer; Donat R Spahn; Christoph B Nöthiger; David Werner Tscholl Journal: J Med Internet Res Date: 2020-09-07 Impact factor: 5.428
Authors: Samira Akbas; Sadiq Said; Tadzio Raoul Roche; Christoph B Nöthiger; Donat R Spahn; David W Tscholl; Lisa Bergauer Journal: JMIR Hum Factors Date: 2022-03-18