André Mewes1, Bennet Hensen2, Frank Wacker2, Christian Hansen3. 1. Faculty of Computer Science, University of Magdeburg, Magdeburg, Germany. andre.mewes@ovgu.de. 2. Institute for Diagnostic and Interventional Radiology, Medical School Hanover, Hanover, Germany. 3. Faculty of Computer Science, University of Magdeburg, Magdeburg, Germany.
Abstract
PURPOSE: In this article, we systematically examine the current state of research of systems that focus on touchless human-computer interaction in operating rooms and interventional radiology suites. We further discuss the drawbacks of current solutions and underline promising technologies for future development. METHODS: A systematic literature search of scientific papers that deal with touchless control of medical software in the immediate environment of the operation room and interventional radiology suite was performed. This includes methods for touchless gesture interaction, voice control and eye tracking. RESULTS: Fifty-five research papers were identified and analyzed in detail including 33 journal publications. Most of the identified literature (62 %) deals with the control of medical image viewers. The others present interaction techniques for laparoscopic assistance (13 %), telerobotic assistance and operating room control (9 % each) as well as for robotic operating room assistance and intraoperative registration (3.5 % each). Only 8 systems (14.5 %) were tested in a real clinical environment, and 7 (12.7 %) were not evaluated at all. CONCLUSION: In the last 10 years, many advancements have led to robust touchless interaction approaches. However, only a few have been systematically evaluated in real operating room settings. Further research is required to cope with current limitations of touchless software interfaces in clinical environments. The main challenges for future research are the improvement and evaluation of usability and intuitiveness of touchless human-computer interaction and the full integration into productive systems as well as the reduction of necessary interaction steps and further development of hands-free interaction.
PURPOSE: In this article, we systematically examine the current state of research of systems that focus on touchless human-computer interaction in operating rooms and interventional radiology suites. We further discuss the drawbacks of current solutions and underline promising technologies for future development. METHODS: A systematic literature search of scientific papers that deal with touchless control of medical software in the immediate environment of the operation room and interventional radiology suite was performed. This includes methods for touchless gesture interaction, voice control and eye tracking. RESULTS: Fifty-five research papers were identified and analyzed in detail including 33 journal publications. Most of the identified literature (62 %) deals with the control of medical image viewers. The others present interaction techniques for laparoscopic assistance (13 %), telerobotic assistance and operating room control (9 % each) as well as for robotic operating room assistance and intraoperative registration (3.5 % each). Only 8 systems (14.5 %) were tested in a real clinical environment, and 7 (12.7 %) were not evaluated at all. CONCLUSION: In the last 10 years, many advancements have led to robust touchless interaction approaches. However, only a few have been systematically evaluated in real operating room settings. Further research is required to cope with current limitations of touchless software interfaces in clinical environments. The main challenges for future research are the improvement and evaluation of usability and intuitiveness of touchless human-computer interaction and the full integration into productive systems as well as the reduction of necessary interaction steps and further development of hands-free interaction.
Authors: Julian Hettig; Patrick Saalfeld; Maria Luz; Mathias Becker; Martin Skalej; Christian Hansen Journal: Int J Comput Assist Radiol Surg Date: 2017-01-24 Impact factor: 2.924
Authors: Yaa A Kumah-Crystal; Claude J Pirtle; Harrison M Whyte; Edward S Goode; Shilo H Anders; Christoph U Lehmann Journal: Appl Clin Inform Date: 2018-07-18 Impact factor: 2.342
Authors: David Black; Michael Unger; Nele Fischer; Ron Kikinis; Horst Hahn; Thomas Neumuth; Bernhard Glaser Journal: Int J Comput Assist Radiol Surg Date: 2017-10-27 Impact factor: 2.924