Yohannes Kassahun1, Bingbin Yu2, Abraham Temesgen Tibebu2, Danail Stoyanov3, Stamatia Giannarou4, Jan Hendrik Metzen2, Emmanuel Vander Poorten5. 1. Robotics Innovation Center, German Research Center for Artificial Intelligence, Robert-Hooke-Str. 1, 28359, Bremen, Germany. yohannes.kassahun@dfki.de. 2. Faculty 3 - Mathematics and Computer Science, University of Bremen, Robert-Hooke-Str. 1, 28359, Bremen, Germany. 3. Centre for Medical Image Computing, Department of Computer Science, University College London, London, UK. 4. Hamlyn Centre for Robotic Surgery, Imperial College London, London, UK. 5. Department of Mechanical Engineering, University of Leuven, Celestijnenlaan 300B, 3001, Heverlee, Belgium.
Abstract
PURPOSE: Advances in technology and computing play an increasingly important role in the evolution of modern surgical techniques and paradigms. This article reviews the current role of machine learning (ML) techniques in the context of surgery with a focus on surgical robotics (SR). Also, we provide a perspective on the future possibilities for enhancing the effectiveness of procedures by integrating ML in the operating room. METHODS: The review is focused on ML techniques directly applied to surgery, surgical robotics, surgical training and assessment. The widespread use of ML methods in diagnosis and medical image computing is beyond the scope of the review. Searches were performed on PubMed and IEEE Explore using combinations of keywords: ML, surgery, robotics, surgical and medical robotics, skill learning, skill analysis and learning to perceive. RESULTS: Studies making use of ML methods in the context of surgery are increasingly being reported. In particular, there is an increasing interest in using ML for developing tools to understand and model surgical skill and competence or to extract surgical workflow. Many researchers begin to integrate this understanding into the control of recent surgical robots and devices. CONCLUSION: ML is an expanding field. It is popular as it allows efficient processing of vast amounts of data for interpreting and real-time decision making. Already widely used in imaging and diagnosis, it is believed that ML will also play an important role in surgery and interventional treatments. In particular, ML could become a game changer into the conception of cognitive surgical robots. Such robots endowed with cognitive skills would assist the surgical team also on a cognitive level, such as possibly lowering the mental load of the team. For example, ML could help extracting surgical skill, learned through demonstration by human experts, and could transfer this to robotic skills. Such intelligent surgical assistance would significantly surpass the state of the art in surgical robotics. Current devices possess no intelligence whatsoever and are merely advanced and expensive instruments.
PURPOSE: Advances in technology and computing play an increasingly important role in the evolution of modern surgical techniques and paradigms. This article reviews the current role of machine learning (ML) techniques in the context of surgery with a focus on surgical robotics (SR). Also, we provide a perspective on the future possibilities for enhancing the effectiveness of procedures by integrating ML in the operating room. METHODS: The review is focused on ML techniques directly applied to surgery, surgical robotics, surgical training and assessment. The widespread use of ML methods in diagnosis and medical image computing is beyond the scope of the review. Searches were performed on PubMed and IEEE Explore using combinations of keywords: ML, surgery, robotics, surgical and medical robotics, skill learning, skill analysis and learning to perceive. RESULTS: Studies making use of ML methods in the context of surgery are increasingly being reported. In particular, there is an increasing interest in using ML for developing tools to understand and model surgical skill and competence or to extract surgical workflow. Many researchers begin to integrate this understanding into the control of recent surgical robots and devices. CONCLUSION: ML is an expanding field. It is popular as it allows efficient processing of vast amounts of data for interpreting and real-time decision making. Already widely used in imaging and diagnosis, it is believed that ML will also play an important role in surgery and interventional treatments. In particular, ML could become a game changer into the conception of cognitive surgical robots. Such robots endowed with cognitive skills would assist the surgical team also on a cognitive level, such as possibly lowering the mental load of the team. For example, ML could help extracting surgical skill, learned through demonstration by human experts, and could transfer this to robotic skills. Such intelligent surgical assistance would significantly surpass the state of the art in surgical robotics. Current devices possess no intelligence whatsoever and are merely advanced and expensive instruments.
Entities:
Keywords:
Learning to perceive; Skill analysis; Skill learning; Surgical robotics
Authors: R Bauernschmitt; E U Schirmbeck; A Knoll; H Mayer; I Nagy; N Wessel; S M Wildhirt; R Lange Journal: Int J Med Robot Date: 2005-09 Impact factor: 2.547
Authors: E Bauzano; I Garcia-Morales; P del Saz-Orozco; J C Fraile; V F Muñoz Journal: Comput Methods Programs Biomed Date: 2013-04-06 Impact factor: 5.428
Authors: Iulia Andras; Elio Mazzone; Fijs W B van Leeuwen; Geert De Naeyer; Matthias N van Oosterom; Sergi Beato; Tessa Buckle; Shane O'Sullivan; Pim J van Leeuwen; Alexander Beulens; Nicolae Crisan; Frederiek D'Hondt; Peter Schatteman; Henk van Der Poel; Paolo Dell'Oglio; Alexandre Mottrie Journal: World J Urol Date: 2019-11-27 Impact factor: 4.226
Authors: Joshua Makary; Danielle C van Diepen; Ranjan Arianayagam; George McClintock; Jeremy Fallot; Scott Leslie; Ruban Thanigasalam Journal: J Robot Surg Date: 2021-09-04
Authors: Andrew A Gumbs; Vincent Grasso; Nicolas Bourdel; Roland Croner; Gaya Spolverato; Isabella Frigerio; Alfredo Illanes; Mohammad Abu Hilal; Adrian Park; Eyad Elyan Journal: Sensors (Basel) Date: 2022-06-29 Impact factor: 3.847
Authors: Martin Wagner; Andreas Bihlmaier; F Mathis-Ullrich; B P Müller-Stich; Hannes Götz Kenngott; Patrick Mietkowski; Paul Maria Scheikl; Sebastian Bodenstedt; Anja Schiepe-Tiska; Josephin Vetter; Felix Nickel; S Speidel; H Wörn Journal: Surg Endosc Date: 2021-04-27 Impact factor: 4.584