Literature DB >> 29380122

Video and accelerometer-based motion analysis for automated surgical skills assessment.

Aneeq Zia1, Yachna Sharma2, Vinay Bettadapura2, Eric L Sarin3, Irfan Essa2.   

Abstract

PURPOSE: Basic surgical skills of suturing and knot tying are an essential part of medical training. Having an automated system for surgical skills assessment could help save experts time and improve training efficiency. There have been some recent attempts at automated surgical skills assessment using either video analysis or acceleration data. In this paper, we present a novel approach for automated assessment of OSATS-like surgical skills and provide an analysis of different features on multi-modal data (video and accelerometer data).
METHODS: We conduct a large study for basic surgical skill assessment on a dataset that contained video and accelerometer data for suturing and knot-tying tasks. We introduce "entropy-based" features-approximate entropy and cross-approximate entropy, which quantify the amount of predictability and regularity of fluctuations in time series data. The proposed features are compared to existing methods of Sequential Motion Texture, Discrete Cosine Transform and Discrete Fourier Transform, for surgical skills assessment.
RESULTS: We report average performance of different features across all applicable OSATS-like criteria for suturing and knot-tying tasks. Our analysis shows that the proposed entropy-based features outperform previous state-of-the-art methods using video data, achieving average classification accuracies of 95.1 and 92.2% for suturing and knot tying, respectively. For accelerometer data, our method performs better for suturing achieving 86.8% average accuracy. We also show that fusion of video and acceleration features can improve overall performance for skill assessment.
CONCLUSION: Automated surgical skills assessment can be achieved with high accuracy using the proposed entropy features. Such a system can significantly improve the efficiency of surgical training in medical schools and teaching hospitals.

Keywords:  Computer vision; Machine learning; Multi-modal data; Surgical skills assessment

Mesh:

Year:  2018        PMID: 29380122     DOI: 10.1007/s11548-018-1704-z

Source DB:  PubMed          Journal:  Int J Comput Assist Radiol Surg        ISSN: 1861-6410            Impact factor:   2.924


  13 in total

1.  Approximate entropy as a measure of system complexity.

Authors:  S M Pincus
Journal:  Proc Natl Acad Sci U S A       Date:  1991-03-15       Impact factor: 11.205

2.  Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills.

Authors:  Alvin C Goh; David W Goldfarb; James C Sander; Brian J Miles; Brian J Dunkin
Journal:  J Urol       Date:  2011-11-17       Impact factor: 7.450

3.  Cross-Approximate Entropy parallel computation on GPUs for biomedical signal analysis. Application to MEG recordings.

Authors:  Mario Martínez-Zarzuela; Carlos Gómez; Francisco Javier Díaz-Pernas; Alberto Fernández; Roberto Hornero
Journal:  Comput Methods Programs Biomed       Date:  2013-07-31       Impact factor: 5.428

4.  Surgical gesture classification from video and kinematic data.

Authors:  Luca Zappella; Benjamín Béjar; Gregory Hager; René Vidal
Journal:  Med Image Anal       Date:  2013-04-28       Impact factor: 8.545

5.  Objective structured assessment of technical skill (OSATS) for surgical residents.

Authors:  J A Martin; G Regehr; R Reznick; H MacRae; J Murnaghan; C Hutchison; M Brown
Journal:  Br J Surg       Date:  1997-02       Impact factor: 6.939

6.  Surgical gesture classification from video data.

Authors:  Benjamín Béjar Haro; Luca Zappella; René Vidal
Journal:  Med Image Comput Comput Assist Interv       Date:  2012

7.  Using Contact Forces and Robot Arm Accelerations to Automatically Rate Surgeon Skill at Peg Transfer.

Authors:  Jeremy D Brown; Conor E O Brien; Sarah C Leung; Kristoffel R Dumon; David I Lee; Katherine J Kuchenbecker
Journal:  IEEE Trans Biomed Eng       Date:  2016-12-02       Impact factor: 4.538

8.  Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills.

Authors:  J Rosen; B Hannaford; C G Richards; M N Sinanan
Journal:  IEEE Trans Biomed Eng       Date:  2001-05       Impact factor: 4.538

9.  Automated video-based assessment of surgical skills for training and evaluation in medical schools.

Authors:  Aneeq Zia; Yachna Sharma; Vinay Bettadapura; Eric L Sarin; Thomas Ploetz; Mark A Clements; Irfan Essa
Journal:  Int J Comput Assist Radiol Surg       Date:  2016-08-27       Impact factor: 2.924

10.  Temporal clustering of surgical activities in robot-assisted surgery.

Authors:  Aneeq Zia; Chi Zhang; Xiaobin Xiong; Anthony M Jarc
Journal:  Int J Comput Assist Radiol Surg       Date:  2017-05-05       Impact factor: 2.924

View more
  11 in total

1.  Machine learning methods for automated technical skills assessment with instructional feedback in ultrasound-guided interventions.

Authors:  Matthew S Holden; Sean Xia; Hillary Lia; Zsuzsanna Keri; Colin Bell; Lindsey Patterson; Tamas Ungi; Gabor Fichtinger
Journal:  Int J Comput Assist Radiol Surg       Date:  2019-04-20       Impact factor: 2.924

2.  A computer vision technique for automated assessment of surgical performance using surgeons' console-feed videos.

Authors:  Amir Baghdadi; Ahmed A Hussein; Youssef Ahmed; Lora A Cavuoto; Khurshid A Guru
Journal:  Int J Comput Assist Radiol Surg       Date:  2018-11-20       Impact factor: 2.924

3.  CAI4CAI: The Rise of Contextual Artificial Intelligence in Computer Assisted Interventions.

Authors:  Tom Vercauteren; Mathias Unberath; Nicolas Padoy; Nassir Navab
Journal:  Proc IEEE Inst Electr Electron Eng       Date:  2019-10-23       Impact factor: 10.961

4.  Automated surgical skill assessment in RMIS training.

Authors:  Aneeq Zia; Irfan Essa
Journal:  Int J Comput Assist Radiol Surg       Date:  2018-03-16       Impact factor: 2.924

5.  Evaluation of surgical skill using machine learning with optimal wearable sensor locations.

Authors:  Rahul Soangra; R Sivakumar; E R Anirudh; Sai Viswanth Reddy Y; Emmanuel B John
Journal:  PLoS One       Date:  2022-06-03       Impact factor: 3.752

6.  An Intelligent Augmented Reality Training Framework for Neonatal Endotracheal Intubation.

Authors:  Shang Zhao; Xiao Xiao; Qiyue Wang; Xiaoke Zhang; Wei Li; Lamia Soghier; James Hahn
Journal:  Int Symp Mix Augment Real       Date:  2020-12-14

Review 7.  Deep learning-enabled medical computer vision.

Authors:  Andre Esteva; Katherine Chou; Serena Yeung; Nikhil Naik; Ali Madani; Ali Mottaghi; Yun Liu; Eric Topol; Jeff Dean; Richard Socher
Journal:  NPJ Digit Med       Date:  2021-01-08

8.  Automated recognition of objects and types of forceps in surgical images using deep learning.

Authors:  Yoshiko Bamba; Shimpei Ogawa; Michio Itabashi; Shingo Kameoka; Takahiro Okamoto; Masakazu Yamamoto
Journal:  Sci Rep       Date:  2021-11-19       Impact factor: 4.379

9.  Surgical Performance Analysis and Classification Based on Video Annotation of Laparoscopic Tasks.

Authors:  Constantinos Loukas; Athanasios Gazis; Meletios A Kanakis
Journal:  JSLS       Date:  2020 Oct-Dec       Impact factor: 2.172

10.  CEPS: An Open Access MATLAB Graphical User Interface (GUI) for the Analysis of Complexity and Entropy in Physiological Signals.

Authors:  David Mayor; Deepak Panday; Hari Kala Kandel; Tony Steffert; Duncan Banks
Journal:  Entropy (Basel)       Date:  2021-03-08       Impact factor: 2.524

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.