Aneeq Zia1, Yachna Sharma2, Vinay Bettadapura2, Eric L Sarin3, Irfan Essa2. 1. College of Computing, Georgia Tech, Atlanta, Georgia. aneeqzia@gmail.com. 2. College of Computing, Georgia Tech, Atlanta, Georgia. 3. Department of Surgery, Emory University, Atlanta, Georgia.
Abstract
PURPOSE: Basic surgical skills of suturing and knot tying are an essential part of medical training. Having an automated system for surgical skills assessment could help save experts time and improve training efficiency. There have been some recent attempts at automated surgical skills assessment using either video analysis or acceleration data. In this paper, we present a novel approach for automated assessment of OSATS-like surgical skills and provide an analysis of different features on multi-modal data (video and accelerometer data). METHODS: We conduct a large study for basic surgical skill assessment on a dataset that contained video and accelerometer data for suturing and knot-tying tasks. We introduce "entropy-based" features-approximate entropy and cross-approximate entropy, which quantify the amount of predictability and regularity of fluctuations in time series data. The proposed features are compared to existing methods of Sequential Motion Texture, Discrete Cosine Transform and Discrete Fourier Transform, for surgical skills assessment. RESULTS: We report average performance of different features across all applicable OSATS-like criteria for suturing and knot-tying tasks. Our analysis shows that the proposed entropy-based features outperform previous state-of-the-art methods using video data, achieving average classification accuracies of 95.1 and 92.2% for suturing and knot tying, respectively. For accelerometer data, our method performs better for suturing achieving 86.8% average accuracy. We also show that fusion of video and acceleration features can improve overall performance for skill assessment. CONCLUSION: Automated surgical skills assessment can be achieved with high accuracy using the proposed entropy features. Such a system can significantly improve the efficiency of surgical training in medical schools and teaching hospitals.
PURPOSE: Basic surgical skills of suturing and knot tying are an essential part of medical training. Having an automated system for surgical skills assessment could help save experts time and improve training efficiency. There have been some recent attempts at automated surgical skills assessment using either video analysis or acceleration data. In this paper, we present a novel approach for automated assessment of OSATS-like surgical skills and provide an analysis of different features on multi-modal data (video and accelerometer data). METHODS: We conduct a large study for basic surgical skill assessment on a dataset that contained video and accelerometer data for suturing and knot-tying tasks. We introduce "entropy-based" features-approximate entropy and cross-approximate entropy, which quantify the amount of predictability and regularity of fluctuations in time series data. The proposed features are compared to existing methods of Sequential Motion Texture, Discrete Cosine Transform and Discrete Fourier Transform, for surgical skills assessment. RESULTS: We report average performance of different features across all applicable OSATS-like criteria for suturing and knot-tying tasks. Our analysis shows that the proposed entropy-based features outperform previous state-of-the-art methods using video data, achieving average classification accuracies of 95.1 and 92.2% for suturing and knot tying, respectively. For accelerometer data, our method performs better for suturing achieving 86.8% average accuracy. We also show that fusion of video and acceleration features can improve overall performance for skill assessment. CONCLUSION: Automated surgical skills assessment can be achieved with high accuracy using the proposed entropy features. Such a system can significantly improve the efficiency of surgical training in medical schools and teaching hospitals.
Authors: Mario Martínez-Zarzuela; Carlos Gómez; Francisco Javier Díaz-Pernas; Alberto Fernández; Roberto Hornero Journal: Comput Methods Programs Biomed Date: 2013-07-31 Impact factor: 5.428
Authors: Jeremy D Brown; Conor E O Brien; Sarah C Leung; Kristoffel R Dumon; David I Lee; Katherine J Kuchenbecker Journal: IEEE Trans Biomed Eng Date: 2016-12-02 Impact factor: 4.538
Authors: Aneeq Zia; Yachna Sharma; Vinay Bettadapura; Eric L Sarin; Thomas Ploetz; Mark A Clements; Irfan Essa Journal: Int J Comput Assist Radiol Surg Date: 2016-08-27 Impact factor: 2.924
Authors: Amir Baghdadi; Ahmed A Hussein; Youssef Ahmed; Lora A Cavuoto; Khurshid A Guru Journal: Int J Comput Assist Radiol Surg Date: 2018-11-20 Impact factor: 2.924
Authors: Andre Esteva; Katherine Chou; Serena Yeung; Nikhil Naik; Ali Madani; Ali Mottaghi; Yun Liu; Eric Topol; Jeff Dean; Richard Socher Journal: NPJ Digit Med Date: 2021-01-08