Germain Forestier1, François Petitjean2, Pavel Senin3, Fabien Despinoy4, Arnaud Huaulmé5, Hassan Ismail Fawaz6, Jonathan Weber7, Lhassane Idoumghar8, Pierre-Alain Muller9, Pierre Jannin10. 1. IRIMAS, Université de Haute-Alsace, Mulhouse, France; Faculty of Information Technology, Monash University, Melbourne, Australia. Electronic address: germain.forestier@uha.fr. 2. Faculty of Information Technology, Monash University, Melbourne, Australia. Electronic address: francois.petitjean@monash.edu. 3. Los Alamos National Laboratory, University Of Hawai'i at Mānoa, United States. Electronic address: senin@hawaii.edu. 4. Univ Rennes, Inserm, LTSI - UMR_S 1099, F35000 Rennes, France. Electronic address: fabien.despinoy@chu-rennes.fr. 5. Univ Rennes, Inserm, LTSI - UMR_S 1099, F35000 Rennes, France. Electronic address: arnaud.huaulme@univ-rennes1.fr. 6. IRIMAS, Université de Haute-Alsace, Mulhouse, France. Electronic address: hassan.ismail-fawaz@uha.fr. 7. IRIMAS, Université de Haute-Alsace, Mulhouse, France. Electronic address: jonathan.weber@uha.fr. 8. IRIMAS, Université de Haute-Alsace, Mulhouse, France. Electronic address: lhassane.idoumghar@uha.fr. 9. IRIMAS, Université de Haute-Alsace, Mulhouse, France. Electronic address: pierre-alain.muller@uha.fr. 10. Univ Rennes, Inserm, LTSI - UMR_S 1099, F35000 Rennes, France. Electronic address: pierre.jannin@univ-rennes1.fr.
Abstract
OBJECTIVE: The analysis of surgical motion has received a growing interest with the development of devices allowing their automatic capture. In this context, the use of advanced surgical training systems makes an automated assessment of surgical trainee possible. Automatic and quantitative evaluation of surgical skills is a very important step in improving surgical patient care. MATERIAL AND METHOD: In this paper, we present an approach for the discovery and ranking of discriminative and interpretable patterns of surgical practice from recordings of surgical motions. A pattern is defined as a series of actions or events in the kinematic data that together are distinctive of a specific gesture or skill level. Our approach is based on the decomposition of continuous kinematic data into a set of overlapping gestures represented by strings (bag of words) for which we compute comparative numerical statistic (tf-idf) enabling the discriminative gesture discovery via its relative occurrence frequency. RESULTS: We carried out experiments on three surgical motion datasets. The results show that the patterns identified by the proposed method can be used to accurately classify individual gestures, skill levels and surgical interfaces. We also present how the patterns provide a detailed feedback on the trainee skill assessment. CONCLUSIONS: The proposed approach is an interesting addition to existing learning tools for surgery as it provides a way to obtain a feedback on which parts of an exercise have been used to classify the attempt as correct or incorrect.
OBJECTIVE: The analysis of surgical motion has received a growing interest with the development of devices allowing their automatic capture. In this context, the use of advanced surgical training systems makes an automated assessment of surgical trainee possible. Automatic and quantitative evaluation of surgical skills is a very important step in improving surgical patient care. MATERIAL AND METHOD: In this paper, we present an approach for the discovery and ranking of discriminative and interpretable patterns of surgical practice from recordings of surgical motions. A pattern is defined as a series of actions or events in the kinematic data that together are distinctive of a specific gesture or skill level. Our approach is based on the decomposition of continuous kinematic data into a set of overlapping gestures represented by strings (bag of words) for which we compute comparative numerical statistic (tf-idf) enabling the discriminative gesture discovery via its relative occurrence frequency. RESULTS: We carried out experiments on three surgical motion datasets. The results show that the patterns identified by the proposed method can be used to accurately classify individual gestures, skill levels and surgical interfaces. We also present how the patterns provide a detailed feedback on the trainee skill assessment. CONCLUSIONS: The proposed approach is an interesting addition to existing learning tools for surgery as it provides a way to obtain a feedback on which parts of an exercise have been used to classify the attempt as correct or incorrect.
Authors: Jason D Kelly; Ashley Petersen; Thomas S Lendvay; Timothy M Kowalewski Journal: Int J Comput Assist Radiol Surg Date: 2020-09-30 Impact factor: 2.924
Authors: Recai Yilmaz; Alexander Winkler-Schwartz; Nykan Mirchi; Aiden Reich; Sommer Christie; Dan Huy Tran; Nicole Ledwos; Ali M Fazlollahi; Carlo Santaguida; Abdulrahman J Sabbagh; Khalid Bajunaid; Rolando Del Maestro Journal: NPJ Digit Med Date: 2022-04-26
Authors: Jani Koskinen; Antti Huotarinen; Antti-Pekka Elomaa; Bin Zheng; Roman Bednarik Journal: Int J Comput Assist Radiol Surg Date: 2021-12-15 Impact factor: 2.924