Amir Baghdadi1,2, Ahmed A Hussein1, Youssef Ahmed1, Lora A Cavuoto2, Khurshid A Guru3. 1. A.T.L.A.S (Applied Technology Laboratory for Advanced Surgery) Program, Department of Urology, Roswell Park Comprehensive Cancer Center, Elm & Carlton St, Buffalo, NY, 14263, USA. 2. Department of Industrial and Systems Engineering, University at Buffalo, Buffalo, NY, USA. 3. A.T.L.A.S (Applied Technology Laboratory for Advanced Surgery) Program, Department of Urology, Roswell Park Comprehensive Cancer Center, Elm & Carlton St, Buffalo, NY, 14263, USA. Khurshid.guru@roswellpark.org.
Abstract
PURPOSE: To develop and validate an automated assessment of surgical performance (AASP) system for objective and computerized assessment of pelvic lymph node dissection (PLND) as an integral part of robot-assisted radical cystectomy (RARC) using console-feed videos recorded during live surgery. METHODS: Video recordings of 20 PLNDs were included. The quality of lymph node clearance was assessed based on the features derived from the computer vision process which include: the number and cleared area of the vessels/nerve (N-Vs); image median color map; and mean entropy (measures the level of disorganization) in the video frame. The automated scores were compared to the validated pelvic lymphadenectomy appropriateness and completion evaluation (PLACE) scoring rated by a panel of expert surgeons. Logistic regression analysis was employed to compare automated scores versus PLACE scores. RESULTS: Fourteen procedures were used to develop the AASP algorithm. A logistic regression model was trained and validated using the aforementioned features with 30% holdout cross-validation. The model was tested on the remaining six procedures, and the accuracy of predicting the expert-based PLACE scores was 83.3%. CONCLUSIONS: To our knowledge, this is the first automated surgical skill assessment tool that provides an objective evaluation of surgical performance with high accuracy compared to expert surgeons' assessment that can be extended to any endoscopic or robotic video-enabled surgical procedure.
PURPOSE: To develop and validate an automated assessment of surgical performance (AASP) system for objective and computerized assessment of pelvic lymph node dissection (PLND) as an integral part of robot-assisted radical cystectomy (RARC) using console-feed videos recorded during live surgery. METHODS: Video recordings of 20 PLNDs were included. The quality of lymph node clearance was assessed based on the features derived from the computer vision process which include: the number and cleared area of the vessels/nerve (N-Vs); image median color map; and mean entropy (measures the level of disorganization) in the video frame. The automated scores were compared to the validated pelvic lymphadenectomy appropriateness and completion evaluation (PLACE) scoring rated by a panel of expert surgeons. Logistic regression analysis was employed to compare automated scores versus PLACE scores. RESULTS: Fourteen procedures were used to develop the AASP algorithm. A logistic regression model was trained and validated using the aforementioned features with 30% holdout cross-validation. The model was tested on the remaining six procedures, and the accuracy of predicting the expert-based PLACE scores was 83.3%. CONCLUSIONS: To our knowledge, this is the first automated surgical skill assessment tool that provides an objective evaluation of surgical performance with high accuracy compared to expert surgeons' assessment that can be extended to any endoscopic or robotic video-enabled surgical procedure.
Authors: N Stylopoulos; S Cotin; S K Maithel; M Ottensmeye; P G Jackson; R S Bardsley; P F Neumann; D W Rattner; S L Dawson Journal: Surg Endosc Date: 2004-05 Impact factor: 4.584
Authors: Nicholas J Hellenthal; Abid Hussain; Paul E Andrews; Paul Carpentier; Erik Castle; Prokar Dasgupta; Jihad Kaouk; Shamim Khan; Adam Kibel; Hyung Kim; Murugesan Manoharan; Mani Menon; Alex Mottrie; David Ornstein; Joan Palou; James Peabody; Raj Pruthi; Lee Richstone; Francis Schanne; Hans Stricker; Raju Thomas; Peter Wiklund; Greg Wilding; Khurshid A Guru Journal: BJU Int Date: 2011-02 Impact factor: 5.588
Authors: Bernard H Bochner; Daniel Cho; Harry W Herr; Machele Donat; Michael W Kattan; Guido Dalbagni Journal: J Urol Date: 2004-10 Impact factor: 7.450
Authors: Saratu Kutana; Daniel P Bitner; Poppy Addison; Paul J Chung; Mark A Talamini; Filippo Filicori Journal: Surg Endosc Date: 2022-02-28 Impact factor: 3.453
Authors: Sandeep Ganni; Sanne M B I Botden; Magdalena Chmarra; Meng Li; Richard H M Goossens; Jack J Jakimowicz Journal: J Med Syst Date: 2020-01-24 Impact factor: 4.460