Andrew J Hung1, Jian Chen1, Zhengping Che2, Tanachat Nilanon2, Anthony Jarc3, Micha Titus1, Paul J Oh1, Inderbir S Gill1, Yan Liu2. 1. 1 Catherine & Joseph Aresty Department of Urology, Center for Robotic Simulation & Education, USC Institute of Urology, University of Southern California , Los Angeles, California. 2. 2 USC Machine Learning Center, Viterbi School of Engineering, University of Southern California , Los Angeles, California. 3. 3 Medical Research, Intuitive Surgical, Inc. , Norcross, Georgia .
Abstract
PURPOSE: Surgical performance is critical for clinical outcomes. We present a novel machine learning (ML) method of processing automated performance metrics (APMs) to evaluate surgical performance and predict clinical outcomes after robot-assisted radical prostatectomy (RARP). MATERIALS AND METHODS: We trained three ML algorithms utilizing APMs directly from robot system data (training material) and hospital length of stay (LOS; training label) (≤2 days and >2 days) from 78 RARP cases, and selected the algorithm with the best performance. The selected algorithm categorized the cases as "Predicted as expected LOS (pExp-LOS)" and "Predicted as extended LOS (pExt-LOS)." We compared postoperative outcomes of the two groups (Kruskal-Wallis/Fisher's exact tests). The algorithm then predicted individual clinical outcomes, which we compared with actual outcomes (Spearman's correlation/Fisher's exact tests). Finally, we identified five most relevant APMs adopted by the algorithm during predicting. RESULTS: The "Random Forest-50" (RF-50) algorithm had the best performance, reaching 87.2% accuracy in predicting LOS (73 cases as "pExp-LOS" and 5 cases as "pExt-LOS"). The "pExp-LOS" cases outperformed the "pExt-LOS" cases in surgery time (3.7 hours vs 4.6 hours, p = 0.007), LOS (2 days vs 4 days, p = 0.02), and Foley duration (9 days vs 14 days, p = 0.02). Patient outcomes predicted by the algorithm had significant association with the "ground truth" in surgery time (p < 0.001, r = 0.73), LOS (p = 0.05, r = 0.52), and Foley duration (p < 0.001, r = 0.45). The five most relevant APMs, adopted by the RF-50 algorithm in predicting, were largely related to camera manipulation. CONCLUSION: To our knowledge, ours is the first study to show that APMs and ML algorithms may help assess surgical RARP performance and predict clinical outcomes. With further accrual of clinical data (oncologic and functional data), this process will become increasingly relevant and valuable in surgical assessment and training.
PURPOSE: Surgical performance is critical for clinical outcomes. We present a novel machine learning (ML) method of processing automated performance metrics (APMs) to evaluate surgical performance and predict clinical outcomes after robot-assisted radical prostatectomy (RARP). MATERIALS AND METHODS: We trained three ML algorithms utilizing APMs directly from robot system data (training material) and hospital length of stay (LOS; training label) (≤2 days and >2 days) from 78 RARP cases, and selected the algorithm with the best performance. The selected algorithm categorized the cases as "Predicted as expected LOS (pExp-LOS)" and "Predicted as extended LOS (pExt-LOS)." We compared postoperative outcomes of the two groups (Kruskal-Wallis/Fisher's exact tests). The algorithm then predicted individual clinical outcomes, which we compared with actual outcomes (Spearman's correlation/Fisher's exact tests). Finally, we identified five most relevant APMs adopted by the algorithm during predicting. RESULTS: The "Random Forest-50" (RF-50) algorithm had the best performance, reaching 87.2% accuracy in predicting LOS (73 cases as "pExp-LOS" and 5 cases as "pExt-LOS"). The "pExp-LOS" cases outperformed the "pExt-LOS" cases in surgery time (3.7 hours vs 4.6 hours, p = 0.007), LOS (2 days vs 4 days, p = 0.02), and Foley duration (9 days vs 14 days, p = 0.02). Patient outcomes predicted by the algorithm had significant association with the "ground truth" in surgery time (p < 0.001, r = 0.73), LOS (p = 0.05, r = 0.52), and Foley duration (p < 0.001, r = 0.45). The five most relevant APMs, adopted by the RF-50 algorithm in predicting, were largely related to camera manipulation. CONCLUSION: To our knowledge, ours is the first study to show that APMs and ML algorithms may help assess surgical RARP performance and predict clinical outcomes. With further accrual of clinical data (oncologic and functional data), this process will become increasingly relevant and valuable in surgical assessment and training.
Authors: Jason D Kelly; Ashley Petersen; Thomas S Lendvay; Timothy M Kowalewski Journal: Int J Comput Assist Radiol Surg Date: 2020-09-30 Impact factor: 2.924
Authors: Iulia Andras; Elio Mazzone; Fijs W B van Leeuwen; Geert De Naeyer; Matthias N van Oosterom; Sergi Beato; Tessa Buckle; Shane O'Sullivan; Pim J van Leeuwen; Alexander Beulens; Nicolae Crisan; Frederiek D'Hondt; Peter Schatteman; Henk van Der Poel; Paolo Dell'Oglio; Alexandre Mottrie Journal: World J Urol Date: 2019-11-27 Impact factor: 4.226
Authors: Andrew J Hung; Jian Chen; Saum Ghodoussipour; Paul J Oh; Zequn Liu; Jessica Nguyen; Sanjay Purushotham; Inderbir S Gill; Yan Liu Journal: BJU Int Date: 2019-03-20 Impact factor: 5.588
Authors: Samaneh Azargoshasb; Imke Boekestijn; Meta Roestenberg; Gijs H KleinJan; Jos A van der Hage; Henk G van der Poel; Daphne D D Rietbergen; Matthias N van Oosterom; Fijs W B van Leeuwen Journal: Mol Imaging Biol Date: 2022-06-16 Impact factor: 3.488
Authors: Jason D Kelly; Ashley Petersen; Thomas S Lendvay; Timothy M Kowalewski Journal: Int J Comput Assist Radiol Surg Date: 2020-04-15 Impact factor: 2.924