Andrew J Hung1, Jian Chen2, Anthony Jarc3, David Hatcher2, Hooman Djaladat2, Inderbir S Gill2. 1. Center for Robotic Simulation & Education, Catherine & Joseph Aresty Department of Urology, University of Southern California Institute of Urology, Los Angeles, California. Electronic address: Andrew.Hung@med.usc.edu. 2. Center for Robotic Simulation & Education, Catherine & Joseph Aresty Department of Urology, University of Southern California Institute of Urology, Los Angeles, California. 3. Medical Research, Intuitive Surgical, Inc., Norcross, Georgia.
Abstract
PURPOSE: We explore and validate objective surgeon performance metrics using a novel recorder ("dVLogger") to directly capture surgeon manipulations on the da Vinci® Surgical System. We present the initial construct and concurrent validation study of objective metrics during preselected steps of robot-assisted radical prostatectomy. MATERIALS AND METHODS: Kinematic and events data were recorded for expert (100 or more cases) and novice (less than 100 cases) surgeons performing bladder mobilization, seminal vesicle dissection, anterior vesicourethral anastomosis and right pelvic lymphadenectomy. Expert/novice metrics were compared using mixed effect statistical modeling (construct validation). Expert reviewers blindly rated seminal vesicle dissection and anterior vesicourethral anastomosis using GEARS (Global Evaluative Assessment of Robotic Skills). Intraclass correlation measured inter-rater variability. Objective metrics were correlated to corresponding GEARS metrics using Spearman's test (concurrent validation). RESULTS: The performance of 10 experts (mean 810 cases, range 100 to 2,000) and 10 novices (mean 35 cases, range 5 to 80) was evaluated in 100 robot-assisted radical prostatectomy cases. For construct validation the experts completed operative steps faster (p <0.001) with less instrument travel distance (p <0.01), less aggregate instrument idle time (p <0.001), shorter camera path length (p <0.001) and more frequent camera movements (p <0.03). Experts had a greater ratio of dominant-to-nondominant instrument path distance for all steps (p <0.04) except anterior vesicourethral anastomosis. For concurrent validation the median experience of 3 expert reviewers was 300 cases (range 200 to 500). Intraclass correlation among reviewers was 0.6-0.7. For anterior vesicourethral anastomosis and seminal vesicle dissection, kinematic metrics had low associations with GEARS metrics. CONCLUSIONS: Objective metrics revealed experts to be more efficient and directed during preselected steps of robot-assisted radical prostatectomy. Objective metrics had limited associations to GEARS. These findings lay the foundation for developing standardized metrics for surgeon training and assessment.
PURPOSE: We explore and validate objective surgeon performance metrics using a novel recorder ("dVLogger") to directly capture surgeon manipulations on the da Vinci® Surgical System. We present the initial construct and concurrent validation study of objective metrics during preselected steps of robot-assisted radical prostatectomy. MATERIALS AND METHODS: Kinematic and events data were recorded for expert (100 or more cases) and novice (less than 100 cases) surgeons performing bladder mobilization, seminal vesicle dissection, anterior vesicourethral anastomosis and right pelvic lymphadenectomy. Expert/novice metrics were compared using mixed effect statistical modeling (construct validation). Expert reviewers blindly rated seminal vesicle dissection and anterior vesicourethral anastomosis using GEARS (Global Evaluative Assessment of Robotic Skills). Intraclass correlation measured inter-rater variability. Objective metrics were correlated to corresponding GEARS metrics using Spearman's test (concurrent validation). RESULTS: The performance of 10 experts (mean 810 cases, range 100 to 2,000) and 10 novices (mean 35 cases, range 5 to 80) was evaluated in 100 robot-assisted radical prostatectomy cases. For construct validation the experts completed operative steps faster (p <0.001) with less instrument travel distance (p <0.01), less aggregate instrument idle time (p <0.001), shorter camera path length (p <0.001) and more frequent camera movements (p <0.03). Experts had a greater ratio of dominant-to-nondominant instrument path distance for all steps (p <0.04) except anterior vesicourethral anastomosis. For concurrent validation the median experience of 3 expert reviewers was 300 cases (range 200 to 500). Intraclass correlation among reviewers was 0.6-0.7. For anterior vesicourethral anastomosis and seminal vesicle dissection, kinematic metrics had low associations with GEARS metrics. CONCLUSIONS: Objective metrics revealed experts to be more efficient and directed during preselected steps of robot-assisted radical prostatectomy. Objective metrics had limited associations to GEARS. These findings lay the foundation for developing standardized metrics for surgeon training and assessment.
Authors: Timothy M Kowalewski; Lee W White; Thomas S Lendvay; Iris S Jiang; Robert Sweet; Andrew Wright; Blake Hannaford; Mika N Sinanan Journal: J Surg Res Date: 2014-06-04 Impact factor: 2.192
Authors: Andrew J Hung; Thomas Bottyan; Thomas G Clifford; Sarfaraz Serang; Zein K Nakhoda; Swar H Shah; Hana Yokoi; Monish Aron; Inderbir S Gill Journal: World J Urol Date: 2016-04-22 Impact factor: 4.226
Authors: Monty A Aghazadeh; Isuru S Jayaratna; Andrew J Hung; Michael M Pan; Mihir M Desai; Inderbir S Gill; Alvin C Goh Journal: Surg Endosc Date: 2015-01-22 Impact factor: 4.584
Authors: Hamid Abboudi; Mohammed Shamim Khan; Khurshid A Guru; Saied Froghi; Gunter de Win; Hendrik Van Poppel; Prokar Dasgupta; Kamran Ahmed Journal: BJU Int Date: 2013-10-24 Impact factor: 5.588
Authors: Catherine Lovegrove; Giacomo Novara; Alex Mottrie; Khurshid A Guru; Matthew Brown; Ben Challacombe; Richard Popert; Johar Raza; Henk Van der Poel; James Peabody; Prokar Dasgupta; Kamran Ahmed Journal: Eur Urol Date: 2015-11-14 Impact factor: 20.096
Authors: Andrew J Hung; Jian Chen; Saum Ghodoussipour; Paul J Oh; Zequn Liu; Jessica Nguyen; Sanjay Purushotham; Inderbir S Gill; Yan Liu Journal: BJU Int Date: 2019-03-20 Impact factor: 5.588
Authors: Jessica H Nguyen; Jian Chen; Sandra P Marshall; Saum Ghodoussipour; Andrew Chen; Inderbir S Gill; Andrew J Hung Journal: World J Urol Date: 2019-07-25 Impact factor: 4.226
Authors: Tyler J Loftus; Amanda C Filiberto; Jeremy Balch; Alexander L Ayzengart; Patrick J Tighe; Parisa Rashidi; Azra Bihorac; Gilbert R Upchurch Journal: J Surg Res Date: 2020-04-24 Impact factor: 2.192