BACKGROUND: Current evaluation methods for robotic-assisted surgery (ARCS or GEARS) are limited to 5-point Likert scales which are inherently time-consuming and require a degree of subjective scoring. In this study, we demonstrate a method to break down complex robotic surgical procedures using a combination of an objective cumulative sum (CUSUM) analysis and kinematics data obtained from the da Vinci® Surgical System to evaluate the performance of novice robotic surgeons. METHODS: Two HPB fellows performed 40 robotic-assisted hepaticojejunostomy reconstructions to model a portion of a Whipple procedure. Kinematics data from the da Vinci® system was recorded using the dV Logger® while CUSUM analyses were performed for each procedural step. Each kinematic variable was modeled using machine learning to reflect the fellows' learning curves for each task. Statistically significant kinematics variables were then combined into a single formula to create the operative robotic index (ORI). RESULTS: The inflection points of our overall CUSUM analysis showed improvement in technical performance beginning at trial 16. The derived ORI model showed a strong fit to our observed kinematics data (R2 = 0.796) with an ability to distinguish between novice and intermediate robotic performance with 89.3% overall accuracy. CONCLUSIONS: In this study, we demonstrate a novel approach to objectively break down novice performance on the da Vinci® Surgical System. We identified kinematics variables associated with improved overall technical performance to create an objective ORI. This approach to robotic operative evaluation demonstrates a valuable method to break down complex surgical procedures in an objective, stepwise fashion. Continued research into objective methods of evaluation for robotic surgery will be invaluable for future training and clinical implementation of the robotic platform.
BACKGROUND: Current evaluation methods for robotic-assisted surgery (ARCS or GEARS) are limited to 5-point Likert scales which are inherently time-consuming and require a degree of subjective scoring. In this study, we demonstrate a method to break down complex robotic surgical procedures using a combination of an objective cumulative sum (CUSUM) analysis and kinematics data obtained from the da Vinci® Surgical System to evaluate the performance of novice robotic surgeons. METHODS: Two HPB fellows performed 40 robotic-assisted hepaticojejunostomy reconstructions to model a portion of a Whipple procedure. Kinematics data from the da Vinci® system was recorded using the dV Logger® while CUSUM analyses were performed for each procedural step. Each kinematic variable was modeled using machine learning to reflect the fellows' learning curves for each task. Statistically significant kinematics variables were then combined into a single formula to create the operative robotic index (ORI). RESULTS: The inflection points of our overall CUSUM analysis showed improvement in technical performance beginning at trial 16. The derived ORI model showed a strong fit to our observed kinematics data (R2 = 0.796) with an ability to distinguish between novice and intermediate robotic performance with 89.3% overall accuracy. CONCLUSIONS: In this study, we demonstrate a novel approach to objectively break down novice performance on the da Vinci® Surgical System. We identified kinematics variables associated with improved overall technical performance to create an objective ORI. This approach to robotic operative evaluation demonstrates a valuable method to break down complex surgical procedures in an objective, stepwise fashion. Continued research into objective methods of evaluation for robotic surgery will be invaluable for future training and clinical implementation of the robotic platform.
Authors: Melissa E Hogg; Mazen Zenati; Stephanie Novak; Yong Chen; Yan Jun; Jennifer Steve; Stacy J Kowalsky; David L Bartlett; Amer H Zureikat; Herbert J Zeh Journal: Ann Surg Date: 2016-09 Impact factor: 12.969
Authors: John D Birkmeyer; Jonathan F Finks; Amanda O'Reilly; Mary Oerline; Arthur M Carlin; Andre R Nunn; Justin Dimick; Mousumi Banerjee; Nancy J O Birkmeyer Journal: N Engl J Med Date: 2013-10-10 Impact factor: 91.245
Authors: Shanley B Deal; Dimitrios Stefanidis; Dana Telem; Robert D Fanelli; Marian McDonald; Michael Ujiki; L Michael Brunt; Adnan A Alseidi Journal: Surg Endosc Date: 2017-04-25 Impact factor: 4.584
Authors: René Vonlanthen; Ksenija Slankamenac; Stefan Breitenstein; Milo A Puhan; Markus K Muller; Dieter Hahnloser; Dimitri Hauri; Rolf Graf; Pierre-Alain Clavien Journal: Ann Surg Date: 2011-12 Impact factor: 12.969
Authors: Hugh Mackenzie; Danilo Miskovic; Melody Ni; Amjad Parvaiz; Austin G Acheson; John T Jenkins; John Griffith; Mark G Coleman; George B Hanna Journal: Surg Endosc Date: 2013-02-08 Impact factor: 4.584