James T Mills1, Helen Y Hougen2, Daniel Bitner2, Tracey L Krupski3, Noah S Schenkman3. 1. Department of Urology, University of Virginia, Charlottesville, Virginia. Electronic address: jtm5se@virginia.edu. 2. University of Virginia School of Medicine, Charlottesville, Virginia. 3. Department of Urology, University of Virginia, Charlottesville, Virginia.
Abstract
OBJECTIVE: To assess the relationship between robotic surgical simulation performance and the real-life surgical skill of attending surgeons. We hypothesized that simulation performance would not correlate with real-life robotic surgical skill in attending surgeons. DESIGN: In 2013, Birkmeyer et al. demonstrated an association between laparoscopic surgical performance as determined by expert review of video clips and surgical outcomes. Using that model of expert review, we studied the relationship between robotic simulator performance and real-life surgical skill. Ten attending robotic surgeons performed 4 tasks on the da Vinci Skills Simulator (Camera Targeting 1, Ring Walk 3, Suture Sponge 3, and Energy Dissection 3). Two video clips of a robotic-assisted operation were then recorded for each surgeon. Three expert robotic surgeons reviewed the recordings and rated surgical technique using the Global Evaluative Assessment of Robotic Skills. SETTING: University of Virginia; Charlottesville, VA; tertiary hospital PARTICIPANTS: All attending surgeons who perform robotic-assisted surgery at our institution were enrolled and completed the study. RESULTS: The surgeons had a median of 7.25 years of robotic surgical experience with a median of 91 cases (ranging: 20-346 cases) in the last 4 years. Median scores for each simulator task were 87.5%, 39.0%, 77.5%, and 81.5%. Using Pearson's correlation, scores for each of the individual tasks correlated poorly with expert review of intraoperative performance. There was also no correlation (r = -0.0304) between overall simulation score (mean: 70.7 ± 9.6%) and expert video ratings (mean: 3.66 ± 0.32 points). CONCLUSIONS: There was no correlation between attending surgeons' simulator performance and expert ratings of intraoperative videos based on the Global Evaluative Assessment of Robotic Skills scale. Although novice surgeons may put considerable effort into training on robotic simulators, performance on a simulator may not correlate with attending robotic surgical performance. Development of simulation exercises that guide novice surgeons toward expert performance is needed.
OBJECTIVE: To assess the relationship between robotic surgical simulation performance and the real-life surgical skill of attending surgeons. We hypothesized that simulation performance would not correlate with real-life robotic surgical skill in attending surgeons. DESIGN: In 2013, Birkmeyer et al. demonstrated an association between laparoscopic surgical performance as determined by expert review of video clips and surgical outcomes. Using that model of expert review, we studied the relationship between robotic simulator performance and real-life surgical skill. Ten attending robotic surgeons performed 4 tasks on the da Vinci Skills Simulator (Camera Targeting 1, Ring Walk 3, Suture Sponge 3, and Energy Dissection 3). Two video clips of a robotic-assisted operation were then recorded for each surgeon. Three expert robotic surgeons reviewed the recordings and rated surgical technique using the Global Evaluative Assessment of Robotic Skills. SETTING: University of Virginia; Charlottesville, VA; tertiary hospital PARTICIPANTS: All attending surgeons who perform robotic-assisted surgery at our institution were enrolled and completed the study. RESULTS: The surgeons had a median of 7.25 years of robotic surgical experience with a median of 91 cases (ranging: 20-346 cases) in the last 4 years. Median scores for each simulator task were 87.5%, 39.0%, 77.5%, and 81.5%. Using Pearson's correlation, scores for each of the individual tasks correlated poorly with expert review of intraoperative performance. There was also no correlation (r = -0.0304) between overall simulation score (mean: 70.7 ± 9.6%) and expert video ratings (mean: 3.66 ± 0.32 points). CONCLUSIONS: There was no correlation between attending surgeons' simulator performance and expert ratings of intraoperative videos based on the Global Evaluative Assessment of Robotic Skills scale. Although novice surgeons may put considerable effort into training on robotic simulators, performance on a simulator may not correlate with attending robotic surgical performance. Development of simulation exercises that guide novice surgeons toward expert performance is needed.
Keywords:
Patient Care; Practice-Based Learning and Improvement; clinical competence in medical education; education; robotics; simulation center; surgery; training
Authors: Saba Balvardi; Anitha Kammili; Melissa Hanson; Carmen Mueller; Melina Vassiliou; Lawrence Lee; Kevin Schwartzman; Julio F Fiore; Liane S Feldman Journal: Surg Endosc Date: 2022-05-12 Impact factor: 4.584
Authors: M W Schmidt; K F Köppinger; C Fan; K-F Kowalewski; L P Schmidt; J Vey; T Proctor; P Probst; V V Bintintan; B-P Müller-Stich; F Nickel Journal: BJS Open Date: 2021-03-05
Authors: Andreas S Vilmann; Christian Lachenmeier; Morten Bo S Svendsen; Bo Soendergaard; Yoon S Park; Lars Bo Svendsen; Lars Konge Journal: Endosc Int Open Date: 2022-01-14