Peter J Frederick1, J Brian Szender2, Ahmed A Hussein3, Joshua P Kesterson4, James A Shelton5, Ted L Anderson6, Vanessa M Barnabei5, Khurshid Guru7. 1. Department of Gynecologic Oncology, Roswell Park Cancer Institute, Buffalo, New York. Electronic address: peter.frederick@roswellpark.org. 2. Department of Gynecologic Oncology, Roswell Park Cancer Institute, Buffalo, New York. 3. Department of Urologic Oncology, Roswell Park Cancer Institute, Buffalo, New York; Department of Urology, Cairo University, Cairo, Egypt. 4. Department of Gynecologic Oncology, Penn State Milton S. Hershey Medical Center, Hershey, Pennsylvania. 5. Department of Obstetrics and Gynecology, State University of New York at Buffalo, Buffalo, New York. 6. Department of Obstetrics and Gynecology, Vanderbilt University, Nashville, Tennessee. 7. Department of Urologic Oncology, Roswell Park Cancer Institute, Buffalo, New York.
Abstract
STUDY OBJECTIVE: To develop and validate a procedure-specific scoring algorithm to objectively measure robotic surgical skills during robot-assisted hysterectomy and to facilitate robotic surgery training and education. DESIGN: (Canadian Task Force classification III). SETTING: A National Comprehensive Cancer Network-designated comprehensive cancer center. PATIENTS: Deidentified videos for robot-assisted hysterectomies were evaluated. INTERVENTIONS: Videos from 26 robotic hysterectomies performed by surgeons with varying degrees of experience using the scoring system were evaluated. In phase I, critical elements of a robotic hysterectomy were deconstructed into 6 key domains to assess technical skills for procedure completion. Anchor descriptions were developed for each domain to match a 5-point Likert scale. Delphi methodology was used for content validation. A panel of 5 expert robotic surgeons refined this scoring system. In phase II, video recordings of procedures performed by surgeons with varying degrees of experience (expert, advanced beginner, and novice) were evaluated by blinded expert reviewers using the scoring system. Descriptive statistics were used to summarize the scores for each domain. Intraclass correlation was used to determine the interrater reliability. A p value <.05 was considered significant. MEASUREMENTS AND MAIN RESULTS: The average score for the 3 classes of surgeon was 75.6 for expert, 71.3 for advanced beginner, and 69.0 for novice (p = .006). There were significant differences in scores of most individual domains among the various classes of surgeons. Novice surgeons took significantly longer than expert surgeons to complete their half of a hysterectomy (22.2 vs 12.0 minutes; p = .001). CONCLUSION: This pilot study demonstrates the feasibility of using a standardized rubric for clinical skills assessment in robotic hysterectomy. Blinded expert reviewers were able to differentiate between varying levels of surgical experience using this assessment tool.
STUDY OBJECTIVE: To develop and validate a procedure-specific scoring algorithm to objectively measure robotic surgical skills during robot-assisted hysterectomy and to facilitate robotic surgery training and education. DESIGN: (Canadian Task Force classification III). SETTING: A National Comprehensive Cancer Network-designated comprehensive cancer center. PATIENTS: Deidentified videos for robot-assisted hysterectomies were evaluated. INTERVENTIONS: Videos from 26 robotic hysterectomies performed by surgeons with varying degrees of experience using the scoring system were evaluated. In phase I, critical elements of a robotic hysterectomy were deconstructed into 6 key domains to assess technical skills for procedure completion. Anchor descriptions were developed for each domain to match a 5-point Likert scale. Delphi methodology was used for content validation. A panel of 5 expert robotic surgeons refined this scoring system. In phase II, video recordings of procedures performed by surgeons with varying degrees of experience (expert, advanced beginner, and novice) were evaluated by blinded expert reviewers using the scoring system. Descriptive statistics were used to summarize the scores for each domain. Intraclass correlation was used to determine the interrater reliability. A p value <.05 was considered significant. MEASUREMENTS AND MAIN RESULTS: The average score for the 3 classes of surgeon was 75.6 for expert, 71.3 for advanced beginner, and 69.0 for novice (p = .006). There were significant differences in scores of most individual domains among the various classes of surgeons. Novice surgeons took significantly longer than expert surgeons to complete their half of a hysterectomy (22.2 vs 12.0 minutes; p = .001). CONCLUSION: This pilot study demonstrates the feasibility of using a standardized rubric for clinical skills assessment in robotic hysterectomy. Blinded expert reviewers were able to differentiate between varying levels of surgical experience using this assessment tool.
Authors: Ahmed A Hussein; Kevin J Sexton; Paul R May; Maxwell V Meng; Abolfazl Hosseini; Daniel D Eun; Siamak Daneshmand; Bernard H Bochner; James O Peabody; Ronney Abaza; Eila C Skinner; Richard E Hautmann; Khurshid A Guru Journal: Surg Endosc Date: 2018-04-13 Impact factor: 4.584
Authors: Saratu Kutana; Daniel P Bitner; Poppy Addison; Paul J Chung; Mark A Talamini; Filippo Filicori Journal: Surg Endosc Date: 2022-02-28 Impact factor: 3.453