BACKGROUND: We previously developed a comprehensive proficiency-based robotic training curriculum demonstrating construct, content, and face validity. This study aimed to assess reliability, feasibility, and educational benefit associated with curricular implementation. METHODS: Over an 11-month period, 55 residents, fellows, and faculty (robotic novices) from general surgery, urology, and gynecology were enrolled in a 2-month curriculum: online didactics, half-day hands-on tutorial, and self-practice using nine inanimate exercises. Each trainee completed a questionnaire and performed a single proctored repetition of each task before (pretest) and after (post-test) training. Tasks were scored for time and errors using modified FLS metrics. For inter-rater reliability (IRR), three trainees were scored by two raters and analyzed using intraclass correlation coefficients (ICC). Data from eight experts were analyzed using ICC and Cronbach's α to determine test-retest reliability and internal consistency, respectively. Educational benefit was assessed by comparing baseline (pretest) and final (post-test) trainee performance; comparisons used Wilcoxon signed-rank test. RESULTS: Of the 55 trainees that pretested, 53 (96 %) completed all curricular components in 9-17 h and reached proficiency after completing an average of 72 ± 28 repetitions over 5 ± 1 h. Trainees indicated minimal prior robotic experience and "poor comfort" with robotic skills at baseline (1.8 ± 0.9) compared to final testing (3.1 ± 0.8, p < 0.001). IRR data for the composite score revealed an ICC of 0.96 (p < 0.001). Test-retest reliability was 0.91 (p < 0.001) and internal consistency was 0.81. Performance improved significantly after training for all nine tasks and according to composite scores (548 ± 176 vs. 914 ± 81, p < 0.001), demonstrating educational benefit. CONCLUSION: This curriculum is associated with high reliability measures, demonstrated feasibility for a large cohort of trainees, and yielded significant educational benefit. Further studies and adoption of this curriculum are encouraged.
BACKGROUND: We previously developed a comprehensive proficiency-based robotic training curriculum demonstrating construct, content, and face validity. This study aimed to assess reliability, feasibility, and educational benefit associated with curricular implementation. METHODS: Over an 11-month period, 55 residents, fellows, and faculty (robotic novices) from general surgery, urology, and gynecology were enrolled in a 2-month curriculum: online didactics, half-day hands-on tutorial, and self-practice using nine inanimate exercises. Each trainee completed a questionnaire and performed a single proctored repetition of each task before (pretest) and after (post-test) training. Tasks were scored for time and errors using modified FLS metrics. For inter-rater reliability (IRR), three trainees were scored by two raters and analyzed using intraclass correlation coefficients (ICC). Data from eight experts were analyzed using ICC and Cronbach's α to determine test-retest reliability and internal consistency, respectively. Educational benefit was assessed by comparing baseline (pretest) and final (post-test) trainee performance; comparisons used Wilcoxon signed-rank test. RESULTS: Of the 55 trainees that pretested, 53 (96 %) completed all curricular components in 9-17 h and reached proficiency after completing an average of 72 ± 28 repetitions over 5 ± 1 h. Trainees indicated minimal prior robotic experience and "poor comfort" with robotic skills at baseline (1.8 ± 0.9) compared to final testing (3.1 ± 0.8, p < 0.001). IRR data for the composite score revealed an ICC of 0.96 (p < 0.001). Test-retest reliability was 0.91 (p < 0.001) and internal consistency was 0.81. Performance improved significantly after training for all nine tasks and according to composite scores (548 ± 176 vs. 914 ± 81, p < 0.001), demonstrating educational benefit. CONCLUSION: This curriculum is associated with high reliability measures, demonstrated feasibility for a large cohort of trainees, and yielded significant educational benefit. Further studies and adoption of this curriculum are encouraged.
Authors: Gerald M Fried; Liane S Feldman; Melina C Vassiliou; Shannon A Fraser; Donna Stanbridge; Gabriela Ghitulescu; Christopher G Andrew Journal: Ann Surg Date: 2004-09 Impact factor: 12.969
Authors: Genevieve Dulan; Robert V Rege; Deborah C Hogg; Kristine K Gilberg-Fisher; Seifu T Tesfay; Daniel J Scott Journal: Am J Surg Date: 2012-02-09 Impact factor: 2.565
Authors: M C Vassiliou; G A Ghitulescu; L S Feldman; D Stanbridge; K Leffondré; H H Sigman; G M Fried Journal: Surg Endosc Date: 2006-02-27 Impact factor: 4.584
Authors: Kevin C Zorn; Gagan Gautam; Arieh L Shalhav; Ralph V Clayman; Thomas E Ahlering; David M Albala; David I Lee; Chandru P Sundaram; Surena F Matin; Erik P Castle; Howard N Winfield; Matthew T Gettman; Benjamin R Lee; Raju Thomas; Vipul R Patel; Raymond J Leveillee; Carson Wong; Gopal H Badlani; Koon H Rha; Scott E Eggener; Peter Wiklund; Alex Mottrie; Fatih Atug; Ali R Kural; Jean V Joseph Journal: J Urol Date: 2009-07-21 Impact factor: 7.450
Authors: Genevieve Dulan; Robert V Rege; Deborah C Hogg; Kristine M Gilberg-Fisher; Nabeel A Arain; Seifu T Tesfay; Daniel J Scott Journal: Surgery Date: 2012-09 Impact factor: 3.982
Authors: Daniel J Kiely; Walter H Gotlieb; Susie Lau; Xing Zeng; Vanessa Samouelian; Agnihotram V Ramanakumar; Helena Zakrzewski; Sonya Brin; Shannon A Fraser; Pira Korsieporn; Laura Drudi; Joshua Z Press Journal: J Robot Surg Date: 2015-05-16
Authors: Michael I Hanzly; Tareq Al-Tartir; Syed Johar Raza; Atif Khan; Mohammad Manan Durrani; Thomas Fiorica; Phillip Ginsberg; James L Mohler; Boris Kuvshinoff; Khurshid A Guru Journal: Curr Urol Rep Date: 2015-06 Impact factor: 3.092
Authors: Amir Szold; Roberto Bergamaschi; Ivo Broeders; Jenny Dankelman; Antonello Forgione; Thomas Langø; Andreas Melzer; Yoav Mintz; Salvador Morales-Conde; Michael Rhodes; Richard Satava; Chung-Ngai Tang; Ramon Vilallonga Journal: Surg Endosc Date: 2014-11-08 Impact factor: 4.584
Authors: Rabi R Datta; Sebastian Schönhage; Thomas Dratsch; Justus Toader; Dolores T Müller; Roger Wahba; Robert Kleinert; Michael Thomas; Georg Dieplinger; Dirk L Stippel; Christiane J Bruns; Hans F Fuchs Journal: Surg Endosc Date: 2020-09-23 Impact factor: 4.584