Ariel Kate Dubin1, Danielle Julian2, Alyssa Tanaka3, Patricia Mattingly4, Roger Smith2. 1. Department of Obstetrics and Gynecology, Columbia University Medical Center, 622 W 168th Street PH 16-127, New York, NY, 10032, USA. akhdubin@gmail.com. 2. Florida Hospital Nicholson Center, Orlando, FL, USA. 3. SoarTech Inc., Orlando, FL, USA. 4. Department of Obstetrics and Gynecology, Columbia University Medical Center, 622 W 168th Street PH 16-127, New York, NY, 10032, USA.
Abstract
BACKGROUND: Surgical education relies heavily upon simulation. Assessment tools include robotic simulator assessments and Global Evaluative Assessment of Robotic Skills (GEARS) metrics, which have been validated. Training programs use GEARS for proficiency testing; however, it requires a trained human evaluator. Due to limited time, learners are reliant on surgical simulator feedback to improve their skills. GEARS and simulator scores have been shown to be correlated but in what capacity is unknown. Our goal is to develop a model for predicting GEARS score using simulator metrics. METHODS: Linear and multivariate logistic regressions were used on previously reported data by this group. Subjects performed simple (Ring and Rail 1) and complex (Suture Sponge 1) tasks on simulators, the dV-Trainer (dVT) and the da Vinci Skills Simulator (dVSS). They were scored via simulator metrics and GEARS. RESULTS: A linear model for each simulator and exercise showed a positive linear correlation. Equations were developed for predicting GEARS Total Score from simulator Overall Score. Next, the effects of each individual simulator metric on the GEARS Total Score for each simulator and exercise were examined. On the dVSS, Excessive Instrument Force was significant for Ring and Rail 1 and Instrument Collision was significant for Suture Sponge 1. On the dVT, Time to Complete was significant for both exercises. Once the significant variables were identified, multivariate models were generated. Comparing the predicted GEARS Total Score from the linear model (using only simulator Overall Score) to that using the multivariate model (using the significant variables for each simulator and exercise), the results were similar. CONCLUSIONS: Our results suggest that trainees can use simulator Overall Score to predict GEARS Total Score using our linear regression equations. This can improve the training process for those preparing for high-stakes assessments.
BACKGROUND: Surgical education relies heavily upon simulation. Assessment tools include robotic simulator assessments and Global Evaluative Assessment of Robotic Skills (GEARS) metrics, which have been validated. Training programs use GEARS for proficiency testing; however, it requires a trained human evaluator. Due to limited time, learners are reliant on surgical simulator feedback to improve their skills. GEARS and simulator scores have been shown to be correlated but in what capacity is unknown. Our goal is to develop a model for predicting GEARS score using simulator metrics. METHODS: Linear and multivariate logistic regressions were used on previously reported data by this group. Subjects performed simple (Ring and Rail 1) and complex (Suture Sponge 1) tasks on simulators, the dV-Trainer (dVT) and the da Vinci Skills Simulator (dVSS). They were scored via simulator metrics and GEARS. RESULTS: A linear model for each simulator and exercise showed a positive linear correlation. Equations were developed for predicting GEARS Total Score from simulator Overall Score. Next, the effects of each individual simulator metric on the GEARS Total Score for each simulator and exercise were examined. On the dVSS, Excessive Instrument Force was significant for Ring and Rail 1 and Instrument Collision was significant for Suture Sponge 1. On the dVT, Time to Complete was significant for both exercises. Once the significant variables were identified, multivariate models were generated. Comparing the predicted GEARS Total Score from the linear model (using only simulator Overall Score) to that using the multivariate model (using the significant variables for each simulator and exercise), the results were similar. CONCLUSIONS: Our results suggest that trainees can use simulator Overall Score to predict GEARS Total Score using our linear regression equations. This can improve the training process for those preparing for high-stakes assessments.
Authors: Andrew J Hung; Mukul B Patil; Pascal Zehnder; Jie Cai; Casey K Ng; Monish Aron; Inderbir S Gill; Mihir M Desai Journal: J Urol Date: 2011-12-15 Impact factor: 7.450
Authors: Daniel J Kiely; Walter H Gotlieb; Susie Lau; Xing Zeng; Vanessa Samouelian; Agnihotram V Ramanakumar; Helena Zakrzewski; Sonya Brin; Shannon A Fraser; Pira Korsieporn; Laura Drudi; Joshua Z Press Journal: J Robot Surg Date: 2015-05-16
Authors: Andrew J Hung; Thomas Bottyan; Thomas G Clifford; Sarfaraz Serang; Zein K Nakhoda; Swar H Shah; Hana Yokoi; Monish Aron; Inderbir S Gill Journal: World J Urol Date: 2016-04-22 Impact factor: 4.226
Authors: Dimitrios Stefanidis; Nick Sevdalis; John Paige; Boris Zevin; Rajesh Aggarwal; Teodor Grantcharov; Daniel B Jones Journal: Ann Surg Date: 2015-05 Impact factor: 12.969
Authors: Amir Baghdadi; Ahmed A Hussein; Youssef Ahmed; Lora A Cavuoto; Khurshid A Guru Journal: Int J Comput Assist Radiol Surg Date: 2018-11-20 Impact factor: 2.924
Authors: Saratu Kutana; Daniel P Bitner; Poppy Addison; Paul J Chung; Mark A Talamini; Filippo Filicori Journal: Surg Endosc Date: 2022-02-28 Impact factor: 3.453