M Ershad1, R Rege2, A Majewicz Fey2,3. 1. Department of Electrical Engineering, University of Texas at Dallas, Richardson, TX, 75080, USA. marzieh.ershadlangroodi@utdallas.edu. 2. Department of Surgery, UT Southwestern Medical Center, Dallas, TX, 75390, USA. 3. Department of Mechanical Engineering, University of Texas at Dallas, Richardson, TX, 75080, USA.
Abstract
OBJECTIVE: Quantitative assessment of surgical skills is an important aspect of surgical training; however, the proposed metrics are sometimes difficult to interpret and may not capture the stylistic characteristics that define expertise. This study proposes a methodology for evaluating the surgical skill, based on metrics associated with stylistic adjectives, and evaluates the ability of this method to differentiate expertise levels. METHODS: We recruited subjects from different expertise levels to perform training tasks on a surgical simulator. A lexicon of contrasting adjective pairs, based on important skills for robotic surgery, inspired by the global evaluative assessment of robotic skills tool, was developed. To validate the use of stylistic adjectives for surgical skill assessment, posture videos of the subjects performing the task, as well as videos of the task were rated by crowd-workers. Metrics associated with each adjective were found using kinematic and physiological measurements through correlation with the crowd-sourced adjective assignment ratings. To evaluate the chosen metrics' ability in distinguishing expertise levels, two classifiers were trained and tested using these metrics. RESULTS: Crowd-assignment ratings for all adjectives were significantly correlated with expertise levels. The results indicate that naive Bayes classifier performs the best, with an accuracy of [Formula: see text], [Formula: see text], [Formula: see text], and [Formula: see text] when classifying into four, three, and two levels of expertise, respectively. CONCLUSION: The proposed method is effective at mapping understandable adjectives of expertise to the stylistic movements and physiological response of trainees.
OBJECTIVE: Quantitative assessment of surgical skills is an important aspect of surgical training; however, the proposed metrics are sometimes difficult to interpret and may not capture the stylistic characteristics that define expertise. This study proposes a methodology for evaluating the surgical skill, based on metrics associated with stylistic adjectives, and evaluates the ability of this method to differentiate expertise levels. METHODS: We recruited subjects from different expertise levels to perform training tasks on a surgical simulator. A lexicon of contrasting adjective pairs, based on important skills for robotic surgery, inspired by the global evaluative assessment of robotic skills tool, was developed. To validate the use of stylistic adjectives for surgical skill assessment, posture videos of the subjects performing the task, as well as videos of the task were rated by crowd-workers. Metrics associated with each adjective were found using kinematic and physiological measurements through correlation with the crowd-sourced adjective assignment ratings. To evaluate the chosen metrics' ability in distinguishing expertise levels, two classifiers were trained and tested using these metrics. RESULTS: Crowd-assignment ratings for all adjectives were significantly correlated with expertise levels. The results indicate that naive Bayes classifier performs the best, with an accuracy of [Formula: see text], [Formula: see text], [Formula: see text], and [Formula: see text] when classifying into four, three, and two levels of expertise, respectively. CONCLUSION: The proposed method is effective at mapping understandable adjectives of expertise to the stylistic movements and physiological response of trainees.
Authors: Narges Ahmidi; Gregory D Hager; Lisa Ishii; Gabor Fichtinger; Gary L Gallia; Masaru Ishii Journal: Med Image Comput Comput Assist Interv Date: 2010
Authors: Melina C Vassiliou; Liane S Feldman; Christopher G Andrew; Simon Bergman; Karen Leffondré; Donna Stanbridge; Gerald M Fried Journal: Am J Surg Date: 2005-07 Impact factor: 2.565
Authors: Lee W White; Timothy M Kowalewski; Rodney Lee Dockter; Bryan Comstock; Blake Hannaford; Thomas S Lendvay Journal: J Endourol Date: 2015-08-24 Impact factor: 2.942