Marc Levin1, Tyler McKechnie2, Shuja Khalid3, Teodor P Grantcharov4, Mitchell Goldenberg4. 1. Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada. Electronic address: marc.levin@medportal.ca. 2. Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada. 3. Surgical Safety Technologies, Li Ka Shing International Knowledge Institute, Toronto, Ontario, Canada. 4. Surgical Safety Technologies, Li Ka Shing International Knowledge Institute, Toronto, Ontario, Canada; Department of Surgery, University of Toronto, Toronto, Ontario, Canada.
Abstract
OBJECTIVE: The goal of the current study is to systematically review the literature addressing the use of automated methods to evaluate technical skills in surgery. BACKGROUND: The classic apprenticeship model of surgical training includes subjective assessments of technical skill. However, automated methods to evaluate surgical technical skill have been recently studied. These automated methods are a more objective, versatile, and analytical way to evaluate a surgical trainee's technical skill. STUDY DESIGN: A literature search of the Ovid Medline, Web of Science, and EMBASE Classic databases was performed. Articles evaluating automated methods for surgical technical skill assessment were abstracted. The quality of all included studies was assessed using the Medical Education Research Study Quality Instrument. RESULTS: A total of 1715 articles were identified, 76 of which were selected for final analysis. An automated methods pathway was defined that included kinetics and computer vision data extraction methods. Automated methods included tool motion tracking, hand motion tracking, eye motion tracking, and muscle contraction analysis. Finally, machine learning, deep learning, and performance classification were used to analyse these methods. These methods of surgical skill assessment were used in the operating room and simulated environments. The average Medical Education Research Study Quality Instrument score across all studies was 10.86 (maximum score of 18). CONCLUSIONS: Automated methods for technical skill assessment is a growing field in surgical education. We found quality studies evaluating these techniques across many environments and surgeries. More research must be done to ensure these techniques are further verified and implemented in surgical curricula.
OBJECTIVE: The goal of the current study is to systematically review the literature addressing the use of automated methods to evaluate technical skills in surgery. BACKGROUND: The classic apprenticeship model of surgical training includes subjective assessments of technical skill. However, automated methods to evaluate surgical technical skill have been recently studied. These automated methods are a more objective, versatile, and analytical way to evaluate a surgical trainee's technical skill. STUDY DESIGN: A literature search of the Ovid Medline, Web of Science, and EMBASE Classic databases was performed. Articles evaluating automated methods for surgical technical skill assessment were abstracted. The quality of all included studies was assessed using the Medical Education Research Study Quality Instrument. RESULTS: A total of 1715 articles were identified, 76 of which were selected for final analysis. An automated methods pathway was defined that included kinetics and computer vision data extraction methods. Automated methods included tool motion tracking, hand motion tracking, eye motion tracking, and muscle contraction analysis. Finally, machine learning, deep learning, and performance classification were used to analyse these methods. These methods of surgical skill assessment were used in the operating room and simulated environments. The average Medical Education Research Study Quality Instrument score across all studies was 10.86 (maximum score of 18). CONCLUSIONS: Automated methods for technical skill assessment is a growing field in surgical education. We found quality studies evaluating these techniques across many environments and surgeries. More research must be done to ensure these techniques are further verified and implemented in surgical curricula.
Authors: M Takeuchi; T Collins; A Ndagijimana; H Kawakubo; Y Kitagawa; J Marescaux; D Mutter; S Perretta; A Hostettler; B Dallemagne Journal: Hernia Date: 2022-05-10 Impact factor: 4.739
Authors: Ryan Daniel; Tyler McKechnie; Colin C Kruse; Marc Levin; Yung Lee; Aristithes G Doumouras; Dennis Hong; Cagla Eskicioglu Journal: Surg Endosc Date: 2022-06-23 Impact factor: 3.453
Authors: I-Hsuan Alan Chen; Ahmed Ghazi; Ashwin Sridhar; Danail Stoyanov; Mark Slack; John D Kelly; Justin W Collins Journal: World J Urol Date: 2020-11-06 Impact factor: 4.226