E M Ritter1, T W Kindelan, C Michael, E A Pimentel, M W Bowyer. 1. NCA Medical Simulation Center, Norman M. Rich Department of Surgery, Uniformed Services University, 4301 Jones Bridge Road, Bethesda, Maryland 20814, USA. eritter@usush.mil
Abstract
OBJECTIVE: Current skills assessment in the Fundamentals of Laparoscopic Surgery (FLS) program is labor intensive, requiring one proctor for every 1-2 subjects. The ProMIS Augmented Reality (AR) simulator (Haptica, Dublin IR) allows for objective assessment of physical tasks through instrument tracking technology. We hypothesized that the ProMIS metrics could differentiate between ability groups as well as standard FLS scoring with fewer personnel requirements METHODS: We recruited 60 volunteer subjects. Subjects were stratified based on their laparoscopic surgical experience. Those who had performed more than 100 laparoscopic procedures were considered experienced (n = 8). Those with fewer than 10 laparoscopic procedures were considered novices (n = 44). The rest were intermediates (n = 8). All subjects performed up to five trials of the peg transfer task from FLS in the ProMIS simulator. The FLS score, instrument path length, and instrument smoothness assessment were generated for each trial. RESULTS: For each of the five trials, experienced surgeons outperformed intermediates, who in turn outperformed novices. Statistically significant differences were seen between the groups across all trials for FLS score (p < 0.001), ProMIS path length (p < 0.001), and ProMIS smoothness (p < 0.001). When the FLS score was compared to the path length and smoothness metrics, a strong relationship between the scores was apparent for novices (r = 0.78, r = 0.94, p < 0.001) respectively), intermediates (r = 0.5, p = 0.2, r = 0.98, p < 0.001), and experienced surgeons (r = 0.86, p = 0.006, r = 0.99, p < 0.001). CONCLUSIONS: The construct that the standard scoring of the FLS peg transfer task can discriminate between experienced, intermediate, and novice surgeons is validated. The same construct is valid when the task is assessed using the metrics of the ProMIS. The high correlation between these scores establishes the concurrent validity of the ProMIS metrics. The use of AR for objective assessment of FLS tasks could reduce the personnel requirements of assessing these skills while maintaining the objectivity.
OBJECTIVE: Current skills assessment in the Fundamentals of Laparoscopic Surgery (FLS) program is labor intensive, requiring one proctor for every 1-2 subjects. The ProMIS Augmented Reality (AR) simulator (Haptica, Dublin IR) allows for objective assessment of physical tasks through instrument tracking technology. We hypothesized that the ProMIS metrics could differentiate between ability groups as well as standard FLS scoring with fewer personnel requirements METHODS: We recruited 60 volunteer subjects. Subjects were stratified based on their laparoscopic surgical experience. Those who had performed more than 100 laparoscopic procedures were considered experienced (n = 8). Those with fewer than 10 laparoscopic procedures were considered novices (n = 44). The rest were intermediates (n = 8). All subjects performed up to five trials of the peg transfer task from FLS in the ProMIS simulator. The FLS score, instrument path length, and instrument smoothness assessment were generated for each trial. RESULTS: For each of the five trials, experienced surgeons outperformed intermediates, who in turn outperformed novices. Statistically significant differences were seen between the groups across all trials for FLS score (p < 0.001), ProMIS path length (p < 0.001), and ProMIS smoothness (p < 0.001). When the FLS score was compared to the path length and smoothness metrics, a strong relationship between the scores was apparent for novices (r = 0.78, r = 0.94, p < 0.001) respectively), intermediates (r = 0.5, p = 0.2, r = 0.98, p < 0.001), and experienced surgeons (r = 0.86, p = 0.006, r = 0.99, p < 0.001). CONCLUSIONS: The construct that the standard scoring of the FLS peg transfer task can discriminate between experienced, intermediate, and novice surgeons is validated. The same construct is valid when the task is assessed using the metrics of the ProMIS. The high correlation between these scores establishes the concurrent validity of the ProMIS metrics. The use of AR for objective assessment of FLS tasks could reduce the personnel requirements of assessing these skills while maintaining the objectivity.
Authors: Neal E Seymour; Anthony G Gallagher; Sanziana A Roman; Michael K O'Brien; Vipin K Bansal; Dana K Andersen; Richard M Satava Journal: Ann Surg Date: 2002-10 Impact factor: 12.969
Authors: Gerald M Fried; Liane S Feldman; Melina C Vassiliou; Shannon A Fraser; Donna Stanbridge; Gabriela Ghitulescu; Christopher G Andrew Journal: Ann Surg Date: 2004-09 Impact factor: 12.969
Authors: Anthony G Gallagher; E Matt Ritter; Howard Champion; Gerald Higgins; Marvin P Fried; Gerald Moses; C Daniel Smith; Richard M Satava Journal: Ann Surg Date: 2005-02 Impact factor: 12.969
Authors: J B Pagador; J Uson; M A Sánchez; J L Moyano; J Moreno; P Bustos; J Mateos; F M Sánchez-Margallo Journal: Int J Comput Assist Radiol Surg Date: 2010-08-11 Impact factor: 2.924
Authors: Fabien Leblanc; Conor P Delaney; Clyde N Ellis; Paul C Neary; Bradley J Champagne; Anthony J Senagore Journal: World J Surg Date: 2010-12 Impact factor: 3.352
Authors: Ignacio Oropesa; Patricia Sánchez-González; Magdalena K Chmarra; Pablo Lamata; Alvaro Fernández; Juan A Sánchez-Margallo; Frank Willem Jansen; Jenny Dankelman; Francisco M Sánchez-Margallo; Enrique J Gómez Journal: Surg Endosc Date: 2012-10-06 Impact factor: 4.584
Authors: Alexandre Y Derevianko; Steven D Schwaitzberg; Shawn Tsuda; Limaris Barrios; David C Brooks; Mark P Callery; David Fobert; Noel Irias; David W Rattner; Daniel B Jones Journal: Surg Endosc Date: 2009-08-18 Impact factor: 4.584