Lane L Frasier1, David P Azari2, Yue Ma1, Sudha R Pavuluri Quamme1, Robert G Radwin3, Carla M Pugh1, Thomas Y Yen3, Chia-Hsiung Chen4, Caprice C Greenberg5. 1. Wisconsin Surgical Outcomes Research Program, Department of Surgery, University of Wisconsin-Madison, Madison, WI. 2. Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, WI. 3. Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, WI; Department of Biomedical Engineering, University of Wisconsin-Madison, Madison, WI. 4. Department of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, WI. 5. Wisconsin Surgical Outcomes Research Program, Department of Surgery, University of Wisconsin-Madison, Madison, WI; Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, WI. Electronic address: greenberg@surgery.wisc.edu.
Abstract
BACKGROUND: Often in simulated settings, quantitative analysis of technical skill relies largely on specially tagged instruments or tracers on surgeons' hands. We investigated a novel, marker-less technique for evaluating technical skill during open operations and for differentiating tasks and surgeon experience level. METHODS: We recorded the operative field via in-light camera for open operations. Sixteen cases yielded 138 video clips of suturing and tying tasks ≥5 seconds in duration. Video clips were categorized based on surgeon role (attending, resident) and task subtype (suturing tasks: body wall, bowel anastomosis, complex anastomosis; tying tasks: body wall, superficial tying, deep tying). We tracked a region of interest on the hand to generate kinematic data. Nested, multilevel modeling addressed the nonindependence of clips obtained from the same surgeon. RESULTS: Interaction effects for suturing tasks were seen between role and task categories for average speed (P = .04), standard deviation of speed (P = .05), and average acceleration (P = .03). There were significant differences across task categories for standard deviation of acceleration (P = .02). Significant differences for tying tasks across task categories were observed for maximum speed (P = .02); standard deviation of speed (P = .04); and average (P = .02), maximum (P < .01), and standard deviation (P = .03) of acceleration. CONCLUSION: We demonstrated the ability to detect kinematic differences in performance using marker-less tracking during open operative cases. Suturing task evaluation was most sensitive to differences in surgeon role and task category and may represent a scalable approach for providing quantitative feedback to surgeons about technical skill.
BACKGROUND: Often in simulated settings, quantitative analysis of technical skill relies largely on specially tagged instruments or tracers on surgeons' hands. We investigated a novel, marker-less technique for evaluating technical skill during open operations and for differentiating tasks and surgeon experience level. METHODS: We recorded the operative field via in-light camera for open operations. Sixteen cases yielded 138 video clips of suturing and tying tasks ≥5 seconds in duration. Video clips were categorized based on surgeon role (attending, resident) and task subtype (suturing tasks: body wall, bowel anastomosis, complex anastomosis; tying tasks: body wall, superficial tying, deep tying). We tracked a region of interest on the hand to generate kinematic data. Nested, multilevel modeling addressed the nonindependence of clips obtained from the same surgeon. RESULTS: Interaction effects for suturing tasks were seen between role and task categories for average speed (P = .04), standard deviation of speed (P = .05), and average acceleration (P = .03). There were significant differences across task categories for standard deviation of acceleration (P = .02). Significant differences for tying tasks across task categories were observed for maximum speed (P = .02); standard deviation of speed (P = .04); and average (P = .02), maximum (P < .01), and standard deviation (P = .03) of acceleration. CONCLUSION: We demonstrated the ability to detect kinematic differences in performance using marker-less tracking during open operative cases. Suturing task evaluation was most sensitive to differences in surgeon role and task category and may represent a scalable approach for providing quantitative feedback to surgeons about technical skill.
Authors: Cassidy Duran; Sean Estrada; Marcia O'Malley; Malachi G Sheahan; Murray L Shames; Jason T Lee; Jean Bismuth Journal: J Vasc Surg Date: 2015-12 Impact factor: 4.268
Authors: L L Leape; T A Brennan; N Laird; A G Lawthers; A R Localio; B A Barnes; L Hebert; J P Newhouse; P C Weiler; H Hiatt Journal: N Engl J Med Date: 1991-02-07 Impact factor: 91.245
Authors: Selwyn O Rogers; Atul A Gawande; Mary Kwaan; Ann Louise Puopolo; Catherine Yoon; Troyen A Brennan; David M Studdert Journal: Surgery Date: 2006-07 Impact factor: 3.982
Authors: Matthew D Karam; Geb W Thomas; Daniel M Koehler; Brian O Westerlind; Paul M Lafferty; Gary Thomas Ohrt; J Lawrence Marsh; Ann E Van Heest; Donald D Anderson Journal: J Bone Joint Surg Am Date: 2015-06-17 Impact factor: 5.284
Authors: Carly E Glarner; Yue-Yung Hu; Chia-Hsiung Chen; Robert G Radwin; Qianqian Zhao; Mark W Craven; Douglas A Wiegmann; Carla M Pugh; Matthew J Carty; Caprice C Greenberg Journal: Surgery Date: 2014-06-21 Impact factor: 3.982
Authors: Lane L Frasier; Sudha R Pavuluri Quamme; Yue Ma; Douglas Wiegmann; Glen Leverson; Eva H DuGoff; Caprice C Greenberg Journal: J Surg Res Date: 2018-11-15 Impact factor: 2.192
Authors: David P Azari; Lane L Frasier; Sudha R Pavuluri Quamme; Caprice C Greenberg; Carla M Pugh; Jacob A Greenberg; Robert G Radwin Journal: Ann Surg Date: 2019-03 Impact factor: 12.969