Leah K Taylor1, Geb W Thomas2, Matthew D Karam3, Clarence D Kreiter4, Donald D Anderson5. 1. Department of Orthopedics and Rehabilitation, The University of Iowa, Iowa City, Iowa; Department of Biomedical Engineering, The University of Iowa, Iowa City, Iowa. 2. Department of Orthopedics and Rehabilitation, The University of Iowa, Iowa City, Iowa; Department of Mechanical and Industrial Engineering, The University of Iowa, Iowa City, Iowa. Electronic address: geb-thomas@uiowa.edu. 3. Department of Orthopedics and Rehabilitation, The University of Iowa, Iowa City, Iowa. 4. Department of Family Medicine, The University of Iowa, Iowa City, Iowa. 5. Department of Orthopedics and Rehabilitation, The University of Iowa, Iowa City, Iowa; Department of Biomedical Engineering, The University of Iowa, Iowa City, Iowa; Department of Mechanical and Industrial Engineering, The University of Iowa, Iowa City, Iowa.
Abstract
OBJECTIVE: There are no widely accepted, objective, and reliable tools for measuring surgical skill in the operating room (OR). Ubiquitous video and imaging technology provide opportunities to develop metrics that meet this need. Hip fracture surgery is a promising area in which to develop these measures because hip fractures are common, the surgery is used as a milestone for residents, and it demands technical skill. The study objective is to develop meaningful, objective measures of wire navigation performance in the OR. DESIGN: Resident surgeons wore a head-mounted video camera while performing surgical open reduction and internal fixation using a dynamic hip screw. Data collected from video included: duration of wire navigation, number of fluoroscopic images, and the degree of intervention by the surgeon׳s supervisor. To determine reliability of these measurements, 4 independent raters performed them for 2 cases. Raters independently measured the tip-apex distance (TAD), which reflects the accuracy of the surgical placement of the wire, on all the 7 cases. SETTING: University of Iowa Hospitals and Clinics in Iowa City, IA-a public tertiary academic center. PARTICIPANTS: In total 7 surgeries were performed by 7 different orthopedic residents. All 10 raters were biomedical engineering graduate students. RESULTS: The standard deviations for anteroposterior, lateral, and combined TAD measurements of the 10 raters were 2.7, 1.9, and 3.7mm, respectively, and interrater reliability produced a Cronbach α of 0.97. The interrater reliability analysis for all 9 video-based measures produced a Cronbach α of 0.99. CONCLUSIONS: Several video-based metrics were consistent across the 4 video reviewers and are likely to be useful for performance assessment. The TAD measurement was less reliable than previous reports have suggested, but remains a valuable metric of performance. Nonexperts can reliably measure these values and they offer an objective assessment of OR performance.
OBJECTIVE: There are no widely accepted, objective, and reliable tools for measuring surgical skill in the operating room (OR). Ubiquitous video and imaging technology provide opportunities to develop metrics that meet this need. Hip fracture surgery is a promising area in which to develop these measures because hip fractures are common, the surgery is used as a milestone for residents, and it demands technical skill. The study objective is to develop meaningful, objective measures of wire navigation performance in the OR. DESIGN: Resident surgeons wore a head-mounted video camera while performing surgical open reduction and internal fixation using a dynamic hip screw. Data collected from video included: duration of wire navigation, number of fluoroscopic images, and the degree of intervention by the surgeon׳s supervisor. To determine reliability of these measurements, 4 independent raters performed them for 2 cases. Raters independently measured the tip-apex distance (TAD), which reflects the accuracy of the surgical placement of the wire, on all the 7 cases. SETTING: University of Iowa Hospitals and Clinics in Iowa City, IA-a public tertiary academic center. PARTICIPANTS: In total 7 surgeries were performed by 7 different orthopedic residents. All 10 raters were biomedical engineering graduate students. RESULTS: The standard deviations for anteroposterior, lateral, and combined TAD measurements of the 10 raters were 2.7, 1.9, and 3.7mm, respectively, and interrater reliability produced a Cronbach α of 0.97. The interrater reliability analysis for all 9 video-based measures produced a Cronbach α of 0.99. CONCLUSIONS: Several video-based metrics were consistent across the 4 video reviewers and are likely to be useful for performance assessment. The TAD measurement was less reliable than previous reports have suggested, but remains a valuable metric of performance. Nonexperts can reliably measure these values and they offer an objective assessment of OR performance.
Authors: Neal E Seymour; Anthony G Gallagher; Sanziana A Roman; Michael K O'Brien; Vipin K Bansal; Dana K Andersen; Richard M Satava Journal: Ann Surg Date: 2002-10 Impact factor: 12.969
Authors: Cornelis J Hopmans; Pieter T den Hoed; Lijckle van der Laan; Erwin van der Harst; Maarten van der Elst; Guido H H Mannaerts; Imro Dawson; Reinier Timman; Bas P L Wijnhoven; Jan N M IJzermans Journal: Surgery Date: 2014-09-16 Impact factor: 3.982
Authors: Thomas R Blattert; Ute A Fill; Elmar Kunz; Werner Panzer; Arnulf Weckbach; Dieter F Regulla Journal: Arch Orthop Trauma Surg Date: 2004-09-10 Impact factor: 3.067
Authors: Geb W Thomas; Steven Long; Marcus Tatum; Timothy Kowalewski; Dominik Mattioli; J Lawrence Marsh; Heather R Kowalski; Matthew D Karam; Joan E Bechtold; Donald D Anderson Journal: Iowa Orthop J Date: 2020
Authors: Steven Long; Geb W Thomas; Matthew D Karam; J Lawrence Marsh; Donald D Anderson Journal: Clin Orthop Relat Res Date: 2021-06-01 Impact factor: 4.755