BACKGROUND: Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice; however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. HYPOTHESIS: The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability when used to assess the technical ability of surgeons performing diagnostic knee arthroscopic surgery on cadaveric specimens. STUDY DESIGN: Cross-sectional study; Level of evidence, 3. METHODS: Content validity was determined by a group of 7 experts using the Delphi method. Intra-articular performance of a right and left diagnostic knee arthroscopic procedure was recorded for 28 residents and 2 sports medicine fellowship-trained attending surgeons. Surgeon performance was assessed by 2 blinded raters using the ASSET. Concurrent criterion-oriented validity, interrater reliability, and test-retest reliability were evaluated. RESULTS: Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in the total ASSET score (P < .05) between novice, intermediate, and advanced experience groups were identified. Interrater reliability: The ASSET scores assigned by each rater were strongly correlated (r = 0.91, P < .01), and the intraclass correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: There was a significant correlation between ASSET scores for both procedures attempted by each surgeon (r = 0.79, P < .01). CONCLUSION: The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopic surgery in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live operating room and other simulated environments.
BACKGROUND: Surgeries employing arthroscopic techniques are among the most commonly performed in orthopaedic clinical practice; however, valid and reliable methods of assessing the arthroscopic skill of orthopaedic surgeons are lacking. HYPOTHESIS: The Arthroscopic Surgery Skill Evaluation Tool (ASSET) will demonstrate content validity, concurrent criterion-oriented validity, and reliability when used to assess the technical ability of surgeons performing diagnostic knee arthroscopic surgery on cadaveric specimens. STUDY DESIGN: Cross-sectional study; Level of evidence, 3. METHODS: Content validity was determined by a group of 7 experts using the Delphi method. Intra-articular performance of a right and left diagnostic knee arthroscopic procedure was recorded for 28 residents and 2 sports medicine fellowship-trained attending surgeons. Surgeon performance was assessed by 2 blinded raters using the ASSET. Concurrent criterion-oriented validity, interrater reliability, and test-retest reliability were evaluated. RESULTS: Content validity: The content development group identified 8 arthroscopic skill domains to evaluate using the ASSET. Concurrent criterion-oriented validity: Significant differences in the total ASSET score (P < .05) between novice, intermediate, and advanced experience groups were identified. Interrater reliability: The ASSET scores assigned by each rater were strongly correlated (r = 0.91, P < .01), and the intraclass correlation coefficient between raters for the total ASSET score was 0.90. Test-retest reliability: There was a significant correlation between ASSET scores for both procedures attempted by each surgeon (r = 0.79, P < .01). CONCLUSION: The ASSET appears to be a useful, valid, and reliable method for assessing surgeon performance of diagnostic knee arthroscopic surgery in cadaveric specimens. Studies are ongoing to determine its generalizability to other procedures as well as to the live operating room and other simulated environments.
Authors: Aaron Insel; Bradley Carofino; Robin Leger; Robert Arciero; Augustus D Mazzocca Journal: J Bone Joint Surg Am Date: 2009-09 Impact factor: 5.284
Authors: Ann Van Heest; Matthew Putnam; Julie Agel; Janet Shanedling; Scott McPherson; Constance Schmitz Journal: J Bone Joint Surg Am Date: 2009-12 Impact factor: 5.284
Authors: Sarah E Peyre; Christian G Peyre; Jeffrey A Hagen; Maura E Sullivan; John C Lipham; Steven R Demeester; Jeffrey H Peters; Tom R Demeester Journal: Surg Endosc Date: 2008-12-05 Impact factor: 4.584
Authors: Stephan Reppenhagen; Manuel Weißenberger; Thomas Barthel; Maximilian Rudert; Hermann Anetzberger Journal: Unfallchirurg Date: 2019-06 Impact factor: 1.000
Authors: Brian Westerlind; Matthew Karam; Donald Anderson; Tameem Yehyawi; Jenniefer Kho; J Lawrence Marsh Journal: J Bone Joint Surg Am Date: 2014-08-20 Impact factor: 5.284
Authors: Tim Dwyer; Veronica Wadey; Douglas Archibald; William Kraemer; Jesse Slade Shantz; John Townley; Darrell Ogilvie-Harris; Massimo Petrera; Peter Ferguson; Markku Nousiainen Journal: Clin Orthop Relat Res Date: 2016-04 Impact factor: 4.176