Ryan J Koehler1, John P Goldblatt2, Michael D Maloney2, Ilya Voloshin2, Gregg T Nicandri2. 1. Department of Orthopaedic Surgery, Vanderbilt Orthopaedic Institute, Vanderbilt University, Nashville, Tennessee, U.S.A.. Electronic address: Ryan.J.Koehler@vanderbilt.edu. 2. Department of Orthopaedics and Rehabilitation, University of Rochester Medical Center, Rochester, New York, U.S.A.
Abstract
PURPOSE: To determine the validity and reliability of using the Arthroscopic Surgery Skill Evaluation Tool (ASSET) to assess arthroscopic skill in the operating room. METHODS: Eight orthopaedic residents, 1 sports medicine fellow, and 3 sports medicine faculty members recorded the diagnostic portion of 3 shoulder and 3 knee procedures in the operating room. Two blinded raters used the ASSET to assess each recorded procedure video. Criterion for a passing score on a procedure was attaining a 3 or greater in all 8 domains assessed. RESULTS: In total 70 videos (36 shoulder, 34 knee) were evaluated by each rater. The attending/fellow group was assigned significantly higher mean ASSET scores compared with resident groups for both procedures (P = .01). The attending/fellow group also had the highest passing percentage (95.8%). Raters were in agreement for total ASSET scores assigned to both diagnostic arthroscopy of the shoulder (intraclass correlation coefficient [ICC] = 0.84) and knee (ICC = 0.81). Agreement on individual ASSET domains was moderate (ICC = 0.61 to 0.80) for all domains except safety and difficulty of procedure. Raters concurred on the pass-fail evaluation in 62 of 70 (88.6%) of procedures evaluated. CONCLUSIONS: Using the ASSET to assess surgical skills in the operating room is feasible, reliable, and valid. CLINICAL RELEVANCE: When combined with previously published results using the ASSET, the ASSET may provide a validated and reliable method for evaluating arthroscopic surgical skills in the surgical simulation lab and operating room.
PURPOSE: To determine the validity and reliability of using the Arthroscopic Surgery Skill Evaluation Tool (ASSET) to assess arthroscopic skill in the operating room. METHODS: Eight orthopaedic residents, 1 sports medicine fellow, and 3 sports medicine faculty members recorded the diagnostic portion of 3 shoulder and 3 knee procedures in the operating room. Two blinded raters used the ASSET to assess each recorded procedure video. Criterion for a passing score on a procedure was attaining a 3 or greater in all 8 domains assessed. RESULTS: In total 70 videos (36 shoulder, 34 knee) were evaluated by each rater. The attending/fellow group was assigned significantly higher mean ASSET scores compared with resident groups for both procedures (P = .01). The attending/fellow group also had the highest passing percentage (95.8%). Raters were in agreement for total ASSET scores assigned to both diagnostic arthroscopy of the shoulder (intraclass correlation coefficient [ICC] = 0.84) and knee (ICC = 0.81). Agreement on individual ASSET domains was moderate (ICC = 0.61 to 0.80) for all domains except safety and difficulty of procedure. Raters concurred on the pass-fail evaluation in 62 of 70 (88.6%) of procedures evaluated. CONCLUSIONS: Using the ASSET to assess surgical skills in the operating room is feasible, reliable, and valid. CLINICAL RELEVANCE: When combined with previously published results using the ASSET, the ASSET may provide a validated and reliable method for evaluating arthroscopic surgical skills in the surgical simulation lab and operating room.
Authors: Kevin C Wang; Eamon D Bernardoni; Eric J Cotter; Brian J Cole; Nikhil N Verma; Anthony A Romeo; Charles A Bush-Joseph; Bernard R Bach; Rachel M Frank Journal: Arthrosc Sports Med Rehabil Date: 2019-09-26
Authors: Michael L Redondo; David R Christian; Anirudh K Gowd; Brandon C Cabarcas; Gregory Cvetanovich; Bernard R Bach; Anthony A Romeo; Brian J Cole; Nikhil N Verma; Rachel M Frank Journal: Arthrosc Sports Med Rehabil Date: 2020-01-19