BACKGROUND: The diagnosis of displacement in scaphoid fractures is notorious for poor interobserver reliability. QUESTIONS/PURPOSES: We tested whether training can improve interobserver reliability and sensitivity, specificity, and accuracy for the diagnosis of scaphoid fracture displacement on radiographs and CT scans. METHODS: Sixty-four orthopaedic surgeons rated a set of radiographs and CT scans of 10 displaced and 10 nondisplaced scaphoid fractures for the presence of displacement, using a web-based rating application. Before rating, observers were randomized to a training group (34 observers) and a nontraining group (30 observers). The training group received an online training module before the rating session, and the nontraining group did not. Interobserver reliability for training and nontraining was assessed by Siegel's multirater kappa and the Z-test was used to test for significance. RESULTS: There was a small, but significant difference in the interobserver reliability for displacement ratings in favor of the training group compared with the nontraining group. Ratings of radiographs and CT scans combined resulted in moderate agreement for both groups. The average sensitivity, specificity, and accuracy of diagnosing displacement of scaphoid fractures were, respectively, 83%, 85%, and 84% for the nontraining group and 87%, 86%, and 87% for the training group. Assuming a 5% prevalence of fracture displacement, the positive predictive value was 0.23 in the nontraining group and 0.25 in the training group. The negative predictive value was 0.99 in both groups. CONCLUSIONS: Our results suggest training can improve interobserver reliability and sensitivity, specificity and accuracy for the diagnosis of scaphoid fracture displacement, but the improvements are slight. These findings are encouraging for future research regarding interobserver variation and how to reduce it further.
RCT Entities:
BACKGROUND: The diagnosis of displacement in scaphoid fractures is notorious for poor interobserver reliability. QUESTIONS/PURPOSES: We tested whether training can improve interobserver reliability and sensitivity, specificity, and accuracy for the diagnosis of scaphoid fracture displacement on radiographs and CT scans. METHODS: Sixty-four orthopaedic surgeons rated a set of radiographs and CT scans of 10 displaced and 10 nondisplaced scaphoid fractures for the presence of displacement, using a web-based rating application. Before rating, observers were randomized to a training group (34 observers) and a nontraining group (30 observers). The training group received an online training module before the rating session, and the nontraining group did not. Interobserver reliability for training and nontraining was assessed by Siegel's multirater kappa and the Z-test was used to test for significance. RESULTS: There was a small, but significant difference in the interobserver reliability for displacement ratings in favor of the training group compared with the nontraining group. Ratings of radiographs and CT scans combined resulted in moderate agreement for both groups. The average sensitivity, specificity, and accuracy of diagnosing displacement of scaphoid fractures were, respectively, 83%, 85%, and 84% for the nontraining group and 87%, 86%, and 87% for the training group. Assuming a 5% prevalence of fracture displacement, the positive predictive value was 0.23 in the nontraining group and 0.25 in the training group. The negative predictive value was 0.99 in both groups. CONCLUSIONS: Our results suggest training can improve interobserver reliability and sensitivity, specificity and accuracy for the diagnosis of scaphoid fracture displacement, but the improvements are slight. These findings are encouraging for future research regarding interobserver variation and how to reduce it further.
Authors: J Ripsweden; H Mir-Akbari; E Bacsovics Brolin; T Brismar; T Nilsson; E Rasmussen; A Rück; A Svensson; C Werner; R Winter; K Cederlund Journal: Acta Radiol Date: 2009-03 Impact factor: 1.990
Authors: Jonathan Stieber; Martin Quirno; Mary Cunningham; Thomas J Errico; John A Bendo Journal: Spine (Phila Pa 1976) Date: 2009-11-01 Impact factor: 3.468
Authors: Wendie A Berg; Carl J D'Orsi; Valerie P Jackson; Lawrence W Bassett; Craig A Beam; Rebecca S Lewis; Philip E Crewson Journal: Radiology Date: 2002-09 Impact factor: 11.105
Authors: Marla E Lujan; Donna R Chizen; Andrew K Peppin; Stefan Kriegler; David A Leswick; Terri G Bloski; Roger A Pierson Journal: Reprod Biol Endocrinol Date: 2008-07-18 Impact factor: 5.211
Authors: Oluwatunmise A Fawole; Matthew S Kelly; Andrew P Steenhoff; Kristen A Feemster; Eric J Crotty; Mantosh S Rattan; Thuso David; Tiny Mazhani; Samir S Shah; Savvas Andronikou; Tonya Arscott-Mills Journal: Pediatr Radiol Date: 2020-06-10
Authors: Elias J Pretorius; Amir D Zarrabi; Stephanie Griffith-Richards; Justin Harvey; Hilgard M Ackermann; Catharina M Meintjes; Willem G Cilliers; Moleen Zunza; Alexander J Szpytko; Richard D Pitcher Journal: World J Urol Date: 2018-01-02 Impact factor: 4.226
Authors: Jos J Mellema; Wouter H Mallee; Thierry G Guitton; C Niek van Dijk; David Ring; Job N Doornberg Journal: J Digit Imaging Date: 2017-10 Impact factor: 4.056
Authors: Julio Urrutia; Pablo Besa; Sergio Morales; Antonio Parlange; Sebastian Flores; Mauricio Campos; Sebastian Mobarec Journal: Eur Spine J Date: 2018-07-11 Impact factor: 3.134