OBJECTIVES: To prospectively evaluate if training with direct feedback improves grading accuracy of inexperienced readers for Crohn's disease activity on magnetic resonance imaging (MRI). METHODS: Thirty-one inexperienced readers assessed 25 cases as a baseline set. Subsequently, all readers received training and assessed 100 cases with direct feedback per case, randomly assigned to four sets of 25 cases. The cases in set 4 were identical to the baseline set. Grading accuracy, understaging, overstaging, mean reading times and confidence scores (scale 0-10) were compared between baseline and set 4, and between the four consecutive sets with feedback. Proportions of grading accuracy, understaging and overstaging per set were compared using logistic regression analyses. Mean reading times and confidence scores were compared by t-tests. RESULTS:Grading accuracy increased from 66 % (95 % CI, 56-74 %) at baseline to 75 % (95 % CI, 66-81 %) in set 4 (P = 0.003). Understaging decreased from 15 % (95 % CI, 9-23 %) to 7 % (95 % CI, 3-14 %) (P < 0.001). Overstaging did not change significantly (20 % vs 19 %). Mean reading time decreased from 6 min 37 s to 4 min 35 s (P < 0.001). Mean confidence increased from 6.90 to 7.65 (P < 0.001). During training, overall grading accuracy, understaging, mean reading times and confidence scores improved gradually. CONCLUSIONS: Inexperienced readers need training with at least 100 cases to achieve the literature reported grading accuracy of 75 %. KEY POINTS: • Most radiologists have limited experience of grading Crohn's disease activity on MRI. • Inexperienced readers need training in the MRI assessment of Crohn's disease. • Grading accuracy, understaging, reading time and confidence scores improved during training. • Radiologists and residents show similar accuracy in grading Crohn's disease. • After 100 cases, grading accuracy can be reached as reported in the literature.
RCT Entities:
OBJECTIVES: To prospectively evaluate if training with direct feedback improves grading accuracy of inexperienced readers for Crohn's disease activity on magnetic resonance imaging (MRI). METHODS: Thirty-one inexperienced readers assessed 25 cases as a baseline set. Subsequently, all readers received training and assessed 100 cases with direct feedback per case, randomly assigned to four sets of 25 cases. The cases in set 4 were identical to the baseline set. Grading accuracy, understaging, overstaging, mean reading times and confidence scores (scale 0-10) were compared between baseline and set 4, and between the four consecutive sets with feedback. Proportions of grading accuracy, understaging and overstaging per set were compared using logistic regression analyses. Mean reading times and confidence scores were compared by t-tests. RESULTS: Grading accuracy increased from 66 % (95 % CI, 56-74 %) at baseline to 75 % (95 % CI, 66-81 %) in set 4 (P = 0.003). Understaging decreased from 15 % (95 % CI, 9-23 %) to 7 % (95 % CI, 3-14 %) (P < 0.001). Overstaging did not change significantly (20 % vs 19 %). Mean reading time decreased from 6 min 37 s to 4 min 35 s (P < 0.001). Mean confidence increased from 6.90 to 7.65 (P < 0.001). During training, overall grading accuracy, understaging, mean reading times and confidence scores improved gradually. CONCLUSIONS: Inexperienced readers need training with at least 100 cases to achieve the literature reported grading accuracy of 75 %. KEY POINTS: • Most radiologists have limited experience of grading Crohn's disease activity on MRI. • Inexperienced readers need training in the MRI assessment of Crohn's disease. • Grading accuracy, understaging, reading time and confidence scores improved during training. • Radiologists and residents show similar accuracy in grading Crohn's disease. • After 100 cases, grading accuracy can be reached as reported in the literature.
Authors: A Dignass; G Van Assche; J O Lindsay; M Lémann; J Söderholm; J F Colombel; S Danese; A D'Hoore; M Gassull; F Gomollón; D W Hommes; P Michetti; C O'Morain; T Oresland; A Windsor; E F Stange; S P L Travis Journal: J Crohns Colitis Date: 2010-01-15 Impact factor: 9.071
Authors: Michael J Steward; Shonit Punwani; Ian Proctor; Yvette Adjei-Gyamfi; Fiona Chatterjee; Stuart Bloom; Marco Novelli; Steve Halligan; Manuel Rodriguez-Justo; Stuart A Taylor Journal: Eur J Radiol Date: 2011-09-15 Impact factor: 3.528
Authors: Damian J M Tolan; Rebecca Greenhalgh; Ian A Zealley; Steve Halligan; Stuart A Taylor Journal: Radiographics Date: 2010-03 Impact factor: 5.333
Authors: Jeroen A W Tielbeek; Mark Löwenberg; Shandra Bipat; Karin Horsthuis; Cyriel Y Ponsioen; Geert R D'Haens; Jaap Stoker Journal: Inflamm Bowel Dis Date: 2013-08 Impact factor: 5.325
Authors: Jeroen A W Tielbeek; Jesica C Makanyanga; Shandra Bipat; Doug A Pendsé; C Yung Nio; Frans M Vos; Stuart A Taylor; Jaap Stoker Journal: AJR Am J Roentgenol Date: 2013-12 Impact factor: 3.959
Authors: Joy L Barber; Alexsandra Zambrano-Perez; Øystein E Olsen; Fevronia Kiparissi; Mila Baycheva; Daniela Knaflez; Neil Shah; Tom A Watson Journal: Pediatr Radiol Date: 2018-04-13