OBJECTIVES: To investigate inter-reader agreement on five severity levels of central vascular changes (none, mild, moderate, severe pre-plus disease, plus disease) and aggressive posterior retinopathy of prematurity (ROP), and to see whether an unintended shift in indication for treatment occurred. METHODS: Four international ROP readers participated. Before the grading of the photographs, the readers were informed that a high proportion of advanced ROP cases were included. In total, 243 photographs/948 quadrants were available from 136 infants. As a standard series of photographs was available, grading was performed under optimised conditions. RESULTS: The four readers agreed on the quadrant scores of only 70 (7.38%) of the 948 quadrants--that is, on 1, 5, 15, 4 and 45 quadrants for scores 0, 1, 2, 3 and 4, respectively. The mean scores differed systematically between the readers (permutation test, p<0.0001). Agreement on presence of aggressive posterior ROP from all four readers was not obtained for any of the photographs. Readers scored plus disease in at least two quadrants in 95.5% of the eyes for which treatment was indicated. All four readers agreed on the scoring of indication for treatment for 195 eyes (80.2%); however, treatment was only recommended in 18 (7.4%) eyes. One reader was found to differ systematically from the others in indicating treatment (Rasch analysis; p=0.0001). Finally, a significant shift in indication for treatment occurred between birth period 2000-2002 and 2003-2006 (Mann-Whitney rank sum test, p<0.001). CONCLUSIONS: Inter-reader agreement on central vascular changes is poor, especially when based on more than two rating categories. The subjective nature of diagnosing such vascular changes possibly resulted in earlier treatment of preterm infants in Denmark over the entire study period (1997-2006). The recent increased incidence of treated infants in Denmark is, at least in part, explained by a significant shift in indication for treatment.
OBJECTIVES: To investigate inter-reader agreement on five severity levels of central vascular changes (none, mild, moderate, severe pre-plus disease, plus disease) and aggressive posterior retinopathy of prematurity (ROP), and to see whether an unintended shift in indication for treatment occurred. METHODS: Four international ROP readers participated. Before the grading of the photographs, the readers were informed that a high proportion of advanced ROP cases were included. In total, 243 photographs/948 quadrants were available from 136 infants. As a standard series of photographs was available, grading was performed under optimised conditions. RESULTS: The four readers agreed on the quadrant scores of only 70 (7.38%) of the 948 quadrants--that is, on 1, 5, 15, 4 and 45 quadrants for scores 0, 1, 2, 3 and 4, respectively. The mean scores differed systematically between the readers (permutation test, p<0.0001). Agreement on presence of aggressive posterior ROP from all four readers was not obtained for any of the photographs. Readers scored plus disease in at least two quadrants in 95.5% of the eyes for which treatment was indicated. All four readers agreed on the scoring of indication for treatment for 195 eyes (80.2%); however, treatment was only recommended in 18 (7.4%) eyes. One reader was found to differ systematically from the others in indicating treatment (Rasch analysis; p=0.0001). Finally, a significant shift in indication for treatment occurred between birth period 2000-2002 and 2003-2006 (Mann-Whitney rank sum test, p<0.001). CONCLUSIONS: Inter-reader agreement on central vascular changes is poor, especially when based on more than two rating categories. The subjective nature of diagnosing such vascular changes possibly resulted in earlier treatment of preterm infants in Denmark over the entire study period (1997-2006). The recent increased incidence of treated infants in Denmark is, at least in part, explained by a significant shift in indication for treatment.
Authors: Chace Moleta; J Peter Campbell; Jayashree Kalpathy-Cramer; R V Paul Chan; Susan Ostmo; Karyn Jonas; Michael F Chiang Journal: Am J Ophthalmol Date: 2017-01-11 Impact factor: 5.258
Authors: V Bolón-Canedo; E Ataer-Cansizoglu; D Erdogmus; J Kalpathy-Cramer; O Fontenla-Romero; A Alonso-Betanzos; M F Chiang Journal: Comput Methods Programs Biomed Date: 2015-06-16 Impact factor: 5.428
Authors: Layla Ghergherehchi; Sang Jin Kim; J Peter Campbell; Susan Ostmo; R V Paul Chan; Michael F Chiang Journal: Asia Pac J Ophthalmol (Phila) Date: 2018-05-24
Authors: Nikolas N Raufi; Caleb K Morris; Sharon F Freedman; David K Wallace; S Grace Prakalapakorn Journal: J Pediatr Ophthalmol Strabismus Date: 2016-05-01 Impact factor: 1.402
Authors: Rene Y Choi; James M Brown; Jayashree Kalpathy-Cramer; R V Paul Chan; Susan Ostmo; Michael F Chiang; J Peter Campbell Journal: Ophthalmol Retina Date: 2020-05-04
Authors: Victor H Guaiquil; Nina J Hewing; Michael F Chiang; Mark I Rosenblatt; R V Paul Chan; Carl P Blobel Journal: Invest Ophthalmol Vis Sci Date: 2013-08-07 Impact factor: 4.799