PURPOSE: The purpose of this study was to measure the accuracy of retinopathy of prematurity (ROP) diagnosis by retinal fellows. METHODS: An atlas of 804 retinal images was captured from 248 eyes of 67 premature infants with a wide-angle camera (RetCam-II, Clarity Medical Systems, Pleasanton, CA). Images were uploaded to a study Web site, from which an expert pediatric retinal specialist and 7 retinal fellows independently provided a diagnosis (no ROP, mild ROP, type 2 ROP, or treatment-requiring ROP) for each eye. The sensitivity and specificity of each retinal fellow were calculated and subsequently compared with a reference standard of diagnosis by an expert pediatric retinal specialist. RESULTS: For detection of type 2 or worse ROP by fellows, mean (range) sensitivity was 0.751 (0.512-0.953), and specificity was 0.841 (0.707-0.976). For detection of treatment-requiring ROP, mean (range) sensitivity was 0.914 (0.667-1.000), and specificity was 0.871 (0.678-0.987). CONCLUSION: In general, fellows showed high accuracy for detecting ROP. However, 3 of 7 fellows achieved <80% sensitivity for diagnosis of type 2 or worse ROP, and 2 of 7 achieved <90% sensitivity for diagnosis of treatment-requiring ROP. This could lead to undermanagement and undertreatment of clinically significant disease and raises potential concerns about the quality of ROP screening examinations performed by less-experienced examiners.
PURPOSE: The purpose of this study was to measure the accuracy of retinopathy of prematurity (ROP) diagnosis by retinal fellows. METHODS: An atlas of 804 retinal images was captured from 248 eyes of 67 premature infants with a wide-angle camera (RetCam-II, Clarity Medical Systems, Pleasanton, CA). Images were uploaded to a study Web site, from which an expert pediatric retinal specialist and 7 retinal fellows independently provided a diagnosis (no ROP, mild ROP, type 2 ROP, or treatment-requiring ROP) for each eye. The sensitivity and specificity of each retinal fellow were calculated and subsequently compared with a reference standard of diagnosis by an expert pediatric retinal specialist. RESULTS: For detection of type 2 or worse ROP by fellows, mean (range) sensitivity was 0.751 (0.512-0.953), and specificity was 0.841 (0.707-0.976). For detection of treatment-requiring ROP, mean (range) sensitivity was 0.914 (0.667-1.000), and specificity was 0.871 (0.678-0.987). CONCLUSION: In general, fellows showed high accuracy for detecting ROP. However, 3 of 7 fellows achieved <80% sensitivity for diagnosis of type 2 or worse ROP, and 2 of 7 achieved <90% sensitivity for diagnosis of treatment-requiring ROP. This could lead to undermanagement and undertreatment of clinically significant disease and raises potential concerns about the quality of ROP screening examinations performed by less-experienced examiners.
Authors: Michael F Chiang; Lu Wang; Mihai Busuioc; Yunling E Du; Patrick Chan; Steven A Kane; Thomas C Lee; David J Weissgold; Audina M Berrocal; Osode Coki; John T Flynn; Justin Starren Journal: Arch Ophthalmol Date: 2007-11
Authors: Brian A Darlow; Mark J Elder; L John Horwood; Deborah A Donoghue; David J Henderson-Smart Journal: Clin Exp Ophthalmol Date: 2008 Jan-Feb Impact factor: 4.207
Authors: Joyce A Martin; Brady E Hamilton; Paul D Sutton; Stephanie J Ventura; Fay Menacker; Sharon Kirmeyer; Martha L Munson Journal: Natl Vital Stat Rep Date: 2007-12-05
Authors: Chace Moleta; J Peter Campbell; Jayashree Kalpathy-Cramer; R V Paul Chan; Susan Ostmo; Karyn Jonas; Michael F Chiang Journal: Am J Ophthalmol Date: 2017-01-11 Impact factor: 5.258
Authors: Michael C Ryan; Susan Ostmo; Karyn Jonas; Audina Berrocal; Kimberly Drenser; Jason Horowitz; Thomas C Lee; Charles Simmons; Maria-Ana Martinez-Castellanos; R V Paul Chan; Michael F Chiang Journal: AMIA Annu Symp Proc Date: 2014-11-14
Authors: J Peter Campbell; Esra Ataer-Cansizoglu; Veronica Bolon-Canedo; Alican Bozkurt; Deniz Erdogmus; Jayashree Kalpathy-Cramer; Samir N Patel; James D Reynolds; Jason Horowitz; Kelly Hutcheson; Michael Shapiro; Michael X Repka; Phillip Ferrone; Kimberly Drenser; Maria Ana Martinez-Castellanos; Susan Ostmo; Karyn Jonas; R V Paul Chan; Michael F Chiang Journal: JAMA Ophthalmol Date: 2016-06-01 Impact factor: 7.389
Authors: Jayashree Kalpathy-Cramer; J Peter Campbell; Deniz Erdogmus; Peng Tian; Dharanish Kedarisetti; Chace Moleta; James D Reynolds; Kelly Hutcheson; Michael J Shapiro; Michael X Repka; Philip Ferrone; Kimberly Drenser; Jason Horowitz; Kemal Sonmez; Ryan Swan; Susan Ostmo; Karyn E Jonas; R V Paul Chan; Michael F Chiang Journal: Ophthalmology Date: 2016-08-24 Impact factor: 12.079
Authors: Shelbi L Olson; Tsengelmaa Chuluunbat; Emily D Cole; Karyn E Jonas; Munkhuu Bayalag; Chimgee Chuluunkhuu; Nita G Valikodath; D Hunter Cherwek; Nathan Congdon; Leslie D MacKeen; Joelle Hallak; Vivien Yap; Susan Ostmo; Wei Chi Wu; J Peter Campbell; Michael F Chiang; R V Paul Chan Journal: J Pediatr Ophthalmol Strabismus Date: 2020-09-01 Impact factor: 1.402