Ashkan M Abbey1, Cagri G Besirli2, David C Musch3, Chris A Andrews2, Antonio Capone1, Kimberly A Drenser1, David K Wallace4, Susan Ostmo5, Michael Chiang6, Paul P Lee2, Michael T Trese7. 1. Department of Ophthalmology, William Beaumont Hospital, Royal Oak, Michigan; Associated Retinal Consultants, Royal Oak, Michigan. 2. Department of Ophthalmology and Visual Sciences, Kellogg Eye Center, University of Michigan, Ann Arbor, Michigan. 3. Department of Ophthalmology and Visual Sciences, Kellogg Eye Center, University of Michigan, Ann Arbor, Michigan; Department of Epidemiology, University of Michigan, Ann Arbor, Michigan. 4. Department of Ophthalmology, Duke University Eye Center, Durham, North Carolina. 5. Department of Ophthalmology, Oregon Health and Science University, Portland, Oregon. 6. Department of Ophthalmology, Oregon Health and Science University, Portland, Oregon; Department of Medical Informatics & Clinical Epidemiology, Oregon Health and Science University, Portland, Oregon. 7. Department of Ophthalmology, William Beaumont Hospital, Royal Oak, Michigan; Associated Retinal Consultants, Royal Oak, Michigan. Electronic address: mgjt46@aol.com.
Abstract
PURPOSE: To determine if (1) tortuosity assessment by a computer program (ROPtool, developed at the University of North Carolina, Chapel Hill, and Duke University, and licensed by FocusROP) that traces retinal blood vessels and (2) assessment by a lay reader are comparable with assessment by a panel of 3 retinopathy of prematurity (ROP) experts for remote clinical grading of vascular abnormalities such as plus disease. DESIGN: Validity and reliability analysis of diagnostic tools. PARTICIPANTS: Three hundred thirty-five fundus images of prematurely born infants. METHODS: Three hundred thirty-five fundus images of prematurely born infants were obtained by neonatal intensive care unit nurses. A panel of 3 ROP experts graded 84 images showing vascular dilatation, tortuosity, or both and 251 images showing no evidence of vascular abnormalities. These images were sent electronically to an experienced lay reader who independently graded them for vascular abnormalities. The images also were analyzed using the ROPtool, which assigns a numerical value to the level of vascular abnormality and tortuosity present in each of 4 quadrants or sectors. The ROPtool measurements of vascular abnormalities were graded and compared with expert panel grades with a receiver operating characteristic (ROC) curve. Grades between human readers were cross-tabulated. The area under the ROC curve was calculated for the ROPtool, and sensitivity and specificity were computed for the lay reader. MAIN OUTCOME MEASURES: Measurements of vascular abnormalities by ROPtool and grading of vascular abnormalities by 3 ROP experts and 1 experienced lay reader. RESULTS: The ROC curve for ROPtool's tortuosity assessment had an area under the ROC curve of 0.917. Using a threshold value of 4.97 for the second most tortuous quadrant, ROPtool's sensitivity was 91% and its specificity was 82%. Lay reader sensitivity and specificity were 99% and 73%, respectively, and had high reliability (κ, 0.87) in repeated measurements. CONCLUSIONS: ROPtool had very good accuracy for detection of vascular abnormalities suggestive of plus disease when compared with expert physician graders. The lay reader's results showed excellent sensitivity and good specificity when compared with those of the expert graders. These options for remote reading of images to detect vascular abnormalities deserve consideration in the quest to use telemedicine with remote reading for efficient delivery of high-quality care and to detect infants requiring bedside examination.
PURPOSE: To determine if (1) tortuosity assessment by a computer program (ROPtool, developed at the University of North Carolina, Chapel Hill, and Duke University, and licensed by FocusROP) that traces retinal blood vessels and (2) assessment by a lay reader are comparable with assessment by a panel of 3 retinopathy of prematurity (ROP) experts for remote clinical grading of vascular abnormalities such as plus disease. DESIGN: Validity and reliability analysis of diagnostic tools. PARTICIPANTS: Three hundred thirty-five fundus images of prematurely born infants. METHODS: Three hundred thirty-five fundus images of prematurely born infants were obtained by neonatal intensive care unit nurses. A panel of 3 ROP experts graded 84 images showing vascular dilatation, tortuosity, or both and 251 images showing no evidence of vascular abnormalities. These images were sent electronically to an experienced lay reader who independently graded them for vascular abnormalities. The images also were analyzed using the ROPtool, which assigns a numerical value to the level of vascular abnormality and tortuosity present in each of 4 quadrants or sectors. The ROPtool measurements of vascular abnormalities were graded and compared with expert panel grades with a receiver operating characteristic (ROC) curve. Grades between human readers were cross-tabulated. The area under the ROC curve was calculated for the ROPtool, and sensitivity and specificity were computed for the lay reader. MAIN OUTCOME MEASURES: Measurements of vascular abnormalities by ROPtool and grading of vascular abnormalities by 3 ROP experts and 1 experienced lay reader. RESULTS: The ROC curve for ROPtool's tortuosity assessment had an area under the ROC curve of 0.917. Using a threshold value of 4.97 for the second most tortuous quadrant, ROPtool's sensitivity was 91% and its specificity was 82%. Lay reader sensitivity and specificity were 99% and 73%, respectively, and had high reliability (κ, 0.87) in repeated measurements. CONCLUSIONS: ROPtool had very good accuracy for detection of vascular abnormalities suggestive of plus disease when compared with expert physician graders. The lay reader's results showed excellent sensitivity and good specificity when compared with those of the expert graders. These options for remote reading of images to detect vascular abnormalities deserve consideration in the quest to use telemedicine with remote reading for efficient delivery of high-quality care and to detect infants requiring bedside examination.
Authors: Hilal Biten; Travis K Redd; Chace Moleta; J Peter Campbell; Susan Ostmo; Karyn Jonas; R V Paul Chan; Michael F Chiang Journal: JAMA Ophthalmol Date: 2018-05-01 Impact factor: 7.389
Authors: Dana Darwish; Ru-Ik Chee; Samir N Patel; Karyn Jonas; Susan Ostmo; J Peter Campbell; Michael F Chiang; R V Paul Chan Journal: Asia Pac J Ophthalmol (Phila) Date: 2018-05-29
Authors: Layla Ghergherehchi; Sang Jin Kim; J Peter Campbell; Susan Ostmo; R V Paul Chan; Michael F Chiang Journal: Asia Pac J Ophthalmol (Phila) Date: 2018-05-24
Authors: J Peter Campbell; Esra Ataer-Cansizoglu; Veronica Bolon-Canedo; Alican Bozkurt; Deniz Erdogmus; Jayashree Kalpathy-Cramer; Samir N Patel; James D Reynolds; Jason Horowitz; Kelly Hutcheson; Michael Shapiro; Michael X Repka; Phillip Ferrone; Kimberly Drenser; Maria Ana Martinez-Castellanos; Susan Ostmo; Karyn Jonas; R V Paul Chan; Michael F Chiang Journal: JAMA Ophthalmol Date: 2016-06-01 Impact factor: 7.389
Authors: Maria A Woodward; David C Musch; Christopher T Hood; Jonathan B Greene; Leslie M Niziol; V Swetha E Jeganathan; Paul P Lee Journal: Cornea Date: 2017-10 Impact factor: 2.651
Authors: Jayashree Kalpathy-Cramer; J Peter Campbell; Deniz Erdogmus; Peng Tian; Dharanish Kedarisetti; Chace Moleta; James D Reynolds; Kelly Hutcheson; Michael J Shapiro; Michael X Repka; Philip Ferrone; Kimberly Drenser; Jason Horowitz; Kemal Sonmez; Ryan Swan; Susan Ostmo; Karyn E Jonas; R V Paul Chan; Michael F Chiang Journal: Ophthalmology Date: 2016-08-24 Impact factor: 12.079