Scott R Shuldiner1, Michael V Boland2, Pradeep Y Ramulu1, C Gustavo De Moraes3, Tobias Elze2, Jonathan Myers4, Louis Pasquale5, Sarah Wellik6, Jithin Yohannan1. 1. Wilmer Eye Institute, Johns Hopkins University School of Medicine, Baltimore, MD, United States of America. 2. Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, United States of America. 3. Department of Ophthalmology, Columbia University Medical Center, New York, NY, United States of America. 4. Wills Eye Hospital, Thomas Jefferson University, Philadelphia, PA, United States of America. 5. The Eye and Vision Research Institute of New York Eye and Ear Infirmary at Mount Sinai, Icahn School of Medicine at Mount Sinai School, New York, NY, United States of America. 6. Bascom Palmer Eye Institute, University of Miami, Miami, FL, United States of America.
Abstract
OBJECTIVE: To assess whether machine learning algorithms (MLA) can predict eyes that will undergo rapid glaucoma progression based on an initial visual field (VF) test. DESIGN: Retrospective analysis of longitudinal data. SUBJECTS: 175,786 VFs (22,925 initial VFs) from 14,217 patients who completed ≥5 reliable VFs at academic glaucoma centers were included. METHODS: Summary measures and reliability metrics from the initial VF and age were used to train MLA designed to predict the likelihood of rapid progression. Additionally, the neural network model was trained with point-wise threshold data in addition to summary measures, reliability metrics and age. 80% of eyes were used for a training set and 20% were used as a test set. MLA test set performance was assessed using the area under the receiver operating curve (AUC). Performance of models trained on initial VF data alone was compared to performance of models trained on data from the first two VFs. MAIN OUTCOME MEASURES: Accuracy in predicting future rapid progression defined as MD worsening more than 1 dB/year. RESULTS: 1,968 eyes (8.6%) underwent rapid progression. The support vector machine model (AUC 0.72 [95% CI 0.70-0.75]) most accurately predicted rapid progression when trained on initial VF data. Artificial neural network, random forest, logistic regression and naïve Bayes classifiers produced AUC of 0.72, 0.70, 0.69, 0.68 respectively. Models trained on data from the first two VFs performed no better than top models trained on the initial VF alone. Based on the odds ratio (OR) from logistic regression and variable importance plots from the random forest model, older age (OR: 1.41 per 10 year increment [95% CI: 1.34 to 1.08]) and higher pattern standard deviation (OR: 1.31 per 5-dB increment [95% CI: 1.18 to 1.46]) were the variables in the initial VF most strongly associated with rapid progression. CONCLUSIONS: MLA can be used to predict eyes at risk for rapid progression with modest accuracy based on an initial VF test. Incorporating additional clinical data to the current model may offer opportunities to predict patients most likely to rapidly progress with even greater accuracy.
OBJECTIVE: To assess whether machine learning algorithms (MLA) can predict eyes that will undergo rapid glaucoma progression based on an initial visual field (VF) test. DESIGN: Retrospective analysis of longitudinal data. SUBJECTS: 175,786 VFs (22,925 initial VFs) from 14,217 patients who completed ≥5 reliable VFs at academic glaucoma centers were included. METHODS: Summary measures and reliability metrics from the initial VF and age were used to train MLA designed to predict the likelihood of rapid progression. Additionally, the neural network model was trained with point-wise threshold data in addition to summary measures, reliability metrics and age. 80% of eyes were used for a training set and 20% were used as a test set. MLA test set performance was assessed using the area under the receiver operating curve (AUC). Performance of models trained on initial VF data alone was compared to performance of models trained on data from the first two VFs. MAIN OUTCOME MEASURES: Accuracy in predicting future rapid progression defined as MD worsening more than 1 dB/year. RESULTS: 1,968 eyes (8.6%) underwent rapid progression. The support vector machine model (AUC 0.72 [95% CI 0.70-0.75]) most accurately predicted rapid progression when trained on initial VF data. Artificial neural network, random forest, logistic regression and naïve Bayes classifiers produced AUC of 0.72, 0.70, 0.69, 0.68 respectively. Models trained on data from the first two VFs performed no better than top models trained on the initial VF alone. Based on the odds ratio (OR) from logistic regression and variable importance plots from the random forest model, older age (OR: 1.41 per 10 year increment [95% CI: 1.34 to 1.08]) and higher pattern standard deviation (OR: 1.31 per 5-dB increment [95% CI: 1.18 to 1.46]) were the variables in the initial VF most strongly associated with rapid progression. CONCLUSIONS: MLA can be used to predict eyes at risk for rapid progression with modest accuracy based on an initial VF test. Incorporating additional clinical data to the current model may offer opportunities to predict patients most likely to rapidly progress with even greater accuracy.