Philipp Prahs1, Viola Radeck2, Christian Mayer3, Yordan Cvetkov2, Nadezhda Cvetkova2, Horst Helbig2, David Märker2. 1. Department of Ophthalmology, University of Regensburg, Franz-Josef-Strauss-Allee 11, 93042, Regensburg, Germany. philipp.prahs@ukr.de. 2. Department of Ophthalmology, University of Regensburg, Franz-Josef-Strauss-Allee 11, 93042, Regensburg, Germany. 3. Department of Ophthalmology, Technical University of Munich, Ismaninger Str. 22, 81675, Munich, Germany.
Abstract
PURPOSE: Intravitreal injections with anti-vascular endothelial growth factor (anti-VEGF) medications have become the standard of care for their respective indications. Optical coherence tomography (OCT) scans of the central retina provide detailed anatomical data and are widely used by clinicians in the decision-making process of anti-VEGF indication. In recent years, significant progress has been made in artificial intelligence and computer vision research. We trained a deep convolutional artificial neural network to predict treatment indication based on central retinal OCT scans without human intervention. METHOD: A total of 183,402 retinal OCT B-scans acquired between 2008 and 2016 were exported from the institutional image archive of a university hospital. OCT images were cross-referenced with the electronic institutional intravitreal injection records. OCT images with a following intravitreal injection during the first 21 days after image acquisition were assigned into the 'injection' group, while the same amount of random OCT images without intravitreal injections was labeled as 'no injection'. After image preprocessing, OCT images were split in a 9:1 ratio to training and test datasets. We trained a GoogLeNet inception deep convolutional neural network and assessed its performance on the validation dataset. We calculated prediction accuracy, sensitivity, specificity, and receiver operating characteristics. RESULTS: The deep convolutional neural network was successfully trained on the extracted clinical data. The trained neural network classifier reached a prediction accuracy of 95.5% on the images in the validation dataset. For single retinal B-scans in the validation dataset, a sensitivity of 90.1% and a specificity of 96.2% were achieved. The area under the receiver operating characteristic curve was 0.968 on a per B-scan image basis, and 0.988 by averaging over six B-scans per examination on the validation dataset. CONCLUSION: Deep artificial neural networks show impressive performance on classification of retinal OCT scans. After training on historical clinical data, machine learning methods can offer the clinician support in the decision-making process. Care should be taken not to mistake neural network output as treatment recommendation and to ensure a final thorough evaluation by the treating physician.
PURPOSE: Intravitreal injections with anti-vascular endothelial growth factor (anti-VEGF) medications have become the standard of care for their respective indications. Optical coherence tomography (OCT) scans of the central retina provide detailed anatomical data and are widely used by clinicians in the decision-making process of anti-VEGF indication. In recent years, significant progress has been made in artificial intelligence and computer vision research. We trained a deep convolutional artificial neural network to predict treatment indication based on central retinal OCT scans without human intervention. METHOD: A total of 183,402 retinal OCT B-scans acquired between 2008 and 2016 were exported from the institutional image archive of a university hospital. OCT images were cross-referenced with the electronic institutional intravitreal injection records. OCT images with a following intravitreal injection during the first 21 days after image acquisition were assigned into the 'injection' group, while the same amount of random OCT images without intravitreal injections was labeled as 'no injection'. After image preprocessing, OCT images were split in a 9:1 ratio to training and test datasets. We trained a GoogLeNet inception deep convolutional neural network and assessed its performance on the validation dataset. We calculated prediction accuracy, sensitivity, specificity, and receiver operating characteristics. RESULTS: The deep convolutional neural network was successfully trained on the extracted clinical data. The trained neural network classifier reached a prediction accuracy of 95.5% on the images in the validation dataset. For single retinal B-scans in the validation dataset, a sensitivity of 90.1% and a specificity of 96.2% were achieved. The area under the receiver operating characteristic curve was 0.968 on a per B-scan image basis, and 0.988 by averaging over six B-scans per examination on the validation dataset. CONCLUSION: Deep artificial neural networks show impressive performance on classification of retinal OCT scans. After training on historical clinical data, machine learning methods can offer the clinician support in the decision-making process. Care should be taken not to mistake neural network output as treatment recommendation and to ensure a final thorough evaluation by the treating physician.
Authors: D Huang; E A Swanson; C P Lin; J S Schuman; W G Stinson; W Chang; M R Hee; T Flotte; K Gregory; C A Puliafito Journal: Science Date: 1991-11-22 Impact factor: 47.728
Authors: Ravi Parikh; Joseph S Ross; Lindsey R Sangaralingham; Ron A Adelman; Nilay D Shah; Andrew J Barkmeier Journal: Ophthalmology Date: 2016-11-24 Impact factor: 12.079
Authors: Praveen J Patel; Andrew C Browning; Fred K Chen; Lyndon Da Cruz; Adnan Tufail Journal: Invest Ophthalmol Vis Sci Date: 2009-06-24 Impact factor: 4.799
Authors: Michael David Abràmoff; Yiyue Lou; Ali Erginay; Warren Clarida; Ryan Amelon; James C Folk; Meindert Niemeijer Journal: Invest Ophthalmol Vis Sci Date: 2016-10-01 Impact factor: 4.799
Authors: Andrew C Lin; Cecilia S Lee; Marian Blazes; Aaron Y Lee; Michael B Gorin Journal: Transl Vis Sci Technol Date: 2021-05-03 Impact factor: 3.283
Authors: Peter M Maloca; Aaron Y Lee; Emanuel R de Carvalho; Mali Okada; Katrin Fasler; Irene Leung; Beat Hörmann; Pascal Kaiser; Susanne Suter; Pascal W Hasler; Javier Zarranz-Ventura; Catherine Egan; Tjebo F C Heeren; Konstantinos Balaskas; Adnan Tufail; Hendrik P N Scholl Journal: PLoS One Date: 2019-08-16 Impact factor: 3.240
Authors: Sudeshna Sil Kar; Duriye Damla Sevgi; Vincent Dong; Sunil K Srivastava; Anant Madabhushi; Justis P Ehlers Journal: IEEE J Transl Eng Health Med Date: 2021-07-12