| Literature DB >> 34737335 |
Kyung Jun Choi1, Jung Eun Choi2, Hyeon Cheol Roh3, Jun Soo Eun4, Jong Min Kim5, Yong Kyun Shin1, Min Chae Kang1, Joon Kyo Chung1, Chaeyeon Lee1, Dongyoung Lee1, Se Woong Kang1, Baek Hwan Cho6,7, Sang Jin Kim8.
Abstract
This study aimed to validate and evaluate deep learning (DL) models for screening of high myopia using spectral-domain optical coherence tomography (OCT). This retrospective cross-sectional study included 690 eyes in 492 patients with OCT images and axial length measurement. Eyes were divided into three groups based on axial length: a "normal group," a "high myopia group," and an "other retinal disease" group. The researchers trained and validated three DL models to classify the three groups based on horizontal and vertical OCT images of the 600 eyes. For evaluation, OCT images of 90 eyes were used. Diagnostic agreements of human doctors and DL models were analyzed. The area under the receiver operating characteristic curve of the three DL models was evaluated. Absolute agreement of retina specialists was 99.11% (range: 97.78-100%). Absolute agreement of the DL models with multiple-column model was 100.0% (ResNet 50), 90.0% (Inception V3), and 72.22% (VGG 16). Areas under the receiver operating characteristic curves of the DL models with multiple-column model were 0.99 (ResNet 50), 0.97 (Inception V3), and 0.86 (VGG 16). The DL model based on ResNet 50 showed comparable diagnostic performance with retinal specialists. The DL model using OCT images demonstrated reliable diagnostic performance to identify high myopia.Entities:
Mesh:
Year: 2021 PMID: 34737335 PMCID: PMC8568935 DOI: 10.1038/s41598-021-00622-x
Source DB: PubMed Journal: Sci Rep ISSN: 2045-2322 Impact factor: 4.379
Figure 1Overview of the framework. (a) Single-column model. (b) Multiple-column model, which considers vertical and horizontal OCT images simultaneously at each CNN feature extractor.
Figure 2Various high myopia related features included in this study. Left column is horizontal section and right column is vertical section. (a) Severe curvature of posterior pole. (b) Paravascular retinal cysts and vascular microfolds (arrows). (c) Foveoschisis and impending macular hole was shown. Paravascular retinal cyst is also shown (arrow). (d) Macular hole and dome shape macula. (e) Macular chorioretinal atrophy. (f) Retinal detachment and retinoschisis. (g) Foveoshcisis and paravascular lamellar hole with retinal cysts (arrow). (h) Retinoschisis (arrows) with vascular microfolds and retinal detachment.
Summary of the demographics of training, validation, and test data sets.
| Training and validation set | Test set | |||||
|---|---|---|---|---|---|---|
| No. of patients | 434 | 58 | ||||
| Age (mean ± SD) | 58.85 ± 13.55 | 64.08 ± 10.95 | ||||
| Sex, (male:female) | 202:232 | 28:30 | ||||
| No. of OCT images | 1200 (600 eyes) | 180 (90 eyes) | ||||
Class myopia included eyes with axial length of 26.5 mm or more.
Class normal and other included eyes with axial length between 21.5 mm and 26.0 mm.
Five-fold cross validation results for each of the single- and multiple-column models.
| CNN backbone | Micro-average AUC of the single-column models | Micro-average AUC of the multiple-column models | ||
|---|---|---|---|---|
| Initialization with ImageNet-pretrained models | Initialization with the pretrained single-column models | |||
| VGG 16 | Vertical | 0.9859 ± 0.00 (0.9826–0.9906) | 0.5801 ± 0.07 (0.5189–0.6409) | 0.6827 ± 0.17 (0.5307–0.8341) |
| Horizontal | 0.9873 ± 0.01 (0.9811–0.9934) | |||
| Resnet 50 | Vertical | 0.9746 ± 0.01 (0.9646–0.9850) | 0.5545 ± 0.08 (0.4829–0.6261) | 1.0000 ± 0.00 (1.0–1.0) |
| Horizontal | 0.9844 ± 0.01 (0.9796–0.9896) | |||
| Inception V3 | Vertical | 0.8967 ± 0.04 (0.8625–0.9310) | 0.8048 ± 0.07 (0.7455–0.8648) | 0.9170 ± 0.03 (0.8886–0.9453) |
| Horizontal | 0.9188 ± 0.04 (0.8809–0.9568) | |||
CNN convolutional neural network, AUC area under the receiver operating characteristic curve.
Data are mean ± standard deviation (95% confidence interval).
Absolute agreement and intergrader agreement of the deep learning models, retinal specialists, and resident ophthalmologists.
| CNN | Absolute agreement of single-column model | Absolute agreement of multiple-column model | Cohen Kappa (95% confidence interval) | |
|---|---|---|---|---|
| VGG 16 | Vertical | 97.78% (88/90) | 72.22% (65/90) | 0.52 (0.38–0.66) |
| Horizonal | 96.67% (87/90) | |||
| Resnet 50 | Vertical | 100.00% (90/90) | 100.00% (90/90) | 1.0 (1.0–1.0) |
| Horizonal | 98.89% (89/90) | |||
| Inception V3 | Vertical | 88.89% (80/90) | 90.00% (81/90) | 0.85 (0.76–0.94) |
| Horizonal | 87.78% (79/90) | |||
CNN convolutional neural network.
(No. of correct diagnosis/no. of test set).
Results of human doctor is given as mean ± standard deviation (four residents and five retinal specialists).
The Cohen κ statistic was evaluated as follows: 0.21 to 0.40 indicated fair agreement; 0.41 to 0.60, moderate agreement; 0.61 to 0.80, substantial agreement; and 0.81 to 1.0, near-perfect agreement.
Figure 3Comparison of the performance of the deep learning models with that of human doctors. (a) The receiver operating characteristic curves of three deep learning models of a single-column model. ResNet 50 demonstrate the best diagnostic performance. (b) The receiver operating characteristic curves of three deep learning models of the multiple-column model and the diagnostic performance of human doctors. ResNet 50 show the best diagnostic performance among the three deep learning models and had comparable performance to that of the retinal specialists.
Figure 4Visual explanations generated by Grad-CAM + + on OCT scans. The Grad-CAM + + image show that the deep learning model accurately identified the differentiation points.
Figure 5Visual explanations generated by Grad-CAM + + on OCT scans of myopia class. The Grad-CAM + + image show that the deep learning model identified some of the characteristic features of high myopia. The deep learning model accurately identified severe curvature of high myopic eye for all of the OCT images. The model also identified vascular microfolds (b), peripapillary artrophy (c, d and e), chorioretinal macular atrophy (e), Retinal cysts and paravascular lamellar hole (g) and retinoschisis (g and h).