Chenchen Yu1, Sha Xie1, Sijie Niu2, Zexuan Ji1, Wen Fan3, Songtao Yuan3,4, Qinghuai Liu3, Qiang Chen1. 1. School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, 210094, China. 2. School of Information Science and Engineering, University of Jinan, Jinan, 250022, China. 3. Department of Ophthalmology, the First Affiliated Hospital with Nanjing Medical University, Nanjing, 210029, China. 4. The Affiliated Jiangsu Shengze Hospital of Nanjing Medical University, Suzhou, 215228, China.
Abstract
PURPOSE: The purpose of this study was to automatically and accurately segment hyper-reflective foci (HRF) in spectral domain optical coherence tomography (SD-OCT) images with diabetic retinopathy (DR) using deep convolutional neural networks. METHODS: An automatic HRF segmentation model for SD-OCT images based on deep networks was constructed. The model segmented small lesions through pixel-wise predictions based on small image patches. We used an approach for discriminative features extraction for small patches by introducing small kernels and strides in convolutional and pooling layers, which was applied on the state-of-the-art deep classification networks (GoogLeNet and ResNet). The features extracted by the adapted deep networks were fed into a softmax layer to produce the probabilities of HRF. We trained different models on a dataset with 16 HRF eyes by using different sizes of patches, and then, we fused these models to generate optimal results. RESULTS: Experimental results on 18 eyes demonstrated that our method is effective for the HRF segmentation. The dice similarity coefficient (DSC) for the foci area in B-scan, projection images, and foci amount in B-scan images reaches 67.81%, 74.09%, and 72.45%, respectively. CONCLUSIONS: The proposed segmentation model can accurately segment HRF in SD-OCT images with DR and outperforms traditional methods. Our model may provide reliable segmentations for small lesions in SD-OCT images and may be helpful in the clinical diagnosis of diseases.
PURPOSE: The purpose of this study was to automatically and accurately segment hyper-reflective foci (HRF) in spectral domain optical coherence tomography (SD-OCT) images with diabetic retinopathy (DR) using deep convolutional neural networks. METHODS: An automatic HRF segmentation model for SD-OCT images based on deep networks was constructed. The model segmented small lesions through pixel-wise predictions based on small image patches. We used an approach for discriminative features extraction for small patches by introducing small kernels and strides in convolutional and pooling layers, which was applied on the state-of-the-art deep classification networks (GoogLeNet and ResNet). The features extracted by the adapted deep networks were fed into a softmax layer to produce the probabilities of HRF. We trained different models on a dataset with 16 HRF eyes by using different sizes of patches, and then, we fused these models to generate optimal results. RESULTS: Experimental results on 18 eyes demonstrated that our method is effective for the HRF segmentation. The dice similarity coefficient (DSC) for the foci area in B-scan, projection images, and foci amount in B-scan images reaches 67.81%, 74.09%, and 72.45%, respectively. CONCLUSIONS: The proposed segmentation model can accurately segment HRF in SD-OCT images with DR and outperforms traditional methods. Our model may provide reliable segmentations for small lesions in SD-OCT images and may be helpful in the clinical diagnosis of diseases.
Authors: Akiyoshi Uemura; Marcus Fruttiger; Patricia A D'Amore; Sandro De Falco; Antonia M Joussen; Florian Sennlaub; Lynne R Brunck; Kristian T Johnson; George N Lambrou; Kay D Rittenhouse; Thomas Langmann Journal: Prog Retin Eye Res Date: 2021-02-25 Impact factor: 21.198