| Literature DB >> 35372832 |
Justin Lo1,2, Adam Lim1,2, Matthias W Wagner3, Birgit Ertl-Wagner3,4, Dafna Sussman1,2,5.
Abstract
Rapid development in Magnetic Resonance Imaging (MRI) has played a key role in prenatal diagnosis over the last few years. Deep learning (DL) architectures can facilitate the process of anomaly detection and affected-organ classification, making diagnosis more accurate and observer-independent. We propose a novel DL image classification architecture, Fetal Organ Anomaly Classification Network (FOAC-Net), which uses squeeze-and-excitation (SE) and naïve inception (NI) modules to automatically identify anomalies in fetal organs. This architecture can identify normal fetal anatomy, as well as detect anomalies present in the (1) brain, (2) spinal cord, and (3) heart. In this retrospective study, we included fetal 3-dimensional (3D) SSFP sequences of 36 participants. We classified the images on a slice-by-slice basis. FOAC-Net achieved a classification accuracy of 85.06, 85.27, 89.29, and 82.20% when predicting brain anomalies, no anomalies (normal), spinal cord anomalies, and heart anomalies, respectively. In a comparison study, FOAC-Net outperformed other state-of-the-art classification architectures in terms of class-average F1 and accuracy. This work aims to develop a novel classification architecture identifying the affected organs in fetal MRI.Entities:
Keywords: Convolutional Neural Network (CNN); deep learning; fetal MRI; fetal disease; fetal organ anomaly; image classification
Year: 2022 PMID: 35372832 PMCID: PMC8972161 DOI: 10.3389/frai.2022.832485
Source DB: PubMed Journal: Front Artif Intell ISSN: 2624-8212
Detailed evaluation of the fetal MRI dataset, training and validation, and examples of diagnoses.
|
|
|
|
|
|
|
|---|---|---|---|---|---|
| Brain | 713 | 227 | 227 | Hypoxic ischemic encephalopathy | 30.41 ± 2.62 |
| Interhemispheric cyst | |||||
| Agenesis of corpus callosum | |||||
| Heart | 760 | 246 | 246 | Intracardiac tuberous sclerosis | 28.29 ± 2.52 |
| Central venous hypertension | |||||
| Ventricular septal defect | |||||
| Spinal Cord | 755 | 233 | 233 | Spina bifida | 31.61 ± 3.62 |
| Vertebra malformation | |||||
| Cervical thoracic scoliosis | |||||
| Normal | 676 | 227 | 227 | 32.17 ± 2.24 | |
| Total | 2,904 | 933 | 933 |
Figure 1An overview of the proposed classification architecture, FOAC-Net.
Figure 2Block diagram representation of the SE module.
Figure 3Block diagram of the naïve inception module.
Mean testing results with standard deviation.
|
|
|
|
|
|
|
|---|---|---|---|---|---|
| FOAC-Net | 85.32 ± 0.0025 | – | 85.24 ± 0.0024 | – | 10,336,178 |
| VGG-16 | 78.93 ± 0.030 | 0.021 | 78.78 ± 0.028 | 0.016 | 138,357,544 |
| VGG-19 | 82.43 ± 0.0079 | 0.011 | 82.83 ± 0.044 | 3.01e−05 | 143,667,240 |
| ResNet-50 | 84.16 ± 0.0064 | 0.0048 | 79.56 ± 0.050 | 0.036 | 25,636,712 |
| ResNet-101 | 82.56 ± 0.0016 | 1.87e−04 | 73.07 ± 0.041 | 0.0069 | 44,707,176 |
| ResNet-152 | 81.93 ± 0.0082 | 0.0027 | 69.41 ± 0.0405 | 0.0025 | 60,419,944 |
| DenseNet-121 | 82.04 ± 0.019 | 0.049 | 79.56 ± 0.033 | 0.042 | 8,062,504 |
| DenseNet-169 | 83.82 ± 0.0060 | 0.020 | 82.05 ±0.018 | 0.039 | 14,307,880 |
| DenseNet-201 | 84.35 ± 0.0012 | 0.0099 | 77.59 ± 0.0093 | 1.56e−04 | 20,242,984 |
| Inception-V3 | 75.75 ± 0.037 | 0.011 | 72.43 ± 0.033 | 3.01e−05 | 23,851,784 |
| Inception-ResNet | 82.02 ± 0.019 | 0.043 | 71.99 ± 0.0026 | 2.82e−07 | 55,873,736 |
| Mobile-Net | 80.76 ± 0.012 | 0.0033 | 71.38 ± 0.016 | 1.11e−04 | 4,253,864 |
| Xception | 83.65 ± 0.0091 | 0.0417 | 78.58 ± 0.029 | 0.016 | 22,910,480 |
Ablation study with mean standard deviation.
|
|
|
|
|
|
|---|---|---|---|---|
| FOAC-Net | 85.29 ± 0.0025 | – | 85.24 ± 0.0024 | – |
| Proposed-NI | 82.01 ± 0.0018 | 1.01e−04 | 82.11 ± 0.0021 | 4.98e−05 |
| Proposed-SE | 80.85 ± 0.0028 | 5.30e−05 | 80.82 ± 0.0223 | 1.76e−05 |
| Proposed-NI-SE | 80.74 ± 0.0048 | 1.63e−04 | 80.82 ± 0.0047 | 1.10e−04 |
| Proposed (K) | 79.69 ± 0.0075 | 2.84e−04 | 79.69 ± 0.0074 | 2.40e−04 |
| Proposed (K)-NI | 79.49 ± 0.0093 | 5.97e−04 | 81.56 ± 0.019 | 0.029 |
| Proposed (K)-SE | 79.25 ± 0.0097 | 4.44e−04 | 79.66 ± 0.034 | 0.046 |
| Proposed (K)-SE-NI | 78.98 ± 0.0064 | 2.52e−04 | 79.52 ± 0.039 | 0.033 |
Figure 4Confusion matrix evaluating specific class performance on the proposed architecture.
Figure 5Predicted classification output of FOAC-Net, ResNet-152, DenseNet-201, and Xception (normalized prediction probabilities). Target classes are [brain, normal, spinal cord, heart], respectively.