| Literature DB >> 33550068 |
Jasjit S Suri1, Sushant Agarwal2, Suneet K Gupta3, Anudeep Puvvula4, Mainak Biswas5, Luca Saba6, Arindam Bit7, Gopal S Tandel8, Mohit Agarwal3, Anubhav Patrick9, Gavino Faa10, Inder M Singh11, Ronald Oberleitner12, Monika Turk13, Paramjit S Chadha11, Amer M Johri14, J Miguel Sanches15, Narendra N Khanna16, Klaudija Viskovic17, Sophie Mavrogeni18, John R Laird19, Gyan Pareek20, Martin Miner21, David W Sobel20, Antonella Balestrieri5, Petros P Sfikakis22, George Tsoulfas23, Athanasios Protogerou24, Durga Prasanna Misra25, Vikas Agarwal26, George D Kitas27, Puneet Ahluwalia28, Jagjit Teji29, Mustafa Al-Maini30, Surinder K Dhanjil31, Meyypan Sockalingam32, Ajit Saxena16, Andrew Nicolaides33, Aditya Sharma34, Vijay Rathore11, Janet N A Ajuluchukwu35, Mostafa Fatemi36, Azra Alizad37, Vijay Viswanathan38, P K Krishnan39, Subbaram Naidu40.
Abstract
COVID-19 has infected 77.4 million people worldwide and has caused 1.7 million fatalities as of December 21, 2020. The primary cause of death due to COVID-19 is Acute Respiratory Distress Syndrome (ARDS). According to the World Health Organization (WHO), people who are at least 60 years old or have comorbidities that have primarily been targeted are at the highest risk from SARS-CoV-2. Medical imaging provides a non-invasive, touch-free, and relatively safer alternative tool for diagnosis during the current ongoing pandemic. Artificial intelligence (AI) scientists are developing several intelligent computer-aided diagnosis (CAD) tools in multiple imaging modalities, i.e., lung computed tomography (CT), chest X-rays, and lung ultrasounds. These AI tools assist the pulmonary and critical care clinicians through (a) faster detection of the presence of a virus, (b) classifying pneumonia types, and (c) measuring the severity of viral damage in COVID-19-infected patients. Thus, it is of the utmost importance to fully understand the requirements of for a fast and successful, and timely lung scans analysis. This narrative review first presents the pathological layout of the lungs in the COVID-19 scenario, followed by understanding and then explains the comorbid statistical distributions in the ARDS framework. The novelty of this review is the approach to classifying the AI models as per the by school of thought (SoTs), exhibiting based on segregation of techniques and their characteristics. The study also discusses the identification of AI models and its extension from non-ARDS lungs (pre-COVID-19) to ARDS lungs (post-COVID-19). Furthermore, it also presents AI workflow considerations of for medical imaging modalities in the COVID-19 framework. Finally, clinical AI design considerations will be discussed. We conclude that the design of the current existing AI models can be improved by considering comorbidity as an independent factor. Furthermore, ARDS post-processing clinical systems must involve include (i) the clinical validation and verification of AI-models, (ii) reliability and stability criteria, and (iii) easily adaptable, and (iv) generalization assessments of AI systems for their use in pulmonary, critical care, and radiological settings.Entities:
Keywords: ARDS; Artificial intelligence; COVID-19; CT; Comorbidity; Deep learning; Machine learning; Medical imaging; Transfer learning; US; Ultrasound; X-ray
Year: 2021 PMID: 33550068 PMCID: PMC7813499 DOI: 10.1016/j.compbiomed.2021.104210
Source DB: PubMed Journal: Comput Biol Med ISSN: 0010-4825 Impact factor: 4.589
Fig. 1Total confirmed cases per million as of December 21, 2020 [15]. (Source: Center for Systems Science and Engineering (CSSE) at Johns Hopkins University, Maryland, USA.).
Fig. 2Images of COVID-19 infection: (a) lung ultrasound (hyper-echoic region of the COVID-19 lung), (b) chest X-rays (the infected region in the lung), and (c) lung CT (segmented lung region; courtesy of Luca Saba, University of Cagliari, Italy). (d) The number of COVID-19 studies involving ARDS, ML, TL, DL, validation, data acquisition (DA), and 3-D imaging.
Fig. 3The flowchart showing the research strategy.
Fig. 4The pathophysiology of ARDS after COVID-19 infection, which consists of six phases: (i) inflammatory phase, (ii) dilatation phase, (iii) edematous phase, (iv) alveolar collapsing phase, (v) gas-exchange disorder, and (vi) hypoxemia. (Courtesy of AtheroPoint™, Roseville, CA, USA; reproduced with permission.)
Fig. 5The number of subjects enrolled in the ARDS-based studies that consider comorbidities.
Fig. 6Depiction of comorbidities collected from 48 studies.
Fig. 7Mortality due to the age factor (in years) with comorbidities in the cohort from the selected studies.
AI-based studies involved during Non-ARDS and ARDS periods. AI-based Non-ARDS: AI on ARDS lung data during pre-COVID-19. AI-based ARDS: AI on ARDS lung data postmarked December 2019 COVID-19 (post-COVID-19).
| Subsystems | AI-based Non-ARDS | AI-based ARDS |
|---|---|---|
| Segmentation | Characteristics | Characteristics |
| Watershed, region-based, contour-based, fusion-based, and model-based. | FC-Densenet103, Unet, DenseNet, and DenseNet121-FPN. | |
| References | References | |
| [ | [ | |
| Classification | Characteristics | Characteristics |
| Gray scale feature extraction and ML classifier, and model-based techniques. | Resnet-50, CNN, SVM, ResNet101, VGG16, and VGG19. | |
| References | References | |
| [ | [ | |
| Joint Segmentation and Classification | Characteristics | Characteristics |
| They use the same characteristics as adapted by segmentation and classification domain for AI-based Non-ARDS. | They use the same characteristics as adapted by segmentation and classification domain for AI-based ARDS. | |
| References | References | |
| [ | [ |
Types of artificial intelligence architectures and severity index.
| SN | AI Components and Attributes | ||
|---|---|---|---|
| Lung Segmentation | AI Component | Severity Index | |
| Auto/Semi-Auto | ML/DL/TL/DL | Categorical/Continuous/Categorical | |
| 1 | Auto | DL | Categorical |
| 2 | Auto | DL | Categorical |
| 3 | Auto | DL | Categorical |
| 4 | Semi-Auto | DL | Categorical |
| 5 | Auto | ML | Categorical |
| 6 | Auto | DL | Categorical |
| 7 | Auto | TL | Categorical |
Both technologies are present.
Clustering of multimodality artificial intelligence architectures and their salient features.
| SoT | Reference | Modality | Imaging | Highlight/Objective | Architecture Description | Performance Metrics |
|---|---|---|---|---|---|---|
| [ | Multiview fusion [ | Resnet50 [ | ||||
| [ | Biomarker based model [ | Resnet34 with logistic regression [ | ||||
| [ | ||||||
| 3-D Convolution Network [ | Resnet50 [ | [ | ||||
| multi-objective differential | [ | |||||
| [ | evolution based CNN [ | (AlexNet, VGG-16 | ||||
| [ | weakly supervised DL model [ | VGG-19, SqueezeNet, | [ | |||
| GoogleNet, MobileNet-V2, ResNet-18, ResNet-50, ResNet-101, and Xception) [ | ||||||
| [ | [ | |||||
| [ | ML and DL hybrid network for classification and prognosis [ | Resnet18 with Gradient Boosting [ | ||||
| [ | Pleural line identification using ML [ | Hidden Markov Model and Viterbi Algorithm combined with SVM [ | ||||
| [ | Ensemble of DL and TL [ | Custom CNN [ | ||||
| 16, VGG-19, Inception-V3, Xception, InceptionResNet- V2, MobileNet- V2, DenseNet-201, NasNet- mobile) [ | ||||||
| [ | Explainable DL to provide explainability about the prediction | |||||
| [ | VGG-16 [ | |||||
| [ | TL model trained on ensemble of two publicly available datasets [ | DenseNet201 [ | ||||
| [ | ||||||
Fig. 8An online ML-based COVID-19 risk prediction system. (Courtesy of AtheroPoint™, Roseville, CA, USA; reproduced with permission.)
Fig. 9A custom CNN-based DL architecture comprising different layers.
Fig. 10An example of transfer learning (TL) architecture using VGG16.
Fig. 11(a) An X-ray scanner. (b) A CT-scanner (Courtesy of Luca Saba, University of Cagliari, Italy). (c) Studies using CT vs. X-ray.
Compatibility of imaging modality for COVID-19 and adaptability for AI [230].
| Imaging Modality | Suitable for COVID-19 as per WHO guidelines | Cost | Risk of radiation | Risk of infection due to close contact | Compatible with AI for COVID-19 diagnosis |
|---|---|---|---|---|---|
| PET/CT | High | Very High | Very High | Low | Low |
| CT | High | High | Very High | Low | Very High |
| X-ray | Medium | Low | High | Low | Medium |
| Ultrasound | Low | Low | No | High | Low |
| MRI | Low | High | No | Low | Low |
Artificial Intelligence-based studies for automatic COVID-19 detection using lung CT.
| SN | Reference | Risk Class | 2-D vs. 3-D | *ROI | AI Model | Augm. | CV | H/W-S/W | Optimal Model | Performances | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Ardakani et al. (2020) [ | 194 | 2 | 2-D | ✗ | CNN + TL | ✗ | NA | SPSS software (version 24, IBM) | ResNet101 | ACC:99.51% |
| SE:100% | |||||||||||
| SP:99.02% | |||||||||||
| AUC:0.994 | |||||||||||
| 2 | Wu et al. (2020) [ | 495 | 3 | 2-D | ✓ | CNN + TL | ✗ | NA | GPU Python | ResNet50 | ACC:76.0% |
| SE:81.1% | |||||||||||
| SP:61.5% | |||||||||||
| AUC:0.819 | |||||||||||
| 3 | Zheng et al. (2020) [ | 499 | 2 | 3-D | ✗ | 3-D CNN + TL | ✓ | NA | GPU PyTorch | UNet | ACC: 90.1% |
| SE: 90.7% | |||||||||||
| SP: 911% | |||||||||||
| AUC: 0.976 | |||||||||||
| 4 | Yang et al. (2020) [ | 679 | 2 | 2-D | ✓ | CNN | ✓ | NA | GPU PyTorch | DenseNet169 | ACC:89% |
| FS:90% | |||||||||||
| AUC:0.98 | |||||||||||
| 5 | Gozes et al. (2020) [ | 270 | 2 | 2-D & 3-D | ✓ | 3-D + 2-D CNN | ✓ | NA | NA | Resnet50 | SE: 98.2% |
| SP: 92.2% | |||||||||||
| AUC: 0.996 | |||||||||||
| 6 | Shi et al. (2020) [ | 2685 | 2 | 2-D | ✓ | ML (RF) | ✗ | K5 | NA | RF | ACC:87.9% |
| SE: 90.7% | |||||||||||
| SP: 83.3% | |||||||||||
| AUC: 0.942 | |||||||||||
| 7 | Liu et al. (2020) [ | 746 | 2 | 2-D | ✗ | LA-DNN + TL | ✗ | NA | NA | LA-DNN | ACC:88.8% |
| F1S: 94.7% | |||||||||||
| AUC: 0.88 | |||||||||||
| 8 | Panwar et al. (2020) [ | 2482 | 2 | 2-D | ✗ | CNN + TL | ✗ | NA | NA | VGG19 | ACC:87.9% |
| SE: 90.7% | |||||||||||
| SP: 83.3% | |||||||||||
| AUC: 0.942 |
Subj.: Number of subjects in the study; Augm.: Augmentation; NA: Not available; ACC: Accuracy, SE: Sensitivity; SP: Specificity; AUC: Area under the curve; F-M: F-measure; KP: Kappa statistics; TL: Transfer Learning; FS: F1-Score LA-DNN: lesion-attention deep neural network; RF: Random forest; ML: machine learning; H/W: Hardware; S/W: Software; CV: Cross-Validation; K5: five-fold; ROI: Automated Region of Interest.
Artificial Intelligence-based studies for automatic COVID-19 detection using lung X-ray.
| SN | Reference | Risk Class | 2-D vs. 3-D | Auto ROI | AI Model | Augm. | CV | H/W-S/W | Optimal Model | Performances | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Narayan Das et al. (2020) [ | NA | 3 | 2-D | ✗ | CNN + TL | ✗ | NA | NA | Proposed CNN | ACC: 97% |
| FM: 96% | |||||||||||
| SE: 97% SP:97% | |||||||||||
| KP:0.97 | |||||||||||
| 2 | Ouchicha et al. (2020) [ | 2905 | 3 | 2-D | ✗ | CNN | ✗ | K5 | NA | CVDNet (proposed CNN) | ACC: 90% |
| PR: 96.72% | |||||||||||
| RC: 96.84% | |||||||||||
| FS: 96.68% | |||||||||||
| 3 | Hemdan et al. (2020) [ | 50 | 2 | 2-D | ✗ | CNN | ✗ | NA | GPU Python | VGG19 DenseNet201 | ACC: 96.69% |
| PR: 83% | |||||||||||
| RC: 100% | |||||||||||
| FS: 91% | |||||||||||
| 4 | Zhang et al. (2020) [ | 43,370 | 1, 2 | 2-D | ✗ | CNN | ✓ | K5 | NA | CAAD (proposed CNN) | ACC: 78.57% |
| SE: 71.70% | |||||||||||
| SP:79.40% | |||||||||||
| AUC: 0.83 | |||||||||||
| 5 | Togacar et al. (2020) [ | 458 | 3 | 2-D | ✓ | CNN + TL | ✓ | K5 | CPU MATLAB | MobileNetV2 | ACC: 99.24% |
| SE: 100% | |||||||||||
| SP: 97.72% | |||||||||||
| FS: 99.43% | |||||||||||
| 6 | Farooq et al. (2020) [ | 2839 | 4 | 2-D | ✗ | CNN + TL | ✓ | NA | NA | ResNet50 | ACC: 96.23% |
| RC: 100% | |||||||||||
| PR: 100% | |||||||||||
| FS: 100% | |||||||||||
| 7 | Cozzi et al. (2020) [ | 1427 | 3 | 2-D | ✗ | CNN + TL | ✗ | K10 | NA | VGG19 | ACC: 96.78% |
| SE: 98.66% | |||||||||||
| SP: 96.46% | |||||||||||
| 8 | Pereira et al. (2020) [ | 1144 | 7 | 2-D | ✗ | ML + DL + TL | ✗ | NA | NA | Multilayer Perceptron | FS: 89% |
Subj.: Number of subjects in the study; Augm: Augmentation; NA: Not available; ACC: Accuracy; SE: Sensitivity; SP: Specificity; AUC: Area under the curve; F-M: F-measure; KP: Kappa statistics; PR: precision; RC: recall; FS:F-Score; TL: Transfer Learning; LA-DNN: lesion-attention deep neural network; ML: machine learning; H/W: Hardware; S/W: Software; CAAD: confidence-aware anomaly detection model; ROI: Region of Interest.
Fig. 12X-ray scans of COVID-19, pneumonia, and normal lungs (Reproduced with permission [219]).
Fig. 13CT scans classified as positive for coronavirus abnormalities and their corresponding color heatmaps (Reproduced with permission [220]).
Fig. 14A 3-D graph representing the relationship between CNN layers, data augmentation, and accuracy. (Courtesy of AtheroPoint™, Roseville, CA, USA; reproduced with permission [14].)
Fig. 15Microscopic views of (a) interstitial pneumonia and (b) COVID-19 pneumonia. (Courtesy of Luca Saba, A.O.U., Cagliari, Italy.)
Fig. 16Three lungs with non-COVID-19 pneumonia (a1, a2, and a3). Three lungs with COVID-19 pneumonia with different COVID-19 severities (b1, b2, and b3). (Courtesy of AtheroPoint™, Roseville, CA, USA; reproduced with permission.)
Fig. 17Bispectrum analysis of non-COVID-19 pneumonia (NCoP) and COVID-19 pneumonia (CoP). (Courtesy of AtheroPoint™, Roseville, CA, USA; reproduced with permission.)