| Literature DB >> 33846685 |
Danial Sharifrazi1, Roohallah Alizadehsani2, Mohamad Roshanzamir3, Javad Hassannataj Joloudari4, Afshin Shoeibi5,6, Mahboobeh Jafari7, Sadiq Hussain8, Zahra Alizadeh Sani9,10, Fereshteh Hasanzadeh10, Fahime Khozeimeh2, Abbas Khosravi2, Saeid Nahavandi2, Maryam Panahiazar11, Assef Zare12, Sheikh Mohammed Shariful Islam13,14,15, U Rajendra Acharya16,17,18.
Abstract
The coronavirus (COVID-19) is currently the most common contagious disease which is prevalent all over the world. The main challenge of this disease is the primary diagnosis to prevent secondary infections and its spread from one person to another. Therefore, it is essential to use an automatic diagnosis system along with clinical procedures for the rapid diagnosis of COVID-19 to prevent its spread. Artificial intelligence techniques using computed tomography (CT) images of the lungs and chest radiography have the potential to obtain high diagnostic performance for Covid-19 diagnosis. In this study, a fusion of convolutional neural network (CNN), support vector machine (SVM), and Sobel filter is proposed to detect COVID-19 using X-ray images. A new X-ray image dataset was collected and subjected to high pass filter using a Sobel filter to obtain the edges of the images. Then these images are fed to CNN deep learning model followed by SVM classifier with ten-fold cross validation strategy. This method is designed so that it can learn with not many data. Our results show that the proposed CNN-SVM with Sobel filter (CNN-SVM + Sobel) achieved the highest classification accuracy, sensitivity and specificity of 99.02%, 100% and 95.23%, respectively in automated detection of COVID-19. It showed that using Sobel filter can improve the performance of CNN. Unlike most of the other researches, this method does not use a pre-trained network. We have also validated our developed model using six public databases and obtained the highest performance. Hence, our developed model is ready for clinical application.Entities:
Keywords: CNN.; Covid-19; Data Mining; Deep Learning; Feature Extraction; Image Processing; Machine Learning; SVM; Sobel operator
Year: 2021 PMID: 33846685 PMCID: PMC8026268 DOI: 10.1016/j.bspc.2021.102622
Source DB: PubMed Journal: Biomed Signal Process Control ISSN: 1746-8094 Impact factor: 3.880
Summary of works done on automated detection of COVID-19 using DL techniques with X-ray and CT images.
| Study | Modality | Number of Cases (or Images) | Network |
|---|---|---|---|
| Wang et al. [ | X-ray | 13,975 images | Deep CNN |
| Hall et al. [ | X-ray | 455 images | VGG-16 and ResNet-50 |
| Farooq et al. [ | X-ray | 5941 images | ResNet-50 |
| Hemdan et al. [ | X-ray | 50 images | DesnseNet, VGG16, MobileNet v2.0 etc. |
| Abbas et al. [ | X-ray | 196 images | CNN with transfer learning |
| Minaee et al. [ | X-ray | 5000 images | DenseNet-121, SqueezeNet, ResNet50, ResNet18 |
| Zhang et al. [ | X-ray | 213 images | ResNet, EfficientNet |
| Apostolopoulos et al. [ | X-ray | 3905 images | MobileNet v2.0 |
| Narin et al. [ | X-ray | 100 images | InceptionResNetV2, InceptionV3, ResNet50 |
| Luz et al. [ | X-ray | 13, 800 images | EfficientNet |
| Brunese et al. [ | X-ray | 6523 images | VGG-16 and transfer learning |
| Ozturk et al. [ | X-ray | Two publically available databases were used where images were updated regularly. | Darknet-19 |
| Khan et al. [ | X-ray | 1251 images | CNN |
| Silva et al. [ | CT scans | 2482 images | A slice voting-based approach extending the Efficient Net Family of deep artificial neural networks |
| Luz et al. [ | X-ray | 13, 800 images | Efficient Net |
| Ozturk et al. [ | X-ray | Two publically available databases were used where images were updated regularly. | Darknet-19 |
| Khan et al. [ | X-ray | 1251 images | CNN |
| Haghanifar et al. [ | X-ray | 7700 images | DenseNet-121 |
| U-Net | |||
| Oh et al. [ | X-ray | 502 images | DenseNet |
| U-Net | |||
| Tartaglione et al. [ | X-ray | 5 different databases | ResNet |
| Rahimzadeh et al. [ | X-ray | 11,302 images | Xception and ResNet50V2 |
| Jamil et al. [ | X-ray | 14,150 images | Deep CNN |
| Horry et al. [ | X-ray | 60,798 images | VGG, Inception, Xception, and Resnet |
| Elasnaoui et al. [ | X-ray | 6087 images | inception_Resnet_V2 and Densnet201 |
| And CT | |||
| Ardakani et al. [ | CT | 1020 | ResNet-101, ResNet-50, ResNet-18, GoogleNet, SqueezeNet, VGG-19, AlexNet |
Fig. 1Sample X-ray images: a) healthy subjects and b) COVID-19 patients. The marked region indicates the infected parts.
Fig. 2Proposed methodology used for the automated detection of COVID-19 patients using X-ray images.
Fig. 3Sample images: (a) original (b) after applying Sobel filter.
Fig. 4Results of applying various filter sizes of: (a) 3, (b) 5 and (c) 7.
Details of parameters used in the proposed CNN architecture.
| Number of Kernels related to first and second connection | Size of the convolution kernels | Size of the max pooling kernels | Number of neurons in the Fully Connected layer | Number of neurons in the output layer | Size of the Dropout layer | Number of batch size | Number of epochs | Value of validation data | Optimizer function | Activator function | Loss function for CNN + Sigmoid | Loss function for CNN + SVM | SVM function kernel | Output layer classifiers |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 128 and 256 | 3*3 | 2*2 | 64, 32 and 16 | 2(health and sick) | 0.2 | 32 | 100 | 0.3 and 0.2 | Adam | ReLU | binary cross entropy | Hinge | Linear | Sigmoid and SVM |
Fig. 5Proposed CNN architecture for the automated detection of COVID-19 patients using X-ray images.
Fig. 6Output obtained at different layers of CNN.
Fig. 7Performance metrics of CNN-sigmoid method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.
Fig. 14Performance metrics of CNN-SVM method with Sobel operator using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.
Fig. 8Performance metrics of CNN-SVM method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.
Fig. 10Performance metrics of CNN-SVM with Sobel operator method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.
Fig. 11Performance metrics of CNN-sigmoid method using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.
Fig. 9Performance metrics of CNN-sigmoid with Sobel operator method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.
Fig. 12Performance metrics of CNN-SVM method using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.
Fig. 13Performance metrics of CNN-sigmoid method with Sobel operator using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.
Various performance measures obtained using different combination of methods.
| Methods | Accuracy (%) | PPV (%) | Recall (%) | Specificity (%) | F1-score (%) | Loss | AUC | ||
|---|---|---|---|---|---|---|---|---|---|
| AVG | Min | Max | |||||||
| CNN-Sigmoid | 92.9418 | 89.3256 | 95.1267 | 98.00 | 92.99 | 91.13 | 95.42 | 0.2327 | 0.9203 |
| CNN-SVM | 98.2729 | 96.2564 | 99.0224 | 97.80 | 100 | 93.16 | 98.89 | 0.8088 | 0.9658 |
| CNN-Sigmoid + Sobel | 96.5435 | 93.1657 | 98.9652 | 97.50 | 98.30 | 90.42 | 97.90 | 0.1368 | 0.9438 |
Evaluation performance measures obtained by applying different algorithms and combination of our methods using augmented COVID-19 X-ray images database.
| Methods | Accuracy (%) | PPV (%) | Recall (%) | Specificity (%) | F1-score (%) | Loss | AUC |
|---|---|---|---|---|---|---|---|
| Alqudah et al. (a) [ | 99.46 | NA | 99.46 | 99.73 | NA | NA | NA |
| Alqudah et al. (b) [ | 95.2 | 100 | 93.3 | 100 | NA | NA | NA |
| Haque et al. [ | 99.00 | NA | NA | NA | NA | NA | NA |
| CNN-Sigmoid | 91.3883 | 93.40 | 94.00 | 89.96 | 93.69 | 0.6894 | 0.9192 |
| CNN-SVM | 98.2477 | 98.00 | 98.80 | 97.86 | 98.39 | 0.8044 | 0.9828 |
| CNN-Sigmoid + Sobel | 98.4636 | 98.80 | 98.40 | 98.68 | 98.60 | 0.0100 | 0.9848 |
| 99.6156 | 99.60 | 99.80 | 99.56 | 99.70 | 0.8047 | 0.9968 |
Fig. 15Performance obtained using different methods with our private database for COVID-19 diagnosis.
Fig. 16Performance obtained using different methods with augmented COVID-19 X-ray images database for COVID-19 diagnosis.
Evaluation metrics obtained for our proposed method using different public databases.
| Accuracy (%) | Other Performance Measurement Factors | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Database | Collected from | Number of cases | Method | AVG | Min | Max | PPV (%) | Recall (%) | Specificity (%) | F1-score (%) | Loss | AUC |
| [ | Bangladesh | 1820 | CNN-Sigmoid | 91.39 | 90.02 | 92.56 | 93.40 | 94.00 | 89.93 | 93.70 | 0.69 | 0.92 |
| CNN-SVM | 98.25 | 96.35 | 99.06 | 98.00 | 98.80 | 97.87 | 98.40 | 0.80 | 0.98 | |||
| CNN-Sigmoid + Sobel | 98.46 | 96.25 | 99.63 | 98.80 | 98.40 | 98.68 | 98.60 | 0.01 | 0.98 | |||
| 99.61 | 97.98 | 100 | 99.60 | 99.80 | 99.57 | 99.70 | 0.80 | 0.99 | ||||
| [ | India | 1160 | CNN-Sigmoid | 96.47 | 93.56 | 97.98 | 96.00 | 100 | 92.86 | 97.96 | 0.20 | 0.96 |
| CNN-SVM | 97.82 | 94.89 | 99.28 | 97.10 | 100 | 95.46 | 98.53 | 0.80 | 0.98 | |||
| CNN-Sigmoid + Sobel | 99.56 | 98.67 | 100 | 99.30 | 100 | 99.26 | 99.65 | 0.01 | 0.99 | |||
| 99.98 | 100 | 99.95 | 100 | 99.97 | 99.97 | 0.79 | 0.99 | |||||
| [ | Italy | 1550 | CNN-Sigmoid | 85.92 | 83.62 | 89.65 | 87.30 | 86.20 | 83.75 | 86.75 | 1.44 | 0.85 |
| CNN-SVM | 86.60 | 82.78 | 89.63 | 97.30 | 87.30 | 70.99 | 92.03 | 0.84 | 0.84 | |||
| CNN-Sigmoid + Sobel | 94.97 | 93.04 | 97.05 | 97.80 | 96.50 | 85.07 | 97.15 | 0.15 | 0.91 | |||
| 96.86 | 94.67 | 98.14 | 96.80 | 99.70 | 78.56 | 98.23 | 0.82 | 0.89 | ||||
| [ | India | 1120 | CNN-Sigmoid | 97.54 | 95.63 | 99.04 | 96.60 | 99.40 | 95.81 | 97.98 | 0.07 | 0.97 |
| CNN-SVM | 99.10 | 97.46 | 100 | 99.50 | 98.80 | 99.37 | 99.15 | 0.80 | 0.99 | |||
| CNN-Sigmoid + Sobel | 99.46 | 98.73 | 99.98 | 98.90 | 100 | 99.05 | 99.45 | 0.01 | 0.99 | |||
| 99.92 | 98.91 | 100 | 99.80 | 100 | 99.84 | 99.90 | 0.80 | 0.99 | ||||
| [ | Singapore | 460 | CNN-Sigmoid | 89.67 | 86.07 | 92.56 | 92.90 | 92.70 | 83.42 | 92.80 | 0.33 | 0.88 |
| CNN-SVM | 97.61 | 94.92 | 99.46 | 99.70 | 96.50 | 99.33 | 98.07 | 0.80 | 0.98 | |||
| CNN-Sigmoid + Sobel | 98.04 | 96.35 | 99.79 | 99.10 | 98.70 | 98 | 98.90 | 0.05 | 0.98 | |||
| 99.35 | 97.43 | 100 | 99.10 | 100 | 98 | 99.55 | 0.79 | 0.99 | ||||
| [ | Unknown | 1930 | CNN-Sigmoid | 97.50 | 95.68 | 99.63 | 98.10 | 99.00 | 73.32 | 98.55 | 0.10 | 0.86 |
| CNN-SVM | 97.30 | 94.57 | 98.79 | 97.90 | 99.30 | 66.69 | 98.60 | 0.82 | 0.83 | |||
| 98.18 | 95.76 | 98.67 | 97.90 | 100 | 71.64 | 98.94 | 0.15 | 0.86 | ||||
| CNN-SVM + Sobel | 98.07 | 96.38 | 99.46 | 97.90 | 99.90 | 71.64 | 98.89 | 0.81 | 0.86 | |||
Comparison of proposed CNN-SVM + Sobel method using private database with other methods in detecting COVID-19 using X-ray images from different private databases.
| Study | Number of Cases | Network | Train-Test | Evaluation Metrics |
|---|---|---|---|---|
| Hall et al. [ | 455 images | VGG-16 and ResNet-50 | 10-fold | AUC: 0.997 |
| Hemdan et al. [ | 50 images | DesnseNet, VGG16, MobileNet v2.0 etc. | 80–20% | F1 score: 91% |
| Abbas et al. [ | 196 images | CNN with transfer learning | 70–30% | Accuracy: 95.12% |
| Sensitivity: 97.91% | ||||
| Specificity: 91.87% | ||||
| PPV: 93.36% | ||||
| Zhang et al. [ | 213 images | ResNet, EfficientNet | 5-fold | Sensitivity: 71.70% |
| AUC: 0.8361 | ||||
| Narin et al. [ | 100 images | ResNet50 | 10-fold | Accuracy: 98% |
| Ozturk et al. [ | 625 images | Darknet-19 | 5-fold | Accuracy: 98.08% |
| Khan et al. [ | 1251 images | CNN | 4-fold | Accuracy: 89.6% |
| Sensitivity: 98.2% | ||||
| PPV: 93% | ||||
| Iwendi et al. [ | NA | Random Forest algorithm | NA | Accuracy: 94% |
| boosted by the AdaBoost algorithm | F1-score: 86% | |||
| Haghanifar et al. [ | 780 images | DenseNet-121 | 75–25% | Accuracy: 87.21% |
| U-Net | ||||
| Oh et al. [ | 502 images | DenseNet | 80–20% | Accuracy: 91.9% |
| U-Net | ||||
| Tartaglione et al. [ | 137 images | ResNet | 70–30% | Accuracy: 85% |
| Proposed Method | 1332 images | 10-fold | Accuracy: 99.02% | |
| Sensitivity: 100% | ||||
| Specificity: 95.23% | ||||
| AUC: 0.9770 |