Literature DB >> 33846685

Fusion of convolution neural network, support vector machine and Sobel filter for accurate detection of COVID-19 patients using X-ray images.

Danial Sharifrazi1, Roohallah Alizadehsani2, Mohamad Roshanzamir3, Javad Hassannataj Joloudari4, Afshin Shoeibi5,6, Mahboobeh Jafari7, Sadiq Hussain8, Zahra Alizadeh Sani9,10, Fereshteh Hasanzadeh10, Fahime Khozeimeh2, Abbas Khosravi2, Saeid Nahavandi2, Maryam Panahiazar11, Assef Zare12, Sheikh Mohammed Shariful Islam13,14,15, U Rajendra Acharya16,17,18.   

Abstract

The coronavirus (COVID-19) is currently the most common contagious disease which is prevalent all over the world. The main challenge of this disease is the primary diagnosis to prevent secondary infections and its spread from one person to another. Therefore, it is essential to use an automatic diagnosis system along with clinical procedures for the rapid diagnosis of COVID-19 to prevent its spread. Artificial intelligence techniques using computed tomography (CT) images of the lungs and chest radiography have the potential to obtain high diagnostic performance for Covid-19 diagnosis. In this study, a fusion of convolutional neural network (CNN), support vector machine (SVM), and Sobel filter is proposed to detect COVID-19 using X-ray images. A new X-ray image dataset was collected and subjected to high pass filter using a Sobel filter to obtain the edges of the images. Then these images are fed to CNN deep learning model followed by SVM classifier with ten-fold cross validation strategy. This method is designed so that it can learn with not many data. Our results show that the proposed CNN-SVM with Sobel filter (CNN-SVM + Sobel) achieved the highest classification accuracy, sensitivity and specificity of 99.02%, 100% and 95.23%, respectively in automated detection of COVID-19. It showed that using Sobel filter can improve the performance of CNN. Unlike most of the other researches, this method does not use a pre-trained network. We have also validated our developed model using six public databases and obtained the highest performance. Hence, our developed model is ready for clinical application.
© 2021 Elsevier Ltd. All rights reserved.

Entities:  

Keywords:  CNN.; Covid-19; Data Mining; Deep Learning; Feature Extraction; Image Processing; Machine Learning; SVM; Sobel operator

Year:  2021        PMID: 33846685      PMCID: PMC8026268          DOI: 10.1016/j.bspc.2021.102622

Source DB:  PubMed          Journal:  Biomed Signal Process Control        ISSN: 1746-8094            Impact factor:   3.880


Introduction

Coronavirus disease 2019 (COVID-19) has been spreading unprecedentedly across the globe from the beginning of 2020. The clinical characteristics of COVID-19 include respiratory symptoms, fever, cough, dyspnea, pneumonia, and fatigue during early stages [[1], [2], [3]]. The COVID-19 also affects the cardiovascular and respiratory systems and may lead to multiple organ failure or acute respiratory distress in critical cases and is highly contagious [[3], [4], [5], [6], [7]]. Therefore, COVID-19 infections are a crucial healthcare challenge around the world and has become a global threat [8]. The World Health Organization (WHO) declared the outbreak a “public health emergency of international concern” on 30th January 2020. Reverse-transcription polymerase chain reaction (RT-PCR) is generally used to confirm the incidence of COVID-19 [9]. Contrary to RT-PCR, chest X-ray is found to be low cost, fast, and widely available for the early diagnosis and screening of COVID-19 [10]. It is economical and can be made available in most of the clinical settings, even in third world countries. This non-invasive imaging modality can help to detect specific characteristic manifestations in the lung related to the COVID-19 [11]. Indeed, it is especially useful (and viable) for symptomatic patients. One of the bottlenecks of the system is that expert radiologists are required to interpret the radiography images. As such, computer-aided diagnostic systems (CAD) can help the radiologists to detect COVID-19 cases accurately and rapidly. There are few deep learning (DL)-based techniques proposed for such automated detection using X-ray radiographs [[11], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21]]. These techniques have exhibited great success by extracting relevant hidden signatures (features) from the medical images using deep learning [22]. The main contributions of this work are listed as follows: New private database collected by the authors is used. Proposed model is tested using six public databases and the results are found to be better than most of the existing state of the art methods. Sobel filter is found to improve the performance of CNN. Obtained highest classification performance for all databases. Nowadays, machine learning (ML) methods are widely used for Covid-19. These methods can improve the diagnosis accuracy of clinicians. However, there are few limitations in these methods. For example, feature extraction is a challenging step in almost all ML methods. So, automatic feature extraction is a great improvement in this field. Among the different ML methods, deep learning (DL) can solve this challenge. It can do feature extraction automatically. In addition, when there are large amount of data, its performance is better than other ML methods. Consequently, nowadays DL is used to diagnose different diseases [[23], [24], [25], [26], [27], [28], [29]] such as COVID-19 [21,30]. An overview of the works done on automated detection of COVID-19 using DL is presented in Table 1 . In this table, the recently published DL works on COVID-19 detection using X-ray and CT scan images are listed. However, almost all of them used pre-trained networks using public databases.
Table 1

Summary of works done on automated detection of COVID-19 using DL techniques with X-ray and CT images.

StudyModalityNumber of Cases (or Images)Network
Wang et al. [31]X-ray13,975 imagesDeep CNN
Hall et al. [11]X-ray455 imagesVGG-16 and ResNet-50
Farooq et al. [12]X-ray5941 imagesResNet-50
Hemdan et al. [14]X-ray50 imagesDesnseNet, VGG16, MobileNet v2.0 etc.
Abbas et al. [15]X-ray196 imagesCNN with transfer learning
Minaee et al. [16]X-ray5000 imagesDenseNet-121, SqueezeNet, ResNet50, ResNet18
Zhang et al. [17]X-ray213 imagesResNet, EfficientNet
Apostolopoulos et al. [19]X-ray3905 imagesMobileNet v2.0
Narin et al. [20]X-ray100 imagesInceptionResNetV2, InceptionV3, ResNet50
Luz et al. [32]X-ray13, 800 imagesEfficientNet
Brunese et al. [33]X-ray6523 imagesVGG-16 and transfer learning
Ozturk et al. [34]X-rayTwo publically available databases were used where images were updated regularly.Darknet-19
Khan et al. [35]X-ray1251 imagesCNN
Silva et al. [36]CT scans2482 imagesA slice voting-based approach extending the Efficient Net Family of deep artificial neural networks
Luz et al. [32]X-ray13, 800 imagesEfficient Net
Ozturk et al. [34]X-rayTwo publically available databases were used where images were updated regularly.Darknet-19
Khan et al. [35]X-ray1251 imagesCNN
Haghanifar et al. [37]X-ray7700 imagesDenseNet-121
U-Net
Oh et al. [38]X-ray502 imagesDenseNet
U-Net
Tartaglione et al. [39]X-ray5 different databasesResNet
Rahimzadeh et al. [40]X-ray11,302 imagesXception and ResNet50V2
Jamil et al. [41]X-ray14,150 imagesDeep CNN
Horry et al. [42]X-ray60,798 imagesVGG, Inception, Xception, and Resnet
Elasnaoui et al. [43]X-ray6087 imagesinception_Resnet_V2 and Densnet201
And CT
Ardakani et al. [44]CT1020ResNet-101, ResNet-50, ResNet-18, GoogleNet, SqueezeNet, VGG-19, AlexNet
Summary of works done on automated detection of COVID-19 using DL techniques with X-ray and CT images. This paper is organized as follows. The computer aided diagnosis (CAD) based on the proposed deep learning to detect COVID-19 is described in Section 2. The results obtained is presented and discussed in Section 3. Finally, the paper concludes with brief summary in Section 4.

CADS based COVID-19 diagnosis using 2D-CNN

Nowadays, many CAD systems have been developed using deep learning techniques to detect various diseases, including COVID-19, have attracted the attention of many researchers. The CAD based deep learning methods require huge database to yield highest performance.

X-ray database

In this study, 333 chest X-ray images comprising of 77 images of COVID-19 patients and 256 images of normal subjects were recorded at Omid Hospital in Tehran. They are collected from February 2020 to April 2020. The mean and standard deviation of their age are 49.5 ± 18.5 years old. 55% of cases are female. Three radiologists checked each image and determined whether a case has Covid-19 or not. Ethical approval of these data was also obtained. Some examples of these data can be seen in Fig. 1 . They show the typical X-ray images of normal and COVID-19 patients.
Fig. 1

Sample X-ray images: a) healthy subjects and b) COVID-19 patients. The marked region indicates the infected parts.

Sample X-ray images: a) healthy subjects and b) COVID-19 patients. The marked region indicates the infected parts.

Proposed method

This paper proposes a novel 2D-CNN architecture to detect COVID-19 using X-ray images. The 2D-CNN with a number of convolutional layers, max-pooling, and fully connected (FC) layers are used. In our methodology, support vector machine (SVM) is used instead of the sigmoid activation function in fully connected layers to obtain highest classification performance. The proposed CAD system is shown in Fig. 2 .
Fig. 2

Proposed methodology used for the automated detection of COVID-19 patients using X-ray images.

Proposed methodology used for the automated detection of COVID-19 patients using X-ray images. As shown in Fig. 2, X-ray images are fed to our CAD system. The data augmentation technique is adopted to prevent the overfitting and increase the input data size. Each of the existing images in the dataset undergoes augmentation to obtain multiple new ones. The number of generated images differs depending on the class of the original image. Width and height shift, changing brightness and rotation were used with parameter {0.10, 0.15}. These eight transformation methods were used to generate eight new examples for each image in positive class. Two or three of the eight possible transformations are used randomly to generate new examples for each image in negative class. As the number of positive and negative examples was not the same, we applied data augmentation more on positive cases to reduce the bias in the performance. At the end of this step, about 45% of cases were positive and about 55% were negative. In the next step, we performed edge detection on the images to improve the deep networks classification performance. Sobel and Canny are among popular edge detection methods [45]. The computational complexity of Canny is higher compared to Sobel [46]. In our experiments, Sobel was able to provide us with acceptable results. Therefore, we chose Sobel over Canny to reduce computational complexity without sacrificing performance. Sobel employs two separate filters to extract vertical and horizontal edges. Using just one of the vertical or horizontal filters leads to much noise on the results. Therefore, we employed both of them simultaneously to avoid such an issue. An example of applying Sobel filter on the images is shown in Fig. 3 . The noise enhancement of Sobel is controlled by setting its filter size appropriately. The effect of different filter sizes is demonstrated in Fig. 4 . It is evident that the appropriate size is 3 (Fig. 4.a) which has reasonable noise level and extracts useful edge information. The filter sizes of 5 (Fig. 4.b) and 7 (Fig. 4.c) have flooded the image with noisy pixels which impair CNN training.
Fig. 3

Sample images: (a) original (b) after applying Sobel filter.

Fig. 4

Results of applying various filter sizes of: (a) 3, (b) 5 and (c) 7.

Sample images: (a) original (b) after applying Sobel filter. Results of applying various filter sizes of: (a) 3, (b) 5 and (c) 7. Using images with original dimensions (512 512) increases the training complexity of the 2D-CNN network without noticeable performance gain. Moreover, data normalization almost always leads to better training results. Therefore, as a pre-processing step, the images are resized to 100 100 and normalized to the interval [0,1]. The preprocessed images are fed to the convolutional layers of the 2D-CNN network to extract the features. Then, the classification operation is accomplished by FC layers using two methods: (i) sigmoid and (ii) SVM separately. The generated results are compared to select the best performing method. The motivation of employing SVM in the last layer of the 2D-CNN is improvement of classification performance. SVM is a robust binary classifier which draws a decision boundary between samples of the two classes such that the gap between them is maximized.

CNN architecture

Nowadays, 2D-CNN networks are employed in many medical applications, including the diagnosis of COVID-19 using X-ray images [47]. These deep learning networks consists of three main layers, convolutional layers, pooling, and fully connected (FC) layers [25]. The convolutional layers are responsible for extracting features from images. Max-pooling layers are often applied to reduce the features in CNN architectures. The last part of 2D-CNN is FC, and in the previous layer, there is an activation function that is responsible for classification. Usually, the Softmax function is employed. The Sigmoid activation function has been proved to perform efficiently in binary classification problems in this deep learning architecture. In 2D-CNNs, replacing Sigmoid with support vector machine (SVM) may lead to better results. Such achievement using SVM has been reported in some of the prior works such as [48]. In this work, at first, the number of data is increased using data augmentation algorithm. Data augmentation is done by using width shift range, height shift range, and rotation techniques. Using this method, the data is increased from 333 to 1332 images. Then, a 2D-CNN with sigmoid activation function is used to classify X-ray images. In addition, binary SVM is also used in the 2D-CNN network for classification. The hinge error function is used to obtain best results when using SVM in 2D-CNN. More details about the proposed 2D-CNN architecture is shown in Table 2 and Fig. 5 .
Table 2

Details of parameters used in the proposed CNN architecture.

Number of Kernels related to first and second connectionSize of the convolution kernelsSize of the max pooling kernelsNumber of neurons in the Fully Connected layerNumber of neurons in the output layerSize of the Dropout layerNumber of batch sizeNumber of epochsValue of validation dataOptimizer functionActivator functionLoss function for CNN + SigmoidLoss function for CNN + SVMSVM function kernelOutput layer classifiers
128 and 2563*32*264, 32 and 162(health and sick)0.2321000.3 and 0.2AdamReLUbinary cross entropyHingeLinearSigmoid and SVM
Fig. 5

Proposed CNN architecture for the automated detection of COVID-19 patients using X-ray images.

Details of parameters used in the proposed CNN architecture. Proposed CNN architecture for the automated detection of COVID-19 patients using X-ray images. As CNN operates as a black box, its training steps are not clear. So, when using this algorithm, one of the important challenges is checking the correct training process. To verify that the CNN training is sound, the outputs of its layers have been inspected. In each generated image, the x axis shows the input data and y axis shows the output of a layer. The output obtained at the different layers of CNN are shown in Fig. 6 . The size of input data in first and second layer (convolutional layers) is equal to the number of filters in that layer. The size of input to the third layer onwards (fully-connected layers) is equal to the number of neurons in the layer. In these images, the brighter regions indicate more weight and more features can be extracted from them.
Fig. 6

Output obtained at different layers of CNN.

Output obtained at different layers of CNN.

Performance measures

In this study, to evaluate the performance of proposed methods, various evaluation metrics have been used and they are given below: In these equations, true positive (TP) is the correct classification of positive class. False-negative (FN) is the incorrect prediction of the positive case. True negative (TN) is the correct classification of the samples in the negative class. False-positive (FP) is the incorrect prediction of the negative case. In this work, positive class is symptom of COVID-19 and normal class is negative class.

Results and discussion

In this section, the results of our proposed CNN-SVM and CNN-Sigmoid methods and its combination with Sobel filter are provided. All simulations are done using Keras library have been conducted with back-end TensorFlow. The COVID-19 X-ray images database is obtained from Omid Hospital, Tehran, Iran. In this work, total number of 1332 (total images number is 333, which is increased to 1332 after the data augmentation operation) images are used. The results are obtained in two modes: (i) CNN network with sigmoid output layer and (ii) CNN network with SVM output layer with 10-fold cross-validation strategy. In order to validate the proposed method, we have tested with another public database named as augmented COVID-19 X-ray images database [49]. The experiment results are presented in Figs. 7 to 14.
Fig. 7

Performance metrics of CNN-sigmoid method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.

Fig. 14

Performance metrics of CNN-SVM method with Sobel operator using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.

Performance metrics of CNN-sigmoid method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy. Performance metrics of CNN-SVM method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy. Performance metrics of CNN-sigmoid with Sobel operator method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy. Performance metrics of CNN-SVM with Sobel operator method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy. Performance metrics of CNN-sigmoid method using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy. Performance metrics of CNN-SVM method using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy. Performance metrics of CNN-sigmoid method with Sobel operator using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy. Performance metrics of CNN-SVM method with Sobel operator using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy. Fig. 7 illustrates the results obtained using private database with CNN-sigmoid method with 10-fold cross-validation. Figs. 8 to 10, shows the private database results obtained by applying CNN-SVM, CNN-sigmoid with Sobel operator, and CNN-SVM with Sobel operator, respectively with 10-fold cross-validation.
Fig. 8

Performance metrics of CNN-SVM method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.

Fig. 10

Performance metrics of CNN-SVM with Sobel operator method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.

Figs. 11 to 14, show the results obtained by applying CNN-Sigmoid, CNN-SVM, CNN-sigmoid with Sobel, and CNN-SVM with Sobel operator respectively with 10-fold cross-validation strategy using augmented COVID-19 X-ray images database.
Fig. 11

Performance metrics of CNN-sigmoid method using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.

As can be seen in Figs. 7 to 14, during the learning, the loss of the algorithms is decreased and their accuracy is increased. These figures make it possible to observe the effect of using Sobel and data augmentation with CNN-Sigmoid and CNN-SVM algorithms. Fig. 7, Fig. 8 belong to CNN-Sigmoid and CNN-SVM methods, respectively. The performance of these methods accompanied with Sobel operator is illustrated in Fig. 9, Fig. 10. Careful comparison of Figs. 7 with 9 and 8 with 10 reveals that Sobel has accelerated the convergence of both methods.
Fig. 9

Performance metrics of CNN-sigmoid with Sobel operator method using private database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.

As a further enhancement, the data augmentation was added to the four experiments mentioned above. Fig. 11, Fig. 12, Fig. 13, Fig. 14 are related to scenarios CNN-Sigmoid + data-augmentation, CNN-SVM + data-augmentation, CNN-Sigmoid + Sobel + data-augmentation, and CCN-SVM + Sobel + data-augmentation. Comparing Figs. 7 with 11, 8 with 12, 9 with 13 and 10 with 14 shows that data augmentation leads to performance improvement just like Sobel.
Fig. 12

Performance metrics of CNN-SVM method using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.

Fig. 13

Performance metrics of CNN-sigmoid method with Sobel operator using augmented COVID-19 X-ray images database: (a) loss function curve, and b) accuracy curve with 10-fold cross-validation strategy.

Table 3, Table 4 depict the results obtained using various combination of networks with private database and augmented COVID-19 X-ray images database, respectively. Table 3 clearly shows the effect of using sigmoid or SVM classifiers and Sobel Filter when we used in our proposed method with our database.
Table 3

Various performance measures obtained using different combination of methods.

MethodsAccuracy (%)
PPV (%)Recall (%)Specificity (%)F1-score (%)LossAUC
AVGMinMax
CNN-Sigmoid92.941889.325695.126798.0092.9991.1395.420.23270.9203
CNN-SVM98.272996.256499.022497.8010093.1698.890.80880.9658
CNN-Sigmoid + Sobel96.543593.165798.965297.5098.3090.4297.900.13680.9438
CNN-SVM + Sobel99.024897.952110098.7010095.2399.350.80310.9770
Table 4

Evaluation performance measures obtained by applying different algorithms and combination of our methods using augmented COVID-19 X-ray images database.

MethodsAccuracy (%)PPV (%)Recall (%)Specificity (%)F1-score (%)LossAUC
Alqudah et al. (a) [50]99.46NA99.4699.73NANANA
Alqudah et al. (b) [51]95.210093.3100NANANA
Haque et al. [52]99.00NANANANANANA
CNN-Sigmoid91.388393.4094.0089.9693.690.68940.9192
CNN-SVM98.247798.0098.8097.8698.390.80440.9828
CNN-Sigmoid + Sobel98.463698.8098.4098.6898.600.01000.9848
CNN-SVM + Sobel99.615699.6099.8099.5699.700.80470.9968
Various performance measures obtained using different combination of methods. Evaluation performance measures obtained by applying different algorithms and combination of our methods using augmented COVID-19 X-ray images database. It can be noted from Table 3 that, SVM classifier experiences loss values higher than Sigmoid classifier. At first glance this observation might suggest that Sigmoid classifier is superior to SVM. However, SVM has clearly outperformed Sigmoid classifier. This counterintuitive scenario is due to the difference between loss function of SVM and Sigmoid classifier. Comparing the first with third row and second with forth row show that Sobel filter can be used to improve the performance of classification. Table 4 shows the evaluation performance measures obtained by applying different algorithms and combination of our methods using augmented COVID-19 X-ray images database. It can be noted from Table 4 that Sobel operator improved the performance of CNN-Sigmoid and CNN-SVM approaches in detecting COVID-19 significantly. For better comparison between the achieved results in Table 3, Table 4, the results are also illustrated in Fig. 15, Fig. 16 . They show the impact of using Sobel filtering in our algorithms. As SVM is a more robust classifier, when it is used in our algorithms, the performance has improved.
Fig. 15

Performance obtained using different methods with our private database for COVID-19 diagnosis.

Fig. 16

Performance obtained using different methods with augmented COVID-19 X-ray images database for COVID-19 diagnosis.

Performance obtained using different methods with our private database for COVID-19 diagnosis. Performance obtained using different methods with augmented COVID-19 X-ray images database for COVID-19 diagnosis. Our proposed method is also tested with six public databases to evaluate the performance of our developed model. The public database can be accessed from this link: https://www.kaggle.com [[53], [54], [55], [56], [57], [58]]. The details of the database and results obtained using our database are provided in Table 5 . It can be noted from this table that using the Sobel filter can improve the performance of our algorithm. In all tests, using Sobel filter has a positive impact on the results. Also, CNN-SVM + Sobel performed better than others combinations. For all databases, CNN-Sigmoid + Sobel performed better than the rest of the combinations.
Table 5

Evaluation metrics obtained for our proposed method using different public databases.

Accuracy (%)
Other Performance Measurement Factors
DatabaseCollected fromNumber of casesMethodAVGMinMaxPPV (%)Recall (%)Specificity (%)F1-score (%)LossAUC
[53]Bangladesh1820CNN-Sigmoid91.3990.0292.5693.4094.0089.9393.700.690.92
CNN-SVM98.2596.3599.0698.0098.8097.8798.400.800.98
CNN-Sigmoid + Sobel98.4696.2599.6398.8098.4098.6898.600.010.98
CNN-SVM + Sobel99.6197.9810099.6099.8099.5799.700.800.99
[54]India1160CNN-Sigmoid96.4793.5697.9896.0010092.8697.960.200.96
CNN-SVM97.8294.8999.2897.1010095.4698.530.800.98
CNN-Sigmoid + Sobel99.5698.6710099.3010099.2699.650.010.99
CNN-SVM + Sobel99.9897.5910099.9510099.9799.970.790.99
[55]Italy1550CNN-Sigmoid85.9283.6289.6587.3086.2083.7586.751.440.85
CNN-SVM86.6082.7889.6397.3087.3070.9992.030.840.84
CNN-Sigmoid + Sobel94.9793.0497.0597.8096.5085.0797.150.150.91
CNN-SVM + Sobel96.8694.6798.1496.8099.7078.5698.230.820.89
[56]India1120CNN-Sigmoid97.5495.6399.0496.6099.4095.8197.980.070.97
CNN-SVM99.1097.4610099.5098.8099.3799.150.800.99
CNN-Sigmoid + Sobel99.4698.7399.9898.9010099.0599.450.010.99
CNN-SVM + Sobel99.9298.9110099.8010099.8499.900.800.99
[57]Singapore460CNN-Sigmoid89.6786.0792.5692.9092.7083.4292.800.330.88
CNN-SVM97.6194.9299.4699.7096.5099.3398.070.800.98
CNN-Sigmoid + Sobel98.0496.3599.7999.1098.709898.900.050.98
CNN-SVM + Sobel99.3597.4310099.101009899.550.790.99
[58]Unknown1930CNN-Sigmoid97.5095.6899.6398.1099.0073.3298.550.100.86
CNN-SVM97.3094.5798.7997.9099.3066.6998.600.820.83
CNN-Sigmoid + Sobel98.1895.7698.6797.9010071.6498.940.150.86
CNN-SVM + Sobel98.0796.3899.4697.9099.9071.6498.890.810.86
Evaluation metrics obtained for our proposed method using different public databases. Meanwhile, in Table 6 , the results of the proposed method applied on our database are compared with other researches who used different databases. Accordingly, the performance of our proposed method is better than other researches.
Table 6

Comparison of proposed CNN-SVM + Sobel method using private database with other methods in detecting COVID-19 using X-ray images from different private databases.

StudyNumber of CasesNetworkTrain-TestEvaluation Metrics
Hall et al. [11]455 imagesVGG-16 and ResNet-5010-foldAUC: 0.997
Hemdan et al. [14]50 imagesDesnseNet, VGG16, MobileNet v2.0 etc.80–20%F1 score: 91%
Abbas et al. [15]196 imagesCNN with transfer learning70–30%Accuracy: 95.12%
Sensitivity: 97.91%
Specificity: 91.87%
PPV: 93.36%
Zhang et al. [17]213 imagesResNet, EfficientNet5-foldSensitivity: 71.70%
AUC: 0.8361
Narin et al. [20]100 imagesResNet5010-foldAccuracy: 98%
Ozturk et al. [34]625 imagesDarknet-195-foldAccuracy: 98.08%
Khan et al. [35]1251 imagesCNN4-foldAccuracy: 89.6%
Sensitivity: 98.2%
PPV: 93%
Iwendi et al. [59]NARandom Forest algorithmNAAccuracy: 94%
boosted by the AdaBoost algorithmF1-score: 86%
Haghanifar et al. [37]780 imagesDenseNet-12175–25%Accuracy: 87.21%
U-Net
Oh et al. [38]502 imagesDenseNet80–20%Accuracy: 91.9%
U-Net
Tartaglione et al. [39]137 imagesResNet70–30%Accuracy: 85%
Proposed Method1332 imagesCNN-SVM + Sobel10-foldAccuracy: 99.02%
Sensitivity: 100%
Specificity: 95.23%
AUC: 0.9770
Comparison of proposed CNN-SVM + Sobel method using private database with other methods in detecting COVID-19 using X-ray images from different private databases. Fig. 15 shows the performance obtained using different proposed methods with our private database for automated detection of COVID-19 patients using X-ray images. Fig. 16 shows the performance obtained using various proposed methods with augmented COVID-19 X-ray images database for COVID-19 diagnosis. Fig. 15, Fig. 16 clearly show that our proposed CNN-SVM + Sobel model has performed better than rest of the methods on our database and augmented COVID-19 X-ray images database respectively. Our proposed method has performed better even using six public databases. Advantages of our proposed method are as follows: We collected a new database to validate our developed model. Our proposed method is also tested on six public databases and showed excellent performance. Data augmentation is used to enable it works with small databases. Sobel filter is used to improve the performance of our method Limitations of our proposed method are as follows: Computational cost of different deep learning algorithm is high. Limitation of input data is another weakness of our algorithm.

Conclusion

COVID-19 is currently one of the most life-threatening diseases endangering the health of many people globally. One of the main features of this disease is its rapid prevalence among people in the community. In this work, we have developed a novel COVID-19 detection system using X-ray images. In this work, we have used 333 X-ray images (77 COVID-19 + 256 normal) from Omid Hospital, Tehran to develop the model. First the images are subjected to Sobel filter to obtain the contours of the images and then fed to CNN model followed by SVM classifier. Our method is able to detect the COVID-19 cases correctly with an accuracy of 99.02%. The developed model has also yielded highest detection accuracy using six public databases. Hence, this justifies that our developed model is robust and accurate. For better evaluation of our proposed method, the final model (the best model created during 10-fold validation) was tested on some new data which their labels were determined by two experts. It could classify these new data precisely. In future, we intend to use this model to detect other chest related diseases like cancer, pneumonia, cystic fibrosis, infection, and chronic obstructive pulmonary disease (COPD).

CRediT authorship contribution statement

Danial Sharifrazi: Conceptualization, Methodology, Software, Validation, Investigation, Data curation, Visualization. Roohallah Alizadehsani: Conceptualization, Methodology, Investigation, Writing - original draft, Writing - review & editing, Visualization. Mohamad Roshanzamir: Conceptualization, Methodology, Writing - review & editing. Javad Hassannataj Joloudari: Conceptualization, Methodology, Writing - review & editing. Afshin Shoeibi: Conceptualization, Methodology, Investigation, Resources, Writing - review & editing. Mahboobeh Jafari: Conceptualization, Methodology, Writing - review & editing. Sadiq Hussain: Conceptualization, Methodology, Writing - review & editing. Zahra Alizadeh Sani: Writing - original draft, Writing - review & editing, Supervision. Fereshteh Hasanzadeh: Investigation, Data curation, Writing - original draft. Fahime Khozeimeh: Writing - original draft, Writing - review & editing, Investigation. Abbas Khosravi: Writing - original draft, Writing - review & editing, Supervision. Saeid Nahavandi: Writing - original draft, Writing - review & editing, Project administration, Funding acquisition. Maryam Panahiazar: Writing - original draft, Writing - review & editing. Assef Zare: Writing - original draft, Writing - review & editing. Sheikh Mohammed Shariful Islam: Writing - original draft, Writing - review & editing, Project administration. U. Rajendra Acharya: Writing - original draft, Writing - review & editing, Project administration.

Declaration of Competing Interest

The authors have no competing interests to declare.
  25 in total

1.  Multi-domain integrative Swin transformer network for sparse-view tomographic reconstruction.

Authors:  Jiayi Pan; Heye Zhang; Weifei Wu; Zhifan Gao; Weiwen Wu
Journal:  Patterns (N Y)       Date:  2022-04-22

2.  COVID-19 chest X-ray detection through blending ensemble of CNN snapshots.

Authors:  Avinandan Banerjee; Arya Sarkar; Sayantan Roy; Pawan Kumar Singh; Ram Sarkar
Journal:  Biomed Signal Process Control       Date:  2022-07-15       Impact factor: 5.076

Review 3.  Review of COVID-19 testing and diagnostic methods.

Authors:  Olena Filchakova; Dina Dossym; Aisha Ilyas; Tamila Kuanysheva; Altynay Abdizhamil; Rostislav Bukasov
Journal:  Talanta       Date:  2022-03-31       Impact factor: 6.556

4.  Deep neural networks for COVID-19 detection and diagnosis using images and acoustic-based techniques: a recent review.

Authors:  Walid Hariri; Ali Narin
Journal:  Soft comput       Date:  2021-08-24       Impact factor: 3.732

Review 5.  Automated COVID-19 diagnosis and prognosis with medical imaging and who is publishing: a systematic review.

Authors:  Ashley G Gillman; Febrio Lunardo; Joseph Prinable; Gregg Belous; Aaron Nicolson; Hang Min; Andrew Terhorst; Jason A Dowling
Journal:  Phys Eng Sci Med       Date:  2021-12-17

6.  A deep and handcrafted features-based framework for diagnosis of COVID-19 from chest x-ray images.

Authors:  Ferhat Bozkurt
Journal:  Concurr Comput       Date:  2021-11-19       Impact factor: 1.831

7.  Time series forecasting of new cases and new deaths rate for COVID-19 using deep learning methods.

Authors:  Nooshin Ayoobi; Danial Sharifrazi; Roohallah Alizadehsani; Afshin Shoeibi; Juan M Gorriz; Hossein Moosaei; Abbas Khosravi; Saeid Nahavandi; Abdoulmohammad Gholamzadeh Chofreh; Feybi Ariani Goni; Jiří Jaromír Klemeš; Amir Mosavi
Journal:  Results Phys       Date:  2021-06-26       Impact factor: 4.476

8.  Combining a convolutional neural network with autoencoders to predict the survival chance of COVID-19 patients.

Authors:  Fahime Khozeimeh; Danial Sharifrazi; Navid Hoseini Izadi; Javad Hassannataj Joloudari; Afshin Shoeibi; Roohallah Alizadehsani; Juan M Gorriz; Sadiq Hussain; Zahra Alizadeh Sani; Hossein Moosaei; Abbas Khosravi; Saeid Nahavandi; Sheikh Mohammed Shariful Islam
Journal:  Sci Rep       Date:  2021-07-28       Impact factor: 4.379

Review 9.  Artificial Intelligence for Forecasting the Prevalence of COVID-19 Pandemic: An Overview.

Authors:  Ammar H Elsheikh; Amal I Saba; Hitesh Panchal; Sengottaiyan Shanmugan; Naser A Alsaleh; Mahmoud Ahmadein
Journal:  Healthcare (Basel)       Date:  2021-11-23

10.  Application of CycleGAN and transfer learning techniques for automated detection of COVID-19 using X-ray images.

Authors:  Ghazal Bargshady; Xujuan Zhou; Prabal Datta Barua; Raj Gururajan; Yuefeng Li; U Rajendra Acharya
Journal:  Pattern Recognit Lett       Date:  2021-12-03       Impact factor: 3.756

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.