| Literature DB >> 35378906 |
Seyed Mohammad Jafar Jalali1, Milad Ahmadian2, Sajad Ahmadian3, Rachid Hedjam4, Abbas Khosravi1, Saeid Nahavandi1.
Abstract
Radiological methodologies, such as chest x-rays and CT, are widely employed to help diagnose and monitor COVID-19 disease. COVID-19 displays certain radiological patterns easily detectable by X-rays of the chest. Therefore, radiologists can investigate these patterns for detecting coronavirus disease. However, this task is time-consuming and needs lots of trial and error. One of the main solutions to resolve this issue is to apply intelligent techniques such as deep learning (DL) models to automatically analyze the chest X-rays. Nevertheless, fine-tuning of architecture and hyperparameters of DL models is a complex and time-consuming procedure. In this paper, we propose an effective method to detect COVID-19 disease by applying convolutional neural network (CNN) to the chest X-ray images. To improve the accuracy of the proposed method, the last Softmax CNN layer is replaced with a K -nearest neighbors (KNN) classifier which takes into account the agreement of the neighborhood labeling. Moreover, we develop a novel evolutionary algorithm by improving the basic version of competitive swarm optimizer. To this end, three powerful evolutionary operators: Cauchy Mutation (CM), Evolutionary Boundary Constraint Handling (EBCH), and tent chaotic map are incorporated into the search process of the proposed evolutionary algorithm to speed up its convergence and make an excellent balance between exploration and exploitation phases. Then, the proposed evolutionary algorithm is used to automatically achieve the optimal values of CNN's hyperparameters leading to a significant improvement in the classification accuracy of the proposed method. Comprehensive comparative results reveal that compared with current models in the literature, the proposed method performs significantly more efficient.Entities:
Keywords: COVID-19; Convolutional neural network; Coronavirus; Deep neuroevolution learning; Image classification; K-nearest neighbor classifier
Year: 2022 PMID: 35378906 PMCID: PMC8966159 DOI: 10.1016/j.eswa.2022.116942
Source DB: PubMed Journal: Expert Syst Appl ISSN: 0957-4174 Impact factor: 8.665
Fig. 1Overall procedure of the proposed DNE framework.
Fig. 2The proposed MCSO evolutionary algorithm.
Fig. 3Samples from the X-ray image dataset.
Involved hyperparameters in the evolutionary algorithm and their corresponding values.
| Symbol | Description | Values |
|---|---|---|
| K | Kernel size | [1,25] |
| N | # Of filters | [1500] |
| Opt | Optimizer type | [Adagrad, Adam, SGD, Adamax] |
| N | # Of epochs | [1600] |
| B | Batch size | [10,20, ….,600] |
| N | # Convolution layers | [1,2, …,15] |
| MP | Maxpooling size | [1,25] |
| D | Dropout rate | [0.2, 0.25, …,0.65] |
| Act | Activation function | [Sigmoid, ReLU, Hard Sigmoid, Tanh] |
| L | Learning rate | [0.001, 0.006, …, 0.1] |
| M | Momentum rate | [0.05, 0.1, …,0.95] |
The results of experiments based on different evolutionary algorithms.
| Metric | GA | DE | PSO | MFO | WOA | SSA | HHO | GOA | CSO | MCSO (Proposed) | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| AVG | 0.948424 | 0.879656 | 0.936963 | 0.934118 | 0.896848 | 0.937718 | 0.959885 | 0.945559 | 0.897091 | ||
| STD | 0.027857 | 0.028322 | 0.030082 | 0.018272 | 0.016444 | 0.015544 | 0.026981 | 0.025433 | 0.022989 | ||
| Accuracy | Best | 0.963189 | 0.900377 | 0.951132 | 0.945489 | 0.919887 | 0.949899 | 0.967782 | 0.961089 | 0.910082 | |
| Worst | 0.901882 | 0.839555 | 0.885334 | 0.893778 | 0.867442 | 0.902313 | 0.912287 | 0.921055 | 0.869988 | ||
| AVG | 0.931034 | 0.931507 | 0.967949 | 0.939394 | 0.943184 | 0.910112 | 0.975309 | 0.951515 | 0.84375 | ||
| STD | 0.017291 | 0.016891 | 0.011838 | 0.013949 | 0.015623 | 0.012234 | 0.018996 | 0.026744 | 0.057239 | ||
| Precision | Best | 0.959888 | 0.953998 | 0.973553 | 0.945772 | 0.958669 | 0.922043 | 0.981544 | 0.968892 | 0.890665 | |
| Worst | 0.925343 | 0.936886 | 0.946767 | 0.910093 | 0.924883 | 0.887877 | 0.959882 | 0.927751 | 0.800487 | ||
| AVG | 0.964131 | 0.809524 | 0.898823 | 0.922619 | 0.839286 | 0.965233 | 0.940476 | 0.934524 | 0.968893 | ||
| STD | 0.042911 | 0.033578 | 0.063431 | 0.051967 | 0.049677 | 0.056444 | 0.019843 | 0.020729 | 0.019759 | ||
| Recall | Best | 0.986567 | 0.788992 | 0.945539 | 0.958882 | 0.886321 | 0.976621 | 0.948881 | 0.952881 | 0.978992 | |
| Worst | 0.910533 | 0.846653 | 0.812322 | 0.865531 | 0.786928 | 0.870032 | 0.925521 | 0.911899 | 0.947721 | ||
| AVG | 0.947368 | 0.866242 | 0.932099 | 0.930931 | 0.886792 | 0.936416 | 0.957576 | 0.942943 | 0.893378 | ||
| STD | 0.035201 | 0.031878 | 0.029889 | 0.022213 | 0.027344 | 0.020992 | 0.024434 | 0.027666 | 0.028891 | ||
| F-measure | Best | 0.969189 | 0.906675 | 0.957877 | 0.960219 | 0.907682 | 0.948977 | 0.970221 | 0.968891 | 0.919884 | |
| Worst | 0.903888 | 0.824844 | 0.896763 | 0.911661 | 0.865433 | 0.918896 | 0.933833 | 0.928823 | 0.869066 | ||
| AVG | 0.948994 | 0.877138 | 0.935593 | 0.933685 | 0.894781 | 0.937944 | 0.959188 | 0.945162 | 0.89927 | ||
| STD | 0.032367 | 0.026767 | 0.031198 | 0.019421 | 0.022322 | 0.017669 | 0.019006 | 0.021424 | 0.025589 | ||
| AUC | Best | 0.972081 | 0.903278 | 0.963122 | 0.945488 | 0.917066 | 0.945543 | 0.969928 | 0.965881 | 0.918553 | |
| Worst | 0.888977 | 0.837655 | 0.890789 | 0.910886 | 0.865518 | 0.913908 | 0.940133 | 0.919998 | 0.877001 | ||
Fig. 4Confusion matrices of different evolutionary algorithms.
Fig. 5Box plots of different evolutionary algorithms for accuracy metric as the fitness function.
Fig. 6Convergence curves of different evolutionary algorithms and the proposed MCSO algorithm.
The results of experiments based on different supervised learning classifiers.
| Metric | Decision Tree | Random Forest | LightGBM | AdaBoost | SoftMax | Bagging | KNN (Proposed) | |
|---|---|---|---|---|---|---|---|---|
| AVG | 0.914844 | 0.905444 | 0.899713 | 0.902579 | 0.914048 | 0.919771 | ||
| STD | 0.006131 | 0.006254 | 0.007677 | 0.007147 | 0.006222 | 0.010329 | ||
| Accuracy | Best | 0.919422 | 0.912554 | 0.905334 | 0.913183 | 0.920839 | 0.931064 | |
| Worst | 0.897532 | 0.890411 | 0.883633 | 0.897712 | 0.901899 | 0.911441 | ||
| AVG | 0.901163 | 0.929936 | 0.907975 | 0.852632 | 0.965577 | 0.897727 | ||
| STD | 0.012277 | 0.011899 | 0.014884 | 0.049899 | 0.037877 | 0.04402 | ||
| Precision | Best | 0.927478 | 0.939988 | 0.917888 | 0.913233 | 0.971322 | 0.956566 | |
| Worst | 0.903536 | 0.921443 | 0.898666 | 0.811171 | 0.908788 | 0.853887 | ||
| AVG | 0.922619 | 0.869048 | 0.880952 | 0.964008 | 0.857143 | 0.940476 | ||
| STD | 0.022968 | 0.024344 | 0.023534 | 0.045936 | 0.015366 | 0.019556 | ||
| Recall | Best | 0.944542 | 0.879231 | 0.911488 | 0.973134 | 0.918334 | 0.959189 | |
| Worst | 0.890181 | 0.831066 | 0.867578 | 0.938788 | 0.819878 | 0.920066 | ||
| AVG | 0.911765 | 0.898462 | 0.89426 | 0.905028 | 0.905668 | 0.918605 | ||
| STD | 0.006989 | 0.007461 | 0.008644 | 0.006079 | 0.006256 | 0.018847 | ||
| F-measure | Best | 0.933543 | 0.916466 | 0.909689 | 0.924157 | 0.921177 | 0.935525 | |
| Worst | 0.909978 | 0.896366 | 0.880343 | 0.900758 | 0.901333 | 0.917578 | ||
| AVG | 0.914348 | 0.904137 | 0.89904 | 0.904795 | 0.911997 | 0.920514 | ||
| STD | 0.005979 | 0.006365 | 0.006887 | 0.006989 | 0.006425 | 0.016383 | ||
| AUC | Best | 0.922432 | 0.916576 | 0.906966 | 0.912089 | 0.927816 | 0.935455 | |
| Worst | 0.903879 | 0.899932 | 0.883588 | 0.891777 | 0.903133 | 0.912189 | ||
Fig. 7Confusion matrices of different classifiers.
Fig. 8Box plots of different classification algorithms for accuracy metric as the fitness function.
Performance comparison of the proposed method with different state-of-the-art image classification approaches.
| Metric | DenseNet121 | MobileNet | InceptionV3 | XCeption | ResNet50 | VGGNet19 | DeCoVNet | Brunese et al. | MCSO-CNN | |
|---|---|---|---|---|---|---|---|---|---|---|
| AVG | 0.939828 | 0.937745 | 0.934097 | 0.977077 | 0.974212 | 0.902666 | 0.925501 | 0.942693 | ||
| STD | 0.002357 | 0.002155 | 0.011622 | 0.012113 | 0.034463 | 0.025306 | 0.016311 | 0.010329 | ||
| Accuracy | Best | 0.947612 | 0.942991 | 0.940911 | 0.982833 | 0.981202 | 0.948821 | 0.945599 | 0.957781 | |
| Worst | 0.929881 | 0.922881 | 0.916833 | 0.961198 | 0.957088 | 0.870924 | 0.899006 | 0.938876 | ||
| AVG | 0.924855 | 0.962025 | 0.950311 | 0.987805 | 0.970414 | 0.838384 | 0.961039 | 0.974359 | ||
| STD | 0.015516 | 0.011909 | 0.018922 | 0.014481 | 0.018899 | 0.066718 | 0.014456 | 0.013367 | ||
| Precision | Best | 0.950888 | 0.978811 | 0.972033 | 0.990629 | 0.978884 | 0.903318 | 0.969938 | 0.979665 | |
| Worst | 0.909442 | 0.937022 | 0.931992 | 0.970666 | 0.959993 | 0.782229 | 0.948994 | 0.968834 | ||
| AVG | 0.952381 | 0.904762 | 0.910714 | 0.964286 | 0.976193 | 0.980095 | 0.880952 | 0.906772 | ||
| STD | 0.011828 | 0.021185 | 0.026811 | 0.009999 | 0.009725 | 0.043198 | 0.039293 | 0.019556 | ||
| Recall | Best | 0.969022 | 0.933966 | 0.930019 | 0.973811 | 0.981194 | 0.992322 | 0.934823 | 0.928282 | |
| Worst | 0.916671 | 0.885917 | 0.876614 | 0.979948 | 0.971191 | 0.835558 | 0.869949 | 0.972774 | ||
| AVG | 0.938416 | 0.932515 | 0.930091 | 0.975904 | 0.973294 | 0.907104 | 0.919255 | 0.938272 | ||
| STD | 0.003891 | 0.004029 | 0.016669 | 0.012279 | 0.031835 | 0.027657 | 0.022004 | 0.018847 | ||
| F-measure | Best | 0.945589 | 0.947112 | 0.941992 | 0.981885 | 0.978888 | 0.945433 | 0.940278 | 0.949773 | |
| Worst | 0.931058 | 0.922516 | 0.921001 | 0.955322 | 0.955931 | 0.869028 | 0.882996 | 0.917005 | ||
| AVG | 0.940279 | 0.935806 | 0.933258 | 0.976618 | 0.974283 | 0.905644 | 0.923902 | 0.941331 | ||
| STD | 0.003322 | 0.003102 | 0.017744 | 0.022882 | 0.032918 | 0.025946 | 0.021966 | 0.016383 | ||
| AUC | Best | 0.949881 | 0.942554 | 0.941921 | 0.986464 | 0.979669 | 0.938883 | 0.944888 | 0.958892 | |
| Worst | 0.934155 | 0.929973 | 0.926767 | 0.955032 | 0.933992 | 0.869399 | 0.908873 | 0.922883 | ||
Fig. 9Confusion matrices of different state-of-the-art deep learning architectures.
Fig. 10Box plots of different state-of-the-art deep learning architectures for accuracy metric as the fitness function.
Fig. 11Violin plots of the evolved hyperparameters utilized in the MCSO-CNN model.
The average results of the Friedman ranking test for the proposed and other benchmark models based on different classification performance metrics.
| Model | DenseNet121 | MobileNet | InceptionV3 | XCeption | ResNet50 | VGGNet19 | DeCoVNet | Brunese et al. | GA | DE | PSO | MFO | WOA | SSA | HHO | GOA | CSO | Decision Tree | Random Forest | LightGBM | AdaBoost | SoftMax | Bagging | MCSO-CNN |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ACC | 8 | 9 | 13 | 2 | 3 | 19 | 14 | 7 | 5 | 24 | 11 | 12 | 23 | 10 | 4 | 6 | 22 | 16 | 18 | 21 | 20 | 17 | 15 | |
| Precision | 17 | 8 | 11 | 2 | 5 | 24 | 9 | 4 | 15 | 14 | 6 | 13 | 12 | 18 | 3 | 10 | 23 | 20 | 16 | 19 | 22 | 7 | 21 | |
| Recall | 9 | 17 | 15 | 6 | 3 | 2 | 19 | 16 | 7 | 24 | 18 | 13 | 23 | 5 | 10 | 12 | 4 | 13 | 21 | 19 | 8 | 22 | 10 | |
| F-measure | 7 | 10 | 13 | 2 | 3 | 17 | 14 | 8 | 5 | 24 | 11 | 12 | 23 | 9 | 4 | 6 | 22 | 16 | 20 | 21 | 19 | 18 | 15 | |
| AUC | 8 | 10 | 13 | 2 | 3 | 18 | 14 | 7 | 5 | 24 | 11 | 12 | 23 | 9 | 4 | 6 | 21 | 16 | 20 | 22 | 19 | 17 | 15 | |
| Summation | 49 | 54 | 65 | 14 | 17 | 80 | 70 | 42 | 37 | 110 | 57 | 62 | 104 | 51 | 25 | 40 | 92 | 81 | 95 | 102 | 88 | 81 | 76 | 5 |
| Average | 9.8 | 10.8 | 13 | 2.8 | 3.4 | 16 | 14 | 8.4 | 7.4 | 22 | 11.4 | 12.4 | 20.8 | 10.2 | 5 | 8 | 18.4 | 16.2 | 19 | 20.4 | 17.6 | 16.2 | 15.2 | 1 |
| Final Ranking | 8 | 10 | 13 | 2 | 3 | 16 | 14 | 7 | 5 | 24 | 11 | 12 | 23 | 9 | 4 | 6 | 20 | 17 | 21 | 22 | 19 | 17 | 15 | |
Run-time (in second) of the proposed model and other competitive algorithms for the COVID-19 dataset.
| Model | Optimization time | Training time | Test time |
|---|---|---|---|
| DenseNet121 | – | 1863 | 357 |
| MobileNet | – | 1812 | 353 |
| InceptionV3 | – | 1875 | 416 |
| XCeption | – | 1794 | 331 |
| ResNet50 | – | 1783 | 345 |
| VGGNet19 | – | 1631 | 337 |
| DeCoVNet | – | 1611 | 321 |
| Brunese et al. | – | 1523 | 311 |
| GA | 3830 | 1278 | 293 |
| DE | 3810 | 1263 | 296 |
| PSO | 3794 | 1231 | 287 |
| MFO | 3840 | 1539 | 304 |
| WOA | 3820 | 1381 | 298 |
| SSA | 3780 | 1216 | 286 |
| HHO | 3835 | 1372 | 291 |
| GOA | 3793 | 1201 | 271 |
| CSO | 3789 | 1123 | 263 |
| Decision Tree | 3642 | 1217 | 269 |
| Random Forest | 3621 | 1108 | 234 |
| LightGBM | 3597 | 1116 | 212 |
| AdaBoost | 3607 | 1173 | 225 |
| SoftMax | 3543 | 989 | 183 |
| Bagging | 3589 | 1009 | 195 |
| MCSO-CNN | |||