| Literature DB >> 35965746 |
Abbas Saffari1, Mohammad Khishe1, Mokhtar Mohammadi2, Adil Hussein Mohammed3, Shima Rashidi4.
Abstract
Artificial intelligence (AI) techniques have been considered effective technologies in diagnosing and breaking the transmission chain of COVID-19 disease. Recent research uses the deep convolution neural network (DCNN) as the discoverer or classifier of COVID-19 X-ray images. The most challenging part of neural networks is the subject of their training. Descent-based (GDB) algorithms have long been used to train fullymconnected layer (FCL) at DCNN. Despite the ability of GDBs to run and converge quickly in some applications, their disadvantage is the manual adjustment of many parameters. Therefore, it is not easy to parallelize them with graphics processing units (GPUs). Therefore, in this paper, the whale optimization algorithm (WOA) evolved by a fuzzy system called FuzzyWOA is proposed for DCNN training. With accurate and appropriate tuning of WOA's control parameters, the fuzzy system defines the boundary between the exploration and extraction phases in the search space. It causes the development and upgrade of WOA. To evaluate the performance and capability of the proposed DCNN-FuzzyWOA model, a publicly available database called COVID-Xray-5k is used. DCNN-PSO, DCNN-GA, and LeNet-5 benchmark models are used for fair comparisons. Comparative parameters include accuracy, processing time, standard deviation (STD), curves of ROC and precision-recall, and F1-Score. The results showed that the FuzzyWOA training algorithm with 20 epochs was able to achieve 100% accuracy, at a processing time of 880.44 s with an F1-Score equal to 100%. Structurally, the i-6c-2s-12c-2s model achieved better results than the i-8c-2s-16c-2s model. However, the results of using FuzzyWOA for both models have been very encouraging compared to particle swarm optimization, genetic algorithm, and LeNet-5 methods.Entities:
Mesh:
Year: 2022 PMID: 35965746 PMCID: PMC9363937 DOI: 10.1155/2022/5677961
Source DB: PubMed Journal: Comput Intell Neurosci
Applied fuzzy rules.
| If (NFV is low) and ( |
| If (NFV is low) and ( |
| If (NFV is low) and ( |
| If (NFV is medium) and ( |
| If (NFV is medium) and ( |
| If (NFV is medium) and ( |
| If (NFV is high) and ( |
| If (NFV is high) and ( |
| If (NFV is high) and ( |
| If (NFV is low) and ( |
| If (NFV is low) and ( |
| If (NFV is low) and ( |
| If (NFV is medium) and ( |
| If (NFV is medium) and ( |
| If (NFV is medium) and ( |
| If (NFV is high) and ( |
| If (NFV is high) and ( |
| If (NFV is high) and ( |
Figure 1A proposed fuzzy model for setting parameters and .
Figure 2The LeNet-5 DCNN's architecture.
The COVID data set's image categories [33].
| Category | COVID-19 | Normal |
|---|---|---|
| Training set | 84 (420 after augmentation) | 2000 |
| Test set | 100 | 3000 |
Figure 3Images random from the COVID-X-ray-5k data set [33].
Figure 4ROC curves for DCNN-FuzzyWOA and LeNet-5.
Figure 5Curves of ROC and precision-recall for the i-6c-2s-12c-2s models.
Figure 6Curves of ROC and precision-recall for the i-8c-2s-16c-2s models.
Accuracy and STD for the i-2s-6c-2s-12c structure.
| Epoch | DCNN-FuzzyWOA | DCNN-PSO | DCNN-GA | LeNet-5 | ||||
|---|---|---|---|---|---|---|---|---|
| Accuracy | STD | Accuracy | STD | Accuracy | STD | Accuracy | STD | |
| 1 | 91.44 | N/A | 89.71 | 0.48 | 81.08 | 0.11 | 77.24 | 0.71 |
| 2 | 91.94 | N/A | 90.08 | 0.22 | 82.05 | 0.24 | 78.41 | 0.23 |
| 3 | 92.09 | N/A | 90.89 | 0.45 | 83.40 | 0.13 | 78.99 | 0.41 |
| 4 | 92.73 | N/A | 91.53 | 0.43 | 85.66 | 0.12 | 79.66 | 0.95 |
| 5 | 93.51 | N/A | 92.66 | 0.34 | 86.91 | 0.35 | 80.11 | 0.19 |
| 6 | 93.84 | N/A | 92.99 | 0.38 | 87.25 | 0.16 | 81.25 | 0.33 |
| 7 | 94.11 | N/A | 93.35 | 0.37 | 88.82 | 0.24 | 82.32 | 0.71 |
| 8 | 94.62 | N/A | 93.83 | 0.24 | 89.33 | 0.18 | 83.41 | 0.91 |
| 9 | 94.77 | N/A | 94.16 | 0.33 | 90.14 | 0.16 | 84.53 | 0.15 |
| 10 | 95.14 | N/A | 94.51 | 0.32 | 90.57 | 0.42 | 85.82 | 0.36 |
| 11 | 95.87 | N/A | 94.93 | 0.31 | 91.27 | 0.16 | 86.28 | 0.37 |
| 12 | 96.29 | N/A | 95.10 | 0.30 | 91.89 | 0.30 | 87.23 | 0.26 |
| 13 | 96.71 | N/A | 95.65 | 0.29 | 92.51 | 0.21 | 89.51 | 0.83 |
| 14 | 96.64 | N/A | 96.27 | 0.44 | 93.34 | 0.39 | 90.19 | 0.31 |
| 15 | 97.88 | N/A | 96.69 | 0.23 | 93.97 | 0.17 | 91.50 | 0.66 |
| 16 | 98.07 | N/A | 97.04 | 0.22 | 94.43 | 0.41 | 92.08 | 0.47 |
| 17 | 98.60 | N/A | 97.80 | 0.19 | 94.82 | 0.26 | 93.61 | 0.62 |
| 18 | 99.13 | N/A | 98.13 | 0.67 | 95.60 | 0.18 | 94.33 | 0.59 |
| 19 | 99.72 | N/A | 98.61 | 0.12 | 96.52 | 0.33 | 94.91 | 0.51 |
| 20 | 100 | N/A | 98.76 | 0.09 | 96.71 | 0.10 | 95.14 | 0.13 |
Time required to compute and standard deviation for the i-2s-6c-2s-12c structure.
| Epoch | DCNN-FuzzyWOA | DCNN-PSO | DCNN-GA | LeNet-5 | ||||
|---|---|---|---|---|---|---|---|---|
| Time | STD | Time | STD | Time | STD | Time | STD | |
| 1 | 85.91 | N/A | 108.55 | 1.04 | 115.01 | 0.78 | 127.08 | 0.81 |
| 2 | 115.87 | N/A | 199.43 | 1.02 | 161.76 | 1.71 | 195.20 | 1.07 |
| 3 | 184.65 | N/A | 283.71 | 2.08 | 221.95 | 2.41 | 238.85 | 2.58 |
| 4 | 222.41 | N/A | 305.86 | 1.07 | 260.74 | 1.09 | 299.50 | 1.17 |
| 5 | 291.33 | N/A | 390.29 | 1.23 | 317.55 | 4.99 | 310.17 | 4.37 |
| 6 | 301.96 | N/A | 448.91 | 2.11 | 361.34 | 3.14 | 422.39 | 1.08 |
| 7 | 345.17 | N/A | 519.57 | 1.56 | 433.98 | 2.08 | 531.81 | 2.09 |
| 8 | 379.86 | N/A | 589.39 | 1.84 | 549.27 | 1.19 | 579.27 | 4.01 |
| 9 | 405.16 | N/A | 618.28 | 2.42 | 625.10 | 1.78 | 536.90 | 1.28 |
| 10 | 476.22 | N/A | 697.68 | 3.86 | 677.31 | 2.77 | 640.33 | 4.65 |
| 11 | 495.57 | N/A | 737.70 | 3.07 | 731.79 | 1.18 | 678.88 | 2.65 |
| 12 | 511.79 | N/A | 793.32 | 1.73 | 792.03 | 3.34 | 723.74 | 1.59 |
| 13 | 577.73 | N/A | 836.15 | 1.66 | 841.50 | 4.28 | 791.83 | 2.66 |
| 14 | 601.63 | N/A | 889.04 | 2.37 | 881.53 | 3.11 | 845.70 | 2.13 |
| 15 | 647.85 | N/A | 923.17 | 2.09 | 903.72 | 1.56 | 936.62 | 1.83 |
| 16 | 690.33 | N/A | 978.64 | 1.88 | 930.18 | 4.66 | 1005.78 | 3.11 |
| 17 | 728.36 | N/A | 1001.79 | 3.77 | 982.04 | 1.23 | 1075.29 | 2.64 |
| 18 | 774.14 | N/A | 1060.8 | 1.91 | 1030.77 | 1.11 | 1103.21 | 2.23 |
| 19 | 834.71 | N/A | 1101.08 | 2.14 | 1161.20 | 3.28 | 1152.56 | 3.01 |
| 20 | 880.44 | N/A | 1186.61 | 1.89 | 1240.11 | 4.79 | 1256.07 | 1.74 |
Accuracy and STD for the i-2s-8c-2s-16c structure.
| Epoch | DCNN-FuzzyWOA | DCNN-PSO | DCNN-GA | LeNet-5 | ||||
|---|---|---|---|---|---|---|---|---|
| Accuracy | STD | Accuracy | STD | Accuracy | STD | Accuracy | STD | |
| 1 | 90.23 | N/A | 87.09 | 0.20 | 80.38 | 0.19 | 76.33 | 1.05 |
| 2 | 90.89 | N/A | 88.40 | 0.19 | 80.79 | 0.17 | 77.00 | 0.89 |
| 3 | 91.63 | N/A | 88.87 | 0.11 | 81.15 | 0.26 | 78.09 | 2.32 |
| 4 | 91.81 | N/A | 90.25 | 0.14 | 81.68 | 0.31 | 79.34 | 3.76 |
| 5 | 92.33 | N/A | 90.66 | 0.27 | 82.34 | 0.19 | 80.55 | 1.90 |
| 6 | 93.26 | N/A | 91.23 | 0.23 | 83.71 | 0.14 | 81.21 | 4.58 |
| 7 | 93.19 | N/A | 92.00 | 0.30 | 84.53 | 0.21 | 82.38 | 3.72 |
| 8 | 93.99 | N/A | 92.19 | 0.18 | 85.61 | 0.16 | 82.79 | 1.18 |
| 9 | 94.20 | N/A | 92.85 | 0.19 | 86.67 | 0.28 | 83.48 | 0.52 |
| 10 | 94.18 | N/A | 93.34 | 0.36 | 87.41 | 0.15 | 84.31 | 2.63 |
| 11 | 95.51 | N/A | 93.28 | 0.15 | 88.52 | 0.22 | 85.63 | 2.88 |
| 12 | 95.79 | N/A | 94.47 | 0.09 | 89.05 | 0.16 | 86.84 | 5.23 |
| 13 | 96.37 | N/A | 95.69 | 0.11 | 89.98 | 0.14 | 87.37 | 4.19 |
| 14 | 97.31 | N/A | 95.91 | 0.22 | 90.37 | 0.32 | 89.06 | 3.55 |
| 15 | 97.72 | N/A | 96.38 | 0.06 | 91.25 | 0.28 | 90.71 | 5.10 |
| 16 | 97.92 | N/A | 96.74 | 0.33 | 92.40 | 0.13 | 91.76 | 1.74 |
| 17 | 98.30 | N/A | 97.29 | 0.31 | 93.71 | 0.19 | 92.25 | 3.19 |
| 18 | 98.65 | N/A | 97.84 | 0.08 | 94.64 | 0.25 | 93.16 | 1.53 |
| 19 | 99.08 | N/A | 98.07 | 0.28 | 95.18 | 0.18 | 94.72 | 0.68 |
| 20 | 99.55 | N/A | 98.63 | 0.12 | 96.31 | 0.12 | 95.08 | 4.80 |
Time required to compute and standard deviation for the the i-2s-8c-2s-16c structure.
| Epoch | DCNN-FuzzyWOA | DCNN-PSO | DCNN-GA | LeNet-5 | ||||
|---|---|---|---|---|---|---|---|---|
| Time | STD | Time | STD | Time | STD | Time | STD | |
| 1 | 83.35 | N/A | 110.21 | 1.04 | 117.43 | 1.53 | 154.51 | 3.74 |
| 2 | 118.24 | N/A | 200.17 | 1.02 | 158.53 | 1.64 | 202.19 | 2.83 |
| 3 | 165.75 | N/A | 275.68 | 2.08 | 215.37 | 2.57 | 244.28 | 1.97 |
| 4 | 218.60 | N/A | 311.72 | 1.07 | 262.71 | 1.67 | 315.37 | 2.55 |
| 5 | 293.19 | N/A | 364.33 | 1.23 | 321.14 | 0.91 | 376.63 | 3.77 |
| 6 | 321.71 | N/A | 446.17 | 2.11 | 365.31 | 3.16 | 418.18 | 1.84 |
| 7 | 353.63 | N/A | 528.91 | 1.56 | 442.28 | 2.27 | 546.92 | 3.74 |
| 8 | 384.28 | N/A | 593.53 | 1.84 | 550.28 | 2.16 | 573.11 | 4.58 |
| 9 | 410.46 | N/A | 625.34 | 2.42 | 628.31 | 1.13 | 535.63 | 2.63 |
| 10 | 496.39 | N/A | 670.81 | 3.86 | 680.32 | 4.28 | 632.27 | 0.63 |
| 11 | 508.77 | N/A | 741.73 | 3.07 | 734.62 | 5.33 | 689.81 | 3.27 |
| 12 | 542.91 | N/A | 799.84 | 1.73 | 783.49 | 2.59 | 722.35 | 3.36 |
| 13 | 596.72 | N/A | 842.59 | 1.69 | 853.78 | 1.49 | 793.44 | 1.25 |
| 14 | 663.85 | N/A | 891.70 | 2.37 | 892.75 | 2.27 | 835.23 | 2.80 |
| 15 | 689.51 | N/A | 928.91 | 2.08 | 913.36 | 1.56 | 947.95 | 2.33 |
| 16 | 734.38 | N/A | 974.32 | 1.87 | 936.77 | 2.23 | 1025.52 | 4.20 |
| 17 | 770.41 | N/A | 1011.30 | 3.76 | 980.19 | 1.44 | 1098.37 | 0.76 |
| 18 | 829.13 | N/A | 1063.85 | 1.95 | 1032.83 | 1.78 | 1110.50 | 1.58 |
| 19 | 857.67 | N/A | 1127.63 | 2.32 | 1163.27 | 2.56 | 1153.48 | 0.99 |
| 20 | 945.61 | N/A | 1201.21 | 1.89 | 1262.46 | 5.11 | 1398.13 | 1.81 |
Comparison of F1-Score in structures i-2s-6c-2s-12c and i-2s-8c-2s-16c.
| Structure | i-2s-6c-2s-12c | i-2s-8c-2s-16c | ||||||
|---|---|---|---|---|---|---|---|---|
| F1−score % | F1−score % | |||||||
| Epoch | DCNN-FuzzyWOA | DCNN-PSO | DCNN-GA | LeNet-5 | DCNN-FuzzyWOA | DCNN-PSO | DCNN-GA | LeNet-5 |
| 1 | 89.10 | 89.71 | 73.21 | 70.06 | 89.89 | 80.51 | 77.84 | 0.10 |
| 2 | 89.13 | 87.86 | 73.87 | 78.41 | 90.25 | 81.19 | 78.45 | 0.42 |
| 3 | 89.89 | 89.04 | 75.62 | 73.24 | 90.63 | 82.27 | 79.86 | 1.53 |
| 4 | 90.78 | 90.18 | 75.75 | 74.93 | 91.03 | 83.97 | 81.68 | 2.46 |
| 5 | 91.20 | 92.14 | 77.19 | 75.08 | 91.19 | 84.23 | 83.54 | 1.90 |
| 6 | 91.22 | 92.31 | 77.73 | 75.62 | 91.43 | 84.35 | 84.94 | 2.68 |
| 7 | 91.49 | 92.45 | 78.62 | 76.80 | 93.19 | 92.00 | 85.53 | 1.52 |
| 8 | 91.98 | 92.45 | 79.79 | 76.71 | 92.44 | 86.54 | 86.54 | 1.18 |
| 9 | 93.44 | 92.83 | 80.81 | 79.82 | 94.08 | 86.11 | 87.68 | 0.52 |
| 10 | 93.47 | 93.10 | 82.11 | 80.74 | 94.02 | 88.37 | 87.41 | 1.27 |
| 11 | 94.19 | 93.13 | 85.51 | 80.97 | 94.51 | 88.62 | 88.52 | 1.36 |
| 12 | 94.28 | 93.27 | 91.89 | 83.44 | 95.79 | 89.49 | 89.18 | 1.89 |
| 13 | 95.31 | 93.76 | 88.48 | 87.32 | 96.37 | 90.13 | 89.57 | 2.25 |
| 14 | 95.77 | 95.00 | 93.35 | 88.18 | 97.31 | 91.91 | 89.96 | 1.46 |
| 15 | 97.01 | 95.13 | 89.22 | 89.04 | 95.11 | 92.81 | 90.14 | 3.91 |
| 16 | 97.47 | 95.50 | 90.67 | 89.49 | 95.34 | 92.65 | 90.72 | 1.23 |
| 17 | 97.90 | 95.89 | 91.34 | 89.78 | 95.89 | 94.29 | 93.71 | 2.85 |
| 18 | 98.53 | 96.31 | 91.52 | 90.08 | 96.51 | 95.81 | 94.64 | 0.79 |
| 19 | 98.99 | 96.66 | 96.25 | 91.37 | 97.00 | 96.07 | 94.89 | 0.91 |
| 20 | 100 | 96.97 | 93.15 | 91.45 | 97.31 | 96.73 | 94.32 | 2.89 |