Literature DB >> 34393647

Enhanced bat algorithm for COVID-19 short-term forecasting using optimized LSTM.

Hafiz Tayyab Rauf1, Jiechao Gao2, Ahmad Almadhor3, Muhammad Arif4, Md Tabrez Nafis5.   

Abstract

The highly infectious COVID-19 critically affected the world that has stuck millions of citizens in their homes to avoid possible spreading of the disease. Researchers in different fields are continually working to develop vaccines and prevention strategies. However, an accurate forecast of the outbreak can help control the pandemic until a vaccine is available. Several machine learning and deep learning-based approaches are available to forecast the confirmed cases, but they lack the optimized temporal component and nonlinearity. To enhance the current forecasting frameworks' capability, we proposed optimized long short-term memory networks (LSTM) to forecast COVID-19 cases and reduce mean absolute error. For the optimization of LSTM, we applied bat algorithm. Furthermore, to tackle the premature convergence and local minima problem of BA, we proposed an enhanced variant of BA. The proposed version utilized Gaussian adaptive inertia weight to control the individual velocity in the entire swarm. In addition, we substitute random walk with the Gaussian walk to observe the local search mechanism. The proposed LSTM examines the personal best solution with the swarm's local best and preserves the optimal solution by combining the Gaussian walk. To evaluate the optimized LSTM, we compared it with the non-optimal version of LSTM, recurrent neural network, gated recurrent units, and other recent state-of-the-art algorithms. The experimental results prove the superiority of the optimized LSTM over other recent algorithms by obtaining 99.52 % accuracy.
© The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2021.

Entities:  

Keywords:  COVID-19; Gaussian distribution; Gaussian inertia weight; LSTM

Year:  2021        PMID: 34393647      PMCID: PMC8356221          DOI: 10.1007/s00500-021-06075-8

Source DB:  PubMed          Journal:  Soft comput        ISSN: 1432-7643            Impact factor:   3.643


Introduction

The entire world is experiencing a continuous pandemic called the coronavirus (COVID-19) disease due to severe acute respiratory syndrome coronavirus two (SARS-CoV-2) (Abrams et al. 2020). It has been arisen from Wuhan, the capital of Hubei Province in China, through December 2019 (WH Organization et al. 2020). The virus has been discovered on 7th January and found that it is distributed by human-to-human transmission through direct contact or droplet (Wang et al. 2020; Cucinotta and Vanelli 2020). Covid-19 was estimated to be an average incubation period of 6.4 times and a first reproduction number of 2.24–3.58. It has been spread over the entire world, and so the World Health Organization (WHO) had announced COVID-19, a worldwide outbreak on 11th March 2020 (Huang et al. 2020). COVID-19 contains a few taxonomy symbols as it belongs to the coronavirus family. All such viruses hold several essential proteins fastened in the viral membrane. As it is well worth discovering, the viral plot displays a large diameter, nearly double of a standard organic layer (Bárcena et al. 2009). The genome of SARS-CoV-2 includes six notable open-reading structures (ORFs), usually investigated in several CoVs. A number of the genes received less than 80 % nucleotide chain identification to SARS-CoV (Zhou et al. 2020). With ultraviolet warmth and rays, COVID-19 is fragile. There is a common misconception that at 27 C, this virus might have disappeared. Additionally, Covid-19 may be inactivated by chloroform, peroxyacetic acid, chlorine-containing disinfectant, ether (75 percent), except for chlorhexidine (Cascella et al. 2020). In 1995, a large-scale study proved that primary clinical symptoms are dyspnea (21.9 percent of cases), expectoration (28.2 percent of cases), fatigue or myalgia (35.8 % of cases), cough (68.6 % of cases), and ever (88.5 percent of cases). In contrast, the minor ones contain vomiting and nausea (3.9 % of cases), nausea (4.8 % of cases), headache, or nausea (12.1 % of cases) (Lq et al. 2020). The frequency of novel coronavirus, like many pathogens, is thought to transpire by respiratory droplets. Thus, the immense bulk of scattering cases is restricted to the adjacent spaces (Cascella et al. 2020). The SARS-CoV-2 is a pathogenic human coronavirus below the beta coronavirus genus. In the last decade, the two pathogenic species MERS-CoV and SARS-CoV were outbreaks in 2012 and 2002 in the Middle East and China, respectively (Lu et al. 2020; Cui et al. 2019). The laboratory of China put at the NCBI GenBank by discovering the whole genomic sequence (Wuhan-HU1) of the massive RNA virus (SARS-CoV-2) on 10th January (Yang 2020). The SARS-CoV-2 is one positive-stranded RNA virus (Lu et al. 2020). Following the WHO, no anti-inflammatory medicines and vaccines are not yet prepared for this pandemic (Basu and Chakraborty 2020), and medical industries are looking hard to acquire the vaccine. The vaccine may take at least 18–24 months until it is available, following the quick tracking of the normal vaccine interval of 5–10 decades, and may take additional time to make it appropriate for the large organizations of the world (Grenfell and Drew 2020). Additionally, we do not understand just how long a vaccine could remain successful since the virus mutates. Every attempt was adopted to slow down the coronavirus spread and prepare reasonable medical systems to protect front-line medical staff with sufficient supplies of protective equipment such as personal protective equipment (PPE) masks and other essentials. Consequently, if we know ahead of the number of new coronavirus cases for the next ten days, we could plan our necessary actions. As compared to Asian countries, the USA has been greatly affected by COVID-19. USA COVID-19 cases summary from Feb 2020 to Sep 2020 is illustrated in Fig. 1.
Fig. 1

USA COVID-19 cases summary from Feb 2020 to Sep 2020

USA COVID-19 cases summary from Feb 2020 to Sep 2020 The success of healthcare technologies is a key to artificial intelligence (Panch et al. 2019). Data is structured in smart devices and increases the efficiency of healthcare machine learning (Knight et al. 2016). Several COVID-19 forecasting approaches have been proposed based on machine learning, deep learning, and statistical learning in the past few weeks. However, the primary issue is they lack the temporal components and nonlinearity in terms of machine learning where deep learning approaches are limited to comparative analysis, and uni-model forecasting (Benvenuto et al. 2020; Wieczorek et al. 2020a). Furthermore, some studies considered epidemiological models that need to make hypothesis-based parameter initialization. That model tends to low the net precision due to its under-fitting data nature (Wieczorek et al. 2020a; Gao et al. 2019). Several optimization algorithms have been used in previous studies to solve time series problems for the weight optimization of neural networks, such as the arithmetic optimization algorithm (Abualigah et al. 2021), group search optimizer (Abualigah 2020), dragonfly algorithm (Alshinwan et al. 2021), genetic algorithm (Momani et al. 2016), reproducing kernel algorithm (Arqub et al. 2017; Arqub 2017) and fuzzy conformable fractional approaches (Arqub and Al-Smadi 2020). To predict the distribution of COVID-19 in various regions, the authors used Google trend and ECDC data term frequency (Prasanth et al. 2021). To pick the successful COVID-related search words, they used Spearman correlation. The optimization of hyperparameters through the LSTM network proposed a new technique based on a meta-heuristic GWO algorithm. Three approaches are suggested (Abbasimehr and Paki 2021) that combine Bayesian optimization and deep learning. The optimized values for hyperparameters are effectively chosen by Bayesian optimization in their process. The system architecture is considered to be a process of multiple-output forecasting. Their proposed methods performed better than the reference model on data from the COVID-19 time series. In order to forecast the COVID-19 outbreak in Saudi Arabia, a study of various deep learning models is proposed (Elsheikh et al. 2021). Officially recorded data was used to evaluate the model. The optimal values of the parameters of the model that optimize the accuracy of forecasting have been determined. They used seven statistical evaluation parameters to forecast the accuracy of the model. Likewise, the previous studies on COVID-19 did not consider the hyperparameter optimization of neural networks that can help boost the performance of models. To overcome the issue as mentioned above, we proposed a deep learning model that predicts real-time transmission using optimized LSTM. For the optimization of LSTM, we employed BA. To further deals with the premature convergence (Perwaiz et al. 2020; Rauf et al. 2020b), and local minima problem (Rauf et al. 2020a) of BA, we proposed an enhanced variant of BA. The proposed version consists of two significant enhancements. Firstly, we carried out Gaussian adaptive inertia weight to control the individual velocity in the entire swarm. Secondly, we substitute the random walk with the Gaussian walk to explore the local search mechanism. Recent related works with their dataset details and results

Methodology

Proposed BA

The real-world challenges are becoming more complicated every day. Swarm intelligence (SI) is the subset of meta-heuristic algorithms employed to tackle complex optimization problems of continuous nature. We used the self-learning nature of this meta-heuristic to optimize the neural network training parameters. Such features clearly state that local interaction is essential between the swarm-based system components to preserve their survival. In this research, we have carried out an enhanced version of BA to optimize LSTM training weights. The optimized LSTM dynamically adopt optimal training parameter and decide the execution cycle timeline based on the global convergence manner of enhanced BA. We bring two modifications to classical BA. Firstly, we proposed Gaussian adaptive inertia weight to improve the velocity updating mechanism. Lastly, we update each individual’s local searching strategy to retain local solutions based on the weighted mean of their personal best and the current global solution of the entire swarm. Properties of standard BA are as follows:BA follows three fundamental rules to converge toward an optimal solution.Population of fixed size , in our case , is initialized with the random initial values following the uniform distribution , where l and u are lower and upper limits of uniformly distributed sequence. After population initialization, the mutation operators are used to encourage the bats’ movement in the multidimensional search space. The ultimate objective of this phase is to obtain the new local solution, while the frequency factor controls the step-size of the solution. For each individual , the current frequency , current velocity and the current bats potion can be updated using the following equations.Referred to equation 1, are the difference of lower and upper corresponding frequency where R indicates the random number over the interval of [0, 1]. Velocity of each individual can be updated using equation 2, where is the mean difference of local solution of entire swarm and global solution of all swarms. Likewise, the new vector solution can be determine using equation 3. Every micro-bat estimates distance within surroundings and prey by utilizing its property of echolocation. Frequency of fixed range is utilized to find micro-bat’s velocity from location beside different loudness and distinct wavelength while searching for prey. Emission pulse rate increases to adjust its pulse frequency while estimating distance among prey and micro-bat. Loudness will decrease from a considerable positive value to a smaller value. Each bat is represented by for with the whole population in an entire search space S and use sonar echolocation to sense the prey and measure the estimated difference of the distance to the prey. During the convergence process, each bat moves with velocity and the frequency of . The current position of individual can be represented by where p represents the partial coordinate of the current search space. The frequency consolidates with bat wavelength and variation of loudness . The variation of loudness depends on the current location and the weighted distance . In the proposed BA, we introduced Gaussian adaptive inertia weight to update the velocity in such a manner to avoid more long jumps leading to exploration and to avoid more short jumps leading to exploitation. The proposed Gaussian adaptive inertia weight can help the velocity updating mechanism achieve each individual’s optimal convergence steps. The Gaussian function can be defined as:where (x, y, z) are real constant that can be varied over the nature of the problem. A bell shape curve in the Gaussian distribution indicates the height of bell curves and can help the population control the exploration process with the following probability density function. In equation 5, and can be interpreted as the expected value with variance . In order to generate optimal location vectors through Gaussian distribution over t iterations and D dimensions, the mathematical definition following the adaptive process can be:where are upper and lower intervals [0, 1] of Gaussian distribution. The proposed BA utilized the following equation to update the velocity of each bat .In equation 7, shows the proposed Gaussian adaptive inertia weight factor, controlling the exploration and exploitation during the entire convergence process. Gaussian bell curves in the adaptive inertia weight dynamically select each bat’s speed to help the local best vector holder bat to escape local minima. Apart from velocity , updated local solutions play an essential role in the exploitation of bats. Consider the speed is regulated, but the newly generated local solutions are not robust enough to limit the boundary of the entire swarm’s global best . In that case, premature convergence can be held. Standard BA uses the following equation to select the best solution among all existing vectors in the swarm: is a random walk generator throughout and represents the average loudness factor. The random walk can produce the best solution in the current iteration t and build the worst one in the next iteration . The entire local best holder individual will likely follow the best solution , which is the worst in the next iteration and leads to the local minima and premature convergence problem. To avoid this random selection that leads to the worst local best solution and effect exploitation, we replace this random walk with a Gaussian walk and propose a local search mechanism. Our proposed variant of BA will use the following equation to attain the local best solution .In the proposed equation 9, is previously computed Gaussian distribution where is the mean difference of local best of swarm and the personal best of each bat. The proposed solution will iteratively evaluate the current best and the local best solution for each swarm in the population and check the following condition to use the iterative difference.Referred to equation 10, the new local best will be selected if the bats’ personal best is less than the swarm local best otherwise, the weighted mean of local best and global best will be chosen as new local best. New N local bests will likely control by the convergence rate, which can be defined by two critical factors loudness and pulse emission rate which can be update thought the following two equations.

Optimized Long Short-Term Memory (LSTM)

Recurrent neural network (RNN) has turned out to be the most reliable algorithm for prediction as essential features are extracted automatically from samples of training (Jiang and Schotten 2020). RNN performed well at data processing, and ensured encouraging outcomes for time series prediction while keeping immense information in the internal state (Connor et al. 1994). Nevertheless, it might take much training time due to gradient detonate and evanescence problems (Tomar and Gupta 2020). Hence, in 1997 a long short-term memory RNN structure was designed by Schmidhuber and Hochreiter (Hochreiter and Schmidhuber 1997) to overcome that flaw by administering long-term dependency through multiplicative gates that will handle memory cells and flow of information in the recurrent hidden layer. LSTM’s architecture comprises four gates, i.e., input gate, output gate, control gate, and forget gate (Tomar and Gupta 2020). Input can be defined as:The information extracted from the above equation can be transferred to the cell. Forget gate decides data that will be ignored from the previous layer’s input by utilizing the following equation:The input from the entire memory cell is controlled by control gate through following equations:Output and hidden layer is updated as following:The interval [-1 to 1] is normalized by using tanh, where W os the weight matrices and shows activation function taken as sigmoid. We feed the learning rate, momentum rate, and dropout rate in each of the LSTM dropout layers to the BA for automatic optimization of the hyperparameters. Each parameter is examined before the classification layer of LSTM to determine BA’s best optimal global solution. If the fitness function produces the same values, the proposed algorithm will check in the next generation to see if it avoids premature convergence. Hyperparameters of each hidden layer for are optimized by providing global solution obtained using equation 9. The output layer of optimized LSTM can be interpreted as:where each hidden layer choose global best of the entire population or mean of personal best and local best of swarm . The pseudocode of proposed Algorithm is presented in Algorithm 1. We also checked single parameter optimization impact on the proposed technique, and we observed that only learning rate optimization produces a negligible impact on the performance of the proposed LSTM. However, the collective optimization of the learning rate, momentum rate, and dropout rate tends to increase the overall performance of the proposed LSTM. Proposed architecture of optimized LSTM

Experiments

WHO accounted for the outbreak of COVID-19 in states and regions around the world. Several areas of South and North America, in particular, witness the adverse effects of a massive COVID-19 explosion. The operation of huge air traffic between each state of the USA has entirely encouraged COVID-19 to propagate from its source to the next infected states; individual-to-individual spread has thus been reported among travelers worldwide. The primary goal of this research is the prediction and forecast of epidemic spreading by COVID-19. This examination contains the count of confirmed and recovered cases obtained from the WHO website regularly. We consider the USA for the experiments and employed live dataset updated daily. The utilized dataset is available at (WHO 2020). The experiments are conducted using specific python packages, namely Keras, TensorFlow, NumPy, and iplot using python language. To compare the performance of the proposed optimized LSTM, we tested other standard forecasting algorithms, i.e., Simple LSTM, GRU, and RNN.

Results

This study provides an optimized deep-learning model for COVID-19’s time series analysis of the USA. The proposed framework dynamically selects optimal training parameters and determines the execution cycle based on enhanced BA’s global convergence manner. The forecasting of COVID-19 was achieved in two preliminary stages: data training and evaluation. To compared the proposed variant with existing algorithms, we used five evaluation metrics; namely root mean absolute error (RMSE), mean absolute percentage error (MAPE), standard deviation (Stdev), prediction interval, and accuracy. The following equations can define RMSE, MAPE, and Stdev:where represents squared difference forecasted and actual values.where indicates absolute error and d shows demand for each period.In the above equation is mean of ith sample and N indicates total number of instance. The raw data is pre-processed and standardized in the initial stages and subsequently used to develop the optimized predictive model based on LSTM. The model’s boundary parameters are selected so that the MAPE can be minimized. From a particular stage on, the optimized LSTM with the optimal learning parameters is used in the testing process to predict the extent of COVID-19 cases in the USA. Table 2 presents the empirical results for confirmed and predicted cases obtained through GRU, RNN, LSTM, and optimized LSTM. RMSE shows the root mean square errors in each network during the training. MAPE is total loss subtracted from precision, where Stdev shows the significant difference between confirmed and predicted COVID-19 cases. Prediction interval represents the difference in response to confirmed cases between each day of the forecasted cases.
Table 2

Comparison of proposed optimized LSTM with other standard deep learning forecasting models

ModelRMSEMAPEStdevPrediction intervalAccuracy
GRU1786.61330.015393261.8956393.31357270
RNN531.30418.817398970.02421901.24791
LSTM751.230912.129511371.5542688.24588
Optimized LSTM32.992620.48387560.23602118.062699.52
We presented a statistical test called Kruskal–Wallis test for the experimental results, comparing the results with other published methods. The average rank, median value, and Z-score obtained through Kruskal–Wallis test for each employed algorithm is presented in Table 5.
Table 5

Kruskal–Wallis test: proposed LSTM vs recent state-of-the-art algorithms

ModelMedianAve rankZ
Adagrad Wieczorek et al. (2020b)40.1002.5\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$-$$\end{document}-1.33
Adam Wieczorek et al. (2020b)87.5309.00.00
Adamax Wieczorek et al. (2020b)87.4708.0\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$-$$\end{document}-0.20
ANN Alakus and Turkoglu (2020)86.9006.0\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$-$$\end{document}-0.61
CNN Alakus and Turkoglu (2020)87.3507.0\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$-$$\end{document}-0.41
CNNLSTM Alakus and Turkoglu (2020)92.30013.00.82
CNNRNN Alakus and Turkoglu (2020)86.2405.0\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$-$$\end{document}-0.82
Ftrl Wieczorek et al. (2020b)40.1002.5\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$-$$\end{document}-1.33
LSTM-1 Chimmula and Zhang (2020)93.40015.01.22
LSTM-2 Chimmula and Zhang (2020)92.67014.01.02
LSTM Alakus and Turkoglu (2020)90.34012.00.61
LSTM Wieczorek et al. (2020b)93.56016.01.43
NAdam Wieczorek et al. (2020b)87.73011.00.41
RMSprop Wieczorek et al. (2020b)87.65010.00.20
RNN Alakus and Turkoglu (2020)84.0004.0\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$-$$\end{document}-1.02
SGD Wieczorek et al. (2020b)9.8001.0\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$-$$\end{document}-1.63
Optimized LSTM99.52017.01.63
Comparison of proposed optimized LSTM with other standard deep learning forecasting models Likewise, training and validation loss minimization curves using GRU, RNN, LSTM, and optimized LSTM are illustrated in Figs. 3, 4, 5, and 6. The convergence curves of real and forecasted COVID-19 cases through optimized LSTM in the USA are presented in Fig. 7.
Fig. 3

Training and validation loss minimization curves using GRU

Fig. 4

Training and validation loss minimization curves using RNN

Fig. 5

Training and validation loss minimization curves using LSTM

Fig. 6

Training and validation loss minimization curves using optimized LSTM

Fig. 7

Convergence of real and forecasted COVID-19 cases trough optimized LSTM in the USA

Training and validation loss minimization curves using GRU Training and validation loss minimization curves using RNN Training and validation loss minimization curves using LSTM A comparison of the proposed optimized LSTM with other standard deep learning forecasting models is tabulated in Table 4. We take the forecasting dates from 1/9/20 to 10/9/20, and to validate the predicted values, we retain previous ten-day cases 22/8/20 to 31/8/20. Referred to Table (4), actual confirmed cases do not appear yet in the USA from 31/8/20 to 1/9/20, predicted shows the forecasted cases through existing GRU, RNN, LSTM, and proposed optimized LSTM, respectively.
Table 4

Comparison of proposed optimized LSTM with other standard deep learning forecasting models

DateGRURNNLSTMOptimized LSTM
1/9/203619310530526549326956012715
2/9/203506454530444649039806045536
3/9/203344938530474748768126077771
4/9/203139538530412848512216109418
5/9/202912792530324448271706140511
6/9/202693745530287948045816171062
7/9/202472994530148047832796201055
8/9/202310167530119047632296230511
9/9/202206934529970747443686259414
10/9/202070085529956947266246287779
For validation of the performance of the proposed optimized LSTM, Fig. 8 represents the forecasting curves of several networks compared to the actual number of cases.
Fig. 8

Predicted cases comparison of optimized LSTM with GRU, RNN, and LSTM

Training and validation loss minimization curves using optimized LSTM Convergence of real and forecasted COVID-19 cases trough optimized LSTM in the USA Comparison of proposed optimized LSTM with other variants of LSTM and other deep learning models is given in Table 3.
Table 3

Comparison of proposed optimized LSTM with other variants of LSTM and other deep learning models

ModelRMSEMAPEAccuracy
LSTM Wieczorek et al. (2020b)93.56
NAdam Wieczorek et al. (2020b)87.73
RMSprop Wieczorek et al. (2020b)87.65
Adam Wieczorek et al. (2020b)87.53
Adamax Wieczorek et al. (2020b)87.47
Ftrl Wieczorek et al. (2020b)40.10
Adagrad Wieczorek et al. (2020b)40.10
SGD Wieczorek et al. (2020b)9.8
Scenario 1 Chowdhury et al. (2020)297.895425
Scenario 2 Chowdhury et al. (2020)216.4823.30
Scenario 3 Chowdhury et al. (2020)600.6138.06
LSTM-1 Chimmula and Zhang (2020)34.8393.4
LSTM-2 Chimmula and Zhang (2020)45.7092.67
Convolutional LSTM Arora et al. (2020)5.05
Stacked LSTM Arora et al. (2020)4.81
Bidirectional LSTM Arora et al. (2020)3.22
RNN Alakus and Turkoglu (2020)84.00
LSTM Alakus and Turkoglu (2020)90.34
CNNRNN Alakus and Turkoglu (2020)86.24
CNNLSTM Alakus and Turkoglu (2020)92.30
CNN Alakus and Turkoglu (2020)87.35
ANN Alakus and Turkoglu (2020)86.90
Optimized LSTM32.990.4899.52
Predicted cases comparison of optimized LSTM with GRU, RNN, and LSTM

Analysis

Table 2 shows that GRU obtained the worst accuracy with 1786.613 RMSE and 3261.895 Stdev, which shows a significant difference between actual and predicted COVID-cases. After GRU, standard LSTM performed better with 2688.245 prediction intervals and 12.12 MAPE. The performance of RNN is relatively good compared to GRU and LSTM with 91 % accuracy and 1371.55 Stdev. Lastly, it can be seen that the proposed version of optimized LSTM outperformed all other deep learning models with 32.99 RMSE better than GRU, 0.4838 MAPE better than LSTM, and only 60.23 significant difference among confirmed and predicted cases. Furthermore, the validation loss in the case of GRU and RNN is not stable throughout the learning process and meets greater than 0.5 and 0.7 (refer Figs. 3 and 4). From Fig. 5, the validation loss of LSTM is stable compared to GRU and RNN throughout the learning process with a greater 0.40. As opposed to GRU, LSTM, and RNN, the proposed model minimized the validation loss up to 0.04 and shows the better capability of loss minimization (refer Fig. 6). The performance of the proposed optimized LSTM can be confirmed through Fig. 7, where the USA’s actual cases on 31/8/20 were 6030587, and the predictions were 3734918, 5328279 7653031, and 6097641 using GRU, RNN, LSTM, and optimized LSTM, respectively. Comparison of proposed optimized LSTM with other variants of LSTM and other deep learning models Comparison of proposed optimized LSTM with other standard deep learning forecasting models Kruskal–Wallis test: proposed LSTM vs recent state-of-the-art algorithms From Table 5, it can be observed that the proposed LSTM obtained the best mean rank of 17.0 through Kruskal–Wallis test as compared to others. Advanced algorithms such as NAdam with 41 mean rank, two LSTM variants with 16 and 13 mean ranks, respectively. Similarly, the proposed LSTM outperformed other published results by obtaining the best positive Z-score of 163. We can conclude that using the proposed optimized framework can help the USA and other governments predict the actual cases with 99 % accuracy and take precautionary measures in advance.

Conclusion

This research offers the optimized LSTM to forecasts COVID-19 cases in the USA. Many machine learning and deep learning approaches are available to forecast confirmed cases, but they lack both the optimized temporal aspect and nonlinearity. To overcome this issue, we applied the BA for the optimization of LSTM. Besides, we implemented an enhanced BA variant to tackle BA’s premature convergence and local minima problems. The proposed version of BA used Gaussian adaptive inertia weight to control the individual velocity in the swarm. In addition, we replace the random walk with the Gaussian walk to observe the local search. The robust local search mechanism assists LSTM hyperparameter optimization during the training process. The proposed optimized LSTM is compared with GRU, RNN, and LSTM. Empirical results reveal that optimized LSTM minimized MAPE by 0.48, which is far better than the existing algorithms. In future work, we intend to adopt other evolutionary models such as the Genetic Algorithm and Differential evolution algorithm in the regression-based deep learning model for multivariate forecasting of a pandemic.
Table 1

Recent related works with their dataset details and results

Ref.DatasetModelResults
Wieczorek et al. (2020b)Government repositoriesNAdam training modelAccuracy above 99%
Chowdhury et al. (2020)Bangladesh COVID-19Neuro-fuzzy inference system (ANFIS)Correlation coefficient 0.75, MAPE 4.51, and RMSE 6.55
Dutta et al. (2020)WHO officialCNN and RNNCNN-LSTM approach outperforms
Chimmula and Zhang (2020)Dataset Canadian Health AuthorityLSTMGained highly accurate results
Arora et al. (2020)Indian datasetLSTMYields high accuracy
Pathan et al. (2020)The patient’s dataset of different countriesRNN and LSTMObtained optimum results
Alakus and Turkoglu (2020)Laboratory dataClinical predictive modelsAccuracy of 86.66% and F1-score of 91.89%,
Tuli et al. (2020)Data by Hannah RitchieML-based improved modelYields high accuracy
Kavadi et al. (2020)Indian datasetLinear regression modelOutperformed state-of-the-art methods
Pinter et al. (2020)Data from HungaryMulti-layered perceptron-imperialist competitive algorithm (MLP-ICA)Obtained promising results
Prasanth et al. (2021)Google trend and ECDC dataA hybrid GWO algorithmReduce MAPE by 74% results
Abbasimehr and Paki (2021)Live time series dataBayesian optimization-based algorithmMean SMAPE is 0.25 results
Elsheikh et al. (2021)Official data from Saudi ArabiaLSTM and other variantsObtained highly accurate results
  25 in total

1.  Long short-term memory.

Authors:  S Hochreiter; J Schmidhuber
Journal:  Neural Comput       Date:  1997-11-15       Impact factor: 2.026

2.  Cryo-electron tomography of mouse hepatitis virus: Insights into the structure of the coronavirion.

Authors:  Montserrat Bárcena; Gert T Oostergetel; Willem Bartelink; Frank G A Faas; Arie Verkleij; Peter J M Rottier; Abraham J Koster; Berend Jan Bosch
Journal:  Proc Natl Acad Sci U S A       Date:  2009-01-05       Impact factor: 11.205

Review 3.  The "inconvenient truth" about AI in healthcare.

Authors:  Trishan Panch; Heather Mattie; Leo Anthony Celi
Journal:  NPJ Digit Med       Date:  2019-08-16

4.  A pneumonia outbreak associated with a new coronavirus of probable bat origin.

Authors:  Peng Zhou; Xing-Lou Yang; Xian-Guang Wang; Ben Hu; Lei Zhang; Wei Zhang; Hao-Rui Si; Yan Zhu; Bei Li; Chao-Lin Huang; Hui-Dong Chen; Jing Chen; Yun Luo; Hua Guo; Ren-Di Jiang; Mei-Qin Liu; Ying Chen; Xu-Rui Shen; Xi Wang; Xiao-Shuang Zheng; Kai Zhao; Quan-Jiao Chen; Fei Deng; Lin-Lin Liu; Bing Yan; Fa-Xian Zhan; Yan-Yi Wang; Geng-Fu Xiao; Zheng-Li Shi
Journal:  Nature       Date:  2020-02-03       Impact factor: 69.504

5.  Many-objective BAT algorithm.

Authors:  Uzman Perwaiz; Irfan Younas; Adeem Ali Anwar
Journal:  PLoS One       Date:  2020-06-11       Impact factor: 3.240

Review 6.  COVID-19 patients' clinical characteristics, discharge rate, and fatality rate of meta-analysis.

Authors:  Long-Quan Li; Tian Huang; Yong-Qing Wang; Zheng-Ping Wang; Yuan Liang; Tao-Bi Huang; Hui-Yun Zhang; Weiming Sun; Yuping Wang
Journal:  J Med Virol       Date:  2020-03-23       Impact factor: 2.327

7.  A novel coronavirus outbreak of global health concern.

Authors:  Chen Wang; Peter W Horby; Frederick G Hayden; George F Gao
Journal:  Lancet       Date:  2020-01-24       Impact factor: 79.321

8.  Time series prediction of COVID-19 by mutation rate analysis using recurrent neural network-based LSTM model.

Authors:  Refat Khan Pathan; Munmun Biswas; Mayeen Uddin Khandaker
Journal:  Chaos Solitons Fractals       Date:  2020-06-13       Impact factor: 5.944

9.  Prediction and analysis of COVID-19 positive cases using deep learning models: A descriptive case study of India.

Authors:  Parul Arora; Himanshu Kumar; Bijaya Ketan Panigrahi
Journal:  Chaos Solitons Fractals       Date:  2020-06-17       Impact factor: 9.922

10.  Application of the ARIMA model on the COVID-2019 epidemic dataset.

Authors:  Domenico Benvenuto; Marta Giovanetti; Lazzaro Vassallo; Silvia Angeletti; Massimo Ciccozzi
Journal:  Data Brief       Date:  2020-02-26
View more
  5 in total

1.  An Improved COVID-19 Detection using GAN-Based Data Augmentation and Novel QuNet-Based Classification.

Authors:  Usman Asghar; Muhammad Arif; Khurram Ejaz; Dragos Vicoveanu; Diana Izdrui; Oana Geman
Journal:  Biomed Res Int       Date:  2022-02-26       Impact factor: 3.411

2.  A quantization assisted U-Net study with ICA and deep features fusion for breast cancer identification using ultrasonic data.

Authors:  Talha Meraj; Wael Alosaimi; Bader Alouffi; Hafiz Tayyab Rauf; Swarn Avinash Kumar; Robertas Damaševičius; Hashem Alyami
Journal:  PeerJ Comput Sci       Date:  2021-12-16

Review 3.  A Comprehensive Review of Bat Inspired Algorithm: Variants, Applications, and Hybridization.

Authors:  Mohammad Shehab; Muhannad A Abu-Hashem; Mohd Khaled Yousef Shambour; Ahmed Izzat Alsalibi; Osama Ahmad Alomari; Jatinder N D Gupta; Anas Ratib Alsoud; Belal Abuhaija; Laith Abualigah
Journal:  Arch Comput Methods Eng       Date:  2022-09-21       Impact factor: 8.171

4.  AI bot to detect fake COVID-19 vaccine certificate.

Authors:  Muhammad Arif; Shermin Shamsudheen; F Ajesh; Guojun Wang; Jianer Chen
Journal:  IET Inf Secur       Date:  2022-05-11       Impact factor: 1.300

5.  Early Warning of Infectious Diseases in Hospitals Based on Multi-Self-Regression Deep Neural Network.

Authors:  Mengying Wang; Cuixia Lee; Wei Wang; Yingyun Yang; Cheng Yang
Journal:  J Healthc Eng       Date:  2022-08-18       Impact factor: 3.822

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.