| Literature DB >> 33758456 |
R K Jana1, Indranil Ghosh2, Debojyoti Das3.
Abstract
This research proposes a differential evolution-based regression framework for forecasting one day ahead price of Bitcoin. The maximal overlap discrete wavelet transformation first decomposes the original series into granular linear and nonlinear components. We then fit polynomial regression with interaction (PRI) and support vector regression (SVR) on linear and nonlinear components and obtain component-wise projections. The sum of these projections constitutes the final forecast. For accurate predictions, the PRI coefficients and tuning of the hyperparameters of SVR must be precisely estimated. Differential evolution, a metaheuristic optimization technique, helps to achieve these goals. We compare the forecast accuracy of the proposed regression framework with six advanced predictive modeling algorithms- multilayer perceptron neural network, random forest, adaptive neural fuzzy inference system, standalone SVR, multiple adaptive regression spline, and least absolute shrinkage and selection operator. Finally, we perform the numerical experimentation based on-(1) the daily closing prices of Bitcoin for January 10, 2013, to February 23, 2019, and (2) randomly generated surrogate time series through Monte Carlo analysis. The forecast accuracy of the proposed framework is higher than the other predictive modeling algorithms.Entities:
Keywords: Bitcoin; Differential evolution; Maximal overlap discrete wavelet transformation; Polynomial regression with interaction; Support vector regression
Year: 2021 PMID: 33758456 PMCID: PMC7970816 DOI: 10.1007/s10479-021-04000-8
Source DB: PubMed Journal: Ann Oper Res ISSN: 0254-5330 Impact factor: 4.854
Fig. 1Temporal evolutionary pattern of Bitcoin
Empirical properties of Bitcoin price
| Jarque–Bera Test | Frosini Test | Philip-Perron Test | Augmented Dickey-Fuller Test | Terasvirta's Test | White's NN Test | Hurst Exponent |
|---|---|---|---|---|---|---|
| 2031.86*** | 5.5217*** | − 9.5062# | − 2.5873# | 33.7355*** | 23.2801*** | 0.89404 |
#Not Significant, ***Significant at 1% level of significance
Fig. 2Proposed research methodology
Fig. 3PACF plot
Fig. 4MODWT decomposition of Bitcoin price
Fig. 5Iteration wise performance of the DE in SVR-DE model
Fig. 6Iteration wise performance of the DE in PRI-DE model
Forecasting performance of the proposed framework
| Series | IA | TI | DA | NSE |
|---|---|---|---|---|
| Bitcoin price | 0.999703 | 0.027424 | 0.989514 | 0.998841 |
| Bitcoin price | 0.999542 | 0.028139 | 0.988408 | 0.998593 |
Fig. 7Actual and predicted Bitcoin price visualization
Parameters of competing models
| Model | Key parameters |
|---|---|
| MLP | Learning rate = 0.7, momentum = 0.9, number of hidden nodes = 20 |
| ANFIS | Membership function = Gaussian |
| Rejected | |
| RF | Number of trees = 500, features for branching = 2 |
| SVR | |
| MARS | Degrees of interaction = 1, generalized cross validation penalty per knot = 2 |
| LASSO | Lambda (regularization) = 0.3 |
Forecasting performance evaluation
| Series | Proposed | MLP | ANFIS | RF | SVR | MARS | LASSO |
|---|---|---|---|---|---|---|---|
| IA | 0.999703 | 0.991793 | 0.992093 | 0.992957 | 0.992777 | 0.988731 | 0.990769 |
| TI | 0.027424 | 0.055312 | 0.044386 | 0.039149 | 0.038274 | 0.048718 | 0.047633 |
| DA | 0.989514 | 0.971166 | 0.973414 | 0.980486 | 0.981639 | 0.962394 | 0.967938 |
| NSE | 0.998841 | 0.998020 | 0.994762 | 0.995152 | 0.994953 | 0.987845 | 0.983132 |
| IA | 0.999542 | 0.991766 | 0.992069 | 0.992944 | 0.992759 | 0.988716 | 0.990734 |
| TI | 0.028139 | 0.055327 | 0.044405 | 0.039162 | 0.038283 | 0.048728 | 0.047669 |
| DA | 0.988408 | 0.971154 | 0.973398 | 0.980474 | 0.981627 | 0.962367 | 0.967917 |
| NSE | 0.998593 | 0.998007 | 0.994741 | 0.995127 | 0.994938 | 0.987823 | 0.983113 |
The DM test results
| Models | MLP (1) | ANFIS (1) | RF(1) | SVR (1) | MARS (1) | LASSO (1) | Proposed (1) |
|---|---|---|---|---|---|---|---|
| MLP (2) | − | ||||||
| ANFIS (2) | 0.217# | − | |||||
| RF (2) | 0.209# | 0.216# | − | ||||
| SVR (2) | 0.211# | 0.208# | 0.223# | − | |||
| MARS (2) | − 3.8245*** | − 3.8663*** | − 3.8792*** | − 3.8804*** | − | ||
| LASSO (2) | − 3.8587*** | − 3.8935*** | − 3.8956*** | − 3.8967*** | 0.231# | − | |
| Proposed (2) | 4.8429*** | 4.8378*** | 4.8249*** | 4.8227*** | 5.2461*** | 5.2583*** | − |
| MLP (2) | − | ||||||
| ANFIS (2) | 0.198# | − | |||||
| RF (2) | 0.237# | 0.207# | − | ||||
| SVR (2) | 0.215# | 0.224# | 0.229# | − | |||
| MARS (2) | − 3.8369*** | − 3.8681*** | − 3.8783*** | − 3.8804*** | − | ||
| LASSO (2) | − 3.8548*** | − 3.8890*** | − 3.8988*** | − 3.8967*** | 0.231# | − | |
| Proposed (2) | 4.8461*** | 4.8451*** | 4.8316*** | 4.8289 *** | 5.2461*** | 5.2583*** | − |
***Significant at 1% level, # Not significant
Fig. 8Simulated surrogate series
Performance on surrogate series in static forecasting
| Series | IA | TI | DA | NSE |
|---|---|---|---|---|
| Proposed | 0.97985 | 0.035044 | 0.96535 | 0.95878 |
| MLP | 0.97082 | 0.061623 | 0.95237 | 0.95532 |
| ANFIS | 0.97166 | 0.062382 | 0.94961 | 0.95549 |
| RF | 0.97231 | 0.059831 | 0.95837 | 0.95731 |
| SVR | 0.97175 | 0.063208 | 0.95318 | 0.96108 |
| MARS | 0.96898 | 0.066013 | 0.94227 | 0.95116 |
| LASSO | 0.96926 | 0.065744 | 0.94359 | 0.95184 |
| Proposed | 0.96389 | 0.037921 | 0.93982 | 0.94337 |
| MLP | 0.95443 | 0.064318 | 0.92096 | 0.93910 |
| ANFIS | 0.95418 | 0.063248 | 0.92262 | 0.93886 |
| RF | 0.95562 | 0.062925 | 0.92126 | 0.93954 |
| SVR | 0.95380 | 0.062475 | 0.92278 | 0.93902 |
| MARS | 0.95085 | 0.065149 | 0.91867 | 0.93626 |
| LASSO | 0.95177 | 0.065022 | 0.91920 | 0.93581 |
| Proposed | 0.94214 | 0.040185 | 0.91887 | 0.91684 |
| MLP | 0.92838 | 0.077623 | 0.90472 | 0.91123 |
| ANFIS | 0.92769 | 0.078014 | 0.90526 | 0.91158 |
| RF | 0.92857 | 0.076352 | 0.90516 | 0.91209 |
| SVR | 0.92711 | 0.077484 | 0.90569 | 0.91202 |
| MARS | 0.92430 | 0.080169 | 0.90291 | 0.90943 |
| LASSO | 0.92461 | 0.080074 | 0.90327 | 0.90959 |
| Proposed | 0.95638 | 0.038772 | 0.90697 | 0.93058 |
| MLP | 0.94344 | 0.069585 | 0.88701 | 0.92155 |
| ANFIS | 0.94275 | 0.069192 | 0.89141 | 0.92119 |
| RF | 0.94393 | 0.068713 | 0.89176 | 0.92208 |
| SVR | 0.94346 | 0.069626 | 0.88637 | 0.92089 |
| MARS | 0.94057 | 0.071233 | 0.88205 | 0.91865 |
| LASSO | 0.94096 | 0.070876 | 0.88289 | 0.91887 |
| Proposed | 0.94196 | 0.039561 | 0.90875 | 0.92658 |
| MLP | 0.92768 | 0.072736 | 0.89912 | 0.91771 |
| ANFIS | 0.92689 | 0.072584 | 0.89873 | 0.91733 |
| RF | 0.92830 | 0.072371 | 0.89966 | 0.91808 |
| SVR | 0.92789 | 0.072905 | 0.89832 | 0.91756 |
| MARS | 0.92494 | 0.073688 | 0.89513 | 0.91412 |
| LASSO | 0.92463 | 0.073641 | 0.89545 | 0.91397 |
Performance on surrogate series in dynamic forecasting
| Series | IA | TI | DA | NSE |
|---|---|---|---|---|
| Proposed | 0.96944 | 0.035759 | 0.96251 | 0.95129 |
| MLP | 0.95893 | 0.062069 | 0.94965 | 0.93986 |
| ANFIS | 0.95814 | 0.061940 | 0.94910 | 0.93967 |
| RF | 0.95917 | 0.060238 | 0.95103 | 0.94223 |
| SVR | 0.95785 | 0.062124 | 0.94815 | 0.94136 |
| MARS | 0.95109 | 0.063496 | 0.94223 | 0.93254 |
| LASSO | 0.95074 | 0.063455 | 0.94178 | 0.93297 |
| Proposed | 0.95031 | 0.038045 | 0.93724 | 0.94106 |
| MLP | 0.96389 | 0.066703 | 0.92761 | 0.92996 |
| ANFIS | 0.94214 | 0.066816 | 0.92691 | 0.92961 |
| RF | 0.95638 | 0.066234 | 0.92778 | 0.93207 |
| SVR | 0.94196 | 0.066589 | 0.92765 | 0.93128 |
| MARS | 0.94196 | 0.068117 | 0.92542 | 0.92766 |
| LASSO | 0.94196 | 0.068077 | 0.92580 | 0.92797 |
| Proposed | 0.92970 | 0.041296 | 0.90855 | 0.91522 |
| MLP | 0.91821 | 0.080927 | 0.90875 | 0.92658 |
| ANFIS | 0.91845 | 0.080918 | 0.90875 | 0.92658 |
| RF | 0.91990 | 0.080335 | 0.90875 | 0.92658 |
| SVR | 0.91873 | 0.080891 | 0.90875 | 0.92658 |
| MARS | 0.91606 | 0.082216 | 0.90875 | 0.92658 |
| LASSO | 0.91575 | 0.081995 | 0.90875 | 0.92658 |
| Proposed | 0.94373 | 0.038837 | 0.91037 | 0.92916 |
| MLP | 0.93236 | 0.070862 | 0.90082 | 0.92018 |
| ANFIS | 0.93277 | 0.070814 | 0.90055 | 0.92033 |
| RF | 0.93344 | 0.070633 | 0.90104 | 0.92105 |
| SVR | 0.93258 | 0.070705 | 0.90029 | 0.92046 |
| MARS | 0.92850 | 0.071276 | 0.89565 | 0.91914 |
| LASSO | 0.92911 | 0.070975 | 0.89533 | 0.91827 |
| Proposed | 0.93106 | 0.039840 | 0.91673 | 0.92347 |
| MLP | 0.92135 | 0.073084 | 0.90347 | 0.92441 |
| ANFIS | 0.92119 | 0.073077 | 0.90304 | 0.92429 |
| RF | 0.92202 | 0.072918 | 0.90395 | 0.92467 |
| SVR | 0.92168 | 0.073109 | 0.90374 | 0.92541 |
| MARS | 0.91825 | 0.073863 | 0.89950 | 0.92118 |
| LASSO | 0.91849 | 0.073839 | 0.89943 | 0.92093 |
The DM test of predictive performance on the surrogate series
| Models | MLP (1) | ANFIS (1) | RF(1) | SVR (1) | MARS (1) | LASSO (1) | Proposed (1) |
|---|---|---|---|---|---|---|---|
| MLP (2) | − | ||||||
| ANFIS (2) | 0.244# | − | |||||
| RF (2) | 0.189# | 0.226# | − | ||||
| SVR (2) | 0.234# | 0.239# | 0.213# | − | |||
| MARS (2) | − 3.7683*** | − 3.7580*** | − 3.8698*** | − 3.8753*** | − | ||
| LASSO (2) | − 3.8491*** | − 3.8881*** | − 3.8479*** | − 3.8811*** | 0.254# | − | |
| Proposed (2) | 5.3628*** | 5.2869*** | 5.2263*** | 5.3259*** | 5.6780*** | 5.7569*** | − |
| MLP (2) | − | ||||||
| ANFIS (2) | 0.214# | − | |||||
| RF (2) | 0.225# | 0.185# | − | ||||
| SVR (2) | 0.241# | 0.228# | 0.242# | − | |||
| MARS (2) | − 3.8316*** | − 3.8579*** | − 3.8856*** | − 3.88923*** | − | ||
| LASSO (2) | − 3.8641*** | − 3.8958*** | − 3.8911*** | − 3.9104*** | 0.239# | − | |
| Proposed (2) | 5.6673*** | 5.6389*** | 5.5427*** | 5.6160*** | 5.8906*** | 6.1425*** | − |
***Significant at 1% level, # Not significant