| Literature DB >> 25360533 |
Yan-Fang Sang1, Changming Liu2, Zhonggen Wang2, Jun Wen3, Lunyu Shang3.
Abstract
De-noising is a substantial issue in hydrologic time series analysis, but it is a difficult task due to the defect of methods. In this paper an energy-based wavelet de-noising method was proposed. It is to remove noise by comparing energy distribution of series with the background energy distribution, which is established from Monte-Carlo test. Differing from wavelet threshold de-noising (WTD) method with the basis of wavelet coefficient thresholding, the proposed method is based on energy distribution of series. It can distinguish noise from deterministic components in series, and uncertainty of de-noising result can be quantitatively estimated using proper confidence interval, but WTD method cannot do this. Analysis of both synthetic and observed series verified the comparable power of the proposed method and WTD, but de-noising process by the former is more easily operable. The results also indicate the influences of three key factors (wavelet choice, decomposition level choice and noise content) on wavelet de-noising. Wavelet should be carefully chosen when using the proposed method. The suitable decomposition level for wavelet de-noising should correspond to series' deterministic sub-signal which has the smallest temporal scale. If too much noise is included in a series, accurate de-noising result cannot be obtained by the proposed method or WTD, but the series would show pure random but not autocorrelation characters, so de-noising is no longer needed.Entities:
Mesh:
Year: 2014 PMID: 25360533 PMCID: PMC4215914 DOI: 10.1371/journal.pone.0110733
Source DB: PubMed Journal: PLoS One ISSN: 1932-6203 Impact factor: 3.240
Figure 1Energy distributions of the gauss (G) (a), 2-parameter lognormal (LN2) (b), and Pearson-III (P) (c) distributed noise with 95% confidence interval.
Figure 2De-noising process of hydrologic time series by the energy-based wavelet de-noising method proposed.
Data used in this paper*.
| Type | Data | Length | True components | |
| Synthetic series | Type-I | SS1 | 1500 | The same damped period |
| SS12 | 1500 | |||
| SS13 | 1500 | |||
| SS14 | 1500 | |||
| Type-II | SS2 | 500 | The same two periods of 50 and 200 | |
| SS22 | ||||
| 500 | The same exponentially upward trend | |||
| SS23 | 500 | |||
| SS24 | 500 | |||
| Observed series | Daily temperature (1980–2001) | RS1 | 8036 | Annual period |
| Monthly runoff (1972–2001) | RS2 | 360 | 12 months |
*: Four series in Type-I have no trend, but four series in Type-II have the same exponentially upward trend with the base of 1.005. These synthetic series include different contents of normally distributed noise (i.e., different true SNR values). The RS1 data were gained from the China Meteorological Data Sharing Service System (http://cdc.cma.gov.cn/). The RS2 data were gained from the Center for Water Resources Research, Chinese Academy of Sciences (http://www.cwrr.cn/).
Figure 3Energy distributions of SS1 (a) and SS2 (b) series obtained by different wavelets.
Evaluation of the de-noising results of SS1 and SS2 series obtained by different wavelets*.
| Series | Index | Wavelet used | ||||
| db2 | db16 | sym4 | coif5 | bior3.9 | ||
| SNR (−0.096) | −0.097 | −0.068 | −0.071 | −0.099 |
| |
| SS1 | MSE | 0.286 | 0.272 | 0.127 | 0.238 |
|
| Rxy | 0.927 | 0.935 | 0.964 | 0.938 |
| |
| SNR (1.116) | 1.035 |
| 1.108 | 1.128 | 1.129 | |
| SS2 | MSE | 0.353 |
| 0.134 | 0.093 | 0.109 |
| Rxy | 0.987 |
| 0.995 | 0.996 | 0.996 | |
*: In Table 2–3, the true SNR values of SS1 and SS2 series are −0.096 and 1.116, respectively.
**: In all Tables, “SNR” means signal-to-noise ratio, “MSE” means mean square error, and “R” means the cross-correlation coefficient between series x and y.
Evaluation of the de-noising results of SS1 and SS2 series obtained by different decomposition levels.
| Series | Index | Decomposition level used | ||||||||
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | ||
| SNR | 0.384 | 0.151 | 0.041 | −0.020 |
| −0.097 | −0.097 | −0.097 | −0.097 | |
| SS1 | MSE | 1.054 | 0.549 | 0.290 | 0.241 |
| 0.161 | 0.161 | 0.161 | 0.161 |
| Rxy | 0.802 | 0.881 | 0.932 | 0.935 |
| 0.959 | 0.959 | 0.959 | 0.959 | |
| SNR | 1.451 | 1.232 | 1.156 |
| 1.130 | 1.130 | 1.130 | 1.130 | ||
| SS2 | MSE | 0.551 | 0.242 | 0.102 |
| 0.085 | 0.085 | 0.085 | 0.085 | |
| Rxy | 0.980 | 0.991 | 0.996 |
| 0.997 | 0.997 | 0.997 | 0.997 | ||
Evaluation of the de-noising results of synthetic series in two types by the energy-based wavelet de-noising method proposed.
| Index | Type-I | Type-II | ||||||
| SS1 | SS12 | SS13 | SS14 | SS2 | SS22 | SS23 | SS24 | |
| R1 | 0.416 | 0.027 | −0.007 | −0.041 | 0.924 | 0.137 | 0.110 | −0.005 |
| True SNR | −0.096 | −1.770 | −3.132 | −3.742 | 1.116 | −0.891 | −2.235 | −4.248 |
| Calculated SNR | −0.097 | −1.391 | −1.241 | −1.395 | 1.130 | −0.856 | −1.261 | −1.851 |
| MSE | 0.161 | 3.586 | 130.44 | 375.29 | 0.085 | 4.097 | 53.508 | 330.6 |
| Rxy | 0.959 | 0.441 | 0.179 | 0.284 | 0.997 | 0.857 | 0.299 | 0.170 |
*: “R” means lag-1 autocorrelation coefficient.
De-noising results of synthetic series by the energy-based wavelet de-noising method proposed and the wavelet threshold de-noising (WTD) method.
| Series | Method used | SNR | MSE | Rxy | |
| true value | Calculated value | ||||
| SS1 | WTD | −0.096 | −0.086 | 0.147 | 0.972 |
| New method | −0.096 | −0.097 | 0.161 | 0.959 | |
| SS12 | WTD | −1.770 | −1.259 | 4.853 | 0.386 |
| New method | −1.770 | −1.391 | 3.586 | 0.441 | |
| SS13 | WTD | −3.132 | −1.135 | 159.81 | 0.156 |
| New method | −3.132 | −1.241 | 130.44 | 0.179 | |
| SS2 | WTD | 1.116 | 1.131 | 0.084 | 0.997 |
| New method | 1.116 | 1.130 | 0.085 | 0.997 | |
| SS22 | WTD | −0.891 | −0.694 | 5.016 | 0.871 |
| New method | −0.891 | −0.856 | 4.097 | 0.857 | |
| SS23 | WTD | −2.235 | −1.194 | 131.06 | 0.261 |
| New method | −2.235 | −1.261 | 53.508 | 0.299 | |
*: “New method” is the energy-based wavelet de-noising method proposed.
Figure 4Energy distributions of RS1 (a) and RS2 (b) series obtained by different wavelets.
Evaluation of the de-noising results of RS1 and RS2 series obtained by different wavelets.
| Series | Index | Wavelet used | ||||
| db3 | db8 | sym7 | coif4 | bior4.4 | ||
| SNR | 1.742 |
| 1.749 | 1.751 | 1.740 | |
| RS1 | MSE | 2.168 |
| 2.133 | 2.124 | 2.177 |
| Rxy | 0.991 |
| 0.991 | 0.991 | 0.991 | |
| SNR | 0.732 |
| 0.776 | 0.906 | 0.900 | |
| RS2 | MSE (105) | 1.651 |
| 1.523 | 1.169 | 1.188 |
| Rxy | 0.913 |
| 0.922 | 0.942 | 0.941 | |
*: In Table 6–7, MSE and R are used to compare original series and the de-noised series.
Figure 5De-noising results of RS1 (a) and RS2 (b) series by the energy-based wavelet de-noising method (the new method) and the wavelet threshold de-noising (WTD) method.
Evaluation of the de-noising results of RS1 and RS2 series obtained by different decomposition levels.
| Series | Index | Decomposition level used | |||||||||||
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | ||
| SNR | 2.171 |
| 1.742 | 1.742 | 1.742 | 1.742 | 1.742 | 1.742 | 1.742 | 1.742 | 1.742 | 1.742 | |
| RS1 | MSE | 0.815 |
| 2.167 | 2.167 | 2.167 | 2.167 | 2.167 | 2.167 | 2.167 | 2.167 | 2.167 | 2.167 |
| Rxy | 0.997 |
| 0.991 | 0.991 | 0.991 | 0.991 | 0.991 | 0.991 | 0.991 | 0.991 | 0.991 | 0.991 | |
| SNR |
| 0.844 | 0.844 | 0.844 | 0.844 | 0.844 | 0.844 | 0.844 | 0.844 | ||||
| RS2 | MSE (105) |
| 1.318 | 1.318 | 1.318 | 1.318 | 1.318 | 1.318 | 1.318 | 1.318 | |||
| Rxy |
| 0.934 | 0.934 | 0.934 | 0.934 | 0.934 | 0.934 | 0.934 | 0.934 | ||||