| Literature DB >> 35746177 |
Bin Lian1,2, Zhongcheng Wei3,4, Xiang Sun5, Zhihua Li3,4, Jijun Zhao3,4.
Abstract
As one of the most critical elements in the hydrological cycle, real-time and accurate rainfall measurement is of great significance to flood and drought disaster risk assessment and early warning. Using commercial microwave links (CMLs) to conduct rainfall measure is a promising solution due to the advantages of high spatial resolution, low implementation cost, near-surface measurement, and so on. However, because of the temporal and spatial dynamics of rainfall and the atmospheric influence, it is necessary to go through complicated signal processing steps from signal attenuation analysis of a CML to rainfall map. This article first introduces the basic principle and the revolution of CML-based rainfall measurement. Then, the article illustrates different steps of signal process in CML-based rainfall measurement, reviewing the state of the art solutions in each step. In addition, uncertainties and errors involved in each step of signal process as well as their impacts on the accuracy of rainfall measurement are analyzed. Moreover, the article also discusses how machine learning technologies facilitate CML-based rainfall measurement. Additionally, the applications of CML in monitoring phenomena other than rain and the hydrological simulation are summarized. Finally, the challenges and future directions are discussed.Entities:
Keywords: machine learning; microwave links; rainfall measurement; remote sensing; wireless cellular networks
Mesh:
Year: 2022 PMID: 35746177 PMCID: PMC9230635 DOI: 10.3390/s22124395
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.847
Comparisons of conventional and CML-based rainfall measurement techniques.
| Techniques | Advantages | Disadvantages |
|---|---|---|
| Rain Gauge | High accuracy | Point measurement; low spatial resolution; high capital and operational cost; difficult to deploy in mountainous areas |
| Weather Radar | Broad spatial coverage of up to 300 km | Low accuracy in near-surface measurement; easy to be affected by ground obstacles at a low elevation angle |
| Satellite | Global scale | Coarse resolution for small spatial and temporal scales; affected by clouds; high time lag |
| Commercial Microwave Links | Path-integrated and near-surface measurements; high spatial and temporal resolution; no additional capital cost | Hard to acquire CML data; relatively high complexity for data processing |
Figure 1Basic operating principle of CML-based rainfall measurement.
Figure 2Correlation between CML power total loss and rainfall intensity.
Countries that have used CML to measure rainfall.
| CML Data | |||||||
|---|---|---|---|---|---|---|---|
| Authors (Year) | Country | Frequency (GHz) | Link Number | Length (km) | Temporal | Quantization Level (dB) | Remarks |
| Messer et al. (2006) [ | Israel | — | — | — | 15 min | — | The correlation between rainfall intensity measured by CML and RG is 0.86 for a 15 min interval and 0.9 for an hourly interval. |
| Leijnse et al. (2007) [ | The Netherlands | 38 | 2 | 7.75, 6.72 | 15 min | 1 | Eight rainfall events are evaluated, and the results are consistent with the rainfall retrieved from RGs and C-band radar. |
| Schleiss et al. (2010) [ | France | 26, 19 | 4 | 3.7, 3.7, 7.1, 2.4 | 30s, 6s | 1 | A wet and dry weather classification method is proposed, which can identify 92% of all rainy periods and 93% of the total rain amount. |
| Chwala et al. (2012) [ | Germany | 15, 18.7, 23 | 5 | 17.4, 10.2, 4, 17.1, 10.4 | selectable | <0.05 | A new algorithm based on short-time Fourier transform (STFT) is proposed for the wet/dry classification. The correlation reaches 0.81 for the link-gauge comparison. |
| Bianchi et al. (2013) [ | Switzerland | 23, 38, 58 | 14 | 0.3–8.4 | 5 min | 0.1 or 1 | RGs, weather radar and CMLs are combined to estimate the intensity and temporal distribution of rainfall more accurately. |
| Fencl et al. (2013) [ | Czech | 38 | 14 | — | — | — | CML networks can better capture the spatio-temporal rainfall dynamics, especially in heavy rain, and thus improve pipe flow prediction. |
| Doumounia et al. | Burkina Faso | 7 | 1 | 29 | 1s | 1 | 95% of the rainy days are detected by CML measurement, and the correlation with the RGs data series is 0.8. |
| D’Amico et al. (2016) [ | Italy | 25 | 3 | average of 6 | — | — | Tomographic technique was applied to reconstruct 2-D fields of rainfall accumulation, and the link density and topology affect the accuracy of the reconstruction algorithm. |
| Rios Gaona et al. (2018) [ | Brazil | above 15 | 145 | shorter than 20 | — | 0.1 | As compared to RGs, CML-based measurement can better capture the city-average rainfall dynamics. |
| Sohail Afzal et al. (2018) [ | Pakistan | 38 | 35 | 0.5–2.5 | 15 min | — | The correlation coefficient value between rainfall intensity measured by CMLs and RGs is as high as 0.97. |
| Jacoby et al. (2020) [ | Sweden | 14–39 | 17 | 1.5–7 | 10 s | — | Using long short-term memory (LSTM) to learn from previous attenuation values is sufficient to generate accurate attenuation predictions. |
| Song et al. (2021) [ | China | 15–23 | 8 | 0.55–1.08 | 1 min | 0.1 | The correlation coefficient values between the rain rate measured by CMLs and RGs are all higher than 0.77, and the highest coefficient is over 0.9. |
| Pudashin et al. (2021) [ | Australia | 10–40 | 144 | 0.2–57 | 15 min | 0.1 | Using two types of datasets collected by different sampling strategies (maximum/minimum RSL and average RSL) to retrieve rainfall, the results show that the maximum/minimum RSL data are better than average in terms of the statistics, i.e., root mean square error (RMSE), bias, and coefficient of variation (CV). |
"—" represents that the content is not mentioned in the literature.
Figure 3Typical steps in CML-based rainfall measurement.
Machine learning algorithms applied in CML-based rainfall measurements.
| Ref. | Algorithms | Function | Data Source | Data for Training and Testing | Results |
|---|---|---|---|---|---|
| [ | LSTM | Wet/dry classification | Experimental data were collected from 1/11–31/12 except for 13/12–21/12 by using a C-band microwave link (7.7 GHz) | Data from 1/11–30/11 are used to train a classifier, and the December data are used for testing. | The accuracy of wet/dry classification is higher than 60%, and even higher than 98% in some days. |
| [ | SVM | Wet/dry classification | 15 microwave links (15–23 GHz) and 8 RGs | Half of the data from rainfall time over 2 h in 14 days were used as the training set and the remaining half as the test set. | The accuracy of rainfall identification is higher than 80%, and most of the accuracy is even higher than 90%. |
| [ | CNN | Wet/dry classification | Data came from 3904 CMLs, and gauge-adjusted radar data are used as a reference | 4 months of data from 800 randomly selected CMLs were used for training and 2 different months of data for testing. | 76% of rainfall and 97% of non-rainfall periods can be detected, and more than 90% of rainfall intensities that are greater than 0.6 mmh−1 can be detected. |
| [ | LSTM | WAA quantization | Total attenuation data of 6 E-band full-duplex CMLs and 4 RGs data | Rain period data were divided into 12 subsets, of which 10 subsets were training sets and the remaining two for testing. | It has a good correlation with the RGs measured WAA, but the cumulative rainfall estimates based on LSTM are lower when the rainfall increases sharply. |
| [ | LSTM | Rain rate estimation | A CML (22.715 GHz) and an OTT PARSIVEL disdrometer | The training group accounts for 80% of the whole sequence, and the remaining 20% is used as testing group. | The relative bias decreases from 7.39% to 1.14%, and the coefficient of determination (R2) increases from 0.71 to 0.82 compared with constant weighted average method. |
| [ | GRU-RNN | Rain rate estimation | A total of 1.4M samples are from 40 full duplex links and 8 RGs in Swedish region, and 1.7M samples are from 34 full duplex links and 9 RGs in the Israeli region | 80% of the total samples are used as training set and the remaining 20% as validation. | RMSE and bias are smaller compared with the traditional power-law-based algorithm, and the trade-off between performance and robustness of RNN methods can be controlled by introducing a TN layer. |
| [ | SVC, ANN | Wet/dry classification, | Measurement report (MR) data from TD-LTE networks, and RGs data and runoff data are used as references | 60% of the wet/dry records are used as ANN training samples for classification, while the remaining 40% are used as testing samples. | The performance of rainfall retrieval from MR data is in good agreement with RG measurements, and the accuracy is more than 80% in the application of runoff simulation. |
| [ | ANN, LSTM | Rain rate estimation | 3×216480 RSL units and 2164800 target rain rate samples in Korea region, and satellite RSL data in Ethiopia region | Data are split into 85% and 15% for training and testing. | Rainfall retrieval performance of ground link is better than that of satellite link. Performance (RMSE, R2, CC) of LSTM at 11 GHz ground link is better than that of ANN. |
| [ | DT, PNN, GDA, LR | Rainfall types classification | 2475 samples of convective rainfall (31.3%) and 5441 samples of stratiform rainfall (68.7%) from March to November | 7916 total samples are divided into 5 groups on average, 4 groups are selected as the training set, and the remaining 1 group is used as the test set. | DT and PNN algorithms have better fault tolerant ability than GDA and LR, and the classification accuracies of tri-frequency models are higher than those of dual-frequency models. |
| [ | LSTM | CML attenuation prediction | 17 CMs with the frequencies of 14–39 GHz | 1400 h of training time; 16 h of validation time. | The prediction accuracy of CML attenuation values by LSTM during rainfall is greater than ARIMA. |
Figure 4LSTM cell structure.
Figure 5GRU structure.
Open-access datasets.
| Dataset | Code | Location | Data Description | URL |
|---|---|---|---|---|
| Dübendorf data [ | No | Dubendorf, Switzerland | Received and transmitted power of 1 dual-polarization CML (38 GHz); rainfall rate and cumulative rainfall from 5 RGs; temperature, dew point, relative humidity, wind direction, and wind speed from 5 weather stations. | |
| Wageningen data [ | No | Wageningen, | Received power of 1 CML (38 GHz) and 2 research microwave links (26 GHz, 38 GHz); relative humidity, temperature, and wind speed from 5 disdrometers. | |
| Melbourne data [ | No | Melbourne, | RSL data from a microwave research link (24 GHz), and specific attenuation, wind speed and direction, air temperature and humidity, barometric pressure, and so on from disdrometers, RGs, and weather station. | |
| PSO data [ | No | The Netherlands | Frequency, minimum and maximum received power, path length, coordinates, and link ID of about 2800 microwave sublinks; rain intensity from gauge-adjusted radar. | |
| Sri Lanka data [ | No | Sri Lanka | The gridded rainfall maps retrieved from CML data from Sri Lanka over the 3.5 month period, and hourly/daily rainfall depths from satellite product and the global precipitation measurement (GPM) product. | |
| R package “RAINLINK” [ | Yes | The Netherlands | Frequency, maximum RSL, minimum RSL, link length, location coordinates of about 2600 CMLs. | |
| Code processing steps: data preprocessing, wet/dry classification, baseline determination, filtering of outliers, correction of received power, path-average rainfall intensity estimation, generation of rainfall map, and map visualization. | ||||
| Prague data and code [ | Yes | Prague, | Total power loss of 6 E-band full-duplex CMLs; rainfall intensity, temperature, and humidity from 4 RGs. | |
| Code processing steps: data preprocessing, loading data, RG-based wet/dry classification, estimating baseline, quantifying WAA, estimating rainfall, quantifying uncertainty, and retrieving water vapor density. | ||||
| Python package “pycomlink” [ | Yes | Germany | Code processing steps: data sanity checks, anomaly detection, wet/dry classification, baseline calculation, wet antenna correction, transformation from attenuation to rain rate, rainfall map generation, and results validation against RGs. |