| Literature DB >> 32731462 |
Yunqi Gao1,2, Feng Luan1,2, Jiaqi Pan1,2, Xu Li3, Yaodong He3.
Abstract
The implementation of neural network regression prediction based on digital circuits is one of the challenging problems in the field of machine learning and cognitive recognition, and it is also an effective way to relieve the pressure of the Internet in the era of intelligence. As a nonlinear network, the stochastic configuration network (SCN) is considered to be an effective method for regression prediction due to its good performance in learning and generalization. Therefore, in this paper, we adapt the SCN to regression analysis, and design and verify the field programmable gate array (FPGA) framework to implement SCN model for the first time. In addition, in order to improve the performance of the SCN model based on the FPGA, the implementation of the nonlinear activation function on the FPGA is optimized, which effectively improves the prediction accuracy while considering the utilization rate of hardware resources. Experimental results based on the simulation data set and the real data set prove that the proposed FPGA framework successfully implements the SCN regression prediction model, and the improved SCN model has higher accuracy and a more stable performance. Compared with the extreme learning machine (ELM), the prediction performance of the proposed SCN implementation model based on the FPGA for the simulation data set and the real data set is improved by 56.37% and 17.35%, respectively.Entities:
Keywords: field programmable gate array; hardware neural networks; regression prediction; stochastic configuration networks
Year: 2020 PMID: 32731462 PMCID: PMC7436126 DOI: 10.3390/s20154191
Source DB: PubMed Journal: Sensors (Basel) ISSN: 1424-8220 Impact factor: 3.576
Figure 1The architecture of FPGA-based SCN.
Figure 2Comparison of different sigmoid functions.
The average and maximum errors of Equations (6)–(12).
| Average Error | Maximum Error | |
|---|---|---|
| Equation (6) | 0.048187 | 0.1192 |
| Equation (7) | 0.035147 | 0.11924 |
| Equation (8) | 0.1914 | 0.25718 |
| Equation (9) | 0.000606 | 0.00244 |
| Equation (10) | 0.006037 | 0.018941 |
| Equation (11) | 0.006228 | 0.013326 |
| Equation (12) | 0.008038 | 0.016176 |
Resource utilization of the sigmoid function with different approximation methods.
| Equation (6) | Equation (7) | Equation (9) | |
| Resource utilization | 0.0282% | 0.0320% | 0.0469% |
Comparison of encoded binary numbers with target values.
|
| Binary Number |
|
|
|---|---|---|---|
| 0.294294 | 0000001001011010 | 0.293945 | 0.119% |
| −1.086123 | 1111011101010000 | −1.085937 | 0.017% |
| 0.294294 | 000000100101101010110 | 0.294281 | 0.004% |
| −1.086123 | 111101110100111110100 | −1.086120 | 0.003% |
Figure 3Functional simulation of the field programmable gate array (FPGA)-based implementation of the stochastic configuration network (SCN).
Figure 4Comparison of SCN (Formulas (6), (7), (9)) and ELM implementation on the simulation data set.
Figure 5Comparison of SCN (Formulas (6), (7), (9)) and ELM implementation on the real data set.
Average root-mean-square error (RMSE) of the prediction results.
| Simulation Data Set | Real Data Set | |
|---|---|---|
| FPGA-based SCN (Equation (6)) | 0.1625 | 4.9169 µm |
| FPGA-based SCN (Equation (7)) | 0.1056 | 4.7567 µm |
| FPGA-based SCN (Equation (9)) | 0.0551 | 3.5783 µm |
| FPGA-based SCN (Equation (10)) | 0.0614 | 3.7821 µm |
| FPGA-based SCN (Equation (11)) | 0.0643 | 3.7994 µm |
| FPGA-based SCN (Equation (12)) | 0.0626 | 3.7187 µm |
| FPGA-based ELM | 0.1263 | 4.3296 µm |
| Computer-based SCN | 0.0150 | 3.5404 µm |
| Computer-based ELM | 0.0126 | 4.2290 µm |
Resource utilization of FPGA-based prediction models.
| SCN (Equation (6)) | SCN (Equation (7)) | SCN (Equation (9)) | ELM | |
|---|---|---|---|---|
| Simulation data set | 2.29% | 2.30% | 2.32% | 2.48% |
| Real data set | 1.65% | 1.66% | 1.68% | 2.14% |
Power consumption of FPGA-based prediction models.
| SCN (Equation (6)) | SCN (Equation (7)) | SCN (Equation (9)) | ELM | |
|---|---|---|---|---|
| Simulation data set | 0.991 W | 0.991 W | 0.991 W | 0.993 W |
| Real data set | 1.039 W | 1.039 W | 1.039 W | 1.043 W |
Actual clock frequency of FPGA-based prediction models.
| SCN (Equation (9)) | ELM | |
|---|---|---|
| Simulation data set | 43.1 MHz | 31.7 MHz |
| Real data set | 48.6 MHz | 41.8 MHz |