Literature DB >> 33351770

Integer Echo State Networks: Efficient Reservoir Computing for Digital Hardware.

Denis Kleyko, Edward Paxon Frady, Mansour Kheffache, Evgeny Osipov.   

Abstract

We propose an approximation of echo state networks (ESNs) that can be efficiently implemented on digital hardware based on the mathematics of hyperdimensional computing. The reservoir of the proposed integer ESN (intESN) is a vector containing only n -bits integers (where is normally sufficient for a satisfactory performance). The recurrent matrix multiplication is replaced with an efficient cyclic shift operation. The proposed intESN approach is verified with typical tasks in reservoir computing: memorizing of a sequence of inputs, classifying time series, and learning dynamic processes. Such architecture results in dramatic improvements in memory footprint and computational efficiency, with minimal performance loss. The experiments on a field-programmable gate array confirm that the proposed intESN approach is much more energy efficient than the conventional ESN.

Entities:  

Year:  2022        PMID: 33351770     DOI: 10.1109/TNNLS.2020.3043309

Source DB:  PubMed          Journal:  IEEE Trans Neural Netw Learn Syst        ISSN: 2162-237X            Impact factor:   10.451


  2 in total

1.  Cellular Automata Can Reduce Memory Requirements of Collective-State Computing.

Authors:  Denis Kleyko; Edward Paxon Frady; Friedrich T Sommer
Journal:  IEEE Trans Neural Netw Learn Syst       Date:  2022-06-01       Impact factor: 14.255

2.  Rotating neurons for all-analog implementation of cyclic reservoir computing.

Authors:  Xiangpeng Liang; Yanan Zhong; Jianshi Tang; Zhengwu Liu; Peng Yao; Keyang Sun; Qingtian Zhang; Bin Gao; Hadi Heidari; He Qian; Huaqiang Wu
Journal:  Nat Commun       Date:  2022-03-23       Impact factor: 14.919

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.