Literature DB >> 33679295

Efficient Spike-Driven Learning With Dendritic Event-Based Processing.

Shuangming Yang1, Tian Gao1, Jiang Wang1, Bin Deng1, Benjamin Lansdell2, Bernabe Linares-Barranco3.   

Abstract

A critical challenge in neuromorphic computing is to present computationally efficient algorithms of learning. When implementing gradient-based learning, error information must be routed through the network, such that each neuron knows its contribution to output, and thus how to adjust its weight. This is known as the credit assignment problem. Exactly implementing a solution like backpropagation involves weight sharing, which requires additional bandwidth and computations in a neuromorphic system. Instead, models of learning from neuroscience can provide inspiration for how to communicate error information efficiently, without weight sharing. Here we present a novel dendritic event-based processing (DEP) algorithm, using a two-compartment leaky integrate-and-fire neuron with partially segregated dendrites that effectively solves the credit assignment problem. In order to optimize the proposed algorithm, a dynamic fixed-point representation method and piecewise linear approximation approach are presented, while the synaptic events are binarized during learning. The presented optimization makes the proposed DEP algorithm very suitable for implementation in digital or mixed-signal neuromorphic hardware. The experimental results show that spiking representations can rapidly learn, achieving high performance by using the proposed DEP algorithm. We find the learning capability is affected by the degree of dendritic segregation, and the form of synaptic feedback connections. This study provides a bridge between the biological learning and neuromorphic learning, and is meaningful for the real-time applications in the field of artificial intelligence.
Copyright © 2021 Yang, Gao, Wang, Deng, Lansdell and Linares-Barranco.

Entities:  

Keywords:  credit assignment; dendritic learning; neuromorphic; spike-driven learning; spiking neural network

Year:  2021        PMID: 33679295      PMCID: PMC7933681          DOI: 10.3389/fnins.2021.601109

Source DB:  PubMed          Journal:  Front Neurosci        ISSN: 1662-453X            Impact factor:   4.677


  8 in total

1.  Rural Workplace Sustainable Development of Smart Rural Governance Workplace Platform for Efficient Enterprise Performances.

Authors:  Yingli Wu; Wanying Ma
Journal:  J Environ Public Health       Date:  2022-06-03

2.  Heterogeneous Ensemble-Based Spike-Driven Few-Shot Online Learning.

Authors:  Shuangming Yang; Bernabe Linares-Barranco; Badong Chen
Journal:  Front Neurosci       Date:  2022-05-09       Impact factor: 5.152

3.  Evolving deep convolutional neutral network by hybrid sine-cosine and extreme learning machine for real-time COVID19 diagnosis from X-ray images.

Authors:  Chao Wu; Mohammad Khishe; Mokhtar Mohammadi; Sarkhel H Taher Karim; Tarik A Rashid
Journal:  Soft comput       Date:  2021-05-10       Impact factor: 3.732

4.  Predicting Spike Features of Hodgkin-Huxley-Type Neurons With Simple Artificial Neural Network.

Authors:  Tian Wang; Ye Wang; Jiamin Shen; Lei Wang; Lihong Cao
Journal:  Front Comput Neurosci       Date:  2022-02-07       Impact factor: 2.380

5.  Functional Implications of Dale's Law in Balanced Neuronal Network Dynamics and Decision Making.

Authors:  Victor J Barranca; Asha Bhuiyan; Max Sundgren; Fangzhou Xing
Journal:  Front Neurosci       Date:  2022-02-28       Impact factor: 4.677

6.  Robust Spike-Based Continual Meta-Learning Improved by Restricted Minimum Error Entropy Criterion.

Authors:  Shuangming Yang; Jiangtong Tan; Badong Chen
Journal:  Entropy (Basel)       Date:  2022-03-25       Impact factor: 2.738

7.  SAM: A Unified Self-Adaptive Multicompartmental Spiking Neuron Model for Learning With Working Memory.

Authors:  Shuangming Yang; Tian Gao; Jiang Wang; Bin Deng; Mostafa Rahimi Azghadi; Tao Lei; Bernabe Linares-Barranco
Journal:  Front Neurosci       Date:  2022-04-18       Impact factor: 5.152

8.  UAV Localization Algorithm Based on Factor Graph Optimization in Complex Scenes.

Authors:  Jun Dai; Songlin Liu; Xiangyang Hao; Zongbin Ren; Xiao Yang
Journal:  Sensors (Basel)       Date:  2022-08-05       Impact factor: 3.847

  8 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.