Literature DB >> 20573887

A reward-modulated hebbian learning rule can explain experimentally observed network reorganization in a brain control task.

Robert Legenstein1, Steven M Chase, Andrew B Schwartz, Wolfgang Maass.   

Abstract

It has recently been shown in a brain-computer interface experiment that motor cortical neurons change their tuning properties selectively to compensate for errors induced by displaced decoding parameters. In particular, it was shown that the three-dimensional tuning curves of neurons whose decoding parameters were reassigned changed more than those of neurons whose decoding parameters had not been reassigned. In this article, we propose a simple learning rule that can reproduce this effect. Our learning rule uses Hebbian weight updates driven by a global reward signal and neuronal noise. In contrast to most previously proposed learning rules, this approach does not require extrinsic information to separate noise from signal. The learning rule is able to optimize the performance of a model system within biologically realistic periods of time under high noise levels. Furthermore, when the model parameters are matched to data recorded during the brain-computer interface learning experiments described above, the model produces learning effects strikingly similar to those found in the experiments.

Entities:  

Mesh:

Year:  2010        PMID: 20573887      PMCID: PMC2917246          DOI: 10.1523/JNEUROSCI.4284-09.2010

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  32 in total

1.  Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning.

Authors:  Jean-Pascal Pfister; Taro Toyoizumi; David Barber; Wulfram Gerstner
Journal:  Neural Comput       Date:  2006-06       Impact factor: 2.026

Review 2.  Useful signals from motor cortex.

Authors:  Andrew B Schwartz
Journal:  J Physiol       Date:  2007-01-25       Impact factor: 5.182

3.  Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity.

Authors:  Yonatan Loewenstein; H Sebastian Seung
Journal:  Proc Natl Acad Sci U S A       Date:  2006-09-28       Impact factor: 11.205

4.  Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity.

Authors:  Răzvan V Florian
Journal:  Neural Comput       Date:  2007-06       Impact factor: 2.026

5.  Functional network reorganization during learning in a brain-computer interface paradigm.

Authors:  Beata Jarosiewicz; Steven M Chase; George W Fraser; Meel Velliste; Robert E Kass; Andrew B Schwartz
Journal:  Proc Natl Acad Sci U S A       Date:  2008-12-01       Impact factor: 11.205

6.  A more biologically plausible learning rule for neural networks.

Authors:  P Mazzoni; R A Andersen; M I Jordan
Journal:  Proc Natl Acad Sci U S A       Date:  1991-05-15       Impact factor: 11.205

7.  Primate motor cortex and free arm movements to visual targets in three-dimensional space. II. Coding of the direction of movement by a neuronal population.

Authors:  A P Georgopoulos; R E Kettner; A B Schwartz
Journal:  J Neurosci       Date:  1988-08       Impact factor: 6.167

8.  Neuronal population coding of movement direction.

Authors:  A P Georgopoulos; A B Schwartz; R E Kettner
Journal:  Science       Date:  1986-09-26       Impact factor: 47.728

Review 9.  Dopamine-dependent plasticity of corticostriatal synapses.

Authors:  John N J Reynolds; Jeffery R Wickens
Journal:  Neural Netw       Date:  2002 Jun-Jul

10.  Emergence of a stable cortical map for neuroprosthetic control.

Authors:  Karunesh Ganguly; Jose M Carmena
Journal:  PLoS Biol       Date:  2009-07-21       Impact factor: 8.029

View more
  34 in total

1.  Behavioral and neural correlates of visuomotor adaptation observed through a brain-computer interface in primary motor cortex.

Authors:  Steven M Chase; Robert E Kass; Andrew B Schwartz
Journal:  J Neurophysiol       Date:  2012-04-11       Impact factor: 2.714

Review 2.  Neural syntax: cell assemblies, synapsembles, and readers.

Authors:  György Buzsáki
Journal:  Neuron       Date:  2010-11-04       Impact factor: 17.173

3.  Distinct types of neural reorganization during long-term learning.

Authors:  Xiao Zhou; Rex N Tien; Sadhana Ravikumar; Steven M Chase
Journal:  J Neurophysiol       Date:  2019-02-06       Impact factor: 2.714

4.  A cortical neural prosthesis for restoring and enhancing memory.

Authors:  Theodore W Berger; Robert E Hampson; Dong Song; Anushka Goonawardena; Vasilis Z Marmarelis; Sam A Deadwyler
Journal:  J Neural Eng       Date:  2011-06-15       Impact factor: 5.379

5.  Predicting non-linear dynamics by stable local learning in a recurrent spiking neural network.

Authors:  Aditya Gilra; Wulfram Gerstner
Journal:  Elife       Date:  2017-11-27       Impact factor: 8.140

6.  The receptive field is dead. Long live the receptive field?

Authors:  Adrienne Fairhall
Journal:  Curr Opin Neurobiol       Date:  2014-03-04       Impact factor: 6.627

Review 7.  Parsing learning in networks using brain-machine interfaces.

Authors:  Amy L Orsborn; Bijan Pesaran
Journal:  Curr Opin Neurobiol       Date:  2017-08-24       Impact factor: 6.627

8.  Explicit and implicit contributions to learning in a sensorimotor adaptation task.

Authors:  Jordan A Taylor; John W Krakauer; Richard B Ivry
Journal:  J Neurosci       Date:  2014-02-19       Impact factor: 6.167

9.  Brain-machine interface in chronic stroke rehabilitation: a controlled study.

Authors:  Ander Ramos-Murguialday; Doris Broetz; Massimiliano Rea; Leonhard Läer; Ozge Yilmaz; Fabricio L Brasil; Giulia Liberati; Marco R Curado; Eliana Garcia-Cossio; Alexandros Vyziotis; Woosang Cho; Manuel Agostini; Ernesto Soares; Surjo Soekadar; Andrea Caria; Leonardo G Cohen; Niels Birbaumer
Journal:  Ann Neurol       Date:  2013-08-07       Impact factor: 10.422

10.  Design of optimal stimulation patterns for neuronal ensembles based on Volterra-type hierarchical modeling.

Authors:  V Z Marmarelis; D C Shin; R E Hampson; S A Deadwyler; D Song; T W Berger
Journal:  J Neural Eng       Date:  2012-10-17       Impact factor: 5.379

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.