Literature DB >> 33734085

Learning precise spatiotemporal sequences via biophysically realistic learning rules in a modular, spiking network.

Ian Cone1,2, Harel Z Shouval1.   

Abstract

Multiple brain regions are able to learn and express temporal sequences, and this functionality is an essential component of learning and memory. We propose a substrate for such representations via a network model that learns and recalls discrete sequences of variable order and duration. The model consists of a network of spiking neurons placed in a modular microcolumn based architecture. Learning is performed via a biophysically realistic learning rule that depends on synaptic 'eligibility traces'. Before training, the network contains no memory of any particular sequence. After training, presentation of only the first element in that sequence is sufficient for the network to recall an entire learned representation of the sequence. An extended version of the model also demonstrates the ability to successfully learn and recall non-Markovian sequences. This model provides a possible framework for biologically plausible sequence learning and memory, in agreement with recent experimental results.
© 2021, Cone and Shouval.

Entities:  

Keywords:  neuroscience; none; reinforcement learning; sequences; systems modeling

Year:  2021        PMID: 33734085      PMCID: PMC7972481          DOI: 10.7554/eLife.63751

Source DB:  PubMed          Journal:  Elife        ISSN: 2050-084X            Impact factor:   8.140


  63 in total

Review 1.  Synaptic reverberation underlying mnemonic persistent activity.

Authors:  X J Wang
Journal:  Trends Neurosci       Date:  2001-08       Impact factor: 13.837

Review 2.  Dynamics and plasticity of stimulus-selective persistent activity in cortical network models.

Authors:  Nicolas Brunel
Journal:  Cereb Cortex       Date:  2003-11       Impact factor: 5.357

3.  Pattern separation in the dentate gyrus and CA3 of the hippocampus.

Authors:  Jill K Leutgeb; Stefan Leutgeb; May-Britt Moser; Edvard I Moser
Journal:  Science       Date:  2007-02-16       Impact factor: 47.728

4.  Reward timing in the primary visual cortex.

Authors:  Marshall G Shuler; Mark F Bear
Journal:  Science       Date:  2006-03-17       Impact factor: 47.728

5.  Spike-time-dependent plasticity and heterosynaptic competition organize networks to produce long scale-free sequences of neural activity.

Authors:  Ila R Fiete; Walter Senn; Claude Z H Wang; Richard H R Hahnloser
Journal:  Neuron       Date:  2010-02-25       Impact factor: 17.173

6.  Generating coherent patterns of activity from chaotic neural networks.

Authors:  David Sussillo; L F Abbott
Journal:  Neuron       Date:  2009-08-27       Impact factor: 17.173

7.  Activity recall in a visual cortical ensemble.

Authors:  Shengjin Xu; Wanchen Jiang; Mu-Ming Poo; Yang Dan
Journal:  Nat Neurosci       Date:  2012-01-22       Impact factor: 24.884

Review 8.  Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules.

Authors:  Nicolas Frémaux; Wulfram Gerstner
Journal:  Front Neural Circuits       Date:  2016-01-19       Impact factor: 3.492

9.  Unsupervised Learning of Persistent and Sequential Activity.

Authors:  Ulises Pereira; Nicolas Brunel
Journal:  Front Comput Neurosci       Date:  2020-01-17       Impact factor: 2.380

10.  Why Neurons Have Thousands of Synapses, a Theory of Sequence Memory in Neocortex.

Authors:  Jeff Hawkins; Subutai Ahmad
Journal:  Front Neural Circuits       Date:  2016-03-30       Impact factor: 3.492

View more
  5 in total

1.  Sequence learning, prediction, and replay in networks of spiking neurons.

Authors:  Younes Bouhadjar; Dirk J Wouters; Markus Diesmann; Tom Tetzlaff
Journal:  PLoS Comput Biol       Date:  2022-06-21       Impact factor: 4.779

2.  A series of unforced events.

Authors:  Paul Miller
Journal:  Neuron       Date:  2022-01-05       Impact factor: 18.688

3.  The spatiotemporal organization of experience dictates hippocampal involvement in primary visual cortical plasticity.

Authors:  Peter S B Finnie; Robert W Komorowski; Mark F Bear
Journal:  Curr Biol       Date:  2021-07-26       Impact factor: 10.900

4.  Encoding time in neural dynamic regimes with distinct computational tradeoffs.

Authors:  Shanglin Zhou; Sotiris C Masmanidis; Dean V Buonomano
Journal:  PLoS Comput Biol       Date:  2022-03-03       Impact factor: 4.475

5.  Thunderstruck: The ACDC model of flexible sequences and rhythms in recurrent neural circuits.

Authors:  Cristian Buc Calderon; Tom Verguts; Michael J Frank
Journal:  PLoS Comput Biol       Date:  2022-02-02       Impact factor: 4.475

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.