Literature DB >> 19346478

Learning reward timing in cortex through reward dependent expression of synaptic plasticity.

Jeffrey P Gavornik1, Marshall G Hussain Shuler, Yonatan Loewenstein, Mark F Bear, Harel Z Shouval.   

Abstract

The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representations is lacking. It is commonly believed that the underlying cellular mechanisms reside in high order cortical regions but recent studies show sustained neural activity in primary sensory cortices that can represent the timing of expected reward. Here, we show that local cortical networks can learn temporal representations through a simple framework predicated on reward dependent expression of synaptic plasticity. We assert that temporal representations are stored in the lateral synaptic connections between neurons and demonstrate that reward-modulated plasticity is sufficient to learn these representations. We implement our model numerically to explain reward-time learning in the primary visual cortex (V1), demonstrate experimental support, and suggest additional experimentally verifiable predictions.

Mesh:

Year:  2009        PMID: 19346478      PMCID: PMC2672535          DOI: 10.1073/pnas.0901835106

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  52 in total

Review 1.  Synaptic reverberation underlying mnemonic persistent activity.

Authors:  X J Wang
Journal:  Trends Neurosci       Date:  2001-08       Impact factor: 13.837

2.  Short-term memory in orthogonal neural networks.

Authors:  Olivia L White; Daniel D Lee; Haim Sompolinsky
Journal:  Phys Rev Lett       Date:  2004-04-09       Impact factor: 9.161

3.  Remembering the time: a continuous clock.

Authors:  Penelope A Lewis; R Chris Miall
Journal:  Trends Cogn Sci       Date:  2006-08-08       Impact factor: 20.229

4.  Timing in the absence of clocks: encoding time in neural network states.

Authors:  Uma R Karmarkar; Dean V Buonomano
Journal:  Neuron       Date:  2007-02-01       Impact factor: 17.173

5.  Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity.

Authors:  Yonatan Loewenstein; H Sebastian Seung
Journal:  Proc Natl Acad Sci U S A       Date:  2006-09-28       Impact factor: 11.205

6.  Responses of neurons in primary auditory cortex (A1) to pure tones in the halothane-anesthetized cat.

Authors:  Dina Moshitch; Liora Las; Nachum Ulanovsky; Omer Bar-Yosef; Israel Nelken
Journal:  J Neurophysiol       Date:  2006-03-22       Impact factor: 2.714

7.  Synaptic tagging and long-term potentiation.

Authors:  U Frey; R G Morris
Journal:  Nature       Date:  1997-02-06       Impact factor: 49.962

8.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex.

Authors:  D J Amit; N Brunel
Journal:  Cereb Cortex       Date:  1997 Apr-May       Impact factor: 5.357

9.  Microcircuitry of forward and feedback connections within rat visual cortex.

Authors:  R R Johnson; A Burkhalter
Journal:  J Comp Neurol       Date:  1996-05-06       Impact factor: 3.215

10.  Disruption of central cholinergic systems in the rat by basal forebrain lesions or atropine: effects on feeding, sensorimotor behaviour, locomotor activity and spatial navigation.

Authors:  I Q Whishaw; W T O'Connor; S B Dunnett
Journal:  Behav Brain Res       Date:  1985 Sep-Oct       Impact factor: 3.332

View more
  34 in total

1.  A single spiking neuron that can represent interval timing: analysis, plasticity and multi-stability.

Authors:  Harel Z Shouval; Jeffrey P Gavornik
Journal:  J Comput Neurosci       Date:  2010-09-09       Impact factor: 1.621

2.  A network of spiking neurons that can represent interval timing: mean field analysis.

Authors:  Jeffrey P Gavornik; Harel Z Shouval
Journal:  J Comput Neurosci       Date:  2010-09-10       Impact factor: 1.621

3.  Changes in S1 neural responses during tactile discrimination learning.

Authors:  Michael C Wiest; Eric Thomson; Janaina Pantoja; Miguel A L Nicolelis
Journal:  J Neurophysiol       Date:  2010-05-05       Impact factor: 2.714

4.  Networks that learn the precise timing of event sequences.

Authors:  Alan Veliz-Cuba; Harel Z Shouval; Krešimir Josić; Zachary P Kilpatrick
Journal:  J Comput Neurosci       Date:  2015-09-03       Impact factor: 1.621

5.  Relational associative learning induces cross-modal plasticity in early visual cortex.

Authors:  Drew B Headley; Norman M Weinberger
Journal:  Cereb Cortex       Date:  2013-11-24       Impact factor: 5.357

6.  Selective activation of a putative reinforcement signal conditions cued interval timing in primary visual cortex.

Authors:  Cheng-Hang Liu; Jason E Coleman; Heydar Davoudi; Kechen Zhang; Marshall G Hussain Shuler
Journal:  Curr Biol       Date:  2015-05-21       Impact factor: 10.834

7.  Theta Oscillations in Visual Cortex Emerge with Experience to Convey Expected Reward Time and Experienced Reward Rate.

Authors:  Camila L Zold; Marshall G Hussain Shuler
Journal:  J Neurosci       Date:  2015-07-01       Impact factor: 6.167

8.  Encoding Time in Feedforward Trajectories of a Recurrent Neural Network Model.

Authors:  N F Hardy; Dean V Buonomano
Journal:  Neural Comput       Date:  2017-11-21       Impact factor: 2.026

9.  Neurocomputational Models of Interval and Pattern Timing.

Authors:  Nicholas F Hardy; Dean V Buonomano
Journal:  Curr Opin Behav Sci       Date:  2016-02-12

10.  Distinct Eligibility Traces for LTP and LTD in Cortical Synapses.

Authors:  Kaiwen He; Marco Huertas; Su Z Hong; XiaoXiu Tie; Johannes W Hell; Harel Shouval; Alfredo Kirkwood
Journal:  Neuron       Date:  2015-10-22       Impact factor: 17.173

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.