Literature DB >> 32001108

Neural Correlates of Reinforcement Learning in Mid-lateral Cerebellum.

Naveen Sendhilnathan1, Mulugeta Semework2, Michael E Goldberg3, Anna E Ipata2.   

Abstract

The role of the cerebellum in non-motor learning is poorly understood. Here, we investigated the activity of Purkinje cells (P-cells) in the mid-lateral cerebellum as the monkey learned to associate one arbitrary symbol with the movement of the left hand and another with the movement of the right hand. During learning, but not when the monkey had learned the association, the simple spike responses of P-cells reported the outcome of the animal's most recent decision without concomitant changes in other sensorimotor parameters such as hand movement, licking, or eye movement. At the population level, P-cells collectively maintained a memory of the most recent decision throughout the entire trial. As the monkeys learned the association, the magnitude of this reward-related error signal approached zero. Our results provide a major departure from the current understanding of cerebellar processing and have critical implications for cerebellum's role in cognitive control.
Copyright © 2020 Elsevier Inc. All rights reserved.

Entities:  

Keywords:  Purkinje cell; cerebellum; cognition; complex spike; crus I; crus II; learning; reinforcement learning; simple spike; visuomotor association learning

Mesh:

Year:  2020        PMID: 32001108      PMCID: PMC8015782          DOI: 10.1016/j.neuron.2019.12.032

Source DB:  PubMed          Journal:  Neuron        ISSN: 0896-6273            Impact factor:   17.173


  46 in total

1.  The cerebellar cognitive profile.

Authors:  Anna M Tedesco; Francesca R Chiricozzi; Silvia Clausi; Michela Lupo; Marco Molinari; Maria G Leggio
Journal:  Brain       Date:  2011-10-27       Impact factor: 13.501

2.  A neural circuit model of flexible sensorimotor mapping: learning and forgetting on multiple timescales.

Authors:  Stefano Fusi; Wael F Asaad; Earl K Miller; Xiao-Jing Wang
Journal:  Neuron       Date:  2007-04-19       Impact factor: 17.173

3.  Evidence of common and separate eye and hand accumulators underlying flexible eye-hand coordination.

Authors:  Sumitash Jana; Atul Gopal; Aditya Murthy
Journal:  J Neurophysiol       Date:  2016-10-26       Impact factor: 2.714

4.  A theory of cerebellar cortex.

Authors:  D Marr
Journal:  J Physiol       Date:  1969-06       Impact factor: 5.182

Review 5.  The Errors of Our Ways: Understanding Error Representations in Cerebellar-Dependent Motor Learning.

Authors:  Laurentiu S Popa; Martha L Streng; Angela L Hewitt; Timothy J Ebner
Journal:  Cerebellum       Date:  2016-04       Impact factor: 3.847

6.  Dissociable contributions of the prefrontal and neocerebellar cortex to time perception.

Authors:  J A Mangels; R B Ivry; N Shimizu
Journal:  Brain Res Cogn Brain Res       Date:  1998-07

Review 7.  The cerebellum and cognitive function: 25 years of insight from anatomy and neuroimaging.

Authors:  Randy L Buckner
Journal:  Neuron       Date:  2013-10-30       Impact factor: 17.173

8.  Coordinated cerebellar climbing fiber activity signals learned sensorimotor predictions.

Authors:  William Heffley; Eun Young Song; Ziye Xu; Benjamin N Taylor; Mary Anne Hughes; Andrew McKinney; Mati Joshua; Court Hull
Journal:  Nat Neurosci       Date:  2018-09-17       Impact factor: 24.884

9.  Cerebellar Contribution to Preparatory Activity in Motor Neocortex.

Authors:  Francois P Chabrol; Antonin Blot; Thomas D Mrsic-Flogel
Journal:  Neuron       Date:  2019-06-11       Impact factor: 17.173

10.  Cerebellar contributions to cognitive functions: a progress report after two decades of research.

Authors:  Dagmar Timmann; Irene Daum
Journal:  Cerebellum       Date:  2007       Impact factor: 3.648

View more
  23 in total

Review 1.  Diversity and dynamism in the cerebellum.

Authors:  Chris I De Zeeuw; Stephen G Lisberger; Jennifer L Raymond
Journal:  Nat Neurosci       Date:  2020-12-07       Impact factor: 24.884

2.  Impulsivity in Cerebellar Ataxias: Testing the Cerebellar Reward Hypothesis in Humans.

Authors:  Nadia Amokrane; Anisha Viswanathan; Samantha Freedman; Chen-Ya Yang; Natasha A Desai; Ming-Kai Pan; Sheng-Han Kuo; Chi-Ying Lin
Journal:  Mov Disord       Date:  2020-06-04       Impact factor: 10.338

3.  Research on the cerebellum yields rewards.

Authors:  Jennifer L Raymond
Journal:  Nature       Date:  2020-03       Impact factor: 49.962

Review 4.  Bidirectional learning in upbound and downbound microzones of the cerebellum.

Authors:  Chris I De Zeeuw
Journal:  Nat Rev Neurosci       Date:  2020-11-17       Impact factor: 34.870

Review 5.  Cortico-cerebellar interactions during goal-directed behavior.

Authors:  Nuo Li; Thomas D Mrsic-Flogel
Journal:  Curr Opin Neurobiol       Date:  2020-09-24       Impact factor: 6.627

6.  Encoding of eye movements explains reward-related activity in cerebellar simple spikes.

Authors:  Adi Lixenberg; Merav Yarkoni; Yehudit Botschko; Mati Joshua
Journal:  J Neurophysiol       Date:  2020-01-15       Impact factor: 2.714

7.  VTA-projecting cerebellar neurons mediate stress-dependent depression-like behaviors.

Authors:  Soo Ji Baek; Jin Sung Park; Jinhyun Kim; Yukio Yamamoto; Keiko Tanaka-Yamamoto
Journal:  Elife       Date:  2022-02-14       Impact factor: 8.140

8.  What do Reinforcement Learning Models Measure? Interpreting Model Parameters in Cognition and Neuroscience.

Authors:  Maria K Eckstein; Linda Wilbrecht; Anne G E Collins
Journal:  Curr Opin Behav Sci       Date:  2021-07-03

9.  Reward-Based Learning and Emotional Habit Formation in the Cerebellum.

Authors:  Jordan E Pierce; Julie A Péron
Journal:  Adv Exp Med Biol       Date:  2022       Impact factor: 3.650

Review 10.  The Rules of Cerebellar Learning: Around the Ito Hypothesis.

Authors:  Stephen G Lisberger
Journal:  Neuroscience       Date:  2020-08-29       Impact factor: 3.590

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.