Literature DB >> 35584665

Choice-selective sequences dominate in cortical relative to thalamic inputs to NAc to support reinforcement learning.

Nathan F Parker1, Avinash Baidya2, Julia Cox3, Laura M Haetzel1, Anna Zhukovskaya1, Malavika Murugan1, Ben Engelhard1, Mark S Goldman4, Ilana B Witten5.   

Abstract

How are actions linked with subsequent outcomes to guide choices? The nucleus accumbens, which is implicated in this process, receives glutamatergic inputs from the prelimbic cortex and midline regions of the thalamus. However, little is known about whether and how representations differ across these input pathways. By comparing these inputs during a reinforcement learning task in mice, we discovered that prelimbic cortical inputs preferentially represent actions and choices, whereas midline thalamic inputs preferentially represent cues. Choice-selective activity in the prelimbic cortical inputs is organized in sequences that persist beyond the outcome. Through computational modeling, we demonstrate that these sequences can support the neural implementation of reinforcement-learning algorithms, in both a circuit model based on synaptic plasticity and one based on neural dynamics. Finally, we test and confirm a prediction of our circuit models by direct manipulation of nucleus accumbens input neurons.
Copyright © 2022 The Author(s). Published by Elsevier Inc. All rights reserved.

Entities:  

Keywords:  CP: Neuroscience; circuit modeling; imaging; learning; nucleus accumbens; optogenetics; prelimbic; reinforcement learning; thalamus

Mesh:

Year:  2022        PMID: 35584665      PMCID: PMC9218875          DOI: 10.1016/j.celrep.2022.110756

Source DB:  PubMed          Journal:  Cell Rep            Impact factor:   9.995


  128 in total

1.  Social modulation of sequence and syllable variability in adult birdsong.

Authors:  Jon T Sakata; Cara M Hampton; Michael S Brainard
Journal:  J Neurophysiol       Date:  2008-01-23       Impact factor: 2.714

2.  GABA and enkephalin projection from the nucleus accumbens and ventral pallidum to the ventral tegmental area.

Authors:  P W Kalivas; L Churchill; M A Klitenick
Journal:  Neuroscience       Date:  1993-12       Impact factor: 3.590

3.  A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task.

Authors:  R E Suri; W Schultz
Journal:  Neuroscience       Date:  1999       Impact factor: 3.590

4.  Paraventricular Thalamus Projection Neurons Integrate Cortical and Hypothalamic Signals for Cue-Reward Processing.

Authors:  James M Otis; ManHua Zhu; Vijay M K Namboodiri; Cory A Cook; Oksana Kosyk; Ana M Matan; Rose Ying; Yoshiko Hashikawa; Koichi Hashikawa; Ivan Trujillo-Pisanty; Jiami Guo; Randall L Ung; Jose Rodriguez-Romaguera; E S Anton; Garret D Stuber
Journal:  Neuron       Date:  2019-06-10       Impact factor: 17.173

5.  Enhanced Population Coding for Rewarded Choices in the Medial Frontal Cortex of the Mouse.

Authors:  Michael J Siniscalchi; Hongli Wang; Alex C Kwan
Journal:  Cereb Cortex       Date:  2019-09-13       Impact factor: 5.357

6.  Hidden Parameter Markov Decision Processes: A Semiparametric Regression Approach for Discovering Latent Task Parametrizations.

Authors:  Finale Doshi-Velez; George Konidaris
Journal:  IJCAI (U S)       Date:  2016-07

Review 7.  Reinforcement Learning, Fast and Slow.

Authors:  Matthew Botvinick; Sam Ritter; Jane X Wang; Zeb Kurth-Nelson; Charles Blundell; Demis Hassabis
Journal:  Trends Cogn Sci       Date:  2019-04-16       Impact factor: 20.229

Review 8.  Beyond dichotomies in reinforcement learning.

Authors:  Anne G E Collins; Jeffrey Cockburn
Journal:  Nat Rev Neurosci       Date:  2020-09-01       Impact factor: 34.870

9.  Internally generated cell assembly sequences in the rat hippocampus.

Authors:  Eva Pastalkova; Vladimir Itskov; Asohan Amarasingham; György Buzsáki
Journal:  Science       Date:  2008-09-05       Impact factor: 47.728

10.  Excitatory transmission from the amygdala to nucleus accumbens facilitates reward seeking.

Authors:  Garret D Stuber; Dennis R Sparta; Alice M Stamatakis; Wieke A van Leeuwen; Juanita E Hardjoprajitno; Saemi Cho; Kay M Tye; Kimberly A Kempadoo; Feng Zhang; Karl Deisseroth; Antonello Bonci
Journal:  Nature       Date:  2011-06-29       Impact factor: 49.962

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.