Literature DB >> 25716849

Distinct neural representation in the dorsolateral, dorsomedial, and ventral parts of the striatum during fixed- and free-choice tasks.

Makoto Ito1, Kenji Doya2.   

Abstract

The striatum is a major input site of the basal ganglia, which play an essential role in decision making. Previous studies have suggested that subareas of the striatum have distinct roles: the dorsolateral striatum (DLS) functions in habitual action, the dorsomedial striatum (DMS) in goal-directed actions, and the ventral striatum (VS) in motivation. To elucidate distinctive functions of subregions of the striatum in decision making, we systematically investigated information represented by phasically active neurons in DLS, DMS, and VS. Rats performed two types of choice tasks: fixed- and free-choice tasks. In both tasks, rats were required to perform nose poking to either the left or right hole after cue-tone presentation. A food pellet was delivered probabilistically depending on the presented cue and the selected action. The reward probability was fixed in fixed-choice task and varied in a block-wise manner in free-choice task. We found the following: (1) when rats began the tasks, a majority of VS neurons increased their firing rates and information regarding task type and state value was most strongly represented in VS; (2) during action selection, information of action and action values was most strongly represented in DMS; (3) action-command information (action representation before action selection) was stronger in the fixed-choice task than in the free-choice task in both DLS and DMS; and (4) action-command information was strongest in DLS, particularly when the same choice was repeated. We propose a hypothesis of hierarchical reinforcement learning in the basal ganglia to coherently explain these results.
Copyright © 2015 the authors 0270-6474/15/353499-16$15.00/0.

Entities:  

Keywords:  action value; basal ganglia; decision making; reinforcement learning; state value; striatum

Mesh:

Year:  2015        PMID: 25716849      PMCID: PMC4339358          DOI: 10.1523/JNEUROSCI.1962-14.2015

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  44 in total

1.  What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?

Authors:  K Doya
Journal:  Neural Netw       Date:  1999-10

Review 2.  Putting a spin on the dorsal-ventral divide of the striatum.

Authors:  Pieter Voorn; Louk J M J Vanderschuren; Henk J Groenewegen; Trevor W Robbins; Cyriel M A Pennartz
Journal:  Trends Neurosci       Date:  2004-08       Impact factor: 13.837

3.  Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning.

Authors:  Henry H Yin; Barbara J Knowlton; Bernard W Balleine
Journal:  Behav Brain Res       Date:  2005-09-08       Impact factor: 3.332

Review 4.  Model-based fMRI and its application to reward learning and decision making.

Authors:  John P O'Doherty; Alan Hampton; Hackjin Kim
Journal:  Ann N Y Acad Sci       Date:  2007-04-07       Impact factor: 5.691

Review 5.  Striatal contributions to reward and decision making: making sense of regional variations in a reiterated processing matrix.

Authors:  Jeffery R Wickens; Christopher S Budd; Brian I Hyland; Gordon W Arbuthnott
Journal:  Ann N Y Acad Sci       Date:  2007-04-07       Impact factor: 5.691

6.  Neural computations underlying action-based decision making in the human brain.

Authors:  Klaus Wunderlich; Antonio Rangel; John P O'Doherty
Journal:  Proc Natl Acad Sci U S A       Date:  2009-09-28       Impact factor: 11.205

7.  Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning.

Authors:  Catherine A Thorn; Hisham Atallah; Mark Howe; Ann M Graybiel
Journal:  Neuron       Date:  2010-06-10       Impact factor: 17.173

8.  Dissociable roles of ventral and dorsal striatum in instrumental conditioning.

Authors:  John O'Doherty; Peter Dayan; Johannes Schultz; Ralf Deichmann; Karl Friston; Raymond J Dolan
Journal:  Science       Date:  2004-04-16       Impact factor: 47.728

Review 9.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex.

Authors:  Rudolf N Cardinal; John A Parkinson; Jeremy Hall; Barry J Everitt
Journal:  Neurosci Biobehav Rev       Date:  2002-05       Impact factor: 8.989

10.  Silencing the critics: understanding the effects of cocaine sensitization on dorsolateral and ventral striatum in the context of an actor/critic model.

Authors:  Yuji Takahashi; Geoffrey Schoenbaum; Yael Niv
Journal:  Front Neurosci       Date:  2008-07-09       Impact factor: 4.677

View more
  33 in total

1.  Differential encoding of action selection by orbitofrontal and striatal population dynamics.

Authors:  Long Yang; Sotiris C Masmanidis
Journal:  J Neurophysiol       Date:  2020-07-29       Impact factor: 2.714

2.  Striatal action-value neurons reconsidered.

Authors:  Lotem Elber-Dorozko; Yonatan Loewenstein
Journal:  Elife       Date:  2018-05-31       Impact factor: 8.140

3.  Striosome-dendron bouquets highlight a unique striatonigral circuit targeting dopamine-containing neurons.

Authors:  Jill R Crittenden; Paul W Tillberg; Michael H Riad; Yasuyuki Shima; Charles R Gerfen; Jeffrey Curry; David E Housman; Sacha B Nelson; Edward S Boyden; Ann M Graybiel
Journal:  Proc Natl Acad Sci U S A       Date:  2016-09-19       Impact factor: 11.205

4.  An open cortico-basal ganglia loop allows limbic control over motor output via the nigrothalamic pathway.

Authors:  Sho Aoki; Jared B Smith; Hao Li; Xunyi Yan; Masakazu Igarashi; Patrice Coulon; Jeffery R Wickens; Tom Jh Ruigrok; Xin Jin
Journal:  Elife       Date:  2019-09-06       Impact factor: 8.140

5.  Stable Representations of Decision Variables for Flexible Behavior.

Authors:  Bilal A Bari; Cooper D Grossman; Emily E Lubin; Adithya E Rajagopalan; Jianna I Cressy; Jeremiah Y Cohen
Journal:  Neuron       Date:  2019-07-04       Impact factor: 17.173

6.  Neural substrate of dynamic Bayesian inference in the cerebral cortex.

Authors:  Akihiro Funamizu; Bernd Kuhn; Kenji Doya
Journal:  Nat Neurosci       Date:  2016-09-19       Impact factor: 24.884

7.  Spatial representations in the superior colliculus are modulated by competition among targets.

Authors:  Mario J Lintz; Jaclyn Essig; Joel Zylberberg; Gidon Felsen
Journal:  Neuroscience       Date:  2019-04-11       Impact factor: 3.590

Review 8.  Using fMRI to study reward processing in humans: past, present, and future.

Authors:  Kainan S Wang; David V Smith; Mauricio R Delgado
Journal:  J Neurophysiol       Date:  2016-01-06       Impact factor: 2.714

9.  Basal ganglia output reflects internally-specified movements.

Authors:  Mario J Lintz; Gidon Felsen
Journal:  Elife       Date:  2016-07-05       Impact factor: 8.140

10.  Fractionating choice: A study on reward discrimination, preference, and relative valuation in the rat (Rattus norvegicus).

Authors:  Joshua M Ricker; Justin D Hatch; Daniel D Powers; Howard Casey Cromwell
Journal:  J Comp Psychol       Date:  2016-04-14       Impact factor: 2.231

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.