Literature DB >> 22836263

Reward prediction error signaling in posterior dorsomedial striatum is action specific.

Thomas A Stalnaker1, Gwendolyn G Calhoon, Masaaki Ogawa, Matthew R Roesch, Geoffrey Schoenbaum.   

Abstract

Neural correlates of reward prediction errors (RPEs) have been found in dorsal striatum. Such signals may be important for updating associative action representations within striatum. In order that the appropriate representations can be updated, it might be important for the RPE signal to be specific for the action that led to that error. However, RPEs signaled by midbrain dopamine neurons, which project heavily to striatum, are not action-specific. Here we tested whether RPE-like activity in dorsal striatum is action-specific; we recorded single-unit activity in posterior dorsomedial and dorsolateral striatum as rats performed a task in which the reward predictions associated with two different actions were repeatedly violated, thereby eliciting RPEs. We separately analyzed fast firing neurons (FFNs) and phasically firing neurons (total n = 1076). Only among FFNs recorded in posterior dorsomedial striatum did we find a population with RPE-like characteristics (19 of all 196 FFNs, 10%). This population showed a phasic increase in activity during unexpected rewards, a phasic decrease in activity during unexpected omission of rewards, and a phasic increase in activity during cues when they predicted high-value reward. However, unlike a classical RPE signal, this signal was linked to the action that elicited the prediction error, in that neurons tended to signal RPEs only after their anti-preferred action. This action-specific RPE-like signal could provide a mechanism for updating specific associative action representations in posterior dorsomedial striatum.

Entities:  

Mesh:

Year:  2012        PMID: 22836263      PMCID: PMC3419368          DOI: 10.1523/JNEUROSCI.0832-12.2012

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  46 in total

1.  Tracking the hemodynamic responses to reward and punishment in the striatum.

Authors:  M R Delgado; L E Nystrom; C Fissell; D C Noll; J A Fiez
Journal:  J Neurophysiol       Date:  2000-12       Impact factor: 2.714

2.  A neural correlate of response bias in monkey caudate nucleus.

Authors:  Johan Lauwereyns; Katsumi Watanabe; Brian Coe; Okihide Hikosaka
Journal:  Nature       Date:  2002-07-25       Impact factor: 49.962

Review 3.  Putting a spin on the dorsal-ventral divide of the striatum.

Authors:  Pieter Voorn; Louk J M J Vanderschuren; Henk J Groenewegen; Trevor W Robbins; Cyriel M A Pennartz
Journal:  Trends Neurosci       Date:  2004-08       Impact factor: 13.837

Review 4.  Striatal contributions to reward and decision making: making sense of regional variations in a reiterated processing matrix.

Authors:  Jeffery R Wickens; Christopher S Budd; Brian I Hyland; Gordon W Arbuthnott
Journal:  Ann N Y Acad Sci       Date:  2007-04-07       Impact factor: 5.691

Review 5.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

6.  Cortically driven immediate-early gene expression reflects modular influence of sensorimotor cortex on identified striatal neurons in the squirrel monkey.

Authors:  H B Parthasarathy; A M Graybiel
Journal:  J Neurosci       Date:  1997-04-01       Impact factor: 6.167

7.  Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning.

Authors:  Catherine A Thorn; Hisham Atallah; Mark Howe; Ann M Graybiel
Journal:  Neuron       Date:  2010-06-10       Impact factor: 17.173

8.  Dissociable roles of ventral and dorsal striatum in instrumental conditioning.

Authors:  John O'Doherty; Peter Dayan; Johannes Schultz; Ralf Deichmann; Karl Friston; Raymond J Dolan
Journal:  Science       Date:  2004-04-16       Impact factor: 47.728

9.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards.

Authors:  Matthew R Roesch; Donna J Calu; Geoffrey Schoenbaum
Journal:  Nat Neurosci       Date:  2007-11-18       Impact factor: 24.884

10.  Contributions of striatal subregions to place and response learning.

Authors:  Henry H Yin; Barbara J Knowlton
Journal:  Learn Mem       Date:  2004 Jul-Aug       Impact factor: 2.460

View more
  30 in total

1.  Habit Learning by Naive Macaques Is Marked by Response Sharpening of Striatal Neurons Representing the Cost and Outcome of Acquired Action Sequences.

Authors:  Theresa M Desrochers; Ken-ichi Amemori; Ann M Graybiel
Journal:  Neuron       Date:  2015-08-19       Impact factor: 17.173

2.  Nucleus accumbens responses differentiate execution and restraint in reward-directed behavior.

Authors:  Jamie D Roitman; Amy L Loriaux
Journal:  J Neurophysiol       Date:  2013-10-30       Impact factor: 2.714

Review 3.  From ventral-medial to dorsal-lateral striatum: neural correlates of reward-guided decision-making.

Authors:  Amanda C Burton; Kae Nakamura; Matthew R Roesch
Journal:  Neurobiol Learn Mem       Date:  2014-05-21       Impact factor: 2.877

4.  Hippocampus and subregions of the dorsal striatum respond differently to a behavioral strategy change on a spatial navigation task.

Authors:  Paul S Regier; Seiichiro Amemiya; A David Redish
Journal:  J Neurophysiol       Date:  2015-06-17       Impact factor: 2.714

5.  Differential encoding of action selection by orbitofrontal and striatal population dynamics.

Authors:  Long Yang; Sotiris C Masmanidis
Journal:  J Neurophysiol       Date:  2020-07-29       Impact factor: 2.714

6.  Changes in activity of fast-spiking interneurons of the monkey striatum during reaching at a visual target.

Authors:  Kévin Marche; Paul Apicella
Journal:  J Neurophysiol       Date:  2016-10-12       Impact factor: 2.714

7.  Differential entrainment and learning-related dynamics of spike and local field potential activity in the sensorimotor and associative striatum.

Authors:  Catherine A Thorn; Ann M Graybiel
Journal:  J Neurosci       Date:  2014-02-19       Impact factor: 6.167

8.  Selective effects of dopamine depletion and L-DOPA therapy on learning-related firing dynamics of striatal neurons.

Authors:  Ledia F Hernandez; Yasuo Kubota; Dan Hu; Mark W Howe; Nuné Lemaire; Ann M Graybiel
Journal:  J Neurosci       Date:  2013-03-13       Impact factor: 6.167

9.  Action-specific value signals in reward-related regions of the human brain.

Authors:  Thomas H B FitzGerald; Karl J Friston; Raymond J Dolan
Journal:  J Neurosci       Date:  2012-11-14       Impact factor: 6.167

Review 10.  Using fMRI to study reward processing in humans: past, present, and future.

Authors:  Kainan S Wang; David V Smith; Mauricio R Delgado
Journal:  J Neurophysiol       Date:  2016-01-06       Impact factor: 2.714

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.