Literature DB >> 28910622

Dopamine Neurons Respond to Errors in the Prediction of Sensory Features of Expected Rewards.

Yuji K Takahashi1, Hannah M Batchelor2, Bing Liu2, Akash Khanna3, Marisela Morales2, Geoffrey Schoenbaum4.   

Abstract

Midbrain dopamine neurons have been proposed to signal prediction errors as defined in model-free reinforcement learning algorithms. While these algorithms have been extremely powerful in interpreting dopamine activity, these models do not register any error unless there is a difference between the value of what is predicted and what is received. Yet learning often occurs in response to changes in the unique features that characterize what is received, sometimes with no change in its value at all. Here, we show that classic error-signaling dopamine neurons also respond to changes in value-neutral sensory features of an expected reward. This suggests that dopamine neurons have access to a wider variety of information than contemplated by the models currently used to interpret their activity and that, while their firing may conform to predictions of these models in some cases, they are not restricted to signaling errors in the prediction of value. Published by Elsevier Inc.

Entities:  

Keywords:  dopamine; learning; prediction error; rodent; single unit

Mesh:

Year:  2017        PMID: 28910622      PMCID: PMC5658021          DOI: 10.1016/j.neuron.2017.08.025

Source DB:  PubMed          Journal:  Neuron        ISSN: 0896-6273            Impact factor:   17.173


  44 in total

1.  Midbrain dopamine neurons encode decisions for future action.

Authors:  Genela Morris; Alon Nevet; David Arkadir; Eilon Vaadia; Hagai Bergman
Journal:  Nat Neurosci       Date:  2006-07-23       Impact factor: 24.884

Review 2.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

Review 3.  Dopamine reward prediction-error signalling: a two-component response.

Authors:  Wolfram Schultz
Journal:  Nat Rev Neurosci       Date:  2016-02-11       Impact factor: 34.870

Review 4.  Dopamine: generalization and bonuses.

Authors:  Sham Kakade; Peter Dayan
Journal:  Neural Netw       Date:  2002 Jun-Jul

5.  Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term.

Authors:  Andrew S Hart; Robb B Rutledge; Paul W Glimcher; Paul E M Phillips
Journal:  J Neurosci       Date:  2014-01-15       Impact factor: 6.167

6.  The temporal precision of reward prediction in dopamine neurons.

Authors:  Christopher D Fiorillo; William T Newsome; Wolfram Schultz
Journal:  Nat Neurosci       Date:  2008-08       Impact factor: 24.884

7.  Start/stop signals emerge in nigrostriatal circuits during sequence learning.

Authors:  Xin Jin; Rui M Costa
Journal:  Nature       Date:  2010-07-22       Impact factor: 49.962

8.  Dopamine transients are sufficient and necessary for acquisition of model-based associations.

Authors:  Melissa J Sharpe; Chun Yun Chang; Melissa A Liu; Hannah M Batchelor; Lauren E Mueller; Joshua L Jones; Yael Niv; Geoffrey Schoenbaum
Journal:  Nat Neurosci       Date:  2017-04-03       Impact factor: 24.884

9.  Differential Dopamine Release Dynamics in the Nucleus Accumbens Core and Shell Reveal Complementary Signals for Error Prediction and Incentive Motivation.

Authors:  Michael P Saddoris; Fabio Cacciapaglia; R Mark Wightman; Regina M Carelli
Journal:  J Neurosci       Date:  2015-08-19       Impact factor: 6.167

10.  Dopamine reward prediction error responses reflect marginal utility.

Authors:  William R Stauffer; Armin Lak; Wolfram Schultz
Journal:  Curr Biol       Date:  2014-10-02       Impact factor: 10.834

View more
  55 in total

1.  Sweet and bitter taste stimuli activate VTA projection neurons in the parabrachial nucleus.

Authors:  John D Boughter; Lianyi Lu; Louis N Saites; Kenichi Tokita
Journal:  Brain Res       Date:  2019-02-23       Impact factor: 3.252

2.  Rethinking dopamine as generalized prediction error.

Authors:  Matthew P H Gardner; Geoffrey Schoenbaum; Samuel J Gershman
Journal:  Proc Biol Sci       Date:  2018-11-21       Impact factor: 5.349

3.  The Successor Representation: Its Computational Logic and Neural Substrates.

Authors:  Samuel J Gershman
Journal:  J Neurosci       Date:  2018-07-13       Impact factor: 6.167

Review 4.  Hallucinations and Strong Priors.

Authors:  Philip R Corlett; Guillermo Horga; Paul C Fletcher; Ben Alderson-Day; Katharina Schmack; Albert R Powers
Journal:  Trends Cogn Sci       Date:  2018-12-21       Impact factor: 20.229

5.  Assessing Reality Testing in Mice Through Dopamine-Dependent Associatively Evoked Processing of Absent Gustatory Stimuli.

Authors:  Benjamin R Fry; Nicollette Russell; Ryan Gifford; Cindee F Robles; Claire E Manning; Akira Sawa; Minae Niwa; Alexander W Johnson
Journal:  Schizophr Bull       Date:  2020-01-04       Impact factor: 9.306

6.  Loss of striatal tyrosine-hydroxylase interneurons impairs instrumental goal-directed behavior.

Authors:  Jaime Kaminer; Diego Espinoza; Shaznaan Bhimani; James M Tepper; Tibor Koos; Michael W Shiflett
Journal:  Eur J Neurosci       Date:  2019-05-02       Impact factor: 3.386

7.  Novelty, Salience, and Surprise Timing Are Signaled by Neurons in the Basal Forebrain.

Authors:  Kaining Zhang; Charles D Chen; Ilya E Monosov
Journal:  Curr Biol       Date:  2018-12-20       Impact factor: 10.834

8.  Ventral Tegmental Dopamine Neurons Participate in Reward Identity Predictions.

Authors:  Ronald Keiflin; Heather J Pribut; Nisha B Shah; Patricia H Janak
Journal:  Curr Biol       Date:  2018-12-20       Impact factor: 10.834

9.  Orbitofrontal State Representations Are Related to Choice Adaptations and Reward Predictions.

Authors:  Thomas A Stalnaker; Nishika Raheja; Geoffrey Schoenbaum
Journal:  J Neurosci       Date:  2021-01-14       Impact factor: 6.167

10.  Frontostriatal network dysfunction as a domain-general mechanism underlying phantom perception.

Authors:  Jeffrey Hullfish; Ian Abenes; Hye Bin Yoo; Dirk De Ridder; Sven Vanneste
Journal:  Hum Brain Mapp       Date:  2019-01-15       Impact factor: 5.038

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.