Literature DB >> 29096115

Model-based predictions for dopamine.

Angela J Langdon1, Melissa J Sharpe2, Geoffrey Schoenbaum3, Yael Niv4.   

Abstract

Phasic dopamine responses are thought to encode a prediction-error signal consistent with model-free reinforcement learning theories. However, a number of recent findings highlight the influence of model-based computations on dopamine responses, and suggest that dopamine prediction errors reflect more dimensions of an expected outcome than scalar reward value. Here, we review a selection of these recent results and discuss the implications and complications of model-based predictions for computational theories of dopamine and learning.
Copyright © 2017. Published by Elsevier Ltd.

Entities:  

Mesh:

Substances:

Year:  2017        PMID: 29096115      PMCID: PMC6034703          DOI: 10.1016/j.conb.2017.10.006

Source DB:  PubMed          Journal:  Curr Opin Neurobiol        ISSN: 0959-4388            Impact factor:   6.627


  64 in total

Review 1.  The algorithmic anatomy of model-based evaluation.

Authors:  Nathaniel D Daw; Peter Dayan
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2014-11-05       Impact factor: 6.237

2.  Midbrain Dopamine Neurons Signal Belief in Choice Accuracy during a Perceptual Decision.

Authors:  Armin Lak; Kensaku Nomoto; Mehdi Keramati; Masamichi Sakagami; Adam Kepecs
Journal:  Curr Biol       Date:  2017-03-09       Impact factor: 10.834

3.  Dopamine neurons report an error in the temporal prediction of reward during learning.

Authors:  J R Hollerman; W Schultz
Journal:  Nat Neurosci       Date:  1998-08       Impact factor: 24.884

4.  Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments.

Authors:  Yuan Chang Leong; Angela Radulescu; Reka Daniel; Vivian DeWoskin; Yael Niv
Journal:  Neuron       Date:  2017-01-18       Impact factor: 17.173

Review 5.  The orbitofrontal oracle: cortical mechanisms for the prediction and evaluation of specific behavioral outcomes.

Authors:  Peter H Rudebeck; Elisabeth A Murray
Journal:  Neuron       Date:  2014-12-17       Impact factor: 17.173

Review 6.  Learning latent structure: carving nature at its joints.

Authors:  Samuel J Gershman; Yael Niv
Journal:  Curr Opin Neurobiol       Date:  2010-03-11       Impact factor: 6.627

7.  A cellular mechanism of reward-related learning.

Authors:  J N Reynolds; B I Hyland; J R Wickens
Journal:  Nature       Date:  2001-09-06       Impact factor: 49.962

8.  Decision making under uncertainty: a neural model based on partially observable markov decision processes.

Authors:  Rajesh P N Rao
Journal:  Front Comput Neurosci       Date:  2010-11-24       Impact factor: 2.380

9.  Time representation in reinforcement learning models of the basal ganglia.

Authors:  Samuel J Gershman; Ahmed A Moustafa; Elliot A Ludvig
Journal:  Front Comput Neurosci       Date:  2014-01-09       Impact factor: 2.380

10.  Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target.

Authors:  Nathan F Parker; Courtney M Cameron; Joshua P Taliaferro; Junuk Lee; Jung Yoon Choi; Thomas J Davidson; Nathaniel D Daw; Ilana B Witten
Journal:  Nat Neurosci       Date:  2016-04-25       Impact factor: 24.884

View more
  33 in total

Review 1.  Learning task-state representations.

Authors:  Yael Niv
Journal:  Nat Neurosci       Date:  2019-09-24       Impact factor: 24.884

2.  Rethinking dopamine as generalized prediction error.

Authors:  Matthew P H Gardner; Geoffrey Schoenbaum; Samuel J Gershman
Journal:  Proc Biol Sci       Date:  2018-11-21       Impact factor: 5.349

Review 3.  Hallucinations and Strong Priors.

Authors:  Philip R Corlett; Guillermo Horga; Paul C Fletcher; Ben Alderson-Day; Katharina Schmack; Albert R Powers
Journal:  Trends Cogn Sci       Date:  2018-12-21       Impact factor: 20.229

4.  Assessing Reality Testing in Mice Through Dopamine-Dependent Associatively Evoked Processing of Absent Gustatory Stimuli.

Authors:  Benjamin R Fry; Nicollette Russell; Ryan Gifford; Cindee F Robles; Claire E Manning; Akira Sawa; Minae Niwa; Alexander W Johnson
Journal:  Schizophr Bull       Date:  2020-01-04       Impact factor: 9.306

5.  Response-based outcome predictions and confidence regulate feedback processing and learning.

Authors:  Romy Frömer; Matthew R Nassar; Rasmus Bruckner; Birgit Stürmer; Werner Sommer; Nick Yeung
Journal:  Elife       Date:  2021-04-30       Impact factor: 8.140

6.  Catecholaminergic modulation of meta-learning.

Authors:  Hanneke Em den Ouden; Roshan Cools; Jennifer L Cook; Jennifer C Swart; Monja I Froböse; Andreea O Diaconescu; Dirk Em Geurts
Journal:  Elife       Date:  2019-12-18       Impact factor: 8.140

7.  Distinct temporal difference error signals in dopamine axons in three regions of the striatum in a decision-making task.

Authors:  Iku Tsutsui-Kimura; Hideyuki Matsumoto; Korleki Akiti; Melissa M Yamada; Naoshige Uchida; Mitsuko Watabe-Uchida
Journal:  Elife       Date:  2020-12-21       Impact factor: 8.140

8.  Expectancy-Related Changes in Dopaminergic Error Signals Are Impaired by Cocaine Self-Administration.

Authors:  Yuji K Takahashi; Thomas A Stalnaker; Yasmin Marrero-Garcia; Ray M Rada; Geoffrey Schoenbaum
Journal:  Neuron       Date:  2019-01-16       Impact factor: 17.173

Review 9.  Holistic Reinforcement Learning: The Role of Structure and Attention.

Authors:  Angela Radulescu; Yael Niv; Ian Ballard
Journal:  Trends Cogn Sci       Date:  2019-02-26       Impact factor: 20.229

10.  Neural Signatures of Prediction Errors in a Decision-Making Task Are Modulated by Action Execution Failures.

Authors:  Samuel D McDougle; Peter A Butcher; Darius E Parvin; Fasial Mushtaq; Yael Niv; Richard B Ivry; Jordan A Taylor
Journal:  Curr Biol       Date:  2019-05-02       Impact factor: 10.834

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.