Literature DB >> 24320851

Dopamine ramps are a consequence of reward prediction errors.

Samuel J Gershman1.   

Abstract

Temporal difference learning models of dopamine assert that phasic levels of dopamine encode a reward prediction error. However, this hypothesis has been challenged by recent observations of gradually ramping stratal dopamine levels as a goal is approached. This note describes conditions under which temporal difference learning models predict dopamine ramping. The key idea is representational: a quadratic transformation of proximity to the goal implies approximately linear ramping, as observed experimentally.

Entities:  

Mesh:

Substances:

Year:  2013        PMID: 24320851     DOI: 10.1162/NECO_a_00559

Source DB:  PubMed          Journal:  Neural Comput        ISSN: 0899-7667            Impact factor:   2.026


  21 in total

1.  Ramping ensemble activity in dorsal anterior cingulate neurons during persistent commitment to a decision.

Authors:  Tommy C Blanchard; Caleb E Strait; Benjamin Y Hayden
Journal:  J Neurophysiol       Date:  2015-09-02       Impact factor: 2.714

2.  Surprise! Dopamine signals mix action, value and error.

Authors:  Anne G E Collins; Michael J Frank
Journal:  Nat Neurosci       Date:  2016-01       Impact factor: 24.884

3.  Slowly evolving dopaminergic activity modulates the moment-to-moment probability of reward-related self-timed movements.

Authors:  Allison E Hamilos; Giulia Spedicato; Ye Hong; Fangmiao Sun; Yulong Li; John A Assad
Journal:  Elife       Date:  2021-12-23       Impact factor: 8.140

Review 4.  Dopamine Does Double Duty in Motivating Cognitive Effort.

Authors:  Andrew Westbrook; Todd S Braver
Journal:  Neuron       Date:  2016-02-17       Impact factor: 17.173

5.  A Unified Framework for Dopamine Signals across Timescales.

Authors:  HyungGoo R Kim; Athar N Malik; John G Mikhael; Pol Bech; Iku Tsutsui-Kimura; Fangmiao Sun; Yajun Zhang; Yulong Li; Mitsuko Watabe-Uchida; Samuel J Gershman; Naoshige Uchida
Journal:  Cell       Date:  2020-11-27       Impact factor: 41.582

6.  Wave-like dopamine dynamics as a mechanism for spatiotemporal credit assignment.

Authors:  Arif A Hamid; Michael J Frank; Christopher I Moore
Journal:  Cell       Date:  2021-04-15       Impact factor: 41.582

7.  Rigid reduced successor representation as a potential mechanism for addiction.

Authors:  Kanji Shimomura; Ayaka Kato; Kenji Morita
Journal:  Eur J Neurosci       Date:  2021-05-10       Impact factor: 3.386

8.  The role of state uncertainty in the dynamics of dopamine.

Authors:  John G Mikhael; HyungGoo R Kim; Naoshige Uchida; Samuel J Gershman
Journal:  Curr Biol       Date:  2022-02-02       Impact factor: 10.834

Review 9.  Dopamine, Updated: Reward Prediction Error and Beyond.

Authors:  Talia N Lerner; Ashley L Holloway; Jillian L Seiler
Journal:  Curr Opin Neurobiol       Date:  2020-11-14       Impact factor: 6.627

Review 10.  A mosaic of cost-benefit control over cortico-striatal circuitry.

Authors:  Andrew Westbrook; Michael J Frank; Roshan Cools
Journal:  Trends Cogn Sci       Date:  2021-06-10       Impact factor: 24.482

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.