Literature DB >> 34882092

Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference.

Lorenz Deserno1,2,3,4, Rani Moran1,2, Jochen Michely1,2,5, Ying Lee1,2,4, Peter Dayan1,6,7, Raymond J Dolan1,2.   

Abstract

Dopamine is implicated in representing model-free (MF) reward prediction errors a as well as influencing model-based (MB) credit assignment and choice. Putative cooperative interactions between MB and MF systems include a guidance of MF credit assignment by MB inference. Here, we used a double-blind, placebo-controlled, within-subjects design to test an hypothesis that enhancing dopamine levels boosts the guidance of MF credit assignment by MB inference. In line with this, we found that levodopa enhanced guidance of MF credit assignment by MB inference, without impacting MF and MB influences directly. This drug effect correlated negatively with a dopamine-dependent change in purely MB credit assignment, possibly reflecting a trade-off between these two MB components of behavioural control. Our findings of a dopamine boost in MB inference guidance of MF learning highlight a novel DA influence on MB-MF cooperative interactions.
© 2021, Deserno et al.

Entities:  

Keywords:  dopamine; human; model-free/model-based; neuroscience; reinforcement learning

Mesh:

Substances:

Year:  2021        PMID: 34882092      PMCID: PMC8758138          DOI: 10.7554/eLife.67778

Source DB:  PubMed          Journal:  Elife        ISSN: 2050-084X            Impact factor:   8.140


  58 in total

1.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.

Authors:  Nathaniel D Daw; Yael Niv; Peter Dayan
Journal:  Nat Neurosci       Date:  2005-11-06       Impact factor: 24.884

2.  Addiction as a computational process gone awry.

Authors:  A David Redish
Journal:  Science       Date:  2004-12-10       Impact factor: 47.728

Review 3.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates.

Authors:  B W Balleine; A Dickinson
Journal:  Neuropharmacology       Date:  1998 Apr-May       Impact factor: 5.250

Review 4.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning.

Authors:  P R Montague; P Dayan; T J Sejnowski
Journal:  J Neurosci       Date:  1996-03-01       Impact factor: 6.167

Review 5.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

Review 6.  Power failure: why small sample size undermines the reliability of neuroscience.

Authors:  Katherine S Button; John P A Ioannidis; Claire Mokrysz; Brian A Nosek; Jonathan Flint; Emma S J Robinson; Marcus R Munafò
Journal:  Nat Rev Neurosci       Date:  2013-04-10       Impact factor: 34.870

7.  Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans.

Authors:  Mathias Pessiglione; Ben Seymour; Guillaume Flandin; Raymond J Dolan; Chris D Frith
Journal:  Nature       Date:  2006-08-23       Impact factor: 49.962

8.  Dopamine enhances model-based over model-free choice behavior.

Authors:  Klaus Wunderlich; Peter Smittenaar; Raymond J Dolan
Journal:  Neuron       Date:  2012-08-09       Impact factor: 17.173

9.  Prioritized memory access explains planning and hippocampal replay.

Authors:  Marcelo G Mattar; Nathaniel D Daw
Journal:  Nat Neurosci       Date:  2018-10-22       Impact factor: 24.884

Review 10.  Addiction is driven by excessive goal-directed drug choice under negative affect: translational critique of habit and compulsion theory.

Authors:  Lee Hogarth
Journal:  Neuropsychopharmacology       Date:  2020-01-06       Impact factor: 7.853

View more
  1 in total

1.  Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference.

Authors:  Lorenz Deserno; Rani Moran; Jochen Michely; Ying Lee; Peter Dayan; Raymond J Dolan
Journal:  Elife       Date:  2021-12-09       Impact factor: 8.140

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.