Literature DB >> 28808037

Separate mesocortical and mesolimbic pathways encode effort and reward learning signals.

Tobias U Hauser1,2, Eran Eldar3,2, Raymond J Dolan3,2.   

Abstract

Optimal decision making mandates organisms learn the relevant features of choice options. Likewise, knowing how much effort we should expend can assume paramount importance. A mesolimbic network supports reward learning, but it is unclear whether other choice features, such as effort learning, rely on this same network. Using computational fMRI, we show parallel encoding of effort and reward prediction errors (PEs) within distinct brain regions, with effort PEs expressed in dorsomedial prefrontal cortex and reward PEs in ventral striatum. We show a common mesencephalic origin for these signals evident in overlapping, but spatially dissociable, dopaminergic midbrain regions expressing both types of PE. During action anticipation, reward and effort expectations were integrated in ventral striatum, consistent with a computation of an overall net benefit of a stimulus. Thus, we show that motivationally relevant stimulus features are learned in parallel dopaminergic pathways, with formation of an integrated utility signal at choice.

Entities:  

Keywords:  apathy; dorsomedial prefrontal cortex; effort prediction errors; reward prediction errors; substantia nigra/ventral tegmental area

Mesh:

Year:  2017        PMID: 28808037      PMCID: PMC5584432          DOI: 10.1073/pnas.1705643114

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  94 in total

1.  Structural covariance in the human cortex.

Authors:  Andrea Mechelli; Karl J Friston; Richard S Frackowiak; Cathy J Price
Journal:  J Neurosci       Date:  2005-09-07       Impact factor: 6.167

Review 2.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

3.  Learning to minimize efforts versus maximizing rewards: computational principles and neural correlates.

Authors:  Vasilisa Skvortsova; Stefano Palminteri; Mathias Pessiglione
Journal:  J Neurosci       Date:  2014-11-19       Impact factor: 6.167

Review 4.  The mysterious motivational functions of mesolimbic dopamine.

Authors:  John D Salamone; Mercè Correa
Journal:  Neuron       Date:  2012-11-08       Impact factor: 17.173

5.  Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort.

Authors:  F Denk; M E Walton; K A Jennings; T Sharp; M F S Rushworth; D M Bannerman
Journal:  Psychopharmacology (Berl)       Date:  2004-12-10       Impact factor: 4.530

6.  Striatal prediction error modulates cortical coupling.

Authors:  Hanneke E M den Ouden; Jean Daunizeau; Jonathan Roiser; Karl J Friston; Klaas E Stephan
Journal:  J Neurosci       Date:  2010-03-03       Impact factor: 6.167

7.  Subsecond dopamine fluctuations in human striatum encode superposed error signals about actual and counterfactual reward.

Authors:  Kenneth T Kishida; Ignacio Saez; Terry Lohrenz; Mark R Witcher; Adrian W Laxton; Stephen B Tatter; Jason P White; Thomas L Ellis; Paul E M Phillips; P Read Montague
Journal:  Proc Natl Acad Sci U S A       Date:  2015-11-23       Impact factor: 11.205

Review 8.  Apathy: a neuropsychiatric syndrome.

Authors:  R S Marin
Journal:  J Neuropsychiatry Clin Neurosci       Date:  1991       Impact factor: 2.198

9.  Neural mechanisms of foraging.

Authors:  Nils Kolling; Timothy E J Behrens; Rogier B Mars; Matthew F S Rushworth
Journal:  Science       Date:  2012-04-06       Impact factor: 47.728

10.  Dopamine, time, and impulsivity in humans.

Authors:  Alex Pine; Tamara Shiner; Ben Seymour; Raymond J Dolan
Journal:  J Neurosci       Date:  2010-06-30       Impact factor: 6.167

View more
  33 in total

1.  Abnormalities of striatal morphology in gambling disorder and at-risk gambling.

Authors:  Jon E Grant; Masanori Isobe; Samuel R Chamberlain
Journal:  CNS Spectr       Date:  2019-12       Impact factor: 3.790

2.  EEG correlates of physical effort and reward processing during reinforcement learning.

Authors:  Dimitrios J Palidis; Paul L Gribble
Journal:  J Neurophysiol       Date:  2020-07-29       Impact factor: 2.714

3.  Anhedonia in depression: biological mechanisms and computational models.

Authors:  Jessica A Cooper; Amanda R Arulpragasam; Michael T Treadway
Journal:  Curr Opin Behav Sci       Date:  2018-08

4.  Computational mechanisms of curiosity and goal-directed exploration.

Authors:  Philipp Schwartenbeck; Johannes Passecker; Tobias U Hauser; Thomas Hb FitzGerald; Martin Kronbichler; Karl J Friston
Journal:  Elife       Date:  2019-05-10       Impact factor: 8.140

5.  Dopamine-Dependent Loss Aversion during Effort-Based Decision-Making.

Authors:  Xiuli Chen; Sarah Voets; Ned Jenkinson; Joseph M Galea
Journal:  J Neurosci       Date:  2019-11-14       Impact factor: 6.167

6.  Dopaminergic modulation of reward discounting in healthy rats: a systematic review and meta-analysis.

Authors:  Jaime J Castrellon; James Meade; Lucy Greenwald; Katlyn Hurst; Gregory R Samanez-Larkin
Journal:  Psychopharmacology (Berl)       Date:  2020-11-19       Impact factor: 4.530

7.  Dopamine Differentially Regulates Response Dynamics of Prefrontal Cortical Principal Neurons and Interneurons to Optogenetic Stimulation of Inputs from Ventral Tegmental Area.

Authors:  Ping Zhong; Luye Qin; Zhen Yan
Journal:  Cereb Cortex       Date:  2020-06-30       Impact factor: 5.357

8.  Local and distributed cortical markers of effort expenditure during sustained goal pursuit.

Authors:  Lauren M Patrick; Kevin M Anderson; Avram J Holmes
Journal:  Neuroimage       Date:  2021-09-23       Impact factor: 6.556

9.  Anticipatory energization revealed by pupil and brain activity guides human effort-based decision making.

Authors:  Irma T Kurniawan; Marcus Grueschow; Christian C Ruff
Journal:  J Neurosci       Date:  2021-06-07       Impact factor: 6.167

Review 10.  Using pharmacological manipulations to study the role of dopamine in human reward functioning: A review of studies in healthy adults.

Authors:  Heather E Webber; Paula Lopez-Gamundi; Sydney N Stamatovich; Harriet de Wit; Margaret C Wardle
Journal:  Neurosci Biobehav Rev       Date:  2020-11-14       Impact factor: 8.989

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.