Literature DB >> 23658169

Limited encoding of effort by dopamine neurons in a cost-benefit trade-off task.

Benjamin Pasquereau1, Robert S Turner.   

Abstract

Animals are thought to evaluate the desirability of action options using a unified scale that combines predicted benefits ("rewards"), costs, and the animal's internal motivational state. Midbrain dopamine neurons have long been associated with the reward part of this equation, but it is unclear whether these neurons also estimate the costs of taking an action. We studied the spiking activity of dopamine neurons in the substantia nigra pars compacta of monkeys (Macaca mulatta) during a reaching task in which the energetic costs incurred (friction loads) and the benefits gained (drops of food) were manipulated independently. Although the majority of dopamine neurons encoded the upcoming reward alone, a subset predicted net utility of a course of action by signaling the expected reward magnitude discounted by the invested cost in terms of physical effort. In addition, the tonic activity of some dopamine neurons was slowly reduced in conjunction with the accumulated trials, which is consistent with the hypothesized role for tonic dopamine in the invigoration or motivation of instrumental responding. The present results shed light on an often-hypothesized role for dopamine in the regulation of the balance in natural behaviors between the energy expended and the benefits gained, which could explain why dopamine disorders, such as Parkinson's disease, lead to a breakdown of that balance.

Entities:  

Mesh:

Year:  2013        PMID: 23658169      PMCID: PMC3698042          DOI: 10.1523/JNEUROSCI.4619-12.2013

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  48 in total

1.  Optimal feedback control as a theory of motor coordination.

Authors:  Emanuel Todorov; Michael I Jordan
Journal:  Nat Neurosci       Date:  2002-11       Impact factor: 24.884

2.  Phasic nucleus accumbens dopamine release encodes effort- and delay-related costs.

Authors:  Jeremy J Day; Joshua L Jones; R Mark Wightman; Regina M Carelli
Journal:  Biol Psychiatry       Date:  2010-05-10       Impact factor: 13.382

Review 3.  Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits.

Authors:  J D Salamone; M Correa; A Farrar; S M Mingote
Journal:  Psychopharmacology (Berl)       Date:  2007-01-16       Impact factor: 4.530

Review 4.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

5.  Tests of functional equivalence between pimozide pretreatment, extinction and free feeding.

Authors:  P Willner; K Chawla; D Sampson; S Sophokleous; R Muscat
Journal:  Psychopharmacology (Berl)       Date:  1988       Impact factor: 4.530

6.  Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort.

Authors:  F Denk; M E Walton; K A Jennings; T Sharp; M F S Rushworth; D M Bannerman
Journal:  Psychopharmacology (Berl)       Date:  2004-12-10       Impact factor: 4.530

7.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards.

Authors:  Matthew R Roesch; Donna J Calu; Geoffrey Schoenbaum
Journal:  Nat Neurosci       Date:  2007-11-18       Impact factor: 24.884

8.  A common optimization principle for motor execution in healthy subjects and parkinsonian patients.

Authors:  Pierre Baraduc; Stéphane Thobois; Jing Gan; Emmanuel Broussolle; Michel Desmurget
Journal:  J Neurosci       Date:  2013-01-09       Impact factor: 6.167

9.  The temporal precision of reward prediction in dopamine neurons.

Authors:  Christopher D Fiorillo; William T Newsome; Wolfram Schultz
Journal:  Nat Neurosci       Date:  2008-08       Impact factor: 24.884

10.  Dopaminergic Balance between Reward Maximization and Policy Complexity.

Authors:  Naama Parush; Naftali Tishby; Hagai Bergman
Journal:  Front Syst Neurosci       Date:  2011-05-09
View more
  39 in total

1.  Optimizing effort: increased efficiency of motor memory with time away from practice.

Authors:  Sarah E Pekny; Reza Shadmehr
Journal:  J Neurophysiol       Date:  2014-10-29       Impact factor: 2.714

2.  Movement-related discharge in the macaque globus pallidus during high-frequency stimulation of the subthalamic nucleus.

Authors:  Andrew J Zimnik; Gerald J Nora; Michel Desmurget; Robert S Turner
Journal:  J Neurosci       Date:  2015-03-04       Impact factor: 6.167

3.  Separate mesocortical and mesolimbic pathways encode effort and reward learning signals.

Authors:  Tobias U Hauser; Eran Eldar; Raymond J Dolan
Journal:  Proc Natl Acad Sci U S A       Date:  2017-08-14       Impact factor: 11.205

4.  Control of movement vigor and decision making during foraging.

Authors:  Tehrim Yoon; Robert B Geary; Alaa A Ahmed; Reza Shadmehr
Journal:  Proc Natl Acad Sci U S A       Date:  2018-10-15       Impact factor: 11.205

5.  Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys.

Authors:  Chiara Varazzani; Aurore San-Galli; Sophie Gilardeau; Sebastien Bouret
Journal:  J Neurosci       Date:  2015-05-20       Impact factor: 6.167

6.  Overlapping patterns of brain activation to food and cocaine cues in cocaine abusers: association to striatal D2/D3 receptors.

Authors:  Dardo Tomasi; Gene-Jack Wang; Ruiliang Wang; Elisabeth C Caparelli; Jean Logan; Nora D Volkow
Journal:  Hum Brain Mapp       Date:  2014-08-21       Impact factor: 5.038

7.  Dopamine prediction error responses update demand.

Authors:  Kathryn M Rothenhoefer; William R Stauffer
Journal:  Proc Natl Acad Sci U S A       Date:  2017-12-12       Impact factor: 11.205

8.  Dopamine-associated cached values are not sufficient as the basis for action selection.

Authors:  Nick G Hollon; Monica M Arnold; Jerylin O Gan; Mark E Walton; Paul E M Phillips
Journal:  Proc Natl Acad Sci U S A       Date:  2014-12-08       Impact factor: 11.205

9.  Missing motoric manipulations: rethinking the imaging of the ventral striatum and dopamine in human reward.

Authors:  David A Kareken
Journal:  Brain Imaging Behav       Date:  2019-04       Impact factor: 3.978

10.  Movement vigor as a traitlike attribute of individuality.

Authors:  Thomas R Reppert; Ioannis Rigas; David J Herzfeld; Ehsan Sedaghat-Nejad; Oleg Komogortsev; Reza Shadmehr
Journal:  J Neurophysiol       Date:  2018-05-16       Impact factor: 2.714

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.