Literature DB >> 27720488

Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning.

Vincent D Costa1, Olga Dal Monte2, Daniel R Lucas2, Elisabeth A Murray2, Bruno B Averbeck2.   

Abstract

Reinforcement learning (RL) theories posit that dopaminergic signals are integrated within the striatum to associate choices with outcomes. Often overlooked is that the amygdala also receives dopaminergic input and is involved in Pavlovian processes that influence choice behavior. To determine the relative contributions of the ventral striatum (VS) and amygdala to appetitive RL, we tested rhesus macaques with VS or amygdala lesions on deterministic and stochastic versions of a two-arm bandit reversal learning task. When learning was characterized with an RL model relative to controls, amygdala lesions caused general decreases in learning from positive feedback and choice consistency. By comparison, VS lesions only affected learning in the stochastic task. Moreover, the VS lesions hastened the monkeys' choice reaction times, which emphasized a speed-accuracy trade-off that accounted for errors in deterministic learning. These results update standard accounts of RL by emphasizing distinct contributions of the amygdala and VS to RL. Published by Elsevier Inc.

Entities:  

Keywords:  Bayesian; Pearce-Hall; Rescorla-Wagner; amygdala; associability; decision making; lesion; reinforcement learning; speed-accuracy trade-off; ventral striatum

Mesh:

Year:  2016        PMID: 27720488      PMCID: PMC5074688          DOI: 10.1016/j.neuron.2016.09.025

Source DB:  PubMed          Journal:  Neuron        ISSN: 0896-6273            Impact factor:   17.173


  60 in total

1.  A liquid-delivery device that provides precise reward control for neurophysiological and behavioral experiments.

Authors:  Andrew R Mitz
Journal:  J Neurosci Methods       Date:  2005-10-15       Impact factor: 2.390

2.  General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area.

Authors:  Laura H Corbit; Patricia H Janak; Bernard W Balleine
Journal:  Eur J Neurosci       Date:  2007-11-14       Impact factor: 3.386

3.  Optogenetic excitation of central amygdala amplifies and narrows incentive motivation to pursue one reward above another.

Authors:  Mike J F Robinson; Shelley M Warlow; Kent C Berridge
Journal:  J Neurosci       Date:  2014-12-10       Impact factor: 6.167

Review 4.  From circuits to behaviour in the amygdala.

Authors:  Patricia H Janak; Kay M Tye
Journal:  Nature       Date:  2015-01-15       Impact factor: 49.962

5.  Opponent actor learning (OpAL): modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive.

Authors:  Anne G E Collins; Michael J Frank
Journal:  Psychol Rev       Date:  2014-07       Impact factor: 8.934

6.  Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term.

Authors:  Andrew S Hart; Robb B Rutledge; Paul W Glimcher; Paul E M Phillips
Journal:  J Neurosci       Date:  2014-01-15       Impact factor: 6.167

Review 7.  Mini-review: Prediction errors, attention and associative learning.

Authors:  Peter C Holland; Felipe L Schiffino
Journal:  Neurobiol Learn Mem       Date:  2016-03-03       Impact factor: 2.877

8.  Contributions of the amygdala to reward expectancy and choice signals in human prefrontal cortex.

Authors:  Alan N Hampton; Ralph Adolphs; Michael J Tyszka; John P O'Doherty
Journal:  Neuron       Date:  2007-08-16       Impact factor: 17.173

9.  Evidence for model-based computations in the human amygdala during Pavlovian conditioning.

Authors:  Charlotte Prévost; Daniel McNamee; Ryan K Jessup; Peter Bossaerts; John P O'Doherty
Journal:  PLoS Comput Biol       Date:  2013-02-21       Impact factor: 4.475

10.  Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala.

Authors:  Lauren Y Atlas; Bradley B Doll; Jian Li; Nathaniel D Daw; Elizabeth A Phelps
Journal:  Elife       Date:  2016-05-12       Impact factor: 8.140

View more
  49 in total

Review 1.  Age-related variability in decision-making: Insights from neurochemistry.

Authors:  Anne S Berry; William J Jagust; Ming Hsu
Journal:  Cogn Affect Behav Neurosci       Date:  2019-06       Impact factor: 3.282

Review 2.  Specializations for reward-guided decision-making in the primate ventral prefrontal cortex.

Authors:  Elisabeth A Murray; Peter H Rudebeck
Journal:  Nat Rev Neurosci       Date:  2018-07       Impact factor: 34.870

3.  Ventral striatum's role in learning from gains and losses.

Authors:  Craig A Taswell; Vincent D Costa; Elisabeth A Murray; Bruno B Averbeck
Journal:  Proc Natl Acad Sci U S A       Date:  2018-12-13       Impact factor: 11.205

4.  Correlates of Auditory Decision-Making in Prefrontal, Auditory, and Basal Lateral Amygdala Cortical Areas.

Authors:  Julia L Napoli; Corrie R Camalier; Anna-Leigh Brown; Jessica Jacobs; Mortimer M Mishkin; Bruno B Averbeck
Journal:  J Neurosci       Date:  2020-12-10       Impact factor: 6.167

5.  Effects of Ventral Striatum Lesions on Stimulus-Based versus Action-Based Reinforcement Learning.

Authors:  Kathryn M Rothenhoefer; Vincent D Costa; Ramón Bartolo; Raquel Vicario-Feliciano; Elisabeth A Murray; Bruno B Averbeck
Journal:  J Neurosci       Date:  2017-06-16       Impact factor: 6.167

6.  Monkeys are curious about counterfactual outcomes.

Authors:  Maya Zhe Wang; Benjamin Y Hayden
Journal:  Cognition       Date:  2019-03-16

7.  Ventral striatum lesions do not affect reinforcement learning with deterministic outcomes on slow time scales.

Authors:  Raquel Vicario-Feliciano; Elisabeth A Murray; Bruno B Averbeck
Journal:  Behav Neurosci       Date:  2017-08-14       Impact factor: 1.912

8.  Separable Influences of Reward on Visual Processing and Choice.

Authors:  Alireza Soltani; Mohsen Rakhshan; Robert J Schafer; Brittany E Burrows; Tirin Moore
Journal:  J Cogn Neurosci       Date:  2020-11-09       Impact factor: 3.225

9.  The Role of the Amygdala in Value-Based Learning.

Authors:  Cameron D Hassall; Chad C Williams
Journal:  J Neurosci       Date:  2017-07-12       Impact factor: 6.167

10.  Subcortical Substrates of Explore-Exploit Decisions in Primates.

Authors:  Vincent D Costa; Andrew R Mitz; Bruno B Averbeck
Journal:  Neuron       Date:  2019-06-10       Impact factor: 17.173

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.