Literature DB >> 28805428

Ventral striatum lesions do not affect reinforcement learning with deterministic outcomes on slow time scales.

Raquel Vicario-Feliciano1, Elisabeth A Murray1, Bruno B Averbeck1.   

Abstract

A large body of work has implicated the ventral striatum (VS) in aspects of reinforcement learning (RL). However, less work has directly examined the effects of lesions in the VS, or other forms of inactivation, on 2-armed bandit RL tasks. We have recently found that lesions in the VS in macaque monkeys affect learning with stochastic schedules but have minimal effects with deterministic schedules. The reasons for this are not currently clear. Because our previous work used short intertrial intervals, one possibility is that the animals were using working memory to bridge stimulus-reward associations from 1 trial to the next. In the present study, we examined learning of 60 pairs of objects, in which the animals received only 1 trial per day with each pair. The large number of object pairs and the long interval (approximately 24 hr) between trials with a given pair minimized the chances that the animals could use working memory to bridge trials. We found that monkeys with VS lesions were unimpaired relative to controls, which suggests that animals with VS lesions can still learn to select rewarded objects even when they cannot make use of working memory. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Entities:  

Mesh:

Year:  2017        PMID: 28805428      PMCID: PMC5620131          DOI: 10.1037/bne0000211

Source DB:  PubMed          Journal:  Behav Neurosci        ISSN: 0735-7044            Impact factor:   1.912


  42 in total

1.  Injection of a dopamine type 2 receptor antagonist into the dorsal striatum disrupts choices driven by previous outcomes, but not perceptual inference.

Authors:  Eunjeong Lee; Moonsang Seo; Olga Dal Monte; Bruno B Averbeck
Journal:  J Neurosci       Date:  2015-04-22       Impact factor: 6.167

Review 2.  Motivational neural circuits underlying reinforcement learning.

Authors:  Bruno B Averbeck; Vincent D Costa
Journal:  Nat Neurosci       Date:  2017-03-29       Impact factor: 24.884

3.  Predictability modulates human brain response to reward.

Authors:  G S Berns; S M McClure; G Pagnoni; P R Montague
Journal:  J Neurosci       Date:  2001-04-15       Impact factor: 6.167

4.  Differential effects of excitotoxic lesions of the basolateral amygdala, ventral subiculum and medial prefrontal cortex on responding with conditioned reinforcement and locomotor activity potentiated by intra-accumbens infusions of D-amphetamine.

Authors:  L H Burns; T W Robbins; B J Everitt
Journal:  Behav Brain Res       Date:  1993-06-30       Impact factor: 3.332

5.  Frontal-temporal disconnection abolishes object discrimination learning set in macaque monkeys.

Authors:  Philip G F Browning; Alexander Easton; David Gaffan
Journal:  Cereb Cortex       Date:  2006-05-17       Impact factor: 5.357

6.  Opponent actor learning (OpAL): modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive.

Authors:  Anne G E Collins; Michael J Frank
Journal:  Psychol Rev       Date:  2014-07       Impact factor: 8.934

7.  Dissociable roles of ventral and dorsal striatum in instrumental conditioning.

Authors:  John O'Doherty; Peter Dayan; Johannes Schultz; Ralf Deichmann; Karl Friston; Raymond J Dolan
Journal:  Science       Date:  2004-04-16       Impact factor: 47.728

Review 8.  Reinforcement Learning and Episodic Memory in Humans and Animals: An Integrative Framework.

Authors:  Samuel J Gershman; Nathaniel D Daw
Journal:  Annu Rev Psychol       Date:  2016-09-02       Impact factor: 24.137

Review 9.  Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex.

Authors:  Rudolf N Cardinal; John A Parkinson; Jeremy Hall; Barry J Everitt
Journal:  Neurosci Biobehav Rev       Date:  2002-05       Impact factor: 8.989

10.  Differential Dopamine Release Dynamics in the Nucleus Accumbens Core and Shell Reveal Complementary Signals for Error Prediction and Incentive Motivation.

Authors:  Michael P Saddoris; Fabio Cacciapaglia; R Mark Wightman; Regina M Carelli
Journal:  J Neurosci       Date:  2015-08-19       Impact factor: 6.167

View more
  2 in total

1.  Ventral striatum's role in learning from gains and losses.

Authors:  Craig A Taswell; Vincent D Costa; Elisabeth A Murray; Bruno B Averbeck
Journal:  Proc Natl Acad Sci U S A       Date:  2018-12-13       Impact factor: 11.205

Review 2.  Reinforcement-learning in fronto-striatal circuits.

Authors:  Bruno Averbeck; John P O'Doherty
Journal:  Neuropsychopharmacology       Date:  2021-08-05       Impact factor: 7.853

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.