Literature DB >> 25378157

Episodic memory encoding interferes with reward learning and decreases striatal prediction errors.

G Elliott Wimmer1, Erin Kendall Braun2, Nathaniel D Daw3, Daphna Shohamy4.   

Abstract

Learning is essential for adaptive decision making. The striatum and its dopaminergic inputs are known to support incremental reward-based learning, while the hippocampus is known to support encoding of single events (episodic memory). Although traditionally studied separately, in even simple experiences, these two types of learning are likely to co-occur and may interact. Here we sought to understand the nature of this interaction by examining how incremental reward learning is related to concurrent episodic memory encoding. During the experiment, human participants made choices between two options (colored squares), each associated with a drifting probability of reward, with the goal of earning as much money as possible. Incidental, trial-unique object pictures, unrelated to the choice, were overlaid on each option. The next day, participants were given a surprise memory test for these pictures. We found that better episodic memory was related to a decreased influence of recent reward experience on choice, both within and across participants. fMRI analyses further revealed that during learning the canonical striatal reward prediction error signal was significantly weaker when episodic memory was stronger. This decrease in reward prediction error signals in the striatum was associated with enhanced functional connectivity between the hippocampus and striatum at the time of choice. Our results suggest a mechanism by which memory encoding may compete for striatal processing and provide insight into how interactions between different forms of learning guide reward-based decision making.
Copyright © 2014 the authors 0270-6474/14/3414901-12$15.00/0.

Entities:  

Keywords:  decision making; hippocampus; learning; memory; reward; striatum

Mesh:

Year:  2014        PMID: 25378157      PMCID: PMC4220024          DOI: 10.1523/JNEUROSCI.0204-14.2014

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  73 in total

Review 1.  Model-based fMRI and its application to reward learning and decision making.

Authors:  John P O'Doherty; Alan Hampton; Hackjin Kim
Journal:  Ann N Y Acad Sci       Date:  2007-04-07       Impact factor: 5.691

Review 2.  A framework for studying the neurobiology of value-based decision making.

Authors:  Antonio Rangel; Colin Camerer; P Read Montague
Journal:  Nat Rev Neurosci       Date:  2008-06-11       Impact factor: 34.870

Review 3.  Structure and function of declarative and nondeclarative memory systems.

Authors:  L R Squire; S M Zola
Journal:  Proc Natl Acad Sci U S A       Date:  1996-11-26       Impact factor: 11.205

Review 4.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

5.  Neural correlates of encoding in an incidental learning paradigm.

Authors:  K A Paller; M Kutas; A R Mayes
Journal:  Electroencephalogr Clin Neurophysiol       Date:  1987-10

Review 6.  Signal-detectability theory of recognition-memory performance.

Authors:  T E Parks
Journal:  Psychol Rev       Date:  1966-01       Impact factor: 8.934

7.  Cooperation between the hippocampus and the striatum during episodic encoding.

Authors:  Talya Sadeh; Daphna Shohamy; Dana Rubi Levy; Niv Reggev; Anat Maril
Journal:  J Cogn Neurosci       Date:  2010-07-28       Impact factor: 3.225

8.  Ventromedial prefrontal cortex activation is associated with memory formation for predictable rewards.

Authors:  Katharina A Bialleck; Hans-Peter Schaal; Thorsten A Kranz; Juergen Fell; Christian E Elger; Nikolai Axmacher
Journal:  PLoS One       Date:  2011-02-04       Impact factor: 3.240

9.  Positive outcomes enhance incidental learning for both younger and older adults.

Authors:  Mara Mather; Andrej Schoeke
Journal:  Front Neurosci       Date:  2011-11-21       Impact factor: 4.677

10.  Associative learning of social value.

Authors:  Timothy E J Behrens; Laurence T Hunt; Mark W Woolrich; Matthew F S Rushworth
Journal:  Nature       Date:  2008-11-13       Impact factor: 49.962

View more
  36 in total

1.  The simple act of choosing influences declarative memory.

Authors:  Vishnu P Murty; Sarah DuBrow; Lila Davachi
Journal:  J Neurosci       Date:  2015-04-22       Impact factor: 6.167

2.  Signed Reward Prediction Errors in the Ventral Striatum Drive Episodic Memory.

Authors:  Cristian B Calderon; Esther De Loof; Kate Ergo; Anna Snoeck; Carsten N Boehler; Tom Verguts
Journal:  J Neurosci       Date:  2020-12-17       Impact factor: 6.167

Review 3.  Memory systems 2018 - Towards a new paradigm.

Authors:  J Ferbinteanu
Journal:  Neurobiol Learn Mem       Date:  2018-11-13       Impact factor: 2.877

4.  Reward Learning over Weeks Versus Minutes Increases the Neural Representation of Value in the Human Brain.

Authors:  G Elliott Wimmer; Jamie K Li; Krzysztof J Gorgolewski; Russell A Poldrack
Journal:  J Neurosci       Date:  2018-07-30       Impact factor: 6.167

5.  Attenuation of dopamine-modulated prefrontal value signals underlies probabilistic reward learning deficits in old age.

Authors:  Lieke de Boer; Jan Axelsson; Katrine Riklund; Lars Nyberg; Peter Dayan; Lars Bäckman; Marc Guitart-Masip
Journal:  Elife       Date:  2017-09-05       Impact factor: 8.140

6.  Feedback timing modulates interactions between feedback processing and memory encoding: Evidence from event-related potentials.

Authors:  Gerrit Höltje; Axel Mecklinger
Journal:  Cogn Affect Behav Neurosci       Date:  2020-04       Impact factor: 3.282

7.  Dissociable effects of surprising rewards on learning and memory.

Authors:  Nina Rouhani; Kenneth A Norman; Yael Niv
Journal:  J Exp Psychol Learn Mem Cogn       Date:  2018-03-19       Impact factor: 3.051

8.  Neural Signatures of Prediction Errors in a Decision-Making Task Are Modulated by Action Execution Failures.

Authors:  Samuel D McDougle; Peter A Butcher; Darius E Parvin; Fasial Mushtaq; Yael Niv; Richard B Ivry; Jordan A Taylor
Journal:  Curr Biol       Date:  2019-05-02       Impact factor: 10.834

9.  Theta band network supporting human episodic memory is not activated in the seizure onset zone.

Authors:  James J Young; Peter H Rudebeck; Lara V Marcuse; Madeline C Fields; Ji Yeoun Yoo; Fedor Panov; Saadi Ghatan; Arash Fazl; Sarah Mandelbaum; Mark G Baxter
Journal:  Neuroimage       Date:  2018-08-23       Impact factor: 6.556

Review 10.  Using fMRI to study reward processing in humans: past, present, and future.

Authors:  Kainan S Wang; David V Smith; Mauricio R Delgado
Journal:  J Neurophysiol       Date:  2016-01-06       Impact factor: 2.714

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.