Literature DB >> 28581478

Reinstated episodic context guides sampling-based decisions for reward.

Aaron M Bornstein1, Kenneth A Norman1,2.   

Abstract

How does experience inform decisions? In episodic sampling, decisions are guided by a few episodic memories of past choices. This process can yield choice patterns similar to model-free reinforcement learning; however, samples can vary from trial to trial, causing decisions to vary. Here we show that context retrieved during episodic sampling can cause choice behavior to deviate sharply from the predictions of reinforcement learning. Specifically, we show that, when a given memory is sampled, choices (in the present) are influenced by the properties of other decisions made in the same context as the sampled event. This effect is mediated by fMRI measures of context retrieval on each trial, suggesting a mechanism whereby cues trigger retrieval of context, which then triggers retrieval of other decisions from that context. This result establishes a new avenue by which experience can guide choice and, as such, has broad implications for the study of decisions.

Entities:  

Mesh:

Year:  2017        PMID: 28581478     DOI: 10.1038/nn.4573

Source DB:  PubMed          Journal:  Nat Neurosci        ISSN: 1097-6256            Impact factor:   24.884


  14 in total

1.  Dynamic response-by-response models of matching behavior in rhesus monkeys.

Authors:  Brian Lau; Paul W Glimcher
Journal:  J Exp Anal Behav       Date:  2005-11       Impact factor: 2.468

2.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data.

Authors:  Kenneth A Norman; Sean M Polyn; Greg J Detre; James V Haxby
Journal:  Trends Cogn Sci       Date:  2006-08-08       Impact factor: 20.229

Review 3.  Advances in functional and structural MR image analysis and implementation as FSL.

Authors:  Stephen M Smith; Mark Jenkinson; Mark W Woolrich; Christian F Beckmann; Timothy E J Behrens; Heidi Johansen-Berg; Peter R Bannister; Marilena De Luca; Ivana Drobnjak; David E Flitney; Rami K Niazy; James Saunders; John Vickers; Yongyue Zhang; Nicola De Stefano; J Michael Brady; Paul M Matthews
Journal:  Neuroimage       Date:  2004       Impact factor: 6.556

4.  The Psychophysics Toolbox.

Authors:  D H Brainard
Journal:  Spat Vis       Date:  1997

Review 5.  Learning latent structure: carving nature at its joints.

Authors:  Samuel J Gershman; Yael Niv
Journal:  Curr Opin Neurobiol       Date:  2010-03-11       Impact factor: 6.627

6.  Neural context reinstatement predicts memory misattribution.

Authors:  Samuel J Gershman; Anna C Schapiro; Almut Hupbach; Kenneth A Norman
Journal:  J Neurosci       Date:  2013-05-15       Impact factor: 6.167

7.  A context maintenance and retrieval model of organizational processes in free recall.

Authors:  Sean M Polyn; Kenneth A Norman; Michael J Kahana
Journal:  Psychol Rev       Date:  2009-01       Impact factor: 8.934

8.  Learning the value of information in an uncertain world.

Authors:  Timothy E J Behrens; Mark W Woolrich; Mark E Walton; Matthew F S Rushworth
Journal:  Nat Neurosci       Date:  2007-08-05       Impact factor: 24.884

9.  Cortical and hippocampal correlates of deliberation during model-based decisions for rewards in humans.

Authors:  Aaron M Bornstein; Nathaniel D Daw
Journal:  PLoS Comput Biol       Date:  2013-12-05       Impact factor: 4.475

Review 10.  Decision Making and Sequential Sampling from Memory.

Authors:  Michael N Shadlen; Daphna Shohamy
Journal:  Neuron       Date:  2016-06-01       Impact factor: 17.173

View more
  36 in total

1.  Hippocampus Guides Adaptive Learning during Dynamic Social Interactions.

Authors:  Oriel FeldmanHall; David F Montez; Elizabeth A Phelps; Lila Davachi; Vishnu P Murty
Journal:  J Neurosci       Date:  2020-12-23       Impact factor: 6.167

2.  Sampling memory to make profitable choices.

Authors:  Brice A Kuhl; Nicole M Long
Journal:  Nat Neurosci       Date:  2017-06-27       Impact factor: 24.884

3.  Decision-making Increases Episodic Memory via Postencoding Consolidation.

Authors:  Vishnu P Murty; Sarah DuBrow; Lila Davachi
Journal:  J Cogn Neurosci       Date:  2018-07-31       Impact factor: 3.225

Review 4.  Awake Reactivation of Prior Experiences Consolidates Memories and Biases Cognition.

Authors:  Arielle Tambini; Lila Davachi
Journal:  Trends Cogn Sci       Date:  2019-08-22       Impact factor: 20.229

Review 5.  "Chasing the first high": memory sampling in drug choice.

Authors:  Aaron M Bornstein; Hanna Pickard
Journal:  Neuropsychopharmacology       Date:  2020-01-02       Impact factor: 7.853

6.  Manipulating memory efficacy affects the behavioral and neural profiles of deterministic learning and decision-making.

Authors:  Joshua J Tremel; Daniella M Ortiz; Julie A Fiez
Journal:  Neuropsychologia       Date:  2018-04-26       Impact factor: 3.139

7.  Contextual reinstatement promotes extinction generalization in healthy adults but not PTSD.

Authors:  Augustin C Hennings; Mason McClay; Jarrod A Lewis-Peacock; Joseph E Dunsmoor
Journal:  Neuropsychologia       Date:  2020-07-29       Impact factor: 3.139

8.  Memories of control: One-shot episodic learning of item-specific stimulus-control associations.

Authors:  Peter S Whitehead; Christina U Pfeuffer; Tobias Egner
Journal:  Cognition       Date:  2020-02-14

Review 9.  Decoding Cognitive Processes from Neural Ensembles.

Authors:  Joni D Wallis
Journal:  Trends Cogn Sci       Date:  2018-09-29       Impact factor: 20.229

10.  Perceptual decisions based on previously learned information are independent of dopaminergic tone.

Authors:  Alessandra Perugini; Michele A Basso
Journal:  J Neurophysiol       Date:  2017-11-22       Impact factor: 2.714

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.