Literature DB >> 22487032

Dissociating hippocampal and striatal contributions to sequential prediction learning.

Aaron M Bornstein1, Nathaniel D Daw.   

Abstract

Behavior may be generated on the basis of many different kinds of learned contingencies. For instance, responses could be guided by the direct association between a stimulus and response, or by sequential stimulus-stimulus relationships (as in model-based reinforcement learning or goal-directed actions). However, the neural architecture underlying sequential predictive learning is not well understood, in part because it is difficult to isolate its effect on choice behavior. To track such learning more directly, we examined reaction times (RTs) in a probabilistic sequential picture identification task in healthy individuals. We used computational learning models to isolate trial-by-trial effects of two distinct learning processes in behavior, and used these as signatures to analyse the separate neural substrates of each process. RTs were best explained via the combination of two delta rule learning processes with different learning rates. To examine neural manifestations of these learning processes, we used functional magnetic resonance imaging to seek correlates of time-series related to expectancy or surprise. We observed such correlates in two regions, hippocampus and striatum. By estimating the learning rates best explaining each signal, we verified that they were uniquely associated with one of the two distinct processes identified behaviorally. These differential correlates suggest that complementary anticipatory functions drive each region's effect on behavior. Our results provide novel insights as to the quantitative computational distinctions between medial temporal and basal ganglia learning networks and enable experiments that exploit trial-by-trial measurement of the unique contributions of both hippocampus and striatum to response behavior.
© 2012 The Authors. European Journal of Neuroscience © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.

Entities:  

Mesh:

Year:  2012        PMID: 22487032      PMCID: PMC3325519          DOI: 10.1111/j.1460-9568.2011.07920.x

Source DB:  PubMed          Journal:  Eur J Neurosci        ISSN: 0953-816X            Impact factor:   3.386


  102 in total

1.  Perceiving patterns in random series: dynamic processing of sequence in prefrontal cortex.

Authors:  Scott A Huettel; Peter B Mack; Gregory McCarthy
Journal:  Nat Neurosci       Date:  2002-05       Impact factor: 24.884

2.  Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops.

Authors:  Saori C Tanaka; Kenji Doya; Go Okada; Kazutaka Ueda; Yasumasa Okamoto; Shigeto Yamawaki
Journal:  Nat Neurosci       Date:  2004-07-04       Impact factor: 24.884

3.  Human striatal activation reflects degree of stimulus saliency.

Authors:  Caroline F Zink; Giuseppe Pagnoni; Jonathan Chappelow; Megan Martin-Skurski; Gregory S Berns
Journal:  Neuroimage       Date:  2005-09-08       Impact factor: 6.556

4.  Formal learning theory dissociates brain regions with different temporal integration.

Authors:  Jan Gläscher; Christian Büchel
Journal:  Neuron       Date:  2005-07-21       Impact factor: 17.173

Review 5.  A framework for studying the neurobiology of value-based decision making.

Authors:  Antonio Rangel; Colin Camerer; P Read Montague
Journal:  Nat Rev Neurosci       Date:  2008-06-11       Impact factor: 34.870

Review 6.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates.

Authors:  B W Balleine; A Dickinson
Journal:  Neuropharmacology       Date:  1998 Apr-May       Impact factor: 5.250

Review 7.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

8.  Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events.

Authors:  Daphna Shohamy; Anthony D Wagner
Journal:  Neuron       Date:  2008-10-23       Impact factor: 17.173

9.  Robust conjunctive item-place coding by hippocampal neurons parallels learning what happens where.

Authors:  Robert W Komorowski; Joseph R Manns; Howard Eichenbaum
Journal:  J Neurosci       Date:  2009-08-05       Impact factor: 6.167

10.  Striatal activity underlies novelty-based choice in humans.

Authors:  Bianca C Wittmann; Nathaniel D Daw; Ben Seymour; Raymond J Dolan
Journal:  Neuron       Date:  2008-06-26       Impact factor: 17.173

View more
  45 in total

1.  Evidence integration in model-based tree search.

Authors:  Alec Solway; Matthew M Botvinick
Journal:  Proc Natl Acad Sci U S A       Date:  2015-08-31       Impact factor: 11.205

2.  Adult age differences in learning on a sequentially cued prediction task.

Authors:  Kendra L Seaman; Darlene V Howard; James H Howard
Journal:  J Gerontol B Psychol Sci Soc Sci       Date:  2013-06-26       Impact factor: 4.077

3.  Experimental predictions drawn from a computational model of sign-trackers and goal-trackers.

Authors:  Florian Lesaint; Olivier Sigaud; Jeremy J Clark; Shelly B Flagel; Mehdi Khamassi
Journal:  J Physiol Paris       Date:  2014-06-20

4.  Brain networks for confidence weighting and hierarchical inference during probabilistic learning.

Authors:  Florent Meyniel; Stanislas Dehaene
Journal:  Proc Natl Acad Sci U S A       Date:  2017-04-24       Impact factor: 11.205

5.  New insights into statistical learning and chunk learning in implicit sequence acquisition.

Authors:  Yue Du; Jane E Clark
Journal:  Psychon Bull Rev       Date:  2017-08

6.  Retrieving the structure of probabilistic sequences of auditory stimuli from EEG data.

Authors:  Noslen Hernández; Aline Duarte; Guilherme Ost; Ricardo Fraiman; Antonio Galves; Claudia D Vargas
Journal:  Sci Rep       Date:  2021-02-10       Impact factor: 4.379

Review 7.  Domain generality versus modality specificity: the paradox of statistical learning.

Authors:  Ram Frost; Blair C Armstrong; Noam Siegelman; Morten H Christiansen
Journal:  Trends Cogn Sci       Date:  2015-01-24       Impact factor: 20.229

8.  Multiple memory systems as substrates for multiple decision systems.

Authors:  Bradley B Doll; Daphna Shohamy; Nathaniel D Daw
Journal:  Neurobiol Learn Mem       Date:  2014-05-15       Impact factor: 2.877

9.  The necessity of the medial temporal lobe for statistical learning.

Authors:  Anna C Schapiro; Emma Gregory; Barbara Landau; Michael McCloskey; Nicholas B Turk-Browne
Journal:  J Cogn Neurosci       Date:  2014-01-23       Impact factor: 3.225

10.  Complementary learning systems within the hippocampus: a neural network modelling approach to reconciling episodic memory with statistical learning.

Authors:  Anna C Schapiro; Nicholas B Turk-Browne; Matthew M Botvinick; Kenneth A Norman
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2017-01-05       Impact factor: 6.237

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.