Literature DB >> 25459409

Functionally dissociable influences on learning rate in a dynamic environment.

Joseph T McGuire1, Matthew R Nassar2, Joshua I Gold3, Joseph W Kable4.   

Abstract

Maintaining accurate beliefs in a changing environment requires dynamically adapting the rate at which one learns from new experiences. Beliefs should be stable in the face of noisy data but malleable in periods of change or uncertainty. Here we used computational modeling, psychophysics, and fMRI to show that adaptive learning is not a unitary phenomenon in the brain. Rather, it can be decomposed into three computationally and neuroanatomically distinct factors that were evident in human subjects performing a spatial-prediction task: (1) surprise-driven belief updating, related to BOLD activity in visual cortex; (2) uncertainty-driven belief updating, related to anterior prefrontal and parietal activity; and (3) reward-driven belief updating, a context-inappropriate behavioral tendency related to activity in ventral striatum. These distinct factors converged in a core system governing adaptive learning. This system, which included dorsomedial frontal cortex, responded to all three factors and predicted belief updating both across trials and across individuals.
Copyright © 2014 Elsevier Inc. All rights reserved.

Entities:  

Mesh:

Year:  2014        PMID: 25459409      PMCID: PMC4437663          DOI: 10.1016/j.neuron.2014.10.013

Source DB:  PubMed          Journal:  Neuron        ISSN: 0896-6273            Impact factor:   17.173


  46 in total

Review 1.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance.

Authors:  Gary Aston-Jones; Jonathan D Cohen
Journal:  Annu Rev Neurosci       Date:  2005       Impact factor: 12.449

Review 2.  Advances in functional and structural MR image analysis and implementation as FSL.

Authors:  Stephen M Smith; Mark Jenkinson; Mark W Woolrich; Christian F Beckmann; Timothy E J Behrens; Heidi Johansen-Berg; Peter R Bannister; Marilena De Luca; Ivana Drobnjak; David E Flitney; Rami K Niazy; James Saunders; John Vickers; Yongyue Zhang; Nicola De Stefano; J Michael Brady; Paul M Matthews
Journal:  Neuroimage       Date:  2004       Impact factor: 6.556

Review 3.  Decision making, the P3, and the locus coeruleus-norepinephrine system.

Authors:  Sander Nieuwenhuis; Gary Aston-Jones; Jonathan D Cohen
Journal:  Psychol Bull       Date:  2005-07       Impact factor: 17.737

4.  Temporal isolation of the neural correlates of spatial mnemonic processing with fMRI.

Authors:  E Zarahn; G K Aguirre; M D'Esposito
Journal:  Brain Res Cogn Brain Res       Date:  1999-01

5.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages.

Authors:  R W Cox
Journal:  Comput Biomed Res       Date:  1996-06

6.  The variability of human, BOLD hemodynamic responses.

Authors:  G K Aguirre; E Zarahn; M D'esposito
Journal:  Neuroimage       Date:  1998-11       Impact factor: 6.556

7.  Psychophysiological and modulatory interactions in neuroimaging.

Authors:  K J Friston; C Buechel; G R Fink; J Morris; E Rolls; R J Dolan
Journal:  Neuroimage       Date:  1997-10       Impact factor: 6.556

8.  The variable nature of cognitive control: a dual mechanisms framework.

Authors:  Todd S Braver
Journal:  Trends Cogn Sci       Date:  2012-01-12       Impact factor: 20.229

9.  Uncertainty, neuromodulation, and attention.

Authors:  Angela J Yu; Peter Dayan
Journal:  Neuron       Date:  2005-05-19       Impact factor: 17.173

10.  Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration.

Authors:  David Badre; Bradley B Doll; Nicole M Long; Michael J Frank
Journal:  Neuron       Date:  2012-02-09       Impact factor: 17.173

View more
  77 in total

1.  Individual Neurons in the Cingulate Cortex Encode Action Monitoring, Not Selection, during Adaptive Decision-Making.

Authors:  Yin S Li; Matthew R Nassar; Joseph W Kable; Joshua I Gold
Journal:  J Neurosci       Date:  2019-06-19       Impact factor: 6.167

2.  A context-change account of temporal distinctiveness.

Authors:  Brian M Siefke; Troy A Smith; Per B Sederberg
Journal:  Mem Cognit       Date:  2019-08

3.  Brain networks for confidence weighting and hierarchical inference during probabilistic learning.

Authors:  Florent Meyniel; Stanislas Dehaene
Journal:  Proc Natl Acad Sci U S A       Date:  2017-04-24       Impact factor: 11.205

4.  The Caudate Nucleus Mediates Learning of Stimulus-Control State Associations.

Authors:  Yu-Chin Chiu; Jiefeng Jiang; Tobias Egner
Journal:  J Neurosci       Date:  2017-01-25       Impact factor: 6.167

5.  Metaplasticity as a Neural Substrate for Adaptive Learning and Choice under Uncertainty.

Authors:  Shiva Farashahi; Christopher H Donahue; Peyman Khorsand; Hyojung Seo; Daeyeol Lee; Alireza Soltani
Journal:  Neuron       Date:  2017-04-19       Impact factor: 17.173

6.  Dorsal anterior cingulate cortex and the value of control.

Authors:  Amitai Shenhav; Jonathan D Cohen; Matthew M Botvinick
Journal:  Nat Neurosci       Date:  2016-09-27       Impact factor: 24.884

7.  From likely to likable: The role of statistical typicality in human social assessment of faces.

Authors:  Chaitanya K Ryali; Stanny Goffin; Piotr Winkielman; Angela J Yu
Journal:  Proc Natl Acad Sci U S A       Date:  2020-11-24       Impact factor: 11.205

8.  Volatility Facilitates Value Updating in the Prefrontal Cortex.

Authors:  Bart Massi; Christopher H Donahue; Daeyeol Lee
Journal:  Neuron       Date:  2018-07-19       Impact factor: 17.173

9.  Dissociable effects of surprising rewards on learning and memory.

Authors:  Nina Rouhani; Kenneth A Norman; Yael Niv
Journal:  J Exp Psychol Learn Mem Cogn       Date:  2018-03-19       Impact factor: 3.051

10.  Taming the beast: extracting generalizable knowledge from computational models of cognition.

Authors:  Matthew R Nassar; Michael J Frank
Journal:  Curr Opin Behav Sci       Date:  2016-10
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.