Literature DB >> 30033151

Volatility Facilitates Value Updating in the Prefrontal Cortex.

Bart Massi1, Christopher H Donahue2, Daeyeol Lee3.   

Abstract

Adaptation of learning and decision-making might depend on the regulation of activity in the prefrontal cortex. Here we examined how volatility of reward probabilities influences learning and neural activity in the primate prefrontal cortex. We found that animals selected recently rewarded targets more often when reward probabilities of different options fluctuated across trials than when they were fixed. Additionally, neurons in the orbitofrontal cortex displayed more sustained activity related to the outcomes of their previous choices when reward probabilities changed over time. Such volatility also enhanced signals in the dorsolateral prefrontal cortex related to the current but not the previous location of the previously rewarded target. These results suggest that prefrontal activity related to choice and reward is dynamically regulated by the volatility of the environment and underscore the role of the prefrontal cortex in identifying aspects of the environment that are responsible for previous outcomes and should be learned.
Copyright © 2018 Elsevier Inc. All rights reserved.

Entities:  

Keywords:  anterior cingulate cortex; decision-making; orbitofrontal cortex; prefrontal cortex; reinforcement learning; reward; uncertainty

Mesh:

Year:  2018        PMID: 30033151      PMCID: PMC6085887          DOI: 10.1016/j.neuron.2018.06.033

Source DB:  PubMed          Journal:  Neuron        ISSN: 0896-6273            Impact factor:   17.173


  48 in total

Review 1.  Why neurons mix: high dimensionality for higher cognition.

Authors:  Stefano Fusi; Earl K Miller; Mattia Rigotti
Journal:  Curr Opin Neurobiol       Date:  2016-02-04       Impact factor: 6.627

2.  Neurons in the orbitofrontal cortex encode economic value.

Authors:  Camillo Padoa-Schioppa; John A Assad
Journal:  Nature       Date:  2006-04-23       Impact factor: 49.962

3.  Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game.

Authors:  Hyojung Seo; Daeyeol Lee
Journal:  J Neurosci       Date:  2007-08-01       Impact factor: 6.167

4.  Neural computations underlying arbitration between model-based and model-free learning.

Authors:  Sang Wan Lee; Shinsuke Shimojo; John P O'Doherty
Journal:  Neuron       Date:  2014-02-05       Impact factor: 17.173

5.  Neurons in anterior cingulate cortex multiplex information about reward and action.

Authors:  Benjamin Y Hayden; Michael L Platt
Journal:  J Neurosci       Date:  2010-03-03       Impact factor: 6.167

6.  Fictive reward signals in the anterior cingulate cortex.

Authors:  Benjamin Y Hayden; John M Pearson; Michael L Platt
Journal:  Science       Date:  2009-05-15       Impact factor: 47.728

Review 7.  Dorsal Anterior Cingulate Cortex: A Bottom-Up View.

Authors:  Sarah R Heilbronner; Benjamin Y Hayden
Journal:  Annu Rev Neurosci       Date:  2016-04-18       Impact factor: 12.449

8.  Selective aspiration or neurotoxic lesions of orbital frontal areas 11 and 13 spared monkeys' performance on the object discrimination reversal task.

Authors:  Andy Kazama; Jocelyne Bachevalier
Journal:  J Neurosci       Date:  2009-03-04       Impact factor: 6.167

9.  Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm.

Authors:  Lesley K Fellows; Martha J Farah
Journal:  Brain       Date:  2003-06-23       Impact factor: 13.501

10.  Dopamine D1/D5 receptor modulation of excitatory synaptic inputs to layer V prefrontal cortex neurons.

Authors:  J K Seamans; D Durstewitz; B R Christie; C F Stevens; T J Sejnowski
Journal:  Proc Natl Acad Sci U S A       Date:  2001-01-02       Impact factor: 11.205

View more
  19 in total

1.  Reinforcement Learning during Adolescence in Rats.

Authors:  Neema Moin Afshar; Alex J Keip; Jane R Taylor; Daeyeol Lee; Stephanie M Groman
Journal:  J Neurosci       Date:  2020-06-29       Impact factor: 6.167

2.  Catecholaminergic modulation of meta-learning.

Authors:  Hanneke Em den Ouden; Roshan Cools; Jennifer L Cook; Jennifer C Swart; Monja I Froböse; Andreea O Diaconescu; Dirk Em Geurts
Journal:  Elife       Date:  2019-12-18       Impact factor: 8.140

3.  Primate prefrontal neurons signal economic risk derived from the statistics of recent reward experience.

Authors:  Fabian Grabenhorst; Ken-Ichiro Tsutsui; Shunsuke Kobayashi; Wolfram Schultz
Journal:  Elife       Date:  2019-07-25       Impact factor: 8.140

4.  Reinforcement regulates timing variability in thalamus.

Authors:  Jing Wang; Eghbal Hosseini; Nicolas Meirhaeghe; Adam Akkad; Mehrdad Jazayeri
Journal:  Elife       Date:  2020-12-01       Impact factor: 8.140

5.  Orbitofrontal Circuits Control Multiple Reinforcement-Learning Processes.

Authors:  Stephanie M Groman; Colby Keistler; Alex J Keip; Emma Hammarlund; Ralph J DiLeone; Christopher Pittenger; Daeyeol Lee; Jane R Taylor
Journal:  Neuron       Date:  2019-06-25       Impact factor: 17.173

6.  Serotonin neurons modulate learning rate through uncertainty.

Authors:  Cooper D Grossman; Bilal A Bari; Jeremiah Y Cohen
Journal:  Curr Biol       Date:  2021-12-21       Impact factor: 10.834

Review 7.  Reinforcement learning detuned in addiction: integrative and translational approaches.

Authors:  Stephanie M Groman; Summer L Thompson; Daeyeol Lee; Jane R Taylor
Journal:  Trends Neurosci       Date:  2021-12-15       Impact factor: 13.837

8.  Unique features of stimulus-based probabilistic reversal learning.

Authors:  Carl Harris; Claudia Aguirre; Saisriya Kolli; Kanak Das; Alicia Izquierdo; Alireza Soltani
Journal:  Behav Neurosci       Date:  2021-08       Impact factor: 2.154

Review 9.  Adaptive learning under expected and unexpected uncertainty.

Authors:  Alireza Soltani; Alicia Izquierdo
Journal:  Nat Rev Neurosci       Date:  2019-10       Impact factor: 34.870

10.  How many neurons are sufficient for perception of cortical activity?

Authors:  Henry Wp Dalgleish; Lloyd E Russell; Adam M Packer; Arnd Roth; Oliver M Gauld; Francesca Greenstreet; Emmett J Thompson; Michael Häusser
Journal:  Elife       Date:  2020-10-26       Impact factor: 8.140

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.