Literature DB >> 28115481

Orbitofrontal Cortex Signals Expected Outcomes with Predictive Codes When Stable Contingencies Promote the Integration of Reward History.

Justin S Riceberg1, Matthew L Shapiro2.   

Abstract

Memory can inform goal-directed behavior by linking current opportunities to past outcomes. The orbitofrontal cortex (OFC) may guide value-based responses by integrating the history of stimulus-reward associations into expected outcomes, representations of predicted hedonic value and quality. Alternatively, the OFC may rapidly compute flexible "online" reward predictions by associating stimuli with the latest outcome. OFC neurons develop predictive codes when rats learn to associate arbitrary stimuli with outcomes, but the extent to which predictive coding depends on most recent events and the integrated history of rewards is unclear. To investigate how reward history modulates OFC activity, we recorded OFC ensembles as rats performed spatial discriminations that differed only in the number of rewarded trials between goal reversals. The firing rate of single OFC neurons distinguished identical behaviors guided by different goals. When >20 rewarded trials separated goal switches, OFC ensembles developed stable and anticorrelated population vectors that predicted overall choice accuracy and the goal selected in single trials. When <10 rewarded trials separated goal switches, OFC population vectors decorrelated rapidly after each switch, but did not develop anticorrelated firing patterns or predict choice accuracy. The results show that, whereas OFC signals respond rapidly to contingency changes, they predict choices only when reward history is relatively stable, suggesting that consecutive rewarded episodes are needed for OFC computations that integrate reward history into expected outcomes.SIGNIFICANCE STATEMENT Adapting to changing contingencies and making decisions engages the orbitofrontal cortex (OFC). Previous work shows that OFC function can either improve or impair learning depending on reward stability, suggesting that OFC guides behavior optimally when contingencies apply consistently. The mechanisms that link reward history to OFC computations remain obscure. Here, we examined OFC unit activity as rodents performed tasks controlled by contingencies that varied reward history. When contingencies were stable, OFC neurons signaled past, present, and pending events; when contingencies were unstable, past and present coding persisted, but predictive coding diminished. The results suggest that OFC mechanisms require stable contingencies across consecutive episodes to integrate reward history, represent predicted outcomes, and inform goal-directed choices.
Copyright © 2017 the authors 0270-6474/17/372010-12$15.00/0.

Entities:  

Keywords:  decision making; neurophysiology; orbitofrontal cortex; reversal learning; reward prediction; single units

Mesh:

Year:  2017        PMID: 28115481      PMCID: PMC5338752          DOI: 10.1523/JNEUROSCI.2951-16.2016

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  37 in total

Review 1.  Multiple brain-memory systems: the whole does not equal the sum of its parts.

Authors:  J J Kim; M G Baxter
Journal:  Trends Neurosci       Date:  2001-06       Impact factor: 13.837

2.  Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex.

Authors:  Michael P Saddoris; Michela Gallagher; Geoffrey Schoenbaum
Journal:  Neuron       Date:  2005-04-21       Impact factor: 17.173

3.  Abnormal associative encoding in orbitofrontal neurons in cocaine-experienced rats during decision-making.

Authors:  Thomas A Stalnaker; Matthew R Roesch; Theresa M Franz; Kathryn A Burke; Geoffrey Schoenbaum
Journal:  Eur J Neurosci       Date:  2006-11       Impact factor: 3.386

4.  Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys.

Authors:  M Meunier; J Bachevalier; M Mishkin
Journal:  Neuropsychologia       Date:  1997-07       Impact factor: 3.139

5.  Reward stability determines the contribution of orbitofrontal cortex to adaptive behavior.

Authors:  Justin S Riceberg; Matthew L Shapiro
Journal:  J Neurosci       Date:  2012-11-14       Impact factor: 6.167

6.  Different time courses for learning-related changes in amygdala and orbitofrontal cortex.

Authors:  Sara E Morrison; Alexandre Saez; Brian Lau; C Daniel Salzman
Journal:  Neuron       Date:  2011-09-21       Impact factor: 17.173

7.  The rodent orbitofrontal cortex gets time and direction.

Authors:  David H Zald
Journal:  Neuron       Date:  2006-08-17       Impact factor: 17.173

8.  Dynamic coding of goal-directed paths by orbital prefrontal cortex.

Authors:  James J Young; Matthew L Shapiro
Journal:  J Neurosci       Date:  2011-04-20       Impact factor: 6.167

9.  Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning.

Authors:  Mark E Walton; Timothy E J Behrens; Mark J Buckley; Peter H Rudebeck; Matthew F S Rushworth
Journal:  Neuron       Date:  2010-03-25       Impact factor: 17.173

10.  Adaptation of reward sensitivity in orbitofrontal neurons.

Authors:  Shunsuke Kobayashi; Ofelia Pinto de Carvalho; Wolfram Schultz
Journal:  J Neurosci       Date:  2010-01-13       Impact factor: 6.167

View more
  17 in total

1.  Reward-Related Expectations Trigger Dendritic Spine Plasticity in the Mouse Ventrolateral Orbitofrontal Cortex.

Authors:  Alonzo J Whyte; Henry W Kietzman; Andrew M Swanson; Laura M Butkovich; Britton R Barbee; Gary J Bassell; Christina Gross; Shannon L Gourley
Journal:  J Neurosci       Date:  2019-04-02       Impact factor: 6.167

2.  Medial Prefrontal Cortex Reduces Memory Interference by Modifying Hippocampal Encoding.

Authors:  Kevin G Guise; Matthew L Shapiro
Journal:  Neuron       Date:  2017-03-23       Impact factor: 17.173

Review 3.  Linking dynamic patterns of neural activity in orbitofrontal cortex with decision making.

Authors:  Erin L Rich; Frederic M Stoll; Peter H Rudebeck
Journal:  Curr Opin Neurobiol       Date:  2018-01-09       Impact factor: 6.627

4.  Neural encoding of choice during a delayed response task in primate striatum and orbitofrontal cortex.

Authors:  Howard C Cromwell; Leon Tremblay; Wolfram Schultz
Journal:  Exp Brain Res       Date:  2018-04-02       Impact factor: 1.972

5.  Sucrose intensity coding and decision-making in rat gustatory cortices.

Authors:  Esmeralda Fonseca; Victor de Lafuente; Sidney A Simon; Ranier Gutierrez
Journal:  Elife       Date:  2018-11-19       Impact factor: 8.140

Review 6.  Adaptive learning under expected and unexpected uncertainty.

Authors:  Alireza Soltani; Alicia Izquierdo
Journal:  Nat Rev Neurosci       Date:  2019-10       Impact factor: 34.870

Review 7.  The orbitofrontal cartographer.

Authors:  Matthew P H Gardner; Geoffrey Schoenbaum
Journal:  Behav Neurosci       Date:  2021-04       Impact factor: 1.912

8.  Spatial Representations in Rat Orbitofrontal Cortex.

Authors:  Andrew M Wikenheiser; Matthew P H Gardner; Lauren E Mueller; Geoffrey Schoenbaum
Journal:  J Neurosci       Date:  2021-07-01       Impact factor: 6.167

9.  Reward learning in unmedicated women with bulimia nervosa: A pilot investigation.

Authors:  Kelsey E Hagan; Kelsie T Forbush
Journal:  J Psychiatr Res       Date:  2021-02-03       Impact factor: 4.791

10.  Prospective representations in rat orbitofrontal ensembles.

Authors:  Jingfeng Zhou; Wenhui Zong; Chunying Jia; Matthew P H Gardner; Geoffrey Schoenbaum
Journal:  Behav Neurosci       Date:  2021-06-24       Impact factor: 2.154

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.