Literature DB >> 32156831

The Effect of Counterfactual Information on Outcome Value Coding in Medial Prefrontal and Cingulate Cortex: From an Absolute to a Relative Neural Code.

Doris Pischedda1,2,3,4, Stefano Palminteri5,6, Giorgio Coricelli7,8.   

Abstract

Adaptive coding of stimuli is well documented in perception, where it supports efficient encoding over a broad range of possible percepts. Recently, a similar neural mechanism has been reported also in value-based decision, where it allows optimal encoding of vast ranges of values in PFC: neuronal response to value depends on the choice context (relative coding), rather than being invariant across contexts (absolute coding). Additionally, value learning is sensitive to the amount of feedback information: providing complete feedback (both obtained and forgone outcomes) instead of partial feedback (only obtained outcome) improves learning. However, it is unclear whether relative coding occurs in all PFC regions and how it is affected by feedback information. We systematically investigated univariate and multivariate feedback encoding in various mPFC regions and compared three modes of neural coding: absolute, partially-adaptive and fully-adaptive.Twenty-eight human participants (both sexes) performed a learning task while undergoing fMRI scanning. On each trial, they chose between two symbols associated with a certain outcome. Then, the decision outcome was revealed. Notably, in one-half of the trials participants received partial feedback, whereas in the other half they got complete feedback. We used univariate and multivariate analysis to explore value encoding in different feedback conditions.We found that both obtained and forgone outcomes were encoded in mPFC, but with opposite sign in its ventral and dorsal subdivisions. Moreover, we showed that increasing feedback information induced a switch from absolute to relative coding. Our results suggest that complete feedback information enhances context-dependent outcome encoding.SIGNIFICANCE STATEMENT This study offers a systematic investigation of the effect of the amount of feedback information (partial vs complete) on univariate and multivariate outcome value encoding, within multiple regions in mPFC and cingulate cortex that are critical for value-based decisions and behavioral adaptation. Moreover, we provide the first comparison of three possible models of neural coding (i.e., absolute, partially-adaptive, and fully-adaptive coding) of value signal in these regions, by using commensurable measures of prediction accuracy. Taken together, our results help build a more comprehensive picture of how the human brain encodes and processes outcome value. In particular, our results suggest that simultaneous presentation of obtained and foregone outcomes promotes relative value representation.
Copyright © 2020 the authors.

Entities:  

Keywords:  counterfactual; decision-making; multivariate encoding; reinforcement learning; relative coding; reward encoding

Year:  2020        PMID: 32156831      PMCID: PMC7159892          DOI: 10.1523/JNEUROSCI.1712-19.2020

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  58 in total

1.  Neurons in the orbitofrontal cortex encode economic value.

Authors:  Camillo Padoa-Schioppa; John A Assad
Journal:  Nature       Date:  2006-04-23       Impact factor: 49.962

Review 2.  A framework for studying the neurobiology of value-based decision making.

Authors:  Antonio Rangel; Colin Camerer; P Read Montague
Journal:  Nat Rev Neurosci       Date:  2008-06-11       Impact factor: 34.870

3.  Informatic parcellation of the network involved in the computation of subjective value.

Authors:  John A Clithero; Antonio Rangel
Journal:  Soc Cogn Affect Neurosci       Date:  2013-07-24       Impact factor: 3.436

Review 4.  The role of the human ventral striatum and the medial orbitofrontal cortex in the representation of reward magnitude - an activation likelihood estimation meta-analysis of neuroimaging studies of passive reward expectancy and outcome processing.

Authors:  Esther Kristina Diekhof; Lisa Kaps; Peter Falkai; Oliver Gruber
Journal:  Neuropsychologia       Date:  2012-02-18       Impact factor: 3.139

5.  Ubiquity and specificity of reinforcement signals throughout the human brain.

Authors:  Timothy J Vickery; Marvin M Chun; Daeyeol Lee
Journal:  Neuron       Date:  2011-10-06       Impact factor: 17.173

6.  Multiple neural representations of elementary logical connectives.

Authors:  Giosuè Baggio; Paolo Cherubini; Doris Pischedda; Anna Blumenthal; John-Dylan Haynes; Carlo Reverberi
Journal:  Neuroimage       Date:  2016-04-29       Impact factor: 6.556

7.  Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans.

Authors:  R Elliott; Z Agnew; J F W Deakin
Journal:  Eur J Neurosci       Date:  2008-05       Impact factor: 3.386

8.  Confirmation bias in human reinforcement learning: Evidence from counterfactual feedback processing.

Authors:  Stefano Palminteri; Germain Lefebvre; Emma J Kilford; Sarah-Jayne Blakemore
Journal:  PLoS Comput Biol       Date:  2017-08-11       Impact factor: 4.475

9.  Contextual modulation of value signals in reward and punishment learning.

Authors:  Stefano Palminteri; Mehdi Khamassi; Mateus Joffily; Giorgio Coricelli
Journal:  Nat Commun       Date:  2015-08-25       Impact factor: 14.919

10.  Multivariate Neural Representations of Value during Reward Anticipation and Consummation in the Human Orbitofrontal Cortex.

Authors:  Chao Yan; Li Su; Yi Wang; Ting Xu; Da-Zhi Yin; Ming-Xia Fan; Ci-Ping Deng; Yang Hu; Zhao-Xin Wang; Eric F C Cheung; Kelvin O Lim; Raymond C K Chan
Journal:  Sci Rep       Date:  2016-07-05       Impact factor: 4.379

View more
  4 in total

1.  Reinforcement learning with associative or discriminative generalization across states and actions: fMRI at 3 T and 7 T.

Authors:  Jaron T Colas; Neil M Dundon; Raphael T Gerraty; Natalie M Saragosa-Harris; Karol P Szymula; Koranis Tanwisuth; J Michael Tyszka; Camilla van Geen; Harang Ju; Arthur W Toga; Joshua I Gold; Dani S Bassett; Catherine A Hartley; Daphna Shohamy; Scott T Grafton; John P O'Doherty
Journal:  Hum Brain Mapp       Date:  2022-07-21       Impact factor: 5.399

2.  Physiological Correlates of Processing Health-Related Information: An Idea for the Adoption of a Foreign Field.

Authors:  Cornelia Geukes; Horst M Müller
Journal:  Nurs Rep       Date:  2021-03-17

3.  Believing and Beliefs-Neurophysiological Underpinnings.

Authors:  Rüdiger J Seitz
Journal:  Front Behav Neurosci       Date:  2022-04-19       Impact factor: 3.558

4.  On the Influence of Spatial and Value Attentional Cues Across Individuals.

Authors:  Kelly G Garner; Michelle Lovell-Kane; Luke Carroll; Paul E Dux
Journal:  J Cogn       Date:  2022-06-24
  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.