Literature DB >> 31186358

Common neural code for reward and information value.

Kenji Kobayashi1,2, Ming Hsu3,4.   

Abstract

Adaptive information seeking is critical for goal-directed behavior. Growing evidence suggests the importance of intrinsic motives such as curiosity or need for novelty, mediated through dopaminergic valuation systems, in driving information-seeking behavior. However, valuing information for its own sake can be highly suboptimal when agents need to evaluate instrumental benefit of information in a forward-looking manner. Here we show that information-seeking behavior in humans is driven by subjective value that is shaped by both instrumental and noninstrumental motives, and that this subjective value of information (SVOI) shares a common neural code with more basic reward value. Specifically, using a task where subjects could purchase information to reduce uncertainty about outcomes of a monetary lottery, we found information purchase decisions could be captured by a computational model of SVOI incorporating utility of anticipation, a form of noninstrumental motive for information seeking, in addition to instrumental benefits. Neurally, trial-by-trial variation in SVOI was correlated with activity in striatum and ventromedial prefrontal cortex. Furthermore, cross-categorical decoding revealed that, within these regions, SVOI and expected utility of lotteries were represented using a common code. These findings provide support for the common currency hypothesis and shed insight on neurocognitive mechanisms underlying information-seeking behavior.

Entities:  

Keywords:  decoding; fMRI; information seeking; reward; value of information

Mesh:

Year:  2019        PMID: 31186358      PMCID: PMC6600919          DOI: 10.1073/pnas.1820145116

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  29 in total

Review 1.  Control of exploitation-exploration meta-parameter in reinforcement learning.

Authors:  Shin Ishii; Wako Yoshida; Junichiro Yoshimoto
Journal:  Neural Netw       Date:  2002 Jun-Jul

2.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.

Authors:  Nathaniel D Daw; Yael Niv; Peter Dayan
Journal:  Nat Neurosci       Date:  2005-11-06       Impact factor: 24.884

Review 3.  A framework for studying the neurobiology of value-based decision making.

Authors:  Antonio Rangel; Colin Camerer; P Read Montague
Journal:  Nat Rev Neurosci       Date:  2008-06-11       Impact factor: 34.870

4.  A theory of human curiosity.

Authors:  D E BERLYNE
Journal:  Br J Psychol       Date:  1954-08

5.  The novelty exploration bonus and its attentional modulation.

Authors:  Ruth M Krebs; Björn H Schott; Hartmut Schütze; Emrah Düzel
Journal:  Neuropsychologia       Date:  2009-01-19       Impact factor: 3.139

6.  Cortical substrates for exploratory decisions in humans.

Authors:  Nathaniel D Daw; John P O'Doherty; Peter Dayan; Ben Seymour; Raymond J Dolan
Journal:  Nature       Date:  2006-06-15       Impact factor: 49.962

7.  Absolute coding of stimulus novelty in the human substantia nigra/VTA.

Authors:  Nico Bunzeck; Emrah Düzel
Journal:  Neuron       Date:  2006-08-03       Impact factor: 17.173

Review 8.  Dopamine: generalization and bonuses.

Authors:  Sham Kakade; Peter Dayan
Journal:  Neural Netw       Date:  2002 Jun-Jul

Review 9.  Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration.

Authors:  Jonathan D Cohen; Samuel M McClure; Angela J Yu
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2007-05-29       Impact factor: 6.237

10.  Striatal activity underlies novelty-based choice in humans.

Authors:  Bianca C Wittmann; Nathaniel D Daw; Ben Seymour; Raymond J Dolan
Journal:  Neuron       Date:  2008-06-26       Impact factor: 17.173

View more
  19 in total

Review 1.  Filling the gaps: Cognitive control as a critical lens for understanding mechanisms of value-based decision-making.

Authors:  R Frömer; A Shenhav
Journal:  Neurosci Biobehav Rev       Date:  2021-12-10       Impact factor: 8.989

Review 2.  Decision neuroscience and neuroeconomics: Recent progress and ongoing challenges.

Authors:  Jeffrey B Dennison; Daniel Sazhin; David V Smith
Journal:  Wiley Interdiscip Rev Cogn Sci       Date:  2022-02-08

3.  Independent and interacting value systems for reward and information in the human brain.

Authors:  Irene Cogliati Dezza; Axel Cleeremans; William H Alexander
Journal:  Elife       Date:  2022-04-13       Impact factor: 8.713

4.  Value signals guide abstraction during learning.

Authors:  Aurelio Cortese; Asuka Yamamoto; Maryam Hashemzadeh; Pradyumna Sepulveda; Mitsuo Kawato; Benedetto De Martino
Journal:  Elife       Date:  2021-07-13       Impact factor: 8.140

5.  Shared striatal activity in decisions to satisfy curiosity and hunger at the risk of electric shocks.

Authors:  Johnny King L Lau; Hiroki Ozono; Kei Kuratomi; Asuka Komiya; Kou Murayama
Journal:  Nat Hum Behav       Date:  2020-03-30

6.  Dynamic Representation of the Subjective Value of Information.

Authors:  Kenji Kobayashi; Sangil Lee; Alexandre L S Filipowicz; Kara D McGaughey; Joseph W Kable; Matthew R Nassar
Journal:  J Neurosci       Date:  2021-08-11       Impact factor: 6.167

7.  Latent learning, cognitive maps, and curiosity.

Authors:  Maya Zhe Wang; Benjamin Y Hayden
Journal:  Curr Opin Behav Sci       Date:  2020-07-17

8.  The Brain Circuits and Dynamics of Curiosity-Driven Behavior in Naturally Curious Marmosets.

Authors:  Xiaoguang Tian; Afonso C Silva; Cirong Liu
Journal:  Cereb Cortex       Date:  2021-07-29       Impact factor: 5.357

9.  Hunters, busybodies and the knowledge network building associated with deprivation curiosity.

Authors:  David M Lydon-Staley; Dale Zhou; Ann Sizemore Blevins; Perry Zurn; Danielle S Bassett
Journal:  Nat Hum Behav       Date:  2020-11-30

10.  Interoception as modeling, allostasis as control.

Authors:  Eli Sennesh; Jordan Theriault; Dana Brooks; Jan-Willem van de Meent; Lisa Feldman Barrett; Karen S Quigley
Journal:  Biol Psychol       Date:  2021-12-20       Impact factor: 3.111

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.