Literature DB >> 34254586

Value signals guide abstraction during learning.

Aurelio Cortese1,2, Asuka Yamamoto1,3, Maryam Hashemzadeh4, Pradyumna Sepulveda2, Mitsuo Kawato1,5, Benedetto De Martino2.   

Abstract

The human brain excels at constructing and using abstractions, such as rules, or concepts. Here, in two fMRI experiments, we demonstrate a mechanism of abstraction built upon the valuation of sensory features. Human volunteers learned novel association rules based on simple visual features. Reinforcement-learning algorithms revealed that, with learning, high-value abstract representations increasingly guided participant behaviour, resulting in better choices and higher subjective confidence. We also found that the brain area computing value signals - the ventromedial prefrontal cortex - prioritised and selected latent task elements during abstraction, both locally and through its connection to the visual cortex. Such a coding scheme predicts a causal role for valuation. Hence, in a second experiment, we used multivoxel neural reinforcement to test for the causality of feature valuation in the sensory cortex, as a mechanism of abstraction. Tagging the neural representation of a task feature with rewards evoked abstraction-based decisions. Together, these findings provide a novel interpretation of value as a goal-dependent, key factor in forging abstract representations.
© 2021, Cortese et al.

Entities:  

Keywords:  abstraction; confidence; human; multivoxel neural reinforcement; neuroscience; reinforcement learning; valuation; vmpfc

Year:  2021        PMID: 34254586      PMCID: PMC8331191          DOI: 10.7554/eLife.68943

Source DB:  PubMed          Journal:  Elife        ISSN: 2050-084X            Impact factor:   8.140


  83 in total

Review 1.  Closed-loop brain training: the science of neurofeedback.

Authors:  Ranganatha Sitaram; Tomas Ros; Luke Stoeckel; Sven Haller; Frank Scharnowski; Jarrod Lewis-Peacock; Nikolaus Weiskopf; Maria Laura Blefari; Mohit Rana; Ethan Oblak; Niels Birbaumer; James Sulzer
Journal:  Nat Rev Neurosci       Date:  2016-12-22       Impact factor: 34.870

2.  Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation.

Authors:  Kazuhisa Shibata; Takeo Watanabe; Yuka Sasaki; Mitsuo Kawato
Journal:  Science       Date:  2011-12-09       Impact factor: 47.728

Review 3.  Neurobiology of Schemas and Schema-Mediated Memory.

Authors:  Asaf Gilboa; Hannah Marlatte
Journal:  Trends Cogn Sci       Date:  2017-05-24       Impact factor: 20.229

Review 4.  Process-based framework for precise neuromodulation.

Authors:  Nitzan Lubianiker; Noam Goldway; Tom Fruchtman-Steinbok; Christian Paret; Jacob N Keynan; Neomi Singer; Avihay Cohen; Kathrin Cohen Kadosh; David E J Linden; Talma Hendler
Journal:  Nat Hum Behav       Date:  2019-04-15

5.  Distance and Direction Codes Underlie Navigation of a Novel Semantic Space in the Human Brain.

Authors:  Simone Viganò; Manuela Piazza
Journal:  J Neurosci       Date:  2020-02-14       Impact factor: 6.167

6.  Human Orbitofrontal Cortex Represents a Cognitive Map of State Space.

Authors:  Nicolas W Schuck; Ming Bo Cai; Robert C Wilson; Yael Niv
Journal:  Neuron       Date:  2016-09-21       Impact factor: 17.173

7.  Hippocampal representation of related and opposing memories develop within distinct, hierarchically organized neural schemas.

Authors:  Sam McKenzie; Andrea J Frank; Nathaniel R Kinsky; Blake Porter; Pamela D Rivière; Howard Eichenbaum
Journal:  Neuron       Date:  2014-06-05       Impact factor: 17.173

8.  Human VMPFC encodes early signatures of confidence in perceptual decisions.

Authors:  Sabina Gherman; Marios G Philiastides
Journal:  Elife       Date:  2018-09-24       Impact factor: 8.140

9.  Feature-specific prediction errors and surprise across macaque fronto-striatal circuits.

Authors:  Mariann Oemisch; Stephanie Westendorff; Marzyeh Azimi; Seyed Alireza Hassani; Salva Ardid; Paul Tiesinga; Thilo Womelsdorf
Journal:  Nat Commun       Date:  2019-01-11       Impact factor: 14.919

10.  The representation of abstract task rules in the human prefrontal cortex.

Authors:  Sara L Bengtsson; John-Dylan Haynes; Katsuyuki Sakai; Mark J Buckley; Richard E Passingham
Journal:  Cereb Cortex       Date:  2008-12-01       Impact factor: 5.357

View more
  1 in total

1.  From internal models toward metacognitive AI.

Authors:  Mitsuo Kawato; Aurelio Cortese
Journal:  Biol Cybern       Date:  2021-10       Impact factor: 2.086

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.