Literature DB >> 30327418

How the Level of Reward Awareness Changes the Computational and Electrophysiological Signatures of Reinforcement Learning.

Camile M C Correa1, Samuel Noorman1, Jun Jiang2, Stefano Palminteri3,4,5, Michael X Cohen6, Maël Lebreton7,8, Simon van Gaal9,10,11.   

Abstract

The extent to which subjective awareness influences reward processing, and thereby affects future decisions, is currently largely unknown. In the present report, we investigated this question in a reinforcement learning framework, combining perceptual masking, computational modeling, and electroencephalographic recordings (human male and female participants). Our results indicate that degrading the visibility of the reward decreased, without completely obliterating, the ability of participants to learn from outcomes, but concurrently increased their tendency to repeat previous choices. We dissociated electrophysiological signatures evoked by the reward-based learning processes from those elicited by the reward-independent repetition of previous choices and showed that these neural activities were significantly modulated by reward visibility. Overall, this report sheds new light on the neural computations underlying reward-based learning and decision-making and highlights that awareness is beneficial for the trial-by-trial adjustment of decision-making strategies.SIGNIFICANCE STATEMENT The notion of reward is strongly associated with subjective evaluation, related to conscious processes such as "pleasure," "liking," and "wanting." Here we show that degrading reward visibility in a reinforcement learning task decreases, without completely obliterating, the ability of participants to learn from outcomes, but concurrently increases subjects' tendency to repeat previous choices. Electrophysiological recordings, in combination with computational modeling, show that neural activities were significantly modulated by reward visibility. Overall, we dissociate different neural computations underlying reward-based learning and decision-making, which highlights a beneficial role of reward awareness in adjusting decision-making strategies.
Copyright © 2018 the authors 0270-6474/18/3810338-11$15.00/0.

Entities:  

Keywords:  consciousness; decision-making; prediction error; reinforcement learning

Mesh:

Year:  2018        PMID: 30327418      PMCID: PMC6596205          DOI: 10.1523/JNEUROSCI.0457-18.2018

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  63 in total

Review 1.  Motivation concepts in behavioral neuroscience.

Authors:  Kent C Berridge
Journal:  Physiol Behav       Date:  2004-04

2.  Reward expectation modulates feedback-related negativity and EEG spectra.

Authors:  Michael X Cohen; Christian E Elger; Charan Ranganath
Journal:  Neuroimage       Date:  2007-01-25       Impact factor: 6.556

3.  Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices.

Authors:  Gerhard Jocham; Tilmann A Klein; Markus Ullsperger
Journal:  J Neurosci       Date:  2011-02-02       Impact factor: 6.167

4.  The human Turing machine: a neural framework for mental programs.

Authors:  Ariel Zylberberg; Stanislas Dehaene; Pieter R Roelfsema; Mariano Sigman
Journal:  Trends Cogn Sci       Date:  2011-06-21       Impact factor: 20.229

Review 5.  The Importance of Falsification in Computational Cognitive Modeling.

Authors:  Stefano Palminteri; Valentin Wyart; Etienne Koechlin
Journal:  Trends Cogn Sci       Date:  2017-05-02       Impact factor: 20.229

Review 6.  Kinds of access: different methods for report reveal different kinds of metacognitive access.

Authors:  Morten Overgaard; Kristian Sandberg
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2012-05-19       Impact factor: 6.237

7.  Dissociable effects of dopamine and serotonin on reversal learning.

Authors:  Hanneke E M den Ouden; Nathaniel D Daw; Guillén Fernandez; Joris A Elshout; Mark Rijpkema; Martine Hoogman; Barbara Franke; Roshan Cools
Journal:  Neuron       Date:  2013-11-20       Impact factor: 17.173

Review 8.  Multiple dopamine functions at different time courses.

Authors:  Wolfram Schultz
Journal:  Annu Rev Neurosci       Date:  2007       Impact factor: 12.449

9.  Distinct neural responses to conscious versus unconscious monetary reward cues.

Authors:  Erik Bijleveld; Ruud Custers; Stefan Van der Stigchel; Henk Aarts; Pascal Pas; Matthijs Vink
Journal:  Hum Brain Mapp       Date:  2014-07-02       Impact factor: 5.038

10.  Contextual modulation of value signals in reward and punishment learning.

Authors:  Stefano Palminteri; Mehdi Khamassi; Mateus Joffily; Giorgio Coricelli
Journal:  Nat Commun       Date:  2015-08-25       Impact factor: 14.919

View more
  7 in total

1.  Response-based outcome predictions and confidence regulate feedback processing and learning.

Authors:  Romy Frömer; Matthew R Nassar; Rasmus Bruckner; Birgit Stürmer; Werner Sommer; Nick Yeung
Journal:  Elife       Date:  2021-04-30       Impact factor: 8.140

2.  Implicit Counterfactual Effect in Partial Feedback Reinforcement Learning: Behavioral and Modeling Approach.

Authors:  Zahra Barakchian; Abdol-Hossein Vahabie; Majid Nili Ahmadabadi
Journal:  Front Neurosci       Date:  2022-05-10       Impact factor: 5.152

Review 3.  What Is It Like to Be a Bass? Red Herrings, Fish Pain and the Study of Animal Sentience.

Authors:  G J Mason; J M Lavery
Journal:  Front Vet Sci       Date:  2022-04-27

4.  Pupil Dilation and the Slow Wave ERP Reflect Surprise about Choice Outcome Resulting from Intrinsic Variability in Decision Confidence.

Authors:  Jan Willem de Gee; Camile M C Correa; Matthew Weaver; Tobias H Donner; Simon van Gaal
Journal:  Cereb Cortex       Date:  2021-06-10       Impact factor: 5.357

5.  Neurofeedback Training of Auditory Selective Attention Enhances Speech-In-Noise Perception.

Authors:  Subong Kim; Caroline Emory; Inyong Choi
Journal:  Front Hum Neurosci       Date:  2021-06-22       Impact factor: 3.169

6.  Automatic and fast encoding of representational uncertainty underlies the distortion of relative frequency.

Authors:  Xiangjuan Ren; Huan Luo; Hang Zhang
Journal:  J Neurosci       Date:  2021-03-05       Impact factor: 6.167

7.  Persistent activity in human parietal cortex mediates perceptual choice repetition bias.

Authors:  Anne E Urai; Tobias H Donner
Journal:  Nat Commun       Date:  2022-10-12       Impact factor: 17.694

  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.