Literature DB >> 34302057

Single-trial modeling separates multiple overlapping prediction errors during reward processing in human EEG.

Colin W Hoy1, Sheila C Steiner2, Robert T Knight2,3.   

Abstract

Learning signals during reinforcement learning and cognitive control rely on valenced reward prediction errors (RPEs) and non-valenced salience prediction errors (PEs) driven by surprise magnitude. A core debate in reward learning focuses on whether valenced and non-valenced PEs can be isolated in the human electroencephalogram (EEG). We combine behavioral modeling and single-trial EEG regression to disentangle sequential PEs in an interval timing task dissociating outcome valence, magnitude, and probability. Multiple regression across temporal, spatial, and frequency dimensions characterized a spatio-tempo-spectral cascade from early valenced RPE value to non-valenced RPE magnitude, followed by outcome probability indexed by a late frontal positivity. Separating negative and positive outcomes revealed the valenced RPE value effect is an artifact of overlap between two non-valenced RPE magnitude responses: frontal theta feedback-related negativity on losses and posterior delta reward positivity on wins. These results reconcile longstanding debates on the sequence of components representing reward and salience PEs in the human EEG.
© 2021. The Author(s).

Entities:  

Year:  2021        PMID: 34302057     DOI: 10.1038/s42003-021-02426-1

Source DB:  PubMed          Journal:  Commun Biol        ISSN: 2399-3642


  91 in total

Review 1.  Dopamine in motivational control: rewarding, aversive, and alerting.

Authors:  Ethan S Bromberg-Martin; Masayuki Matsumoto; Okihide Hikosaka
Journal:  Neuron       Date:  2010-12-09       Impact factor: 17.173

2.  A Neural Circuit Mechanism for Encoding Aversive Stimuli in the Mesolimbic Dopamine System.

Authors:  Johannes W de Jong; Seyedeh Atiyeh Afjei; Iskra Pollak Dorocic; James R Peck; Christine Liu; Christina K Kim; Lin Tian; Karl Deisseroth; Stephan Lammel
Journal:  Neuron       Date:  2018-11-29       Impact factor: 17.173

3.  Two dimensions of value: dopamine neurons represent reward but not aversiveness.

Authors:  Christopher D Fiorillo
Journal:  Science       Date:  2013-08-02       Impact factor: 47.728

Review 4.  A neural substrate of prediction and reward.

Authors:  W Schultz; P Dayan; P R Montague
Journal:  Science       Date:  1997-03-14       Impact factor: 47.728

Review 5.  Believing in dopamine.

Authors:  Samuel J Gershman; Naoshige Uchida
Journal:  Nat Rev Neurosci       Date:  2019-09-30       Impact factor: 34.870

6.  Midbrain dopamine neurons signal aversion in a reward-context-dependent manner.

Authors:  Hideyuki Matsumoto; Ju Tian; Naoshige Uchida; Mitsuko Watabe-Uchida
Journal:  Elife       Date:  2016-10-19       Impact factor: 8.140

7.  Human substantia nigra neurons encode unexpected financial rewards.

Authors:  Kareem A Zaghloul; Justin A Blanco; Christoph T Weidemann; Kathryn McGill; Jurg L Jaggi; Gordon H Baltuch; Michael J Kahana
Journal:  Science       Date:  2009-03-13       Impact factor: 47.728

8.  Medial prefrontal cortex as an action-outcome predictor.

Authors:  William H Alexander; Joshua W Brown
Journal:  Nat Neurosci       Date:  2011-09-18       Impact factor: 24.884

9.  Dopamine neurons share common response function for reward prediction error.

Authors:  Neir Eshel; Ju Tian; Michael Bukwich; Naoshige Uchida
Journal:  Nat Neurosci       Date:  2016-02-08       Impact factor: 24.884

10.  Signed and unsigned reward prediction errors dynamically enhance learning and memory.

Authors:  Nina Rouhani; Yael Niv
Journal:  Elife       Date:  2021-03-04       Impact factor: 8.140

View more
  2 in total

1.  Electrophysiological foundations of the human default-mode network revealed by intracranial-EEG recordings during resting-state and cognition.

Authors:  Anup Das; Carlo de Los Angeles; Vinod Menon
Journal:  Neuroimage       Date:  2022-01-21       Impact factor: 6.556

2.  Electrophysiological evidence for the effects of pain on the different stages of reward evaluation under a purchasing situation.

Authors:  Qingguo Ma; Wenhao Mao; Linfeng Hu
Journal:  Front Psychol       Date:  2022-09-27
  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.