Literature DB >> 20858518

Subjective and model-estimated reward prediction: association with the feedback-related negativity (FRN) and reward prediction error in a reinforcement learning task.

Naho Ichikawa1, Greg J Siegle, Alexandre Dombrovski, Hideki Ohira.   

Abstract

In this study, we examined whether the feedback-related negativity (FRN) is associated with both subjective and objective (model-estimated) reward prediction errors (RPE) per trial in a reinforcement learning task in healthy adults (n=25). The level of RPE was assessed by 1) subjective ratings per trial and by 2) a computational model of reinforcement learning. As results, model-estimated RPE was highly correlated with subjective RPE (r=.82), and the grand-averaged ERP waves based on the trials with high and low model-estimated RPE showed the significant difference only in the time period of the FRN component (p<.05). Regardless of the time course of learning, FRN was associated with both subjective and model-estimated RPEs within subject (r=.47, p<.001; r=.40, p<.05) and between subjects (r=.33, p<.05; r=.41, p<.005) only in the Learnable condition where the internal reward prediction varied enough with a behavior-reward contingency.
Copyright © 2010 Elsevier B.V. All rights reserved.

Entities:  

Mesh:

Year:  2010        PMID: 20858518      PMCID: PMC3150511          DOI: 10.1016/j.ijpsycho.2010.09.001

Source DB:  PubMed          Journal:  Int J Psychophysiol        ISSN: 0167-8760            Impact factor:   2.997


  39 in total

1.  ERP correlates of feedback and reward processing in the presence and absence of response choice.

Authors:  Nick Yeung; Clay B Holroyd; Jonathan D Cohen
Journal:  Cereb Cortex       Date:  2004-08-18       Impact factor: 5.357

Review 2.  Computational roles for dopamine in behavioural control.

Authors:  P Read Montague; Steven E Hyman; Jonathan D Cohen
Journal:  Nature       Date:  2004-10-14       Impact factor: 49.962

Review 3.  Neural systems for error monitoring: recent findings and theoretical perspectives.

Authors:  Stephan F Taylor; Emily R Stern; William J Gehring
Journal:  Neuroscientist       Date:  2007-04       Impact factor: 7.519

4.  Affective-motivational influences on feedback-related ERPs in a gambling task.

Authors:  Hiroaki Masaki; Shigeki Takeuchi; William J Gehring; Noriyoshi Takasawa; Katuo Yamazaki
Journal:  Brain Res       Date:  2006-02-17       Impact factor: 3.252

5.  Individual differences and the neural representations of reward expectation and reward prediction error.

Authors:  Michael X Cohen
Journal:  Soc Cogn Affect Neurosci       Date:  2007-03       Impact factor: 3.436

6.  Differential encoding of losses and gains in the human striatum.

Authors:  Ben Seymour; Nathaniel Daw; Peter Dayan; Tania Singer; Ray Dolan
Journal:  J Neurosci       Date:  2007-05-02       Impact factor: 6.167

7.  Individual differences in reinforcement learning: behavioral, electrophysiological, and neuroimaging correlates.

Authors:  Diane L Santesso; Daniel G Dillon; Jeffrey L Birk; Avram J Holmes; Elena Goetz; Ryan Bogdan; Diego A Pizzagalli
Journal:  Neuroimage       Date:  2008-07-02       Impact factor: 6.556

8.  Error monitoring using external feedback: specific roles of the habenular complex, the reward system, and the cingulate motor area revealed by functional magnetic resonance imaging.

Authors:  Markus Ullsperger; D Yves von Cramon
Journal:  J Neurosci       Date:  2003-05-15       Impact factor: 6.167

Review 9.  Predictive reward signal of dopamine neurons.

Authors:  W Schultz
Journal:  J Neurophysiol       Date:  1998-07       Impact factor: 2.714

10.  Better or worse than expected? Aging, learning, and the ERN.

Authors:  Ben Eppinger; Jutta Kray; Barbara Mock; Axel Mecklinger
Journal:  Neuropsychologia       Date:  2007-09-07       Impact factor: 3.139

View more
  7 in total

1.  Frontal theta reflects uncertainty and unexpectedness during exploration and exploitation.

Authors:  James F Cavanagh; Christina M Figueroa; Michael X Cohen; Michael J Frank
Journal:  Cereb Cortex       Date:  2011-11-25       Impact factor: 5.357

Review 2.  Learning from experience: event-related potential correlates of reward processing, neural adaptation, and behavioral choice.

Authors:  Matthew M Walsh; John R Anderson
Journal:  Neurosci Biobehav Rev       Date:  2012-06-07       Impact factor: 8.989

3.  Frontal midline theta reflects anxiety and cognitive control: meta-analytic evidence.

Authors:  James F Cavanagh; Alexander J Shackman
Journal:  J Physiol Paris       Date:  2014-04-29

4.  Decision-making based on emotional images.

Authors:  Kentaro Katahira; Tomomi Fujimura; Kazuo Okanoya; Masato Okada
Journal:  Front Psychol       Date:  2011-10-28

5.  Visual Feedback Modulates Aftereffects and Electrophysiological Markers of Prism Adaptation.

Authors:  Jasmine R Aziz; Stephane J MacLean; Olave E Krigolson; Gail A Eskes
Journal:  Front Hum Neurosci       Date:  2020-04-17       Impact factor: 3.169

6.  Revisiting the importance of model fitting for model-based fMRI: It does matter in computational psychiatry.

Authors:  Kentaro Katahira; Asako Toyama
Journal:  PLoS Comput Biol       Date:  2021-02-09       Impact factor: 4.475

7.  Single-trial modeling separates multiple overlapping prediction errors during reward processing in human EEG.

Authors:  Colin W Hoy; Sheila C Steiner; Robert T Knight
Journal:  Commun Biol       Date:  2021-07-23
  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.