Literature DB >> 17215398

Reinforcement learning signals predict future decisions.

Michael X Cohen1, Charan Ranganath.   

Abstract

Optimal behavior in a competitive world requires the flexibility to adapt decision strategies based on recent outcomes. In the present study, we tested the hypothesis that this flexibility emerges through a reinforcement learning process, in which reward prediction errors are used dynamically to adjust representations of decision options. We recorded event-related brain potentials (ERPs) while subjects played a strategic economic game against a computer opponent to evaluate how neural responses to outcomes related to subsequent decision-making. Analyses of ERP data focused on the feedback-related negativity (FRN), an outcome-locked potential thought to reflect a neural prediction error signal. Consistent with predictions of a computational reinforcement learning model, we found that the magnitude of ERPs after losing to the computer opponent predicted whether subjects would change decision behavior on the subsequent trial. Furthermore, FRNs to decision outcomes were disproportionately larger over the motor cortex contralateral to the response hand that was used to make the decision. These findings provide novel evidence that humans engage a reinforcement learning process to adjust representations of competing decision options.

Entities:  

Mesh:

Year:  2007        PMID: 17215398      PMCID: PMC6672075          DOI: 10.1523/JNEUROSCI.4421-06.2007

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  60 in total

1.  Removing electroencephalographic artifacts by blind source separation.

Authors:  T P Jung; S Makeig; C Humphries; T W Lee; M J McKeown; V Iragui; T J Sejnowski
Journal:  Psychophysiology       Date:  2000-03       Impact factor: 4.016

2.  Representation of a perceptual decision in developing oculomotor commands.

Authors:  J I Gold; M N Shadlen
Journal:  Nature       Date:  2000-03-23       Impact factor: 49.962

3.  Detecting the onset of the lateralized readiness potential: a comparison of available methods and procedures.

Authors:  J T Mordkoff; P J Gianaros
Journal:  Psychophysiology       Date:  2000-05       Impact factor: 4.016

4.  Functions of the medial frontal cortex in the processing of conflict and errors.

Authors:  W J Gehring; D E Fencsik
Journal:  J Neurosci       Date:  2001-12-01       Impact factor: 6.167

5.  A computational model of action selection in the basal ganglia. I. A new functional anatomy.

Authors:  K Gurney; T J Prescott; P Redgrave
Journal:  Biol Cybern       Date:  2001-06       Impact factor: 2.086

6.  Medial prefrontal cortex and error potentials.

Authors:  Clay B Holroyd; Michael G H Coles; Sander Nieuwenhuis
Journal:  Science       Date:  2002-05-31       Impact factor: 47.728

Review 7.  The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum.

Authors:  D Joel; I Weiner
Journal:  Neuroscience       Date:  2000       Impact factor: 3.590

8.  The medial frontal cortex and the rapid processing of monetary gains and losses.

Authors:  William J Gehring; Adrian R Willoughby
Journal:  Science       Date:  2002-03-22       Impact factor: 47.728

9.  Dopamine responses comply with basic assumptions of formal learning theory.

Authors:  P Waelti; A Dickinson; W Schultz
Journal:  Nature       Date:  2001-07-05       Impact factor: 49.962

10.  Error-related brain potentials are differentially related to awareness of response errors: evidence from an antisaccade task.

Authors:  S Nieuwenhuis; K R Ridderinkhof; J Blom; G P Band; A Kok
Journal:  Psychophysiology       Date:  2001-09       Impact factor: 4.016

View more
  99 in total

1.  Brain oscillatory activity associated with task switching and feedback processing.

Authors:  Toni Cunillera; Lluís Fuentemilla; Jose Periañez; Josep Marco-Pallarès; Ulrike M Krämer; Estela Càmara; Thomas F Münte; Antoni Rodríguez-Fornells
Journal:  Cogn Affect Behav Neurosci       Date:  2012-03       Impact factor: 3.282

Review 2.  Learning from experience: event-related potential correlates of reward processing, neural adaptation, and behavioral choice.

Authors:  Matthew M Walsh; John R Anderson
Journal:  Neurosci Biobehav Rev       Date:  2012-06-07       Impact factor: 8.989

3.  Anxiety and outcome evaluation: the good, the bad and the ambiguous.

Authors:  Ruolei Gu; Yue Ge; Yang Jiang; Yue-jia Luo
Journal:  Biol Psychol       Date:  2010-07-07       Impact factor: 3.251

4.  Punishing an error improves learning: the influence of punishment magnitude on error-related neural activity and subsequent learning.

Authors:  Robert Hester; Kevin Murphy; Felicity L Brown; Ashley J Skilleter
Journal:  J Neurosci       Date:  2010-11-17       Impact factor: 6.167

5.  Perceptual Salience and Reward Both Influence Feedback-Related Neural Activity Arising from Choice.

Authors:  Bin Lou; Wha-Yin Hsu; Paul Sajda
Journal:  J Neurosci       Date:  2015-09-23       Impact factor: 6.167

6.  Modulation of the feedback-related negativity by instruction and experience.

Authors:  Matthew M Walsh; John R Anderson
Journal:  Proc Natl Acad Sci U S A       Date:  2011-11-07       Impact factor: 11.205

7.  Medial prefrontal cortex predicts and evaluates the timing of action outcomes.

Authors:  Sarah E Forster; Joshua W Brown
Journal:  Neuroimage       Date:  2010-11-18       Impact factor: 6.556

8.  Reward processing deficits and impulsivity in high-risk offspring of alcoholics: A study of event-related potentials during a monetary gambling task.

Authors:  Chella Kamarajan; Ashwini K Pandey; David B Chorlian; Niklas Manz; Arthur T Stimus; Lance O Bauer; Victor M Hesselbrock; Marc A Schuckit; Samuel Kuperman; John Kramer; Bernice Porjesz
Journal:  Int J Psychophysiol       Date:  2015-09-18       Impact factor: 2.997

Review 9.  Neurocomputational models of basal ganglia function in learning, memory and choice.

Authors:  Michael X Cohen; Michael J Frank
Journal:  Behav Brain Res       Date:  2008-10-04       Impact factor: 3.332

10.  Frontal theta links prediction errors to behavioral adaptation in reinforcement learning.

Authors:  James F Cavanagh; Michael J Frank; Theresa J Klein; John J B Allen
Journal:  Neuroimage       Date:  2009-12-05       Impact factor: 6.556

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.