Literature DB >> 25066083

A reinforcement learning mechanism responsible for the valuation of free choice.

Jeffrey Cockburn1, Anne G E Collins1, Michael J Frank2.   

Abstract

Humans exhibit a preference for options they have freely chosen over equally valued options they have not; however, the neural mechanism that drives this bias and its functional significance have yet to be identified. Here, we propose a model in which choice biases arise due to amplified positive reward prediction errors associated with free choice. Using a novel variant of a probabilistic learning task, we show that choice biases are selective to options that are predominantly associated with positive outcomes. A polymorphism in DARPP-32, a gene linked to dopaminergic striatal plasticity and individual differences in reinforcement learning, was found to predict the effect of choice as a function of value. We propose that these choice biases are the behavioral byproduct of a credit assignment mechanism responsible for ensuring the effective delivery of dopaminergic reinforcement learning signals broadcast to the striatum.
Copyright © 2014 Elsevier Inc. All rights reserved.

Entities:  

Mesh:

Substances:

Year:  2014        PMID: 25066083      PMCID: PMC4126879          DOI: 10.1016/j.neuron.2014.06.035

Source DB:  PubMed          Journal:  Neuron        ISSN: 0896-6273            Impact factor:   17.173


  33 in total

1.  Do decisions shape preference? Evidence from blind choice.

Authors:  Tali Sharot; Cristina M Velasquez; Raymond J Dolan
Journal:  Psychol Sci       Date:  2010-08-02

2.  Dopaminergic genes predict individual differences in susceptibility to confirmation bias.

Authors:  Bradley B Doll; Kent E Hutchison; Michael J Frank
Journal:  J Neurosci       Date:  2011-04-20       Impact factor: 6.167

3.  Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism.

Authors:  Michael J Frank
Journal:  J Cogn Neurosci       Date:  2005-01       Impact factor: 3.225

4.  Human reinforcement learning subdivides structured action spaces by learning effector-specific values.

Authors:  Samuel J Gershman; Bijan Pesaran; Nathaniel D Daw
Journal:  J Neurosci       Date:  2009-10-28       Impact factor: 6.167

5.  A phosphatase cascade by which rewarding stimuli control nucleosomal response.

Authors:  Alexandre Stipanovich; Emmanuel Valjent; Miriam Matamales; Akinori Nishi; Jung-Hyuck Ahn; Matthieu Maroteaux; Jesus Bertran-Gonzalez; Karen Brami-Cherrier; Hervé Enslen; Anne-Gaëlle Corbillé; Odile Filhol; Angus C Nairn; Paul Greengard; Denis Hervé; Jean-Antoine Girault
Journal:  Nature       Date:  2008-05-21       Impact factor: 49.962

6.  How choice reveals and shapes expected hedonic outcome.

Authors:  Tali Sharot; Benedetto De Martino; Raymond J Dolan
Journal:  J Neurosci       Date:  2009-03-25       Impact factor: 6.167

7.  C957T polymorphism of dopamine D2 receptor gene affects striatal DRD2 in vivo availability by changing the receptor affinity.

Authors:  Mika M Hirvonen; Aki Laakso; Kjell Någren; Juha O Rinne; Tiina Pohjalainen; Jarmo Hietala
Journal:  Synapse       Date:  2009-10       Impact factor: 2.562

Review 8.  Fitness and its role in evolutionary genetics.

Authors:  H Allen Orr
Journal:  Nat Rev Genet       Date:  2009-08       Impact factor: 53.242

9.  Bayesian model selection for group studies.

Authors:  Klaas Enno Stephan; Will D Penny; Jean Daunizeau; Rosalyn J Moran; Karl J Friston
Journal:  Neuroimage       Date:  2009-03-20       Impact factor: 6.556

10.  Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation.

Authors:  Michael J Frank; Bradley B Doll; Jen Oas-Terpstra; Francisco Moreno
Journal:  Nat Neurosci       Date:  2009-07-20       Impact factor: 24.884

View more
  35 in total

1.  Surprise! Dopamine signals mix action, value and error.

Authors:  Anne G E Collins; Michael J Frank
Journal:  Nat Neurosci       Date:  2016-01       Impact factor: 24.884

2.  The simple act of choosing influences declarative memory.

Authors:  Vishnu P Murty; Sarah DuBrow; Lila Davachi
Journal:  J Neurosci       Date:  2015-04-22       Impact factor: 6.167

3.  Dopaminergic Modulation of Decision Making and Subjective Well-Being.

Authors:  Robb B Rutledge; Nikolina Skandali; Peter Dayan; Raymond J Dolan
Journal:  J Neurosci       Date:  2015-07-08       Impact factor: 6.167

4.  Functional heterogeneity of perceived control in feedback processing.

Authors:  Ya Zheng; Mengyao Wang; Shiyu Zhou; Jing Xu
Journal:  Soc Cogn Affect Neurosci       Date:  2020-05-19       Impact factor: 3.436

5.  Injection of a dopamine type 2 receptor antagonist into the dorsal striatum disrupts choices driven by previous outcomes, but not perceptual inference.

Authors:  Eunjeong Lee; Moonsang Seo; Olga Dal Monte; Bruno B Averbeck
Journal:  J Neurosci       Date:  2015-04-22       Impact factor: 6.167

6.  The good, the bad and the brain: Neural correlates of appetitive and aversive values underlying decision making.

Authors:  Mathias Pessiglione; Mauricio R Delgado
Journal:  Curr Opin Behav Sci       Date:  2015-08-24

7.  Reinforcement learning with Marr.

Authors:  Yael Niv; Angela Langdon
Journal:  Curr Opin Behav Sci       Date:  2016-10

8.  Interactions Among Working Memory, Reinforcement Learning, and Effort in Value-Based Choice: A New Paradigm and Selective Deficits in Schizophrenia.

Authors:  Anne G E Collins; Matthew A Albrecht; James A Waltz; James M Gold; Michael J Frank
Journal:  Biol Psychiatry       Date:  2017-05-31       Impact factor: 13.382

9.  Cognitive states influence dopamine-driven aberrant learning in Parkinson's disease.

Authors:  James F Cavanagh; Andrea A Mueller; Darin R Brown; Jacqueline R Janowich; Jacqueline H Story-Remer; Ashley Wegele; Sarah Pirio Richardson
Journal:  Cortex       Date:  2017-03-20       Impact factor: 4.027

10.  Taming the beast: extracting generalizable knowledge from computational models of cognition.

Authors:  Matthew R Nassar; Michael J Frank
Journal:  Curr Opin Behav Sci       Date:  2016-10
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.