Literature DB >> 30347192

Dopaminergic genes are associated with both directed and random exploration.

Samuel J Gershman1, Bastian Greshake Tzovaras2.   

Abstract

In order to maximize long-term rewards, agents must balance exploitation (choosing the option with the highest payoff) and exploration (gathering information about options that might have higher payoffs). Although the optimal solution to this trade-off is intractable, humans make use of two effective strategies: selectively exploring options with high uncertainty (directed exploration), and increasing the randomness of their choices when they are more uncertain (random exploration). Using a task that independently manipulates these two forms of exploration, we show that single nucleotide polymorphisms related to dopamine are associated with individual differences in exploration strategies. Variation in a gene linked to prefrontal dopamine (COMT) predicted the degree of directed exploration, as well as the overall randomness of responding. Variation in a gene linked to striatal dopamine (DARPP-32) predicted the degree of both directed and random exploration. These findings suggest that dopamine makes multiple contributions to exploration, depending on its afferent target.
Copyright © 2018 Elsevier Ltd. All rights reserved.

Entities:  

Keywords:  Bayesian inference; Explore-exploit dilemma; Reinforcement learning

Mesh:

Substances:

Year:  2018        PMID: 30347192     DOI: 10.1016/j.neuropsychologia.2018.10.009

Source DB:  PubMed          Journal:  Neuropsychologia        ISSN: 0028-3932            Impact factor:   3.139


  15 in total

1.  Attenuated Directed Exploration during Reinforcement Learning in Gambling Disorder.

Authors:  A Wiehler; K Chakroun; J Peters
Journal:  J Neurosci       Date:  2021-02-02       Impact factor: 6.167

2.  Impulsivity and risk-seeking as Bayesian inference under dopaminergic control.

Authors:  John G Mikhael; Samuel J Gershman
Journal:  Neuropsychopharmacology       Date:  2021-08-10       Impact factor: 7.853

3.  Different brain systems support learning from received and avoided pain during human pain-avoidance learning.

Authors:  Marieke Jepma; Mathieu Roy; Kiran Ramlakhan; Monique van Velzen; Albert Dahan
Journal:  Elife       Date:  2022-06-22       Impact factor: 8.713

4.  Trait somatic anxiety is associated with reduced directed exploration and underestimation of uncertainty.

Authors:  Haoxue Fan; Samuel J Gershman; Elizabeth A Phelps
Journal:  Nat Hum Behav       Date:  2022-10-03

5.  A neural and behavioral trade-off between value and uncertainty underlies exploratory decisions in normative anxiety.

Authors:  Kristoffer C Aberg; Ido Toren; Rony Paz
Journal:  Mol Psychiatry       Date:  2021-11-01       Impact factor: 13.437

6.  Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making.

Authors:  Karima Chakroun; David Mathar; Antonius Wiehler; Florian Ganzer; Jan Peters
Journal:  Elife       Date:  2020-06-02       Impact factor: 8.140

7.  Differential contributions of striatal dopamine D1 and D2 receptors to component processes of value-based decision making.

Authors:  Roger A H Adan; Louk J M J Vanderschuren; Jeroen P H Verharen
Journal:  Neuropsychopharmacology       Date:  2019-06-29       Impact factor: 7.853

8.  Balancing exploration and exploitation with information and randomization.

Authors:  Robert C Wilson; Elizabeth Bonawitz; Vincent D Costa; R Becket Ebitz
Journal:  Curr Opin Behav Sci       Date:  2020-11-06

9.  Dynamic decision policy reconfiguration under outcome uncertainty.

Authors:  Krista Bond; Kyle Dunovan; Alexis Porter; Jonathan E Rubin; Timothy Verstynen
Journal:  Elife       Date:  2021-12-24       Impact factor: 8.140

10.  Variability in Action Selection Relates to Striatal Dopamine 2/3 Receptor Availability in Humans: A PET Neuroimaging Study Using Reinforcement Learning and Active Inference Models.

Authors:  Rick A Adams; Michael Moutoussis; Matthew M Nour; Tarik Dahoun; Declan Lewis; Benjamin Illingworth; Mattia Veronese; Christoph Mathys; Lieke de Boer; Marc Guitart-Masip; Karl J Friston; Oliver D Howes; Jonathan P Roiser
Journal:  Cereb Cortex       Date:  2020-05-18       Impact factor: 5.357

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.