Literature DB >> 32398675

Dissociable neural correlates of uncertainty underlie different exploration strategies.

Momchil S Tomov1,2, Van Q Truong3, Rohan A Hundia3, Samuel J Gershman3.   

Abstract

Most real-world decisions involve a delicate balance between exploring unfamiliar alternatives and committing to the best known option. Previous work has shown that humans rely on different forms of uncertainty to negotiate this "explore-exploit" trade-off, yet the neural basis of the underlying computations remains unclear. Using fMRI (n = 31), we find that relative uncertainty is represented in right rostrolateral prefrontal cortex and drives directed exploration, while total uncertainty is represented in right dorsolateral prefrontal cortex and drives random exploration. The decision value signal combining relative and total uncertainty to compute choice is reflected in motor cortex activity. The variance of this signal scales with total uncertainty, consistent with a sampling mechanism for random exploration. Overall, these results are consistent with a hybrid computational architecture in which different uncertainty computations are performed separately and then combined by downstream decision circuits to compute choice.

Entities:  

Mesh:

Year:  2020        PMID: 32398675      PMCID: PMC7217879          DOI: 10.1038/s41467-020-15766-z

Source DB:  PubMed          Journal:  Nat Commun        ISSN: 2041-1723            Impact factor:   14.919


  40 in total

1.  Decisions from experience and the effect of rare events in risky choice.

Authors:  Ralph Hertwig; Greg Barron; Elke U Weber; Ido Erev
Journal:  Psychol Sci       Date:  2004-08

2.  Comparison of basic assumptions embedded in learning models for experience-based decision making.

Authors:  Eldad Yechiam; Jerome R Busemeyer
Journal:  Psychon Bull Rev       Date:  2005-06

3.  Uncertainty and exploration in a restless bandit problem.

Authors:  Maarten Speekenbrink; Emmanouil Konstantinidis
Journal:  Top Cogn Sci       Date:  2015-04-20

4.  Humans use directed and random exploration to solve the explore-exploit dilemma.

Authors:  Robert C Wilson; Andra Geana; John M White; Elliot A Ludvig; Jonathan D Cohen
Journal:  J Exp Psychol Gen       Date:  2014-10-27

5.  Cortical substrates for exploratory decisions in humans.

Authors:  Nathaniel D Daw; John P O'Doherty; Peter Dayan; Ben Seymour; Raymond J Dolan
Journal:  Nature       Date:  2006-06-15       Impact factor: 49.962

6.  Deconstructing the human algorithms for exploration.

Authors:  Samuel J Gershman
Journal:  Cognition       Date:  2017-12-29

Review 7.  The algorithmic architecture of exploration in the human brain.

Authors:  Eric Schulz; Samuel J Gershman
Journal:  Curr Opin Neurobiol       Date:  2018-12-06       Impact factor: 6.627

8.  Generalization guides human exploration in vast decision spaces.

Authors:  Charley M Wu; Eric Schulz; Maarten Speekenbrink; Jonathan D Nelson; Björn Meder
Journal:  Nat Hum Behav       Date:  2018-11-12

9.  Predicting risk sensitivity in humans and lower animals: risk as variance or coefficient of variation.

Authors:  Elke U Weber; Sharoni Shafir; Ann-Renee Blais
Journal:  Psychol Rev       Date:  2004-04       Impact factor: 8.934

10.  Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation.

Authors:  Michael J Frank; Bradley B Doll; Jen Oas-Terpstra; Francisco Moreno
Journal:  Nat Neurosci       Date:  2009-07-20       Impact factor: 24.884

View more
  10 in total

1.  Gated recurrence enables simple and accurate sequence prediction in stochastic, changing, and structured environments.

Authors:  Cédric Foucault; Florent Meyniel
Journal:  Elife       Date:  2021-12-02       Impact factor: 8.140

Review 2.  From exploration to exploitation: a shifting mental mode in late life development.

Authors:  R Nathan Spreng; Gary R Turner
Journal:  Trends Cogn Sci       Date:  2021-09-27       Impact factor: 20.229

3.  Conceptualisation of Uncertainty in Decision Neuroscience Research: Do We Really Know What Types of Uncertainties The Measured Neural Correlates Relate To?

Authors:  Michal Müller; Petr Adámek; Silvie Kotherová; Marek Petrů; Tomáš Bubík; Anna Daušová; Leona Pelíšková
Journal:  Integr Psychol Behav Sci       Date:  2022-08-09       Impact factor: 1.156

Review 4.  Decision neuroscience and neuroeconomics: Recent progress and ongoing challenges.

Authors:  Jeffrey B Dennison; Daniel Sazhin; David V Smith
Journal:  Wiley Interdiscip Rev Cogn Sci       Date:  2022-02-08

5.  Independent and interacting value systems for reward and information in the human brain.

Authors:  Irene Cogliati Dezza; Axel Cleeremans; William H Alexander
Journal:  Elife       Date:  2022-04-13       Impact factor: 8.713

6.  Balancing exploration and exploitation with information and randomization.

Authors:  Robert C Wilson; Elizabeth Bonawitz; Vincent D Costa; R Becket Ebitz
Journal:  Curr Opin Behav Sci       Date:  2020-11-06

7.  Reinforcement learning approaches to hippocampus-dependent flexible spatial navigation.

Authors:  Charline Tessereau; Reuben O'Dea; Stephen Coombes; Tobias Bast
Journal:  Brain Neurosci Adv       Date:  2021-04-09

8.  Contributions of expected learning progress and perceptual novelty to curiosity-driven exploration.

Authors:  Francesco Poli; Marlene Meyer; Rogier B Mars; Sabine Hunnius
Journal:  Cognition       Date:  2022-04-12

9.  Directed information flow during laparoscopic surgical skill acquisition dissociated skill level and medical simulation technology.

Authors:  Anil Kamat; Basiel Makled; Jack Norfleet; Steven D Schwaitzberg; Xavier Intes; Suvranu De; Anirban Dutta
Journal:  NPJ Sci Learn       Date:  2022-08-25

10.  Distinct motivations to seek out information in healthy individuals and problem gamblers.

Authors:  Irene Cogliati Dezza; Xavier Noel; Axel Cleeremans; Angela J Yu
Journal:  Transl Psychiatry       Date:  2021-07-26       Impact factor: 6.222

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.