Literature DB >> 33393461

Human complex exploration strategies are enriched by noradrenaline-modulated heuristics.

Magda Dubois1,2, Johanna Habicht1,2, Jochen Michely1,2,3, Rani Moran1,2, Ray J Dolan1,2, Tobias U Hauser1,2.   

Abstract

An exploration-exploitation trade-off, the arbitration between sampling a lesser-known against a known rich option, is thought to be solved using computationally demanding exploration algorithms. Given known limitations in human cognitive resources, we hypothesised the presence of additional cheaper strategies. We examined for such heuristics in choice behaviour where we show this involves a value-free random exploration, that ignores all prior knowledge, and a novelty exploration that targets novel options alone. In a double-blind, placebo-controlled drug study, assessing contributions of dopamine (400 mg amisulpride) and noradrenaline (40 mg propranolol), we show that value-free random exploration is attenuated under the influence of propranolol, but not under amisulpride. Our findings demonstrate that humans deploy distinct computationally cheap exploration strategies and that value-free random exploration is under noradrenergic control.
© 2021, Dubois et al.

Entities:  

Keywords:  dopamine; exploration-exploitation; human; neuroscience; noradrenaline

Mesh:

Substances:

Year:  2021        PMID: 33393461      PMCID: PMC7815309          DOI: 10.7554/eLife.59907

Source DB:  PubMed          Journal:  Elife        ISSN: 2050-084X            Impact factor:   8.713


  88 in total

1.  Capacity limits of information processing in the brain.

Authors:  René Marois; Jason Ivanoff
Journal:  Trends Cogn Sci       Date:  2005-06       Impact factor: 20.229

2.  Generalization guides human exploration in vast decision spaces.

Authors:  Charley M Wu; Eric Schulz; Maarten Speekenbrink; Jonathan D Nelson; Björn Meder
Journal:  Nat Hum Behav       Date:  2018-11-12

3.  Novelty and Inductive Generalization in Human Reinforcement Learning.

Authors:  Samuel J Gershman; Yael Niv
Journal:  Top Cogn Sci       Date:  2015-03-23

4.  Trait anxiety affects decision-making differently in healthy men and women: towards gender-specific endophenotypes of anxiety.

Authors:  L de Visser; L J van der Knaap; A J A E van de Loo; C M M van der Weerd; F Ohl; R van den Bos
Journal:  Neuropsychologia       Date:  2010-02-06       Impact factor: 3.139

5.  Noradrenaline and dopamine elevations in the rat prefrontal cortex in spatial working memory.

Authors:  Zvani L Rossetti; Sonia Carboni
Journal:  J Neurosci       Date:  2005-03-02       Impact factor: 6.167

6.  Comparison of ketanserin, buspirone and propranolol on arousal, pupil size and autonomic function in healthy volunteers.

Authors:  Vassilis Koudas; Alexandra Nikolaou; Eugenia Hourdaki; Stella G Giakoumaki; Panos Roussos; Panos Bitsios
Journal:  Psychopharmacology (Berl)       Date:  2009-03-14       Impact factor: 4.530

7.  Serotonin and dopamine play complementary roles in gambling to recover losses.

Authors:  Daniel Campbell-Meiklejohn; Judi Wakeley; Vanessa Herbert; Jennifer Cook; Paolo Scollo; Manaan Kar Ray; Sudhakar Selvaraj; Richard E Passingham; Phillip Cowen; Robert D Rogers
Journal:  Neuropsychopharmacology       Date:  2010-10-27       Impact factor: 7.853

8.  Noradrenaline blockade specifically enhances metacognitive performance.

Authors:  Tobias U Hauser; Micah Allen; Nina Purg; Michael Moutoussis; Geraint Rees; Raymond J Dolan
Journal:  Elife       Date:  2017-05-10       Impact factor: 8.140

9.  Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation.

Authors:  Michael J Frank; Bradley B Doll; Jen Oas-Terpstra; Francisco Moreno
Journal:  Nat Neurosci       Date:  2009-07-20       Impact factor: 24.884

10.  Dual contributions of noradrenaline to behavioural flexibility and motivation.

Authors:  Caroline I Jahn; Sophie Gilardeau; Chiara Varazzani; Bastien Blain; Jerome Sallet; Mark E Walton; Sebastien Bouret
Journal:  Psychopharmacology (Berl)       Date:  2018-07-11       Impact factor: 4.530

View more
  7 in total

Review 1.  From exploration to exploitation: a shifting mental mode in late life development.

Authors:  R Nathan Spreng; Gary R Turner
Journal:  Trends Cogn Sci       Date:  2021-09-27       Impact factor: 20.229

2.  Humans adaptively resolve the explore-exploit dilemma under cognitive constraints: Evidence from a multi-armed bandit task.

Authors:  Vanessa M Brown; Michael N Hallquist; Michael J Frank; Alexandre Y Dombrovski
Journal:  Cognition       Date:  2022-07-30

3.  Trait somatic anxiety is associated with reduced directed exploration and underestimation of uncertainty.

Authors:  Haoxue Fan; Samuel J Gershman; Elizabeth A Phelps
Journal:  Nat Hum Behav       Date:  2022-10-03

4.  Exploration heuristics decrease during youth.

Authors:  Magda Dubois; Aislinn Bowler; Madeleine E Moses-Payne; Johanna Habicht; Rani Moran; Nikolaus Steinbeis; Tobias U Hauser
Journal:  Cogn Affect Behav Neurosci       Date:  2022-05-19       Impact factor: 3.526

5.  Value-free random exploration is linked to impulsivity.

Authors:  Magda Dubois; Tobias U Hauser
Journal:  Nat Commun       Date:  2022-08-04       Impact factor: 17.694

6.  Distinct motivations to seek out information in healthy individuals and problem gamblers.

Authors:  Irene Cogliati Dezza; Xavier Noel; Axel Cleeremans; Angela J Yu
Journal:  Transl Psychiatry       Date:  2021-07-26       Impact factor: 6.222

Review 7.  Neuromodulation of prefrontal cortex cognitive function in primates: the powerful roles of monoamines and acetylcholine.

Authors:  Roshan Cools; Amy F T Arnsten
Journal:  Neuropsychopharmacology       Date:  2021-07-26       Impact factor: 7.853

  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.