Literature DB >> 31235598

Structured, uncertainty-driven exploration in real-world consumer choice.

Eric Schulz1, Rahul Bhui2, Bradley C Love3,4, Bastien Brier5, Michael T Todd5, Samuel J Gershman2.   

Abstract

Making good decisions requires people to appropriately explore their available options and generalize what they have learned. While computational models can explain exploratory behavior in constrained laboratory tasks, it is unclear to what extent these models generalize to real-world choice problems. We investigate the factors guiding exploratory behavior in a dataset consisting of 195,333 customers placing 1,613,967 orders from a large online food delivery service. We find important hallmarks of adaptive exploration and generalization, which we analyze using computational models. In particular, customers seem to engage in uncertainty-directed exploration and use feature-based generalization to guide their exploration. Our results provide evidence that people use sophisticated strategies to explore complex, real-world environments.

Entities:  

Keywords:  decision making; exploration; generalization; reinforcement learning

Year:  2019        PMID: 31235598      PMCID: PMC6628813          DOI: 10.1073/pnas.1821028116

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  19 in total

1.  Frontal cortex and the discovery of abstract action rules.

Authors:  David Badre; Andrew S Kayser; Mark D'Esposito
Journal:  Neuron       Date:  2010-04-29       Impact factor: 17.173

2.  Humans use directed and random exploration to solve the explore-exploit dilemma.

Authors:  Robert C Wilson; Andra Geana; John M White; Elliot A Ludvig; Jonathan D Cohen
Journal:  J Exp Psychol Gen       Date:  2014-10-27

3.  Explaining social learning of food preferences without aversions: an evolutionary simulation model of Norway rats.

Authors:  J Noble; P M Todd; E Tuci
Journal:  Proc Biol Sci       Date:  2001-01-22       Impact factor: 5.349

4.  Cortical substrates for exploratory decisions in humans.

Authors:  Nathaniel D Daw; John P O'Doherty; Peter Dayan; Ben Seymour; Raymond J Dolan
Journal:  Nature       Date:  2006-06-15       Impact factor: 49.962

5.  Novelty and Inductive Generalization in Human Reinforcement Learning.

Authors:  Samuel J Gershman; Yael Niv
Journal:  Top Cogn Sci       Date:  2015-03-23

6.  Generalization of value in reinforcement learning by humans.

Authors:  G Elliott Wimmer; Nathaniel D Daw; Daphna Shohamy
Journal:  Eur J Neurosci       Date:  2012-04       Impact factor: 3.386

Review 7.  Manifesto for a new (computational) cognitive revolution.

Authors:  Thomas L Griffiths
Journal:  Cognition       Date:  2014-12-08

Review 8.  Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration.

Authors:  Jonathan D Cohen; Samuel M McClure; Angela J Yu
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2007-05-29       Impact factor: 6.237

9.  The nature of belief-directed exploratory choice in human decision-making.

Authors:  W Bradley Knox; A Ross Otto; Peter Stone; Bradley C Love
Journal:  Front Psychol       Date:  2012-01-31

10.  Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation.

Authors:  Michael J Frank; Bradley B Doll; Jen Oas-Terpstra; Francisco Moreno
Journal:  Nat Neurosci       Date:  2009-07-20       Impact factor: 24.884

View more
  15 in total

1.  Scaling up psychology via Scientific Regret Minimization.

Authors:  Mayank Agrawal; Joshua C Peterson; Thomas L Griffiths
Journal:  Proc Natl Acad Sci U S A       Date:  2020-04-02       Impact factor: 11.205

Review 2.  Advances in modeling learning and decision-making in neuroscience.

Authors:  Anne G E Collins; Amitai Shenhav
Journal:  Neuropsychopharmacology       Date:  2021-08-27       Impact factor: 7.853

Review 3.  From exploration to exploitation: a shifting mental mode in late life development.

Authors:  R Nathan Spreng; Gary R Turner
Journal:  Trends Cogn Sci       Date:  2021-09-27       Impact factor: 20.229

4.  Humans adaptively resolve the explore-exploit dilemma under cognitive constraints: Evidence from a multi-armed bandit task.

Authors:  Vanessa M Brown; Michael N Hallquist; Michael J Frank; Alexandre Y Dombrovski
Journal:  Cognition       Date:  2022-07-30

5.  Superstitious learning of abstract order from random reinforcement.

Authors:  Yuhao Jin; Greg Jensen; Jacqueline Gottlieb; Vincent Ferrera
Journal:  Proc Natl Acad Sci U S A       Date:  2022-08-23       Impact factor: 12.779

6.  Balance between breadth and depth in human many-alternative decisions.

Authors:  Alice Vidal; Salvador Soto-Faraco; Rubén Moreno-Bote
Journal:  Elife       Date:  2022-09-15       Impact factor: 8.713

7.  Context-dependent choice and evaluation in real-world consumer behavior.

Authors:  Aaron M Bornstein; Kenway Louie; A Ross Otto; Sean Devine; Eric Schulz
Journal:  Sci Rep       Date:  2022-10-22       Impact factor: 4.996

8.  Balancing exploration and exploitation with information and randomization.

Authors:  Robert C Wilson; Elizabeth Bonawitz; Vincent D Costa; R Becket Ebitz
Journal:  Curr Opin Behav Sci       Date:  2020-11-06

9.  Resting functional connectivity of the left inferior frontal gyrus with the dorsomedial prefrontal cortex and temporoparietal junction reflects the social network size for active interactions.

Authors:  Kazuma Mori; Masahiko Haruno
Journal:  Hum Brain Mapp       Date:  2022-03-09       Impact factor: 5.399

10.  Impact of incentive and selection strength on green technology innovation in Moran process.

Authors:  Runtian Zhang; Jinye Li
Journal:  PLoS One       Date:  2020-06-30       Impact factor: 3.240

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.