Literature DB >> 26324932

Evidence integration in model-based tree search.

Alec Solway1, Matthew M Botvinick2.   

Abstract

Research on the dynamics of reward-based, goal-directed decision making has largely focused on simple choice, where participants decide among a set of unitary, mutually exclusive options. Recent work suggests that the deliberation process underlying simple choice can be understood in terms of evidence integration: Noisy evidence in favor of each option accrues over time, until the evidence in favor of one option is significantly greater than the rest. However, real-life decisions often involve not one, but several steps of action, requiring a consideration of cumulative rewards and a sensitivity to recursive decision structure. We present results from two experiments that leveraged techniques previously applied to simple choice to shed light on the deliberation process underlying multistep choice. We interpret the results from these experiments in terms of a new computational model, which extends the evidence accumulation perspective to multiple steps of action.

Entities:  

Keywords:  drift-diffusion model; reinforcement learning; reward-based decision making

Mesh:

Year:  2015        PMID: 26324932      PMCID: PMC4577209          DOI: 10.1073/pnas.1505483112

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  39 in total

1.  Visual fixations and the computation and comparison of value in simple choice.

Authors:  Ian Krajbich; Carrie Armel; Antonio Rangel
Journal:  Nat Neurosci       Date:  2010-09-12       Impact factor: 24.884

2.  A recurrent network mechanism of time integration in perceptual decisions.

Authors:  Kong-Fatt Wong; Xiao-Jing Wang
Journal:  J Neurosci       Date:  2006-01-25       Impact factor: 6.167

Review 3.  The diffusion decision model: theory and data for two-choice decision tasks.

Authors:  Roger Ratcliff; Gail McKoon
Journal:  Neural Comput       Date:  2008-04       Impact factor: 2.026

4.  The Psychophysics Toolbox.

Authors:  D H Brainard
Journal:  Spat Vis       Date:  1997

5.  Disentangling decision models: from independence to competition.

Authors:  Andrei R Teodorescu; Marius Usher
Journal:  Psychol Rev       Date:  2013-01       Impact factor: 8.934

6.  Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates.

Authors:  Alec Solway; Matthew M Botvinick
Journal:  Psychol Rev       Date:  2012-01       Impact factor: 8.934

7.  A context-based theory of recency and contiguity in free recall.

Authors:  Per B Sederberg; Marc W Howard; Michael J Kahana
Journal:  Psychol Rev       Date:  2008-10       Impact factor: 8.934

8.  Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans.

Authors:  Peter Smittenaar; Thomas H B FitzGerald; Vincenzo Romei; Nicholas D Wright; Raymond J Dolan
Journal:  Neuron       Date:  2013-10-24       Impact factor: 17.173

9.  Optimal behavioral hierarchy.

Authors:  Alec Solway; Carlos Diuk; Natalia Córdova; Debbie Yee; Andrew G Barto; Yael Niv; Matthew M Botvinick
Journal:  PLoS Comput Biol       Date:  2014-08-14       Impact factor: 4.475

Review 10.  Goals and habits in the brain.

Authors:  Ray J Dolan; Peter Dayan
Journal:  Neuron       Date:  2013-10-16       Impact factor: 17.173

View more
  14 in total

1.  Continuous track paths reveal additive evidence integration in multistep decision making.

Authors:  Cristian Buc Calderon; Myrtille Dewulf; Wim Gevers; Tom Verguts
Journal:  Proc Natl Acad Sci U S A       Date:  2017-09-18       Impact factor: 11.205

2.  Generalization guides human exploration in vast decision spaces.

Authors:  Charley M Wu; Eric Schulz; Maarten Speekenbrink; Jonathan D Nelson; Björn Meder
Journal:  Nat Hum Behav       Date:  2018-11-12

Review 3.  Advances in modeling learning and decision-making in neuroscience.

Authors:  Anne G E Collins; Amitai Shenhav
Journal:  Neuropsychopharmacology       Date:  2021-08-27       Impact factor: 7.853

4.  A weighted constraint satisfaction approach to human goal-directed decision making.

Authors:  Yuxuan Li; James L McClelland
Journal:  PLoS Comput Biol       Date:  2022-06-16       Impact factor: 4.779

5.  Rational use of cognitive resources in human planning.

Authors:  Frederick Callaway; Bas van Opheusden; Sayan Gul; Priyam Das; Paul M Krueger; Thomas L Griffiths; Falk Lieder
Journal:  Nat Hum Behav       Date:  2022-04-28

Review 6.  Reinforcement Learning and Episodic Memory in Humans and Animals: An Integrative Framework.

Authors:  Samuel J Gershman; Nathaniel D Daw
Journal:  Annu Rev Psychol       Date:  2016-09-02       Impact factor: 24.137

7.  What to Choose Next? A Paradigm for Testing Human Sequential Decision Making.

Authors:  Elisa M Tartaglia; Aaron M Clarke; Michael H Herzog
Journal:  Front Psychol       Date:  2017-03-07

8.  Simulating future value in intertemporal choice.

Authors:  Alec Solway; Terry Lohrenz; P Read Montague
Journal:  Sci Rep       Date:  2017-02-22       Impact factor: 4.379

9.  The Neural Representation of Prospective Choice during Spatial Planning and Decisions.

Authors:  Raphael Kaplan; John King; Raphael Koster; William D Penny; Neil Burgess; Karl J Friston
Journal:  PLoS Biol       Date:  2017-01-12       Impact factor: 8.029

10.  Am I Self-Conscious? (Or Does Self-Organization Entail Self-Consciousness?).

Authors:  Karl Friston
Journal:  Front Psychol       Date:  2018-04-24
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.