Literature DB >> 25621287

Decision from Models: Generalizing Probability Information to Novel Tasks.

Hang Zhang1, Jacienta T Paily2, Laurence T Maloney1.   

Abstract

We investigate a new type of decision under risk where-to succeed-participants must generalize their experience in one set of tasks to a novel set of tasks. We asked participants to trade distance for reward in a virtual minefield where each successive step incurred the same fixed probability of failure (referred to as hazard). With constant hazard, the probability of success (the survival function) decreases exponentially with path length. On each trial, participants chose between a shorter path with smaller reward and a longer (more dangerous) path with larger reward. They received feedback in 160 training trials: encountering a mine along their chosen path resulted in zero reward and successful completion of the path led to the reward associated with the path chosen. They then completed 600 no-feedback test trials with novel combinations of path length and rewards. To maximize expected gain, participants had to learn the correct exponential model in training and generalize it to the test conditions. We compared how participants discounted reward with increasing path length to the predictions of nine choice models including the correct exponential model. The choices of a majority of the participants were best accounted for by a model of the correct exponential form although with marked overestimation of the hazard rate. The decision-from-models paradigm differs from experience-based decision paradigms such as decision-from-sampling in the importance assigned to generalizing experience-based information to novel tasks. The task itself is representative of everyday tasks involving repeated decisions in stochastically invariant environments.

Entities:  

Keywords:  constant hazard rate; decision from experience; decision under risk; exponential survival function; generalization

Year:  2015        PMID: 25621287      PMCID: PMC4300983          DOI: 10.1037/dec0000022

Source DB:  PubMed          Journal:  Decision (Wash D C )        ISSN: 2325-9965


  25 in total

1.  Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART).

Authors:  C W Lejuez; Jennifer P Read; Christopher W Kahler; Jerry B Richards; Susan E Ramsey; Gregory L Stuart; David R Strong; Richard A Brown
Journal:  J Exp Psychol Appl       Date:  2002-06

Review 2.  A discounting framework for choice with delayed and probabilistic rewards.

Authors:  Leonard Green; Joel Myerson
Journal:  Psychol Bull       Date:  2004-09       Impact factor: 17.737

3.  The conceptual basis of function learning and extrapolation: comparison of rule-based and associative-based models.

Authors:  Mark A McDaniel; Jerome R Busemeyer
Journal:  Psychon Bull Rev       Date:  2005-02

4.  Function learning: induction of continuous stimulus-response relations.

Authors:  K Koh; D E Meyer
Journal:  J Exp Psychol Learn Mem Cogn       Date:  1991-09       Impact factor: 3.051

5.  Decision making and learning while taking sequential risks.

Authors:  Timothy J Pleskac
Journal:  J Exp Psychol Learn Mem Cogn       Date:  2008-01       Impact factor: 3.051

6.  Cognitive maps in rats and men.

Authors:  E C TOLMAN
Journal:  Psychol Rev       Date:  1948-07       Impact factor: 8.934

7.  The Psychophysics Toolbox.

Authors:  D H Brainard
Journal:  Spat Vis       Date:  1997

8.  Extrapolation: the sine qua non for abstraction in function learning.

Authors:  E L DeLosh; J R Busemeyer; M A McDaniel
Journal:  J Exp Psychol Learn Mem Cogn       Date:  1997-07       Impact factor: 3.051

9.  The Wisdom of Individuals: Exploring People's Knowledge About Everyday Events Using Iterated Learning.

Authors:  Stephan Lewandowsky; Thomas L Griffiths; Michael L Kalish
Journal:  Cogn Sci       Date:  2009-05-19

10.  Testing whether humans have an accurate model of their own motor uncertainty in a speeded reaching task.

Authors:  Hang Zhang; Nathaniel D Daw; Laurence T Maloney
Journal:  PLoS Comput Biol       Date:  2013-05-23       Impact factor: 4.475

View more
  1 in total

1.  Acquisition, representation, and transfer of models of visuo-motor error.

Authors:  Hang Zhang; Mila Kirstie C Kulsa; Laurence T Maloney
Journal:  J Vis       Date:  2015       Impact factor: 2.240

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.