Literature DB >> 33380453

Optimal utility and probability functions for agents with finite computational precision.

Keno Juechems1,2, Jan Balaguer1, Bernhard Spitzer3, Christopher Summerfield1.   

Abstract

When making economic choices, such as those between goods or gambles, humans act as if their internal representation of the value and probability of a prospect is distorted away from its true value. These distortions give rise to decisions which apparently fail to maximize reward, and preferences that reverse without reason. Why would humans have evolved to encode value and probability in a distorted fashion, in the face of selective pressure for reward-maximizing choices? Here, we show that under the simple assumption that humans make decisions with finite computational precision--in other words, that decisions are irreducibly corrupted by noise--the distortions of value and probability displayed by humans are approximately optimal in that they maximize reward and minimize uncertainty. In two empirical studies, we manipulate factors that change the reward-maximizing form of distortion, and find that in each case, humans adapt optimally to the manipulation. This work suggests an answer to the longstanding question of why humans make "irrational" economic choices.

Entities:  

Keywords:  computational precision; prospect theory; uncertainty; utility

Year:  2021        PMID: 33380453      PMCID: PMC7812798          DOI: 10.1073/pnas.2002232118

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  27 in total

1.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects.

Authors:  R P Rao; D H Ballard
Journal:  Nat Neurosci       Date:  1999-01       Impact factor: 24.884

2.  Decision by sampling.

Authors:  Neil Stewart; Nick Chater; Gordon D A Brown
Journal:  Cogn Psychol       Date:  2006-01-24       Impact factor: 3.468

3.  What are the neural origins of choice variability?

Authors:  Laurence T Hunt
Journal:  Trends Cogn Sci       Date:  2014-02-07       Impact factor: 20.229

Review 4.  Variability in neural activity and behavior.

Authors:  Alfonso Renart; Christian K Machens
Journal:  Curr Opin Neurobiol       Date:  2014-03-12       Impact factor: 6.627

5.  Neural Mechanisms of Updating under Reducible and Irreducible Uncertainty.

Authors:  Kenji Kobayashi; Ming Hsu
Journal:  J Neurosci       Date:  2017-06-16       Impact factor: 6.167

6.  Humans use directed and random exploration to solve the explore-exploit dilemma.

Authors:  Robert C Wilson; Andra Geana; John M White; Elliot A Ludvig; Jonathan D Cohen
Journal:  J Exp Psychol Gen       Date:  2014-10-27

7.  Bayesian model selection for group studies.

Authors:  Klaas Enno Stephan; Will D Penny; Jean Daunizeau; Rosalyn J Moran; Karl J Friston
Journal:  Neuroimage       Date:  2009-03-20       Impact factor: 6.556

8.  Life as we know it.

Authors:  Karl Friston
Journal:  J R Soc Interface       Date:  2013-07-03       Impact factor: 4.118

9.  Efficient coding of subjective value.

Authors:  Rafael Polanía; Michael Woodford; Christian C Ruff
Journal:  Nat Neurosci       Date:  2018-12-17       Impact factor: 24.884

10.  Computational noise in reward-guided learning drives behavioral variability in volatile environments.

Authors:  Charles Findling; Vasilisa Skvortsova; Rémi Dromnelle; Stefano Palminteri; Valentin Wyart
Journal:  Nat Neurosci       Date:  2019-10-28       Impact factor: 24.884

View more
  5 in total

1.  A Normative Account of Confirmation Bias During Reinforcement Learning.

Authors:  Germain Lefebvre; Christopher Summerfield; Rafal Bogacz
Journal:  Neural Comput       Date:  2022-01-14       Impact factor: 2.026

Review 2.  Efficiently irrational: deciphering the riddle of human choice.

Authors:  Paul W Glimcher
Journal:  Trends Cogn Sci       Date:  2022-05-25       Impact factor: 24.482

3.  Human value learning and representation reflect rational adaptation to task demands.

Authors:  Keno Juechems; Tugba Altun; Rita Hira; Andreas Jarvstad
Journal:  Nat Hum Behav       Date:  2022-05-30

4.  Rational inattention in mice.

Authors:  Nikola Grujic; Jeroen Brus; Denis Burdakov; Rafael Polania
Journal:  Sci Adv       Date:  2022-03-04       Impact factor: 14.136

5.  Asymmetric reinforcement learning facilitates human inference of transitive relations.

Authors:  Simon Ciranka; Juan Linde-Domingo; Ivan Padezhki; Clara Wicharz; Charley M Wu; Bernhard Spitzer
Journal:  Nat Hum Behav       Date:  2022-01-31
  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.