Literature DB >> 20194768

Optimal reward harvesting in complex perceptual environments.

Vidhya Navalpakkam1, Christof Koch, Antonio Rangel, Pietro Perona.   

Abstract

The ability to choose rapidly among multiple targets embedded in a complex perceptual environment is key to survival. Targets may differ in their reward value as well as in their low-level perceptual properties (e.g., visual saliency). Previous studies investigated separately the impact of either value or saliency on choice; thus, it is not known how the brain combines these two variables during decision making. We addressed this question with three experiments in which human subjects attempted to maximize their monetary earnings by rapidly choosing items from a brief display. Each display contained several worthless items (distractors) as well as two targets, whose value and saliency were varied systematically. We compared the behavioral data with the predictions of three computational models assuming that (i) subjects seek the most valuable item in the display, (ii) subjects seek the most easily detectable item, and (iii) subjects behave as an ideal Bayesian observer who combines both factors to maximize the expected reward within each trial. Regardless of the type of motor response used to express the choices, we find that decisions are influenced by both value and feature-contrast in a way that is consistent with the ideal Bayesian observer, even when the targets' feature-contrast is varied unpredictably between trials. This suggests that individuals are able to harvest rewards optimally and dynamically under time pressure while seeking multiple targets embedded in perceptual clutter.

Entities:  

Mesh:

Year:  2010        PMID: 20194768      PMCID: PMC2841865          DOI: 10.1073/pnas.0911972107

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  29 in total

1.  A DETECTION METHOD AND PROBALISTIC MODELS FOR ASSESSING INFORMATION PROCESSING FROM BRIEF VISUAL DISPLAYS.

Authors:  W D ESTES; H A TAYLOR
Journal:  Proc Natl Acad Sci U S A       Date:  1964-08       Impact factor: 11.205

Review 2.  Neuronal representations of cognitive state: reward or attention?

Authors:  John H R Maunsell
Journal:  Trends Cogn Sci       Date:  2004-06       Impact factor: 20.229

3.  The Bayesian brain: the role of uncertainty in neural coding and computation.

Authors:  David C Knill; Alexandre Pouget
Journal:  Trends Neurosci       Date:  2004-12       Impact factor: 13.837

4.  Visual correlates of fixation selection: effects of scale and time.

Authors:  Benjamin W Tatler; Roland J Baddeley; Iain D Gilchrist
Journal:  Vision Res       Date:  2005-03       Impact factor: 1.886

5.  Optimal eye movement strategies in visual search.

Authors:  Jiri Najemnik; Wilson S Geisler
Journal:  Nature       Date:  2005-03-17       Impact factor: 49.962

6.  Neural correlates of reward and attention in macaque area LIP.

Authors:  Michael S Bendiksby; Michael L Platt
Journal:  Neuropsychologia       Date:  2006-06-06       Impact factor: 3.139

7.  Bayesian inference with probabilistic population codes.

Authors:  Wei Ji Ma; Jeffrey M Beck; Peter E Latham; Alexandre Pouget
Journal:  Nat Neurosci       Date:  2006-10-22       Impact factor: 24.884

8.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex.

Authors:  S J Luck; L Chelazzi; S A Hillyard; R Desimone
Journal:  J Neurophysiol       Date:  1997-01       Impact factor: 2.714

9.  The representation of visual salience in monkey parietal cortex.

Authors:  J P Gottlieb; M Kusunoki; M E Goldberg
Journal:  Nature       Date:  1998-01-29       Impact factor: 49.962

10.  Microstimulation of macaque area LIP affects decision-making in a motion discrimination task.

Authors:  Timothy D Hanks; Jochen Ditterich; Michael N Shadlen
Journal:  Nat Neurosci       Date:  2006-04-09       Impact factor: 24.884

View more
  68 in total

1.  Dynamic integration of information about salience and value for saccadic eye movements.

Authors:  Alexander C Schütz; Julia Trommershäuser; Karl R Gegenfurtner
Journal:  Proc Natl Acad Sci U S A       Date:  2012-04-23       Impact factor: 11.205

2.  Perceptual Salience and Reward Both Influence Feedback-Related Neural Activity Arising from Choice.

Authors:  Bin Lou; Wha-Yin Hsu; Paul Sajda
Journal:  J Neurosci       Date:  2015-09-23       Impact factor: 6.167

3.  Choice of saccade endpoint under risk.

Authors:  John F Ackermann; Michael S Landy
Journal:  J Vis       Date:  2013-09-10       Impact factor: 2.240

4.  Simultaneous modeling of visual saliency and value computation improves predictions of economic choice.

Authors:  R Blythe Towal; Milica Mormann; Christof Koch
Journal:  Proc Natl Acad Sci U S A       Date:  2013-09-09       Impact factor: 11.205

5.  Value-driven attentional capture.

Authors:  Brian A Anderson; Patryk A Laurent; Steven Yantis
Journal:  Proc Natl Acad Sci U S A       Date:  2011-06-06       Impact factor: 11.205

6.  Reward and attentional control in visual search.

Authors:  Steven Yantis; Brian A Anderson; Emma K Wampler; Patryk A Laurent
Journal:  Nebr Symp Motiv       Date:  2012

7.  Converging structural and functional connectivity of orbitofrontal, dorsolateral prefrontal, and posterior parietal cortex in the human striatum.

Authors:  Kevin Jarbo; Timothy D Verstynen
Journal:  J Neurosci       Date:  2015-03-04       Impact factor: 6.167

8.  Measuring attention to reward as an individual trait: the value-driven attention questionnaire (VDAQ).

Authors:  Brian A Anderson; Haena Kim; Mark K Britton; Andy Jeesu Kim
Journal:  Psychol Res       Date:  2019-06-12

9.  Dissociable dopaminergic control of saccadic target selection and its implications for reward modulation.

Authors:  Alireza Soltani; Behrad Noudoost; Tirin Moore
Journal:  Proc Natl Acad Sci U S A       Date:  2013-02-11       Impact factor: 11.205

10.  Perceptuo-motor, cognitive, and description-based decision-making seem equally good.

Authors:  Andreas Jarvstad; Ulrike Hahn; Simon K Rushton; Paul A Warren
Journal:  Proc Natl Acad Sci U S A       Date:  2013-09-18       Impact factor: 11.205

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.