Literature DB >> 16987636

Rapid decision threshold modulation by reward rate in a neural network.

Patrick Simen1, Jonathan D Cohen, Philip Holmes.   

Abstract

Optimal performance in two-alternative, free response decision-making tasks can be achieved by the drift-diffusion model of decision making--which can be implemented in a neural network--as long as the threshold parameter of that model can be adapted to different task conditions. Evidence exists that people seek to maximize reward in such tasks by modulating response thresholds. However, few models have been proposed for threshold adaptation, and none have been implemented using neurally plausible mechanisms. Here we propose a neural network that adapts thresholds in order to maximize reward rate. The model makes predictions regarding optimal performance and provides a benchmark against which actual performance can be compared, as well as testable predictions about the way in which reward rate may be encoded by neural mechanisms.

Entities:  

Mesh:

Year:  2006        PMID: 16987636      PMCID: PMC1808344          DOI: 10.1016/j.neunet.2006.05.038

Source DB:  PubMed          Journal:  Neural Netw        ISSN: 0893-6080


  31 in total

1.  The time course of perceptual choice: the leaky, competing accumulator model.

Authors:  M Usher; J L McClelland
Journal:  Psychol Rev       Date:  2001-07       Impact factor: 8.934

2.  Matching behavior and the representation of value in the parietal cortex.

Authors:  Leo P Sugrue; Greg S Corrado; William T Newsome
Journal:  Science       Date:  2004-06-18       Impact factor: 47.728

Review 3.  Psychology and neurobiology of simple decisions.

Authors:  Philip L Smith; Roger Ratcliff
Journal:  Trends Neurosci       Date:  2004-03       Impact factor: 13.837

4.  Prefrontal cortex and decision making in a mixed-strategy game.

Authors:  Dominic J Barraclough; Michelle L Conroy; Daeyeol Lee
Journal:  Nat Neurosci       Date:  2004-03-07       Impact factor: 24.884

Review 5.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance.

Authors:  Gary Aston-Jones; Jonathan D Cohen
Journal:  Annu Rev Neurosci       Date:  2005       Impact factor: 12.449

6.  The effect of stimulus strength on the speed and accuracy of a perceptual decision.

Authors:  John Palmer; Alexander C Huk; Michael N Shadlen
Journal:  J Vis       Date:  2005-05-02       Impact factor: 2.240

7.  A logical calculus of the ideas immanent in nervous activity. 1943.

Authors:  W S McCulloch; W Pitts
Journal:  Bull Math Biol       Date:  1990       Impact factor: 1.758

8.  Alopex: a stochastic method for determining visual receptive fields.

Authors:  E Harth; E Tzanakou
Journal:  Vision Res       Date:  1974-12       Impact factor: 1.886

9.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey.

Authors:  M N Shadlen; W T Newsome
Journal:  J Neurophysiol       Date:  2001-10       Impact factor: 2.714

10.  Neural control of voluntary movement initiation.

Authors:  D P Hanes; J D Schall
Journal:  Science       Date:  1996-10-18       Impact factor: 47.728

View more
  51 in total

1.  A symbolic/subsymbolic interface protocol for cognitive modeling.

Authors:  Patrick Simen; Thad Polk
Journal:  Log J IGPL       Date:  2010-10-01       Impact factor: 0.861

2.  Sequential effects: Superstition or rational behavior?

Authors:  Angela J Yu; Jonathan D Cohen
Journal:  Adv Neural Inf Process Syst       Date:  2008

3.  On diffusion processes with variable drift rates as models for decision making during learning.

Authors:  P Eckhoff; P Holmes; C Law; P M Connolly; J I Gold
Journal:  New J Phys       Date:  2008-01-31       Impact factor: 3.729

Review 4.  Neural chronometry and coherency across speed-accuracy demands reveal lack of homomorphism between computational and neural mechanisms of evidence accumulation.

Authors:  Richard P Heitz; Jeffrey D Schall
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2013-09-09       Impact factor: 6.237

Review 5.  Neurocomputational mechanisms of reinforcement-guided learning in humans: a review.

Authors:  Michael X Cohen
Journal:  Cogn Affect Behav Neurosci       Date:  2008-06       Impact factor: 3.282

6.  Neural basis of adaptive response time adjustment during saccade countermanding.

Authors:  Pierre Pouget; Gordon D Logan; Thomas J Palmeri; Leanne Boucher; Martin Paré; Jeffrey D Schall
Journal:  J Neurosci       Date:  2011-08-31       Impact factor: 6.167

7.  A model of interval timing by neural integration.

Authors:  Patrick Simen; Fuat Balci; Laura de Souza; Jonathan D Cohen; Philip Holmes
Journal:  J Neurosci       Date:  2011-06-22       Impact factor: 6.167

8.  Reward rate optimization in two-alternative decision making: empirical tests of theoretical predictions.

Authors:  Patrick Simen; David Contreras; Cara Buck; Peter Hu; Philip Holmes; Jonathan D Cohen
Journal:  J Exp Psychol Hum Percept Perform       Date:  2009-12       Impact factor: 3.332

9.  Effects of category-specific costs on neural systems for perceptual decision-making.

Authors:  Stephen M Fleming; Louise Whiteley; Oliver J Hulme; Maneesh Sahani; Raymond J Dolan
Journal:  J Neurophysiol       Date:  2010-03-31       Impact factor: 2.714

10.  Decision making under uncertainty: a neural model based on partially observable markov decision processes.

Authors:  Rajesh P N Rao
Journal:  Front Comput Neurosci       Date:  2010-11-24       Impact factor: 2.380

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.