Literature DB >> 35930590

Signal neutrality, scalar property, and collapsing boundaries as consequences of a learned multi-timescale strategy.

Luca Manneschi1, Guido Gigante2,3, Eleni Vasilaki1,4, Paolo Del Giudice2,3.   

Abstract

We postulate that three fundamental elements underlie a decision making process: perception of time passing, information processing in multiple timescales and reward maximisation. We build a simple reinforcement learning agent upon these principles that we train on a random dot-like task. Our results, similar to the experimental data, demonstrate three emerging signatures. (1) signal neutrality: insensitivity to the signal coherence in the interval preceding the decision. (2) Scalar property: the mean of the response times varies widely for different signal coherences, yet the shape of the distributions stays almost unchanged. (3) Collapsing boundaries: the "effective" decision-making boundary changes over time in a manner reminiscent of the theoretical optimal. Removing the perception of time or the multiple timescales from the model does not preserve the distinguishing signatures. Our results suggest an alternative explanation for signal neutrality. We propose that it is not part of motor planning. It is part of the decision-making process and emerges from information processing on multiple timescales.

Entities:  

Mesh:

Year:  2022        PMID: 35930590      PMCID: PMC9462745          DOI: 10.1371/journal.pcbi.1009393

Source DB:  PubMed          Journal:  PLoS Comput Biol        ISSN: 1553-734X            Impact factor:   4.779


  57 in total

Review 1.  Degeneracy and complexity in biological systems.

Authors:  G M Edelman; J A Gally
Journal:  Proc Natl Acad Sci U S A       Date:  2001-11-06       Impact factor: 11.205

2.  A comparison of sequential sampling models for two-choice reaction time.

Authors:  Roger Ratcliff; Philip L Smith
Journal:  Psychol Rev       Date:  2004-04       Impact factor: 8.934

Review 3.  Decision making in recurrent neuronal circuits.

Authors:  Xiao-Jing Wang
Journal:  Neuron       Date:  2008-10-23       Impact factor: 17.173

4.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex.

Authors:  D J Amit; N Brunel
Journal:  Cereb Cortex       Date:  1997 Apr-May       Impact factor: 5.357

5.  Collective Activity of Many Bistable Assemblies Reproduces Characteristic Dynamics of Multistable Perception.

Authors:  Robin Cao; Alexander Pastukhov; Maurizio Mattia; Jochen Braun
Journal:  J Neurosci       Date:  2016-06-29       Impact factor: 6.167

6.  NEURONAL MODELING. Single-trial spike trains in parietal cortex reveal discrete steps during decision-making.

Authors:  Kenneth W Latimer; Jacob L Yates; Miriam L R Meister; Alexander C Huk; Jonathan W Pillow
Journal:  Science       Date:  2015-07-10       Impact factor: 47.728

7.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey.

Authors:  M N Shadlen; W T Newsome
Journal:  J Neurophysiol       Date:  2001-10       Impact factor: 2.714

8.  Decision making under uncertainty: a neural model based on partially observable markov decision processes.

Authors:  Rajesh P N Rao
Journal:  Front Comput Neurosci       Date:  2010-11-24       Impact factor: 2.380

9.  A reservoir of time constants for memory traces in cortical neurons.

Authors:  Alberto Bernacchia; Hyojung Seo; Daeyeol Lee; Xiao-Jing Wang
Journal:  Nat Neurosci       Date:  2011-02-13       Impact factor: 24.884

10.  Reinforcement learning can account for associative and perceptual learning on a visual-decision task.

Authors:  Chi-Tat Law; Joshua I Gold
Journal:  Nat Neurosci       Date:  2009-04-19       Impact factor: 24.884

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.