Literature DB >> 24082097

Mice infer probabilistic models for timing.

Yi Li1, Joshua Tate Dudman.   

Abstract

Animals learn both whether and when a reward will occur. Neural models of timing posit that animals learn the mean time until reward perturbed by a fixed relative uncertainty. Nonetheless, animals can learn to perform actions for reward even in highly variable natural environments. Optimal inference in the presence of variable information requires probabilistic models, yet it is unclear whether animals can infer such models for reward timing. Here, we develop a behavioral paradigm in which optimal performance required knowledge of the distribution from which reward delays were chosen. We found that mice were able to accurately adjust their behavior to the SD of the reward delay distribution. Importantly, mice were able to flexibly adjust the amount of prior information used for inference according to the moment-by-moment demands of the task. The ability to infer probabilistic models for timing may allow mice to adapt to complex and dynamic natural environments.

Entities:  

Keywords:  mouse behavior; reinforcement-learning; statistical inference

Mesh:

Year:  2013        PMID: 24082097      PMCID: PMC3801012          DOI: 10.1073/pnas.1310666110

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  37 in total

1.  Attentional modulation in visual cortex depends on task timing.

Authors:  Geoffrey M Ghose; John H R Maunsell
Journal:  Nature       Date:  2002-10-10       Impact factor: 49.962

2.  Matching behavior and the representation of value in the parietal cortex.

Authors:  Leo P Sugrue; Greg S Corrado; William T Newsome
Journal:  Science       Date:  2004-06-18       Impact factor: 47.728

3.  The Bayesian brain: the role of uncertainty in neural coding and computation.

Authors:  David C Knill; Alexandre Pouget
Journal:  Trends Neurosci       Date:  2004-12       Impact factor: 13.837

Review 4.  What makes us tick? Functional and neural mechanisms of interval timing.

Authors:  Catalin V Buhusi; Warren H Meck
Journal:  Nat Rev Neurosci       Date:  2005-10       Impact factor: 34.870

5.  Decision makers calibrate behavioral persistence on the basis of time-interval experience.

Authors:  Joseph T McGuire; Joseph W Kable
Journal:  Cognition       Date:  2012-04-23

Review 6.  Goal-directed instrumental action: contingency and incentive learning and their cortical substrates.

Authors:  B W Balleine; A Dickinson
Journal:  Neuropharmacology       Date:  1998 Apr-May       Impact factor: 5.250

Review 7.  How to grow a mind: statistics, structure, and abstraction.

Authors:  Joshua B Tenenbaum; Charles Kemp; Thomas L Griffiths; Noah D Goodman
Journal:  Science       Date:  2011-03-11       Impact factor: 47.728

8.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion.

Authors:  M N Shadlen; K H Britten; W T Newsome; J A Movshon
Journal:  J Neurosci       Date:  1996-02-15       Impact factor: 6.167

9.  Toward a modern theory of adaptive networks: expectation and prediction.

Authors:  R S Sutton; A G Barto
Journal:  Psychol Rev       Date:  1981-03       Impact factor: 8.934

10.  Time and Associative Learning.

Authors:  Peter D Balsam; Michael R Drew; C R Gallistel
Journal:  Comp Cogn Behav Rev       Date:  2010
View more
  11 in total

1.  The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty.

Authors:  Clara Kwon Starkweather; Samuel J Gershman; Naoshige Uchida
Journal:  Neuron       Date:  2018-04-12       Impact factor: 17.173

Review 2.  Distributional Reinforcement Learning in the Brain.

Authors:  Adam S Lowet; Qiao Zheng; Sara Matias; Jan Drugowitsch; Naoshige Uchida
Journal:  Trends Neurosci       Date:  2020-10-19       Impact factor: 13.837

3.  Serotonin neurons modulate learning rate through uncertainty.

Authors:  Cooper D Grossman; Bilal A Bari; Jeremiah Y Cohen
Journal:  Curr Biol       Date:  2021-12-21       Impact factor: 10.834

4.  Influence of Recent Trial History on Interval Timing.

Authors:  Taorong Xie; Can Huang; Yijie Zhang; Jing Liu; Haishan Yao
Journal:  Neurosci Bull       Date:  2022-10-08       Impact factor: 5.271

Review 5.  Adaptive learning under expected and unexpected uncertainty.

Authors:  Alireza Soltani; Alicia Izquierdo
Journal:  Nat Rev Neurosci       Date:  2019-10       Impact factor: 34.870

Review 6.  The orbitofrontal cortex in temporal cognition.

Authors:  Juan Luis Romero Sosa; Dean Buonomano; Alicia Izquierdo
Journal:  Behav Neurosci       Date:  2021-04       Impact factor: 1.912

7.  Awareness of errors and feedback in human time estimation.

Authors:  Farah Bader; Martin Wiener
Journal:  Learn Mem       Date:  2021-04-15       Impact factor: 2.460

Review 8.  Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior.

Authors:  Peter H Rudebeck; Alicia Izquierdo
Journal:  Neuropsychopharmacology       Date:  2021-08-18       Impact factor: 7.853

9.  Rodents monitor their error in self-generated duration on a single trial basis.

Authors:  Tadeusz Władysław Kononowicz; Virginie van Wassenhove; Valérie Doyère
Journal:  Proc Natl Acad Sci U S A       Date:  2022-03-01       Impact factor: 12.779

10.  Continuous carryover of temporal context dissociates response bias from perceptual influence for duration.

Authors:  Martin Wiener; James C Thompson; H Branch Coslett
Journal:  PLoS One       Date:  2014-06-25       Impact factor: 3.240

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.