Literature DB >> 35026027

Predicting the Future With a Scale-Invariant Temporal Memory for the Past.

Wei Zhong Goh1, Varun Ursekar2, Marc W Howard3.   

Abstract

In recent years, it has become clear that the brain maintains a temporal memory of recent events stretching far into the past. This letter presents a neurally inspired algorithm to use a scale-invariant temporal representation of the past to predict a scale-invariant future. The result is a scale-invariant estimate of future events as a function of the time at which they are expected to occur. The algorithm is time-local, with credit assigned to the present event by observing how it affects the prediction of the future. To illustrate the potential utility of this approach, we test the model on simultaneous renewal processes with different timescales. The algorithm scales well on these problems despite the fact that the number of states needed to describe them as a Markov process grows exponentially.
© 2022 Massachusetts Institute of Technology.

Entities:  

Mesh:

Year:  2022        PMID: 35026027      PMCID: PMC8944185          DOI: 10.1162/neco_a_01475

Source DB:  PubMed          Journal:  Neural Comput        ISSN: 0899-7667            Impact factor:   2.026


  30 in total

1.  A proposed function for hippocampal theta rhythm: separate phases of encoding and retrieval enhance reversal of prior learning.

Authors:  Michael E Hasselmo; Clara Bodelón; Bradley P Wyble
Journal:  Neural Comput       Date:  2002-04       Impact factor: 2.026

2.  On the origin of long-range correlations in texts.

Authors:  Eduardo G Altmann; Giampaolo Cristadoro; Mirko Degli Esposti
Journal:  Proc Natl Acad Sci U S A       Date:  2012-07-02       Impact factor: 11.205

3.  Stimulus representation and the timing of reward-prediction errors in models of the dopamine system.

Authors:  Elliot A Ludvig; Richard S Sutton; E James Kehoe
Journal:  Neural Comput       Date:  2008-12       Impact factor: 2.026

Review 4.  The free-energy principle: a unified brain theory?

Authors:  Karl Friston
Journal:  Nat Rev Neurosci       Date:  2010-01-13       Impact factor: 34.870

5.  Contingency, contiguity, and causality in conditioning: Applying information theory and Weber's Law to the assignment of credit problem.

Authors:  C R Gallistel; Andrew R Craig; Timothy A Shahan
Journal:  Psychol Rev       Date:  2019-08-29       Impact factor: 8.934

6.  Estimating Scale-Invariant Future in Continuous Time.

Authors:  Zoran Tiganj; Samuel J Gershman; Per B Sederberg; Marc W Howard
Journal:  Neural Comput       Date:  2019-02-14       Impact factor: 2.026

7.  Human-level control through deep reinforcement learning.

Authors:  Volodymyr Mnih; Koray Kavukcuoglu; David Silver; Andrei A Rusu; Joel Veness; Marc G Bellemare; Alex Graves; Martin Riedmiller; Andreas K Fidjeland; Georg Ostrovski; Stig Petersen; Charles Beattie; Amir Sadik; Ioannis Antonoglou; Helen King; Dharshan Kumaran; Daan Wierstra; Shane Legg; Demis Hassabis
Journal:  Nature       Date:  2015-02-26       Impact factor: 49.962

Review 8.  Behavioral theories and the neurophysiology of reward.

Authors:  Wolfram Schultz
Journal:  Annu Rev Psychol       Date:  2006       Impact factor: 24.137

9.  Differential Emergence and Stability of Sensory and Temporal Representations in Context-Specific Hippocampal Sequences.

Authors:  Jiannis Taxidis; Eftychios A Pnevmatikakis; Conor C Dorian; Apoorva L Mylavarapu; Jagmeet S Arora; Kian D Samadian; Emily A Hoffberg; Peyman Golshani
Journal:  Neuron       Date:  2020-09-18       Impact factor: 17.173

10.  A reservoir of time constants for memory traces in cortical neurons.

Authors:  Alberto Bernacchia; Hyojung Seo; Daeyeol Lee; Xiao-Jing Wang
Journal:  Nat Neurosci       Date:  2011-02-13       Impact factor: 24.884

View more
  1 in total

1.  How do real animals account for the passage of time during associative learning?

Authors:  Vijay Mohan K Namboodiri
Journal:  Behav Neurosci       Date:  2022-04-28       Impact factor: 2.154

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.