Literature DB >> 34861149

Meta-learning synaptic plasticity and memory addressing for continual familiarity detection.

Danil Tyulmankov1, Guangyu Robert Yang2, L F Abbott3.   

Abstract

Over the course of a lifetime, we process a continual stream of information. Extracted from this stream, memories must be efficiently encoded and stored in an addressable manner for retrieval. To explore potential mechanisms, we consider a familiarity detection task in which a subject reports whether an image has been previously encountered. We design a feedforward network endowed with synaptic plasticity and an addressing matrix, meta-learned to optimize familiarity detection over long intervals. We find that anti-Hebbian plasticity leads to better performance than Hebbian plasticity and replicates experimental results such as repetition suppression. A combinatorial addressing function emerges, selecting a unique neuron as an index into the synaptic memory matrix for storage or retrieval. Unlike previous models, this network operates continuously and generalizes to intervals it has not been trained on. Our work suggests a biologically plausible mechanism for continual learning and demonstrates an effective application of machine learning for neuroscience discovery.
Copyright © 2021 Elsevier Inc. All rights reserved.

Entities:  

Keywords:  addressing; anti-Hebbian; continual learning; deep learning; familiarity; memory; meta-learning; neural networks; recognition; synaptic plasticity

Mesh:

Year:  2021        PMID: 34861149      PMCID: PMC8813911          DOI: 10.1016/j.neuron.2021.11.009

Source DB:  PubMed          Journal:  Neuron        ISSN: 0896-6273            Impact factor:   17.173


  21 in total

Review 1.  Comparison of computational models of familiarity discrimination in the perirhinal cortex.

Authors:  Rafal Bogacz; Malcolm W Brown
Journal:  Hippocampus       Date:  2003       Impact factor: 3.899

2.  Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach.

Authors:  Kenneth A Norman; Randall C O'Reilly
Journal:  Psychol Rev       Date:  2003-10       Impact factor: 8.934

Review 3.  Neural representation for object recognition in inferotemporal cortex.

Authors:  Sidney R Lehky; Keiji Tanaka
Journal:  Curr Opin Neurobiol       Date:  2016-01-06       Impact factor: 6.627

4.  Long short-term memory.

Authors:  S Hochreiter; J Schmidhuber
Journal:  Neural Comput       Date:  1997-11-15       Impact factor: 2.026

5.  Hybrid computing using a neural network with dynamic external memory.

Authors:  Alex Graves; Greg Wayne; Malcolm Reynolds; Tim Harley; Ivo Danihelka; Agnieszka Grabska-Barwińska; Sergio Gómez Colmenarejo; Edward Grefenstette; Tiago Ramalho; John Agapiou; Adrià Puigdomènech Badia; Karl Moritz Hermann; Yori Zwols; Georg Ostrovski; Adam Cain; Helen King; Christopher Summerfield; Phil Blunsom; Koray Kavukcuoglu; Demis Hassabis
Journal:  Nature       Date:  2016-10-12       Impact factor: 49.962

6.  Learning 10,000 pictures.

Authors:  L Standing
Journal:  Q J Exp Psychol       Date:  1973-05       Impact factor: 2.143

7.  Inferior temporal mechanisms for invariant object recognition.

Authors:  A Lueschow; E K Miller; R Desimone
Journal:  Cereb Cortex       Date:  1994 Sep-Oct       Impact factor: 5.357

8.  Neural networks and physical systems with emergent collective computational abilities.

Authors:  J J Hopfield
Journal:  Proc Natl Acad Sci U S A       Date:  1982-04       Impact factor: 11.205

9.  Single-exposure visual memory judgments are reflected in inferotemporal cortex.

Authors:  Travis Meyer; Nicole C Rust
Journal:  Elife       Date:  2018-03-08       Impact factor: 8.140

View more
  1 in total

1.  A neural theory for counting memories.

Authors:  Sanjoy Dasgupta; Daisuke Hattori; Saket Navlakha
Journal:  Nat Commun       Date:  2022-10-10       Impact factor: 17.694

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.