| Literature DB >> 34861149 |
Danil Tyulmankov1, Guangyu Robert Yang2, L F Abbott3.
Abstract
Over the course of a lifetime, we process a continual stream of information. Extracted from this stream, memories must be efficiently encoded and stored in an addressable manner for retrieval. To explore potential mechanisms, we consider a familiarity detection task in which a subject reports whether an image has been previously encountered. We design a feedforward network endowed with synaptic plasticity and an addressing matrix, meta-learned to optimize familiarity detection over long intervals. We find that anti-Hebbian plasticity leads to better performance than Hebbian plasticity and replicates experimental results such as repetition suppression. A combinatorial addressing function emerges, selecting a unique neuron as an index into the synaptic memory matrix for storage or retrieval. Unlike previous models, this network operates continuously and generalizes to intervals it has not been trained on. Our work suggests a biologically plausible mechanism for continual learning and demonstrates an effective application of machine learning for neuroscience discovery.Entities:
Keywords: addressing; anti-Hebbian; continual learning; deep learning; familiarity; memory; meta-learning; neural networks; recognition; synaptic plasticity
Mesh:
Year: 2021 PMID: 34861149 PMCID: PMC8813911 DOI: 10.1016/j.neuron.2021.11.009
Source DB: PubMed Journal: Neuron ISSN: 0896-6273 Impact factor: 17.173