Literature DB >> 33443144

Prioritized experience replays on a hippocampal predictive map for learning.

Hideyoshi Igata1, Yuji Ikegaya2,3,4, Takuya Sasaki1,5.   

Abstract

Hippocampal cells are central to spatial and predictive representations, and experience replays by place cells are crucial for learning and memory. Nonetheless, how hippocampal replay patterns dynamically change during the learning process remains to be elucidated. Here, we designed a spatial task in which rats learned a new behavioral trajectory for reward. We found that as rats updated their behavioral strategies for a novel salient location, hippocampal cell ensembles increased theta-sequences and sharp wave ripple-associated synchronous spikes that preferentially replayed salient locations and reward-related contexts in reverse order. The directionality and contents of the replays progressively varied with learning, including an optimized path that had never been exploited by the animals, suggesting prioritized replays of significant experiences on a predictive map. Online feedback blockade of sharp wave ripples during a learning process inhibited stabilizing optimized behavior. These results implicate learning-associated experience replays that act to learn and reinforce specific behavioral strategies.
Copyright © 2021 the Author(s). Published by PNAS.

Entities:  

Keywords:  hippocampus; learning; place cell; replay; ripple

Year:  2020        PMID: 33443144      PMCID: PMC7817193          DOI: 10.1073/pnas.2011266118

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  36 in total

Review 1.  Hippocampal sharp wave-ripple: A cognitive biomarker for episodic memory and planning.

Authors:  György Buzsáki
Journal:  Hippocampus       Date:  2015-10       Impact factor: 3.899

Review 2.  What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior.

Authors:  Timothy E J Behrens; Timothy H Muller; James C R Whittington; Shirley Mark; Alon B Baram; Kimberly L Stachenfeld; Zeb Kurth-Nelson
Journal:  Neuron       Date:  2018-10-24       Impact factor: 17.173

3.  Social place-cells in the bat hippocampus.

Authors:  David B Omer; Shir R Maimon; Liora Las; Nachum Ulanovsky
Journal:  Science       Date:  2018-01-12       Impact factor: 47.728

4.  Hippocampal "time cells" bridge the gap in memory for discontiguous events.

Authors:  Christopher J MacDonald; Kyle Q Lepage; Uri T Eden; Howard Eichenbaum
Journal:  Neuron       Date:  2011-08-25       Impact factor: 17.173

Review 5.  Reinforcement Learning, Fast and Slow.

Authors:  Matthew Botvinick; Sam Ritter; Jane X Wang; Zeb Kurth-Nelson; Charles Blundell; Demis Hassabis
Journal:  Trends Cogn Sci       Date:  2019-04-16       Impact factor: 20.229

6.  Hippocampal "time cells": time versus path integration.

Authors:  Benjamin J Kraus; Robert J Robinson; John A White; Howard Eichenbaum; Michael E Hasselmo
Journal:  Neuron       Date:  2013-05-23       Impact factor: 17.173

7.  A Dedicated Population for Reward Coding in the Hippocampus.

Authors:  Jeffrey L Gauthier; David W Tank
Journal:  Neuron       Date:  2018-06-28       Impact factor: 17.173

8.  Internally generated cell assembly sequences in the rat hippocampus.

Authors:  Eva Pastalkova; Vladimir Itskov; Asohan Amarasingham; György Buzsáki
Journal:  Science       Date:  2008-09-05       Impact factor: 47.728

9.  Reactivation of experience-dependent cell assembly patterns in the hippocampus.

Authors:  Joseph O'Neill; Timothy J Senior; Kevin Allen; John R Huxter; Jozsef Csicsvari
Journal:  Nat Neurosci       Date:  2008-01-13       Impact factor: 24.884

10.  Hippocampal place-cell sequences depict future paths to remembered goals.

Authors:  Brad E Pfeiffer; David J Foster
Journal:  Nature       Date:  2013-04-17       Impact factor: 49.962

View more
  6 in total

1.  Hippocampal replay reflects specific past experiences rather than a plan for subsequent choice.

Authors:  Anna K Gillespie; Daniela A Astudillo Maya; Eric L Denovellis; Daniel F Liu; David B Kastner; Michael E Coulter; Demetris K Roumis; Uri T Eden; Loren M Frank
Journal:  Neuron       Date:  2021-08-26       Impact factor: 18.688

2.  Hippocampal sharp-wave ripples in cognitive map maintenance versus episodic simulation.

Authors:  Kamran Diba
Journal:  Neuron       Date:  2021-10-06       Impact factor: 18.688

3.  Training a spiking neuronal network model of visual-motor cortex to play a virtual racket-ball game using reinforcement learning.

Authors:  Haroon Anwar; Simon Caby; Salvador Dura-Bernal; David D'Onofrio; Daniel Hasegan; Matt Deible; Sara Grunblatt; George L Chadderdon; Cliff C Kerr; Peter Lakatos; William W Lytton; Hananel Hazan; Samuel A Neymotin
Journal:  PLoS One       Date:  2022-05-11       Impact factor: 3.752

4.  Spatial Learning Drives Rapid Goal Representation in Hippocampal Ripples without Place Field Accumulation or Goal-Oriented Theta Sequences.

Authors:  Brad E Pfeiffer
Journal:  J Neurosci       Date:  2022-04-08       Impact factor: 6.709

5.  Generalized Simultaneous Localization and Mapping (G-SLAM) as unification framework for natural and artificial intelligences: towards reverse engineering the hippocampal/entorhinal system and principles of high-level cognition.

Authors:  Adam Safron; Ozan Çatal; Tim Verbelen
Journal:  Front Syst Neurosci       Date:  2022-09-30

Review 6.  Theta-Range Oscillations in Stress-Induced Mental Disorders as an Oscillotherapeutic Target.

Authors:  Toya Okonogi; Takuya Sasaki
Journal:  Front Behav Neurosci       Date:  2021-06-09       Impact factor: 3.558

  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.