Literature DB >> 25232104

Emergent exploration via novelty management.

Goren Gordon1, Ehud Fonio2, Ehud Ahissar3.   

Abstract

When encountering novel environments, animals perform complex yet structured exploratory behaviors. Despite their typical structuring, the principles underlying exploratory patterns are still not sufficiently understood. Here we analyzed exploratory behavioral data from two modalities: whisking and locomotion in rats and mice. We found that these rodents maximized novelty signal-to-noise ratio during each exploration episode, where novelty is defined as the accumulated information gain. We further found that these rodents maximized novelty during outbound exploration, used novelty-triggered withdrawal-like retreat behavior, and explored the environment in a novelty-descending sequence. We applied a hierarchical curiosity model, which incorporates these principles, to both modalities. We show that the model captures the major components of exploratory behavior in multiple timescales: single excursions, exploratory episodes, and developmental timeline. The model predicted that novelty is managed across exploratory modalities. Using a novel experimental setup in which mice encountered a novel object for the first time in their life, we tested and validated this prediction. Further predictions, related to the development of brain circuitry, are described. This study demonstrates that rodents select exploratory actions according to a novelty management framework and suggests a plausible mechanism by which mammalian exploration primitives can be learned during development and integrated in adult exploration of complex environments.
Copyright © 2014 the authors 0270-6474/14/3412646-16$15.00/0.

Entities:  

Keywords:  active sensing; hierarchical model; intrinsic motivation; reinforcement learning; whisker system

Mesh:

Year:  2014        PMID: 25232104      PMCID: PMC6705324          DOI: 10.1523/JNEUROSCI.1872-14.2014

Source DB:  PubMed          Journal:  J Neurosci        ISSN: 0270-6474            Impact factor:   6.167


  9 in total

1.  Nicotinic receptors in the ventral tegmental area promote uncertainty-seeking.

Authors:  Jérémie Naudé; Stefania Tolu; Malou Dongelmans; Nicolas Torquet; Sébastien Valverde; Guillaume Rodriguez; Stéphanie Pons; Uwe Maskos; Alexandre Mourot; Fabio Marti; Philippe Faure
Journal:  Nat Neurosci       Date:  2016-01-18       Impact factor: 24.884

2.  Parallel Inhibitory and Excitatory Trigemino-Facial Feedback Circuitry for Reflexive Vibrissa Movement.

Authors:  Marie-Andrée Bellavance; Jun Takatoh; Jinghao Lu; Maxime Demers; David Kleinfeld; Fan Wang; Martin Deschênes
Journal:  Neuron       Date:  2017-07-20       Impact factor: 17.173

3.  Social behaviour as an emergent property of embodied curiosity: a robotics perspective.

Authors:  Goren Gordon
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2019-04-29       Impact factor: 6.237

4.  Behavioural plasticity in evolving robots.

Authors:  Jônata Tyska Carvalho; Stefano Nolfi
Journal:  Theory Biosci       Date:  2016-07-21       Impact factor: 1.919

5.  Active sensing associated with spatial learning reveals memory-based attention in an electric fish.

Authors:  James J Jun; André Longtin; Leonard Maler
Journal:  J Neurophysiol       Date:  2016-03-09       Impact factor: 2.714

6.  Intermale aggression in mice, selected for the cognitive trait.

Authors:  O V Perepelkina; A Yu Tarassova; N M Surina; I G Lilp; V A Golibrodo; I I Poletaeva
Journal:  Dokl Biol Sci       Date:  2017-09-01

7.  Task-Related Sensorimotor Adjustments Increase the Sensory Range in Electrolocation.

Authors:  Federico Pedraja; Volker Hofmann; Julie Goulet; Jacob Engelmann
Journal:  J Neurosci       Date:  2019-12-09       Impact factor: 6.167

8.  Perception as a closed-loop convergence process.

Authors:  Ehud Ahissar; Eldad Assa
Journal:  Elife       Date:  2016-05-09       Impact factor: 8.140

9.  Neural activity in a hippocampus-like region of the teleost pallium is associated with active sensing and navigation.

Authors:  Haleh Fotowat; Candice Lee; James Jaeyoon Jun; Len Maler
Journal:  Elife       Date:  2019-04-03       Impact factor: 8.140

  9 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.