Literature DB >> 22617382

A biologically inspired meta-control navigation system for the Psikharpax rat robot.

K Caluwaerts1, M Staffa, S N'Guyen, C Grand, L Dollé, A Favre-Félix, B Girard, M Khamassi.   

Abstract

A biologically inspired navigation system for the mobile rat-like robot named Psikharpax is presented, allowing for self-localization and autonomous navigation in an initially unknown environment. The ability of parts of the model (e.g. the strategy selection mechanism) to reproduce rat behavioral data in various maze tasks has been validated before in simulations. But the capacity of the model to work on a real robot platform had not been tested. This paper presents our work on the implementation on the Psikharpax robot of two independent navigation strategies (a place-based planning strategy and a cue-guided taxon strategy) and a strategy selection meta-controller. We show how our robot can memorize which was the optimal strategy in each situation, by means of a reinforcement learning algorithm. Moreover, a context detector enables the controller to quickly adapt to changes in the environment-recognized as new contexts-and to restore previously acquired strategy preferences when a previously experienced context is recognized. This produces adaptivity closer to rat behavioral performance and constitutes a computational proposition of the role of the rat prefrontal cortex in strategy shifting. Moreover, such a brain-inspired meta-controller may provide an advancement for learning architectures in robotics.

Entities:  

Mesh:

Year:  2012        PMID: 22617382     DOI: 10.1088/1748-3182/7/2/025009

Source DB:  PubMed          Journal:  Bioinspir Biomim        ISSN: 1748-3182            Impact factor:   2.956


  13 in total

1.  Experimental predictions drawn from a computational model of sign-trackers and goal-trackers.

Authors:  Florian Lesaint; Olivier Sigaud; Jeremy J Clark; Shelly B Flagel; Mehdi Khamassi
Journal:  J Physiol Paris       Date:  2014-06-20

2.  Integration of velocity-dependent spatio-temporal structure of place cell activation during navigation in a reservoir model of prefrontal cortex.

Authors:  Pablo Scleidorovich; Alfredo Weitzenfeld; Jean-Marc Fellous; Peter Ford Dominey
Journal:  Biol Cybern       Date:  2022-10-12       Impact factor: 3.072

3.  Model-Based and Model-Free Replay Mechanisms for Reinforcement Learning in Neurorobotics.

Authors:  Elisa Massi; Jeanne Barthélemy; Juliane Mailly; Rémi Dromnelle; Julien Canitrot; Esther Poniatowski; Benoît Girard; Mehdi Khamassi
Journal:  Front Neurorobot       Date:  2022-06-24       Impact factor: 3.493

4.  Modeling choice and reaction time during arbitrary visuomotor learning through the coordination of adaptive working memory and reinforcement learning.

Authors:  Guillaume Viejo; Mehdi Khamassi; Andrea Brovelli; Benoît Girard
Journal:  Front Behav Neurosci       Date:  2015-08-26       Impact factor: 3.558

5.  From self-assessment to frustration, a small step toward autonomy in robotic navigation.

Authors:  Adrien Jauffret; Nicolas Cuperlier; Philippe Tarroux; Philippe Gaussier
Journal:  Front Neurorobot       Date:  2013-10-08       Impact factor: 2.650

6.  Humanoids Learning to Walk: A Natural CPG-Actor-Critic Architecture.

Authors:  Cai Li; Robert Lowe; Tom Ziemke
Journal:  Front Neurorobot       Date:  2013-04-08       Impact factor: 2.650

7.  Scaled free-energy based reinforcement learning for robust and efficient learning in high-dimensional state spaces.

Authors:  Stefan Elfwing; Eiji Uchibe; Kenji Doya
Journal:  Front Neurorobot       Date:  2013-02-28       Impact factor: 2.650

8.  Modeling effects of intrinsic and extrinsic rewards on the competition between striatal learning systems.

Authors:  Joschka Boedecker; Thomas Lampe; Martin Riedmiller
Journal:  Front Psychol       Date:  2013-10-16

9.  A robotic approach to understanding the role and the mechanism of vicarious trial-and-error in a T-maze task.

Authors:  Eiko Matsuda; Julien Hubert; Takashi Ikegami
Journal:  PLoS One       Date:  2014-07-22       Impact factor: 3.240

10.  Interactions of spatial strategies producing generalization gradient and blocking: A computational approach.

Authors:  Laurent Dollé; Ricardo Chavarriaga; Agnès Guillot; Mehdi Khamassi
Journal:  PLoS Comput Biol       Date:  2018-04-09       Impact factor: 4.475

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.