| Literature DB >> 35863351 |
William de Cothi1, Nils Nyberg2, Eva-Maria Griesbauer2, Carole Ghanamé2, Fiona Zisch3, Julie M Lefort4, Lydia Fletcher2, Coco Newton5, Sophie Renaudineau2, Daniel Bendor2, Roddy Grieves6, Éléonore Duvelle6, Caswell Barry4, Hugo J Spiers7.
Abstract
Much of our understanding of navigation comes from the study of individual species, often with specific tasks tailored to those species. Here, we provide a novel experimental and analytic framework integrating across humans, rats, and simulated reinforcement learning (RL) agents to interrogate the dynamics of behavior during spatial navigation. We developed a novel open-field navigation task ("Tartarus maze") requiring dynamic adaptation (shortcuts and detours) to frequently changing obstructions on the path to a hidden goal. Humans and rats were remarkably similar in their trajectories. Both species showed the greatest similarity to RL agents utilizing a "successor representation," which creates a predictive map. Humans also displayed trajectory features similar to model-based RL agents, which implemented an optimal tree-search planning procedure. Our results help refine models seeking to explain mammalian navigation in dynamic environments and highlight the utility of modeling the behavior of different species to uncover the shared mechanisms that support behavior.Entities:
Keywords: artificial intelligence; cognitive map; decision making; detour; hippocampus; planning; reinforcement learning; shortcut; spatial navigation; successor representation
Mesh:
Year: 2022 PMID: 35863351 DOI: 10.1016/j.cub.2022.06.090
Source DB: PubMed Journal: Curr Biol ISSN: 0960-9822 Impact factor: 10.900