Literature DB >> 33152266

The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection.

Thomas Akam1, Ines Rodrigues-Vaz2, Ivo Marcelo3, Xiangyu Zhang4, Michael Pereira5, Rodrigo Freire Oliveira5, Peter Dayan6, Rui M Costa2.   

Abstract

Behavioral control is not unitary. It comprises parallel systems, model based and model free, that respectively generate flexible and habitual behaviors. Model-based decisions use predictions of the specific consequences of actions, but how these are implemented in the brain is poorly understood. We used calcium imaging and optogenetics in a sequential decision task for mice to show that the anterior cingulate cortex (ACC) predicts the state that actions will lead to, not simply whether they are good or bad, and monitors whether outcomes match these predictions. ACC represents the complete state space of the task, with reward signals that depend strongly on the state where reward is obtained but minimally on the preceding choice. Accordingly, ACC is necessary only for updating model-based strategies, not for basic reward-driven action reinforcement. These results reveal that ACC is a critical node in model-based control, with a specific role in predicting future states given chosen actions.
Copyright © 2020 The Authors. Published by Elsevier Inc. All rights reserved.

Entities:  

Keywords:  anterior cingulate cortex (ACC); behavior; calcium imaging; decision making; model-based; optogenetics; reinforcement learning

Year:  2020        PMID: 33152266      PMCID: PMC7837117          DOI: 10.1016/j.neuron.2020.10.013

Source DB:  PubMed          Journal:  Neuron        ISSN: 0896-6273            Impact factor:   17.173


  61 in total

1.  Performance monitoring by the anterior cingulate cortex during saccade countermanding.

Authors:  Shigehiko Ito; Veit Stuphorn; Joshua W Brown; Jeffrey D Schall
Journal:  Science       Date:  2003-10-03       Impact factor: 47.728

2.  Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning.

Authors:  Henry H Yin; Barbara J Knowlton; Bernard W Balleine
Journal:  Eur J Neurosci       Date:  2005-07       Impact factor: 3.386

3.  Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game.

Authors:  Hyojung Seo; Daeyeol Lee
Journal:  J Neurosci       Date:  2007-08-01       Impact factor: 6.167

4.  Neuronal encoding of subjective value in dorsal and ventral anterior cingulate cortex.

Authors:  Xinying Cai; Camillo Padoa-Schioppa
Journal:  J Neurosci       Date:  2012-03-14       Impact factor: 6.167

5.  Neural computations underlying arbitration between model-based and model-free learning.

Authors:  Sang Wan Lee; Shinsuke Shimojo; John P O'Doherty
Journal:  Neuron       Date:  2014-02-05       Impact factor: 17.173

6.  Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions.

Authors:  Mark E Walton; David M Bannerman; Karin Alterescu; Matthew F S Rushworth
Journal:  J Neurosci       Date:  2003-07-23       Impact factor: 6.167

7.  Mouse tracking reveals structure knowledge in the absence of model-based choice.

Authors:  Arkady Konovalov; Ian Krajbich
Journal:  Nat Commun       Date:  2020-04-20       Impact factor: 14.919

8.  Different dorsal striatum circuits mediate action discrimination and action generalization.

Authors:  Mónica Hilario; Terrell Holloway; Xin Jin; Rui M Costa
Journal:  Eur J Neurosci       Date:  2012-04       Impact factor: 3.386

9.  Dopamine enhances model-based over model-free choice behavior.

Authors:  Klaus Wunderlich; Peter Smittenaar; Raymond J Dolan
Journal:  Neuron       Date:  2012-08-09       Impact factor: 17.173

Review 10.  Goals and habits in the brain.

Authors:  Ray J Dolan; Peter Dayan
Journal:  Neuron       Date:  2013-10-16       Impact factor: 17.173

View more
  11 in total

Review 1.  Metastable dynamics of neural circuits and networks.

Authors:  B A W Brinkman; H Yan; A Maffei; I M Park; A Fontanini; J Wang; G La Camera
Journal:  Appl Phys Rev       Date:  2022-03       Impact factor: 19.162

2.  Rat Anterior Cingulate Cortex Continuously Signals Decision Variables in a Patch Foraging Task.

Authors:  Gary A Kane; Morgan H James; Amitai Shenhav; Nathaniel D Daw; Jonathan D Cohen; Gary Aston-Jones
Journal:  J Neurosci       Date:  2022-06-10       Impact factor: 6.709

3.  Explicit knowledge of task structure is a primary determinant of human model-based action.

Authors:  Pedro Castro-Rodrigues; Thomas Akam; Ivar Snorasson; Marta Camacho; Vitor Paixão; Ana Maia; J Bernardo Barahona-Corrêa; Peter Dayan; H Blair Simpson; Rui M Costa; Albino J Oliveira-Maia
Journal:  Nat Hum Behav       Date:  2022-05-19

4.  Open-source, Python-based, hardware and software for controlling behavioural neuroscience experiments.

Authors:  Rui M Costa; Mark E Walton; Thomas Akam; Andy Lustig; James M Rowland; Sampath Kt Kapanaiah; Joan Esteve-Agraz; Mariangela Panniello; Cristina Márquez; Michael M Kohl; Dennis Kätzel
Journal:  Elife       Date:  2022-01-19       Impact factor: 8.140

5.  A low-cost open-source 5-choice operant box system optimized for electrophysiology and optophysiology in mice.

Authors:  Thomas Akam; Dennis Kätzel; Sampath K T Kapanaiah; Bastiaan van der Veen; Daniel Strahnen
Journal:  Sci Rep       Date:  2021-11-15       Impact factor: 4.379

6.  Spatial and Temporal Distribution of Information Processing in the Human Dorsal Anterior Cingulate Cortex.

Authors:  Conor Keogh; Alceste Deli; Amir Puyan Divanbeighi Zand; Mark Jernej Zorman; Sandra G Boccard-Binet; Matthew Parrott; Charalampos Sigalas; Alexander R Weiss; John Frederick Stein; James J FitzGerald; Tipu Z Aziz; Alexander L Green; Martin John Gillies
Journal:  Front Hum Neurosci       Date:  2022-03-18       Impact factor: 3.169

Review 7.  Decision Making as a Learned Skill in Mice and Humans.

Authors:  Michael I Posner; Aldis P Weible; Pascale Voelker; Mary K Rothbart; Cristopher M Niell
Journal:  Front Neurosci       Date:  2022-03-11       Impact factor: 4.677

8.  Cingulate-motor circuits update rule representations for sequential choice decisions.

Authors:  Daigo Takeuchi; Dheeraj Roy; Shruti Muralidhar; Takashi Kawai; Andrea Bari; Chanel Lovett; Heather A Sullivan; Ian R Wickersham; Susumu Tonegawa
Journal:  Nat Commun       Date:  2022-08-04       Impact factor: 17.694

Review 9.  Alzheimer's Disease and Empathic Abilities: The Proposed Role of the Cingulate Cortex.

Authors:  Marina Ávila-Villanueva; Jaime Gómez-Ramírez; Jesús Ávila; Miguel A Fernández-Blázquez
Journal:  J Alzheimers Dis Rep       Date:  2021-05-03

Review 10.  Computational models of adaptive behavior and prefrontal cortex.

Authors:  Alireza Soltani; Etienne Koechlin
Journal:  Neuropsychopharmacology       Date:  2021-08-13       Impact factor: 7.853

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.