Literature DB >> 26378874

Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex.

William H Alexander1, Joshua W Brown2.   

Abstract

Anterior cingulate and dorsolateral prefrontal cortex (ACC and dlPFC, respectively) are core components of the cognitive control network. Activation of these regions is routinely observed in tasks that involve monitoring the external environment and maintaining information in order to generate appropriate responses. Despite the ubiquity of studies reporting coactivation of these two regions, a consensus on how they interact to support cognitive control has yet to emerge. In this letter, we present a new hypothesis and computational model of ACC and dlPFC. The error representation hypothesis states that multidimensional error signals generated by ACC in response to surprising outcomes are used to train representations of expected error in dlPFC, which are then associated with relevant task stimuli. Error representations maintained in dlPFC are in turn used to modulate predictive activity in ACC in order to generate better estimates of the likely outcomes of actions. We formalize the error representation hypothesis in a new computational model based on our previous model of ACC. The hierarchical error representation (HER) model of ACC/dlPFC suggests a mechanism by which hierarchically organized layers within ACC and dlPFC interact in order to solve sophisticated cognitive tasks. In a series of simulations, we demonstrate the ability of the HER model to autonomously learn to perform structured tasks in a manner comparable to human performance, and we show that the HER model outperforms current deep learning networks by an order of magnitude.

Entities:  

Mesh:

Year:  2015        PMID: 26378874     DOI: 10.1162/NECO_a_00779

Source DB:  PubMed          Journal:  Neural Comput        ISSN: 0899-7667            Impact factor:   2.026


  27 in total

1.  Learning to Synchronize: Midfrontal Theta Dynamics during Rule Switching.

Authors:  Pieter Verbeke; Kate Ergo; Esther De Loof; Tom Verguts
Journal:  J Neurosci       Date:  2020-12-11       Impact factor: 6.167

2.  Dorsal anterior cingulate cortex and the value of control.

Authors:  Amitai Shenhav; Jonathan D Cohen; Matthew M Botvinick
Journal:  Nat Neurosci       Date:  2016-09-27       Impact factor: 24.884

3.  A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex.

Authors:  Ben Tsuda; Kay M Tye; Hava T Siegelmann; Terrence J Sejnowski
Journal:  Proc Natl Acad Sci U S A       Date:  2020-11-05       Impact factor: 11.205

4.  Computational evidence for hierarchically structured reinforcement learning in humans.

Authors:  Maria K Eckstein; Anne G E Collins
Journal:  Proc Natl Acad Sci U S A       Date:  2020-11-24       Impact factor: 11.205

5.  Surprise, value and control in anterior cingulate cortex during speeded decision-making.

Authors:  Eliana Vassena; James Deraeve; William H Alexander
Journal:  Nat Hum Behav       Date:  2020-01-13

6.  A Control Theoretic Model of Adaptive Learning in Dynamic Environments.

Authors:  Harrison Ritz; Matthew R Nassar; Michael J Frank; Amitai Shenhav
Journal:  J Cogn Neurosci       Date:  2018-06-07       Impact factor: 3.225

7.  Distinct Frontoparietal Networks Underlying Attentional Effort and Cognitive Control.

Authors:  Anne S Berry; Martin Sarter; Cindy Lustig
Journal:  J Cogn Neurosci       Date:  2017-03-02       Impact factor: 3.225

8.  Social evaluations under conflict: negative judgments of conflicting information are easier than positive judgments.

Authors:  Hannah U Nohlen; Frenk van Harreveld; William A Cunningham
Journal:  Soc Cogn Affect Neurosci       Date:  2019-07-31       Impact factor: 3.436

Review 9.  Advances in modeling learning and decision-making in neuroscience.

Authors:  Anne G E Collins; Amitai Shenhav
Journal:  Neuropsychopharmacology       Date:  2021-08-27       Impact factor: 7.853

10.  Task-specific prioritization of reward and effort information: Novel insights from behavior and computational modeling.

Authors:  Eliana Vassena; James Deraeve; William H Alexander
Journal:  Cogn Affect Behav Neurosci       Date:  2019-06       Impact factor: 3.282

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.