Literature DB >> 16286932

Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control.

Nathaniel D Daw1, Yael Niv, Peter Dayan.   

Abstract

A broad range of neural and behavioral data suggests that the brain contains multiple systems for behavioral choice, including one associated with prefrontal cortex and another with dorsolateral striatum. However, such a surfeit of control raises an additional choice problem: how to arbitrate between the systems when they disagree. Here, we consider dual-action choice systems from a normative perspective, using the computational theory of reinforcement learning. We identify a key trade-off pitting computational simplicity against the flexible and statistically efficient use of experience. The trade-off is realized in a competition between the dorsolateral striatal and prefrontal systems. We suggest a Bayesian principle of arbitration between them according to uncertainty, so each controller is deployed when it should be most accurate. This provides a unifying account of a wealth of experimental evidence about the factors favoring dominance by either system.

Mesh:

Year:  2005        PMID: 16286932     DOI: 10.1038/nn1560

Source DB:  PubMed          Journal:  Nat Neurosci        ISSN: 1097-6256            Impact factor:   24.884


  769 in total

1.  Changes in corticostriatal connectivity during reinforcement learning in humans.

Authors:  Guillermo Horga; Tiago V Maia; Rachel Marsh; Xuejun Hao; Dongrong Xu; Yunsuo Duan; Gregory Z Tau; Barbara Graniello; Zhishun Wang; Alayar Kangarlu; Diana Martinez; Mark G Packard; Bradley S Peterson
Journal:  Hum Brain Mapp       Date:  2014-11-12       Impact factor: 5.038

2.  The prefrontal cortex and hybrid learning during iterative competitive games.

Authors:  Hiroshi Abe; Hyojung Seo; Daeyeol Lee
Journal:  Ann N Y Acad Sci       Date:  2011-12       Impact factor: 5.691

Review 3.  Does the orbitofrontal cortex signal value?

Authors:  Geoffrey Schoenbaum; Yuji Takahashi; Tzu-Lan Liu; Michael A McDannald
Journal:  Ann N Y Acad Sci       Date:  2011-12       Impact factor: 5.691

4.  Representations of appetitive and aversive information in the primate orbitofrontal cortex.

Authors:  Sara E Morrison; C Daniel Salzman
Journal:  Ann N Y Acad Sci       Date:  2011-12       Impact factor: 5.691

Review 5.  A computational framework for the study of confidence in humans and animals.

Authors:  Adam Kepecs; Zachary F Mainen
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2012-05-19       Impact factor: 6.237

6.  Lateral prefrontal cortex contributes to maladaptive decisions.

Authors:  Gui Xue; Chi-Hung Juan; Chi-Fu Chang; Zhong-Lin Lu; Qi Dong
Journal:  Proc Natl Acad Sci U S A       Date:  2012-03-05       Impact factor: 11.205

Review 7.  Learning from experience: event-related potential correlates of reward processing, neural adaptation, and behavioral choice.

Authors:  Matthew M Walsh; John R Anderson
Journal:  Neurosci Biobehav Rev       Date:  2012-06-07       Impact factor: 8.989

8.  Brain function during probabilistic learning in relation to IQ and level of education.

Authors:  Wouter van den Bos; Eveline A Crone; Berna Güroğlu
Journal:  Dev Cogn Neurosci       Date:  2011-10-06       Impact factor: 6.464

9.  Action selection and action value in frontal-striatal circuits.

Authors:  Moonsang Seo; Eunjeong Lee; Bruno B Averbeck
Journal:  Neuron       Date:  2012-06-07       Impact factor: 17.173

10.  Does intrinsic motivation strengthen physical activity habit? Modeling relationships between self-determination, past behaviour, and habit strength.

Authors:  Benjamin Gardner; Phillippa Lally
Journal:  J Behav Med       Date:  2012-07-04
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.