| Literature DB >> 16286932 |
Nathaniel D Daw1, Yael Niv, Peter Dayan.
Abstract
A broad range of neural and behavioral data suggests that the brain contains multiple systems for behavioral choice, including one associated with prefrontal cortex and another with dorsolateral striatum. However, such a surfeit of control raises an additional choice problem: how to arbitrate between the systems when they disagree. Here, we consider dual-action choice systems from a normative perspective, using the computational theory of reinforcement learning. We identify a key trade-off pitting computational simplicity against the flexible and statistically efficient use of experience. The trade-off is realized in a competition between the dorsolateral striatal and prefrontal systems. We suggest a Bayesian principle of arbitration between them according to uncertainty, so each controller is deployed when it should be most accurate. This provides a unifying account of a wealth of experimental evidence about the factors favoring dominance by either system.Mesh:
Year: 2005 PMID: 16286932 DOI: 10.1038/nn1560
Source DB: PubMed Journal: Nat Neurosci ISSN: 1097-6256 Impact factor: 24.884