Authors
Nathaniel D Daw, Yael Niv, Peter Dayan
Publication date
2005/12
Journal
Nature neuroscience
Volume
8
Issue
12
Pages
1704-1711
Publisher
Nature Publishing Group US
Description
A broad range of neural and behavioral data suggests that the brain contains multiple systems for behavioral choice, including one associated with prefrontal cortex and another with dorsolateral striatum. However, such a surfeit of control raises an additional choice problem: how to arbitrate between the systems when they disagree. Here, we consider dual-action choice systems from a normative perspective, using the computational theory of reinforcement learning. We identify a key trade-off pitting computational simplicity against the flexible and statistically efficient use of experience. The trade-off is realized in a competition between the dorsolateral striatal and prefrontal systems. We suggest a Bayesian principle of arbitration between them according to uncertainty, so each controller is deployed when it should be most accurate. This provides a unifying account of a wealth of experimental evidence about the …
Total citations
20062007200820092010201120122013201420152016201720182019202020212022202320245749599584120143136165185157184235209294221206179124