Authors
A Ross Otto, Samuel J Gershman, Arthur B Markman, Nathaniel D Daw
Publication date
2013/5
Journal
Psychological science
Volume
24
Issue
5
Pages
751-761
Publisher
Sage Publications
Description
A number of accounts of human and animal behavior posit the operation of parallel and competing valuation systems in the control of choice behavior. In these accounts, a flexible but computationally expensive model-based reinforcement-learning system has been contrasted with a less flexible but more efficient model-free reinforcement-learning system. The factors governing which system controls behavior—and under what circumstances—are still unclear. Following the hypothesis that model-based reinforcement learning requires cognitive resources, we demonstrated that having human decision makers perform a demanding secondary task engenders increased reliance on a model-free reinforcement-learning strategy. Further, we showed that, across trials, people negotiate the trade-off between the two systems dynamically as a function of concurrent executive-function demands, and people’s choice …
Total citations
201320142015201620172018201920202021202220232024122739344431402734403516