Daw, ND and Gershman, SJ and Seymour, B and Dayan, P and Dolan, RJ (2011) Model-based influences on humans' choices and striatal prediction errors. Neuron, 69. pp. 1204-1215.Full text not available from this repository.
The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors, and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making.
|Additional Information:||PMCID: PMC3077926|
|Uncontrolled Keywords:||Adult Basal Ganglia Brain Mapping Choice Behavior Dopamine Female Humans Logistic Models Magnetic Resonance Imaging Male Models, Neurological Neurons Neuropsychological Tests Reinforcement (Psychology)|
|Divisions:||Div F > Computational and Biological Learning|
|Depositing User:||Cron Job|
|Date Deposited:||28 Apr 2013 10:10|
|Last Modified:||23 Jan 2014 19:03|
Actions (login required)