CUED Publications database

The misbehavior of value and the discipline of the will.

Dayan, P and Niv, Y and Seymour, B and Daw, ND (2006) The misbehavior of value and the discipline of the will. Neural Netw, 19. pp. 1153-1160. ISSN 0893-6080

Full text not available from this repository.


Most reinforcement learning models of animal conditioning operate under the convenient, though fictive, assumption that Pavlovian conditioning concerns prediction learning whereas instrumental conditioning concerns action learning. However, it is only through Pavlovian responses that Pavlovian prediction learning is evident, and these responses can act against the instrumental interests of the subjects. This can be seen in both experimental and natural circumstances. In this paper we study the consequences of importing this competition into a reinforcement learning context, and demonstrate the resulting effects in an omission schedule and a maze navigation task. The misbehavior created by Pavlovian values can be quite debilitating; we discuss how it may be disciplined.

Item Type: Article
Uncontrolled Keywords: Animals Association Learning Avoidance Learning Conditioning, Classical Conditioning, Operant Humans Reinforcement (Psychology) Reinforcement Schedule Time Factors
Divisions: Div F > Computational and Biological Learning
Depositing User: Cron Job
Date Deposited: 17 Jul 2017 19:20
Last Modified: 26 Apr 2018 02:13