CUED Publications database

N-best error simulation for training spoken dialogue systems

Thomson, B and Gasic, M and Henderson, M and Tsiakoulis, P and Young, S (2012) N-best error simulation for training spoken dialogue systems. 2012 IEEE Workshop on Spoken Language Technology, SLT 2012 - Proceedings. pp. 37-42.

Full text not available from this repository.


A recent trend in spoken dialogue research is the use of reinforcement learning to train dialogue systems in a simulated environment. Past researchers have shown that the types of errors that are simulated can have a significant effect on simulated dialogue performance. Since modern systems typically receive an N-best list of possible user utterances, it is important to be able to simulate a full N-best list of hypotheses. This paper presents a new method for simulating such errors based on logistic regression, as well as a new method for simulating the structure of N-best lists of semantics and their probabilities, based on the Dirichlet distribution. Off-line evaluations show that the new Dirichlet model results in a much closer match to the receiver operating characteristics (ROC) of the live data. Experiments also show that the logistic model gives confusions that are closer to the type of confusions observed in live situations. The hope is that these new error models will be able to improve the resulting performance of trained dialogue systems. © 2012 IEEE.

Item Type: Article
Divisions: Div F > Machine Intelligence
Depositing User: Cron Job
Date Deposited: 17 Jul 2017 19:23
Last Modified: 22 May 2018 07:18