A Case Study on the Importance of Belief State Representation for Dialogue Policy Management
Margarita Kotti, Vassilios Diakoloukas, Alexandros Papangelis, Michail Lagoudakis and Yannis Stylianou
Abstract:
A key component of task-oriented dialogue systems is the belief state representation, since it directly affects the policy learning efficiency. In this paper, we propose a novel, binary, compact, yet scalable belief state representation. We compare the standard verbose belief state representation (268 dimensions) with the domain-independent representation (57 dimensions) and the proposed representation (13 or 4 dimensions). To test those representations, the recently introduced Advantage Actor Critic (A2C) algorithm is exploited. The latter has not been tested before for any representation apart from the verbose one. We study the effect of the belief state representation within A2C under 0%, 15%, 30% and 45% semantic error rate and conclude that the novel binary representation in general outperforms both the domain-independent and the verbose belief state representation. Further, the robustness of the binary representation is tested under more realistic scenarios with mismatched semantic error rates, within the A2C and DQN algorithms. The results indicate that the proposed compact, binary representation performs better or similarly to the other representations, being an efficient and promising alternative to the full belief.
Cite as: Kotti, M., Diakoloukas, V., Papangelis, A., Lagoudakis, M., Stylianou, Y. (2018) A Case Study on the Importance of Belief State Representation for Dialogue Policy Management. Proc. Interspeech 2018, 986-990, DOI: 10.21437/Interspeech.2018-1293.
BiBTeX Entry:
@inproceedings{Kotti2018,
author={Margarita Kotti and Vassilios Diakoloukas and Alexandros Papangelis and Michail Lagoudakis and Yannis Stylianou},
title={A Case Study on the Importance of Belief State Representation for Dialogue Policy Management},
year=2018,
booktitle={Proc. Interspeech 2018},
pages={986--990},
doi={10.21437/Interspeech.2018-1293},
url={http://dx.doi.org/10.21437/Interspeech.2018-1293} }