Generating Contextually Coherent Responses by Learning Structured Vectorized Semantics
Document Type
Conference Proceeding
Publication Date
1-1-2021
Abstract
Generating contextually coherent responses has been one of the most critical challenges in building intelligent dialogue systems. Key issues are how to appropriately encode contexts and how to make good use of them during the generation. Past works either directly use (hierarchical) RNN to encode contexts or use attention-based variants to further weight different words and utterances. They tend to learn dispersed focuses over all contextual information, which contradicts the facts that humans tend to respond to certain concentrated semantics of contexts. This leads to the results that generated responses are only show semantically related to, but not precisely coherent with the given contexts. To this end, this paper proposes a contextually coherent dialogue generation (ConDial) method by first encoding contexts into structured semantic vectors using self-attention, and then adaptively choosing key semantic vectors to guide the response generation. Based on the structured semantics, it also develops a calibration mechanism with a dynamic vocabulary during decoding, which enhances exact coherent expressions by adjusting word distribution. According to the experiments, ConDial shows better generative performance than state-of-the-arts and is capable of generating responses that not only continue the topics but also keep coherent contextual expressions.
Identifier
85104737840 (Scopus)
ISBN
[9783030731960]
Publication Title
Lecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics
External Full Text Location
https://doi.org/10.1007/978-3-030-73197-7_5
e-ISSN
16113349
ISSN
03029743
First Page
70
Last Page
87
Volume
12682 LNCS
Grant
2016YFB1001101
Fund Ref
National Key Research and Development Program of China
Recommended Citation
Wang, Yan; Zheng, Yanan; Jiang, Shimin; Dong, Yucheng; Chen, Jessica; and Wang, Shaohua, "Generating Contextually Coherent Responses by Learning Structured Vectorized Semantics" (2021). Faculty Publications. 4667.
https://digitalcommons.njit.edu/fac_pubs/4667