"Generating Contextually Coherent Responses by Learning Structured Vect" by Yan Wang, Yanan Zheng et al.
 

Generating Contextually Coherent Responses by Learning Structured Vectorized Semantics

Document Type

Conference Proceeding

Publication Date

1-1-2021

Abstract

Generating contextually coherent responses has been one of the most critical challenges in building intelligent dialogue systems. Key issues are how to appropriately encode contexts and how to make good use of them during the generation. Past works either directly use (hierarchical) RNN to encode contexts or use attention-based variants to further weight different words and utterances. They tend to learn dispersed focuses over all contextual information, which contradicts the facts that humans tend to respond to certain concentrated semantics of contexts. This leads to the results that generated responses are only show semantically related to, but not precisely coherent with the given contexts. To this end, this paper proposes a contextually coherent dialogue generation (ConDial) method by first encoding contexts into structured semantic vectors using self-attention, and then adaptively choosing key semantic vectors to guide the response generation. Based on the structured semantics, it also develops a calibration mechanism with a dynamic vocabulary during decoding, which enhances exact coherent expressions by adjusting word distribution. According to the experiments, ConDial shows better generative performance than state-of-the-arts and is capable of generating responses that not only continue the topics but also keep coherent contextual expressions.

Identifier

85104737840 (Scopus)

ISBN

[9783030731960]

Publication Title

Lecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics

External Full Text Location

https://doi.org/10.1007/978-3-030-73197-7_5

e-ISSN

16113349

ISSN

03029743

First Page

70

Last Page

87

Volume

12682 LNCS

Grant

2016YFB1001101

Fund Ref

National Key Research and Development Program of China

This document is currently not available here.

Share

COinS