Learning K-way D-dimensional discrete embedding for hierarchical data visualization and retrieval
Document Type
Conference Proceeding
Publication Date
1-1-2019
Abstract
Traditional embedding approaches associate a real-valued embedding vector with each symbol or data point, which is equivalent to applying a linear transformation to “one-hot” encoding of discrete symbols or data objects. Despite simplicity, these methods generate storage-inefficient representations and fail to effectively encode the internal semantic structure of data, especially when the number of symbols or data points and the dimensionality of the real-valued embedding vectors are large. In this paper, we propose a regularized autoencoder framework to learn compact Hierarchical K-way D-dimensional (HKD) discrete embedding of symbols or data points, aiming at capturing essential semantic structures of data. Experimental results on synthetic and real-world datasets show that our proposed HKD embedding can effectively reveal the semantic structure of data via hierarchical data visualization and greatly reduce the search space of nearest neighbor retrieval while preserving high accuracy.
Identifier
85074948607 (Scopus)
ISBN
[9780999241141]
Publication Title
Ijcai International Joint Conference on Artificial Intelligence
External Full Text Location
https://doi.org/10.24963/ijcai.2019/411
ISSN
10450823
First Page
2966
Last Page
2972
Volume
2019-August
Recommended Citation
Liang, Xiaoyuan; Min, Martin Renqiang; Guo, Hongyu; and Wang, Guiling, "Learning K-way D-dimensional discrete embedding for hierarchical data visualization and retrieval" (2019). Faculty Publications. 7988.
https://digitalcommons.njit.edu/fac_pubs/7988
