Bilevel Feature Extraction-Based Text Mining for Fault Diagnosis of Railway Systems
Document Type
Article
Publication Date
1-1-2017
Abstract
A vast amount of text data is recorded in the forms of repair verbatim in railway maintenance sectors. Efficient text mining of such maintenance data plays an important role in detecting anomalies and improving fault diagnosis efficiency. However, unstructured verbatim, high-dimensional data, and imbalanced fault class distribution pose challenges for feature selections and fault diagnosis. We propose a bilevel feature extraction-based text mining that integrates features extracted at both syntax and semantic levels with the aim to improve the fault classification performance. We first perform an improved statistics-based feature selection at the syntax level to overcome the learning difficulty caused by an imbalanced data set. Then, we perform a prior latent Dirichlet allocation-based feature selection at the semantic level to reduce the data set into a low-dimensional topic space. Finally, we fuse fault features derived from both syntax and semantic levels via serial fusion. The proposed method uses fault features at different levels and enhances the precision of fault diagnosis for all fault classes, particularly minority ones. Its performance has been validated by using a railway maintenance data set collected from 2008 to 2014 by a railway corporation. It outperforms traditional approaches.
Identifier
84963984180 (Scopus)
Publication Title
IEEE Transactions on Intelligent Transportation Systems
External Full Text Location
https://doi.org/10.1109/TITS.2016.2521866
ISSN
15249050
First Page
49
Last Page
58
Issue
1
Volume
18
Grant
2014X008-A
Fund Ref
National Science Foundation
Recommended Citation
Wang, Feng; Xu, Tianhua; Tang, Tao; Zhou, Mengchu; and Wang, Haifeng, "Bilevel Feature Extraction-Based Text Mining for Fault Diagnosis of Railway Systems" (2017). Faculty Publications. 10052.
https://digitalcommons.njit.edu/fac_pubs/10052
