An Adaptive Pre-clustering Support Vector Machine for Binary Imbalanced Classification
Document Type
Conference Proceeding
Publication Date
7-2-2018
Abstract
Imbalance classification is a common but critical problem in machine learning and artificial intelligence. Derived from structural risk minimization, a Support Vector Machine (SVM) enjoys great reputation in classification. However, the original SVM is not suitable for the imbalance classification and the existing modifications of SVM for this kind of problems fail to take the distribution of datasets into full consideration, thereby leading to some remarkable loss in their classification performance. Recently, an Adaptive Clustering by Fast Search and Find of Density Peaks (ADPclust) is proposed and performs well in finding cluster centroids in a sample space automatically and more reliably by using adaptive density peak detection and silhouette theory. Motivated by this, this work proposes an adaptive pre-clustering SVM (AP-SVM) such that the information of the original dataset distribution is well utilized to yield balanced sub-datasets for accurate and efficient classification. Specifically, AP-SVM clusters the majority into several groups given a dataset and then applies undersampling on every cluster to re-balance the dataset to be used in the SVM classification step. After experiments on 10 binary public datasets and evaluation using Area Under Curve (AUC), F-Measure, G-Mean, we well show the superiority of the proposed method over SVM, Synthetic Minority Over-sampling Technique algorithm (SMOTE), Undersampling-SVM (U-SVM), K-Means, Fuzzy C Means and EasyEnsemble.
Identifier
85062206106 (Scopus)
ISBN
[9781538666500]
Publication Title
Proceedings 2018 IEEE International Conference on Systems Man and Cybernetics Smc 2018
External Full Text Location
https://doi.org/10.1109/SMC.2018.00124
First Page
681
Last Page
686
Grant
51775385
Fund Ref
National Natural Science Foundation of China
Recommended Citation
Di, Zonglin; Yao, Siya; Kang, Qi; and Zhou, Mengchu, "An Adaptive Pre-clustering Support Vector Machine for Binary Imbalanced Classification" (2018). Faculty Publications. 8540.
https://digitalcommons.njit.edu/fac_pubs/8540
