Generating-kernel based nonlinear feature extraction methods
Document Type
Syllabus
Publication Date
12-1-2011
Abstract
This paper introduces an ideaofgenerating a kernel from an arbitrary function by embedding the training samples into the function. Based on this idea, we develop two nonlinear feature extraction methods: generating kernelprincipal component analysis (GKPCA) and generating kernel Fisher discriminant (GKFD). These two methods are shown to be equivalent to the function-mapping-space PCA (FMS-PCA) and the function-mapping-space LDA (FMS-LDA) methods, respectively. This equivalence reveals that the generating kernel is actually determined by the corresponding function map. From the generating kernel point of view, we can classify the current kernel Fisher Discriminant (KFD)algorithms into two categories: KPCA+LDA based algorithms and Straightforward KFD (SKFD) algorithms. The KPCA+LDA based algorithms directly work on the given kernel and are not suitable for non-kernel functions, while the SKFDalgorithms essentially work on the generating kernel from a given symmetricfunction and are therefore suitable for non-kernels as well as kernels.Experiments using the Face Recognition Grand Challenge (FRGC) and the Biometric Experimentation Environment (BEE) system show the effectiveness of the generating kernel based methods.In particular, the generating kernels from the sigmoid function and the fractional power polynomial function can achieve comparable or even better performance than the popular kernels like the polynomial kernel and the Gaussian kernel. © 2012 by Nova Science Publishers, Inc. All rights reserved.
Identifier
84892861473 (Scopus)
ISBN
[9781612091181]
Publication Title
Perspectives on Pattern Recognition
First Page
87
Last Page
112
Recommended Citation
Yang, Jian and Liu, Chengjun, "Generating-kernel based nonlinear feature extraction methods" (2011). Faculty Publications. 11039.
https://digitalcommons.njit.edu/fac_pubs/11039
