A Class-Information-Incorporated Kernel Principal Component Analysis Method
LI Yong-Zhi1,2, YANG Jing-Yu2, WU Song-Song2
1.School of Information Science and Technology, Nanjing Forestry University, Nanjing 2100372. School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing 210094
Abstract：A supervised feature extraction method based on kernel principal component analysis (KPCA) is presented. In feature extraction the class information of the training kernel sample is sufficiently utilized, and the simple mathematical formulation is employed which is similar to KPCA. Thus, the method is named as class-information-incorporated kernel principal component analysis (CIKPCA). Furthermore, a new classification strategy is presented by fusing two kinds of feature vectors to improve the recognition rate. The experimental results on three databases show that the proposed method is better than KPCA in terms of recognition rate, and it even outperforms KLDA.
[1] Kirby M, Sirovich L. Application of the Karhunen-Loève Procedure for the Characterization of Human Faces. IEEE Trans on Pattern Analysis and Machine Intelligence, 1990, 12 (1): 103-108 [2] Turk M, Pentland A. Eigenfaces for Recognition. Journal of Cognitive Neuroscience, 1991, 3(1): 71-86 [3] Belhumeur P N, Hespanha J P, Kriegman D J. Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans on Pattern Analysis and Machine Intelligence, 1997, 19(7): 711-720 [4] Vapnik V N. The Nature of Statistical Learning Theory. Berlin, Germany: Springer-Verlag, 1995 [5] Lu Juwei, Plataniotis K N, Venetsanopoulos A N. Face Recognition Using Kernel Direct Discriminant Analysis Algorithms. IEEE Trans on Neural Networks, 2003, 14(1): 117-126 [6] Müller K R, Mika S, Rtsch G, et al. An Introduction to Kernel-Based Learning Algorithms. IEEE Trans on Neural Networks, 2001, 12(2): 181-201 [7] Schlkopf B, Mika S, Burges C J C, et al. Input Space vs. Feature Space in Kernel-Based Methods. IEEE Trans on Neural Networks, 1999, 10(5): 1000-1017 [8] Liu Chengjun. Gabor-Based Kernel PCA with Fractional Power Polynomial Models for Face Recognition. IEEE Trans on Pattern Analysis and Machine Intelligence, 2004, 26(5): 572-581 [9] Chen Songcan, Sun Tingkai. Class-Information-Incorporated Principal Component Analysis. Neurocomputing, 2005, 69(1/2/3): 216-223 [10] Becker S, Plumbley M. Unsupervised Neural Network Learning Procedures for Feature Extraction and Classification. Journal of Applied Intelligence, 1996, 6(3): 185-203 [11] Schlkopf B, Smola A, Müller K R. Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Neural Computation, 1998, 10(5): 1299-1319
2008, Vol. 21 
