1.College of Electronic and Information Engineering,Nanjing University of Information Science and Technology,Nanjing 210044 2.Key Laboratory of Underwater Acoustic Signal Processing of Ministry of Education,School of Information Science and Engineering,Southeast University,Nanjing 210096 3.Research Center for Learning Science,Southeast University,Nanjing 210096
Abstract To overcome the drawbacks of the dual-space linear discriminant analysis method, a kernel-based dual-space discriminant analysis method, namely KDS-DA is proposed. A fast algorithm based on the inverse operator of bordered matrix is also proposed for solving the discriminant vectors of KDS-DA. The algorithm utilizes the fact that the inverse computation of higher order bordered matrix can be converted to the inverse computation of a lower order matrix. To solve the (r+1)-th discriminant vector in the principal subspace of the within-class scatter matrix, the computational results obtained in computing the r-th discriminant vector are fully used, which significantly reduces the computational cost. The experimental results on ORL and AR face databases demonstrate the effectiveness of the proposed methods.
[1] Duda R O, Hart P E, Stork D E. Pattern Classification. 2nd Edition. Malden, USA: Wiley, 2001 [2] Zheng Wenming, Zou Cairong, Zhao Li. Real-Time Face Recognition Using Gram-Schmidt Orthogonalization Algorithm for LDA // Proc of the 17th IEEE Conference on Pattern Recognition. Washington, USA, 2004, Ⅱ: 403-406 [3] Park C H, Park H. A Comparison of Generalized Linear Discriminant Analysis Algorithms. Pattern Recognition, 2008, 41(3): 1083-1097 [4] Wang Xiaogang. Tang Xiaoou. Dual-Space Linear Discriminant Analysis for Face Recognition // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA, 2004: 564-569 [5] Zheng Wenming, Tang Xiaoou. Fast Algorithm for Updating the Discriminant Vectors of Dual-Space LDA. IEEE Trans on Information Forensics and Security, 2009, 4(3): 418-427 [6] Zheng Wenming. Class Incremental Generalized Discriminant Analysis. Neural Computation, 2006, 18(4): 979-1006 [7] Jin Zhong, Yang Jingyu, Hu Zhongshan, et al. Face Recognition Based on the Uncorrelated Discriminant Transform. Pattern Recognition, 2001, 34(7): 1405-1416 [8] Martinez A M, Benavente R. The AR Face Database. CVC Technical Report, #24, Barcelona, Spain: Purdue University, 1998 [9] Schlkopf B, Smola A J, Müller K R. Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Neural Computation, 1998, 10(5): 1299-1319 [10] Baudat G, Anouar F. Generalized Discriminant Analysis Using a Kernel Approach. Neural Computation, 2000, 12(10): 2385-2404 [11] Lu J, Plataniotis K N, Venetsanopoulos A N. Face Recognition Using Kernel Direct Discriminant Analysis Algorithms. IEEE Trans on Neural Networks, 2003, 14(1): 117-126
2010, Vol. 23 
