Ensemble Incomplete Wavelet Packet Subspaces for Face Recognition Based on Fuzzy Integral
ZHAI Jun-Hai1, WANG Xi-Zhao1, ZHANG Su-Fang2
1.Key Laboratory of Machine Learning and Computational Intelligence, School of Mathematics and Computer Science, Hebei University, Baoding 071002 2.Teaching and Research Section of Mathematics, Hebei Information Engineering School, Baoding 071000
Abstract:An ensemble incomplete wavelet packet subspaces method based on fuzzy integral for face recognition is proposed, and it is compared with 5 related approaches. Firstly, face images are decomposed into different sub-images with incomplete wavelet packet transform. For sub-images with low frequency information in two directions, features are extracted directly. And for high frequency sub-images with low frequency information in one direction, features are extracted after these images are averaged. Next, fuzzy classifiers are trained by the obtained wavelet subspace images. Finally, the trained classifiers are integrated by fuzzy integral. The proposed method makes full use of the information provided by sub-images with different frequency and improves the accuracy of face recognition. The experimental results on ORL, YALE, JAFFE and FERET show that the proposed method has higher accuracy than 5 related approaches.
[1] Zhang Y J, Jia H X, Li L, et al. Subspace-Based Face Recognition. Beijing, China: Tsinghua University Press, 2009 (in Chinese) (章毓晋,贾彗星,李 乐,等.基于子空间的人脸识别方法.北京:清华大学出版社, 2009) [2] Ren H R, Ji H X. Nonparametric Subspace Analysis Fused to 2DPCA for Face Recognition. Optik-International Journal for Light and Electron Optics, 2014, 125(8): 1922-1925 [3] Turk M, Pentland A. Eigen-Faces for Recognition. Journal of Cognitive Neuroscience, 1991, 3(1): 71-86 [4] Belhumeur P N, Hespanha J P, Kriegman D J. Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans on Pattern Analysis and Machine Intelligence, 1997, 19(7): 711-720 [5] Yang J, Zhang D, Frangi A F, et al. Two-Dimensional PCA: A New Approach to Appearance-Based Face Representation and Recognition. IEEE Trans on Pattern Analysis and Machine Intelligence, 2004, 26(1): 131-137 [6] Li M, Yuan B Z. 2D-LDA: A Statistical Linear Discriminant Analysis for Image Matrix. Pattern Recognition Letters, 2005, 26(5): 527-532 [7] Zhang D Q, Zhou Z H. (2D)2PCA: Two-Directional Two-Dimensional PCA for Efficient Face Representation and Recognition. Neuro-computing, 2005, 69(1/2/3): 224-231 [8] Noushath S, Kumar G H, Shivakumara P. (2D)2LDA: An Efficient Approach for Face Recognition. Pattern Recognition, 2006, 39(7): 1396-1400 [9] Gaidhane V H, Hote Y V, Singh V. An Efficient Approach for Face Recognition Based on Common Eigenvalues. Pattern Recognition, 2014, 47(5): 1869-1879 [10] Wiskott L, Fellous J M, Kruger N, et al. Face Recognition by Elastic Bunch Graph Matching. IEEE Trans on Pattern Analysis and Machine Intelligence, 1997, 19(7): 775-779 [11] Samaria F, Young S. HMM Based Architecture for Face Identification. Image Vision Computing. 1994, 12(8): 537-543 [12] Zhang Y, Zhou Z H. Cost-Sensitive Face Recognition. IEEE Trans on Pattern Analysis and Machine Intelligence, 2010, 32(10): 1758-1769 [13] Stuhlsatz A, Lippel J, Zielke T. Feature Extraction with Deep Neural Networks by a Generalized Discriminant Analysis. IEEE Trans on Neural Networks and Learning Systems, 2012, 23(4): 596-608 [14] Kan M, Shan S G, Su Y, et al. Adaptive Discriminant Learning for Face Recognition. Pattern Recognition, 2013, 46(9): 2497-2509 [15] Dai D Q, Yuen P C. Wavelet Based Discriminant Analysis for Face Recognition. Applied Mathematics and Computation, 2006, 175(1): 307-318 [16] Yin F, Jiao C L, Shang F H, et al. Sparse Regularization Discri- minant Analysis for Face Recognition. Neurocomputing, 2014, 128(Special Issue): 341-362 [17] Kwak K C, Pedrycz W. Face Recognition Using Fuzzy Integral and Wavelet Decomposition Method. IEEE Trans on Systems, Man, and Cybernetics-Part B: Cybernetics, 2004, 34(4): 1666-1675 [18] Yang W K, Wang J G, Ren M W, et al. Feature Extraction Using Fuzzy Inverse FDA. Neurocomputing, 2009, 72(13/14/15): 3384-3390 [19] Wang D H, Wang X K, Kong S. Integration of Multi-feature Fusion and Dictionary Learning for Face Recognition. Image and Vision Computing, 2013, 31(12): 895-904 [20] Zong W W, Huang G B. Face Recognition Based on Extreme Learning Machine. Neurocomputing, 2011, 74(16): 2541-2551 [21] Hu H F. Variable Lighting Face Recognition Using Discrete Wavelet Transform. Pattern Recognition Letters, 2011, 32(13): 1526-1534 [22] Zhu Y L, Liu J, Chen S C. Semi-Random Subspace Method for Face Recognition. Image and Vision Computing, 2009, 27(9): 1358-1370 [23] Sharma P, Arya K V, Yadav R N. Efficient Face Recognition Using Wavelet-Based Generalized Neural Network. Signal Processing, 2013, 93(6): 1557-1565 [24] Beveridge J R, Givens G H, Phillips P J, et al. Factors that Influence Algorithm Performance in the Face Recognition Grand Challenge. Computer Vision and Image Understanding, 2009, 113(6): 750-762 [25] Givens G H, Beveridge J R, Phillips P J, et al. Introduction to Face Recognition and Evaluation of Algorithm Performance. Computational Statistics & Data Analysis, 2013, 67: 236-247 [26] Zhai J H. Image Recognition Based on Wavelet Transforms and Fuzzy Rough Sets Technique. Ph.D Dissertation. Baoding, China: Hebei University, 2010 (in Chinese) (翟俊海.基于小波变换和模糊粗糙集技术的图像识别.博士学位论文.保定:河北大学, 2010) [27] Mallat S G. A Theory for Multiresolution Signal Decomposition: The Wavelet Representation. IEEE Trans on Pattern Analysis and Machine Intelligence, 1989, 11(7): 674-693 [28] Zhai J H, Wang X Z, Zhang S F. Integration of Multiple Fuzzy Decision Tree Based on Fuzzy Integral. Journal of Computer Research and Development, 2009, 46(3): 470-477 (in Chinese) (翟俊海,王熙照,张素芳.基于模糊积分的多模糊决策树融合.计算机研究与发展, 2009, 46(3): 470-477) [29] Kuncheva L I. Combining Pattern Classifiers: Methods and Algorithm. Hoboken, USA: John Wiley & Sons, 2004 [30] Kolesárová A, Stupňanová A, Beganová J. Aggregation-Based Extensions of Fuzzy Measures. Fuzzy Sets and Systems, 2012, 194: 1-14 [31] Foo Ng T, Pham T D, Jia X P. Feature Interaction in Subspace Clustering Using the Choquet Integral. Pattern Recognition, 2012, 45(7): 2645-2660 [32] Choquet G. Theory of Capacities. Annales de L′institut Fourier, 1954, 5: 131-295 [33] Sugeno M. Theory of Fuzzy Integrals and Its Applications. Ph.D. Dissertation. Tokyo, Japan: Tokyo Institute of Technology, 1974 [34] Wang Z Y, Leung K S, Wong M L. A New Type of Nonlinear Integrals and the Computational Algorithm. Fuzzy Sets and Systems, 2000, 112(2): 223-231 [35] Wang X Z. Fuzzy Measure and Fuzzy Integral and Its Application in the Classification Techniques. Beijing, China: Science Press, 2008 (in Chinese) (王熙照.模糊测度和模糊积分及在分类技术中的应用.北京:科学出版社, 2008) [36] Keller J M, Gray M R, Givens J A. A Fuzzy k-Nearest Neighbor Algorithm. IEEE Trans on Systems, Man and Cybernetics, 1985, SMC-15(4): 580-585 [37] Huang G B, Zhu Q Y, Siew C K. Extreme Learning Machine: Theory and Applications. Neurocomputing. 2006, 70(1/2/3): 489-501 [38] Huang G B, Wang D H, Lan Y. Extreme Learning Machines: A Survey. International Journal of Machine Learning and Cybernetics, 2011, 2(2): 107-122 [39] Samaria F, Harter A. Parameterization of a Stochastic Model for Human Face Identification // Proc of the 2nd IEEE Workshop on Applications of Computer Vision. Sarasota, USA, 1994: 138-142 [40] Georghiades A S, Belhumeur P N, Kriegman D J. From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose. IEEE Trans on Pattern Analysis and Machine Intelligence, 2001, 23(6): 643-660 [41] Lyons M J, Budynek J, Akamatsu S. Automatic Classification of Single Facial Images. IEEE Trans on Pattern Analysis and Machine Intelligence, 1999, 21(12): 1357-1362 [42] Phillips P J, Wechsler H, Huang J, et al. The FERET Database and Evaluation Procedure for Face-Recognition Algorithms. Image and Vision Computing, 1998, 16(5): 295-306