An Occluded Facial Expression Recognition Method Based on Sparse Representation
ZHU Ming-Han1,2, LI Shu-Tao1, YE Hua2
1College of Electrical and Information Engineering, Hunan University, Shangsha 410082 2College of Electrical and Information Engineering, Hunan University of Arts and Science, Changde 415000
Abstract:Occlusion dictionary does not have redundancy and facial expression classification is easily disturbed by identity features, which sparse representation based classification(SRC) is used to recognize occluded facial expression. A method for occluded facial expression recognition is proposed to solve this problem. Firstly, an occlusion dictionary with redundancy is constructed by multilevel blocking of the image. Next, sparse representation coefficients of the test image are gained by spare decomposition. Finally, the expression category of test image is judged in its individual subspace. The proposed method makes decomposition coefficients of the test image sparser and avoids identity feature interference to expression classification. The experimental results on Cohn-Kanade and JAFFE face databases show that the proposed method is robust to occluded facial expression recognition.
[1] Buciu I, Kotsia I, Pitas I. Facial Expression Analysis under Partial Occlusion // Proc of the IEEE International Conference on Acoustics, Speech and Signal Processing. Philadelphia, USA, 2005, V: 453-456 [2] Kotsia I, Buciu I, Pitas I. An Analysis of Facial Expression Recognition under Partial Facial Image Occlusion. Image and Vision Computing, 2008, 26(7): 1052-1067 [3] Bourel F, Chibelushi C C, Low A A. Recognition of Facial Expre-ssions in the Presence of Occlusion // Proc of the 12th British Machine Vision Conference. Manchester, UK, 2001: 213-222 [4] Bourel F, Chibelushi C C, Low A A. Robust Facial Expression Recognition Using a State-Based Model of Spatially-Localised Facial Dynamics // Proc of the 5th IEEE International Conference on Automatic Face and Gesture Recognition. Washington, USA, 2002: 106-111 [5] Hammal Z, Arguin M, Gosselin F. Comparing a Novel Model Based on the Transferable Belief Model with Humans During the Recognition of Partially Occluded Facial Expressions[EB/OL]. [2013-04-05]. http://www.journalofvision.org/content/9/2/22.full [6] Xue Y L, Mao X, Caleanu C D, et al. Robust Facial Expression Recognition under Occlusion Condition. Journal of Beijing University of Aeronautics and Astronautics, 2010, 36(4): 429-433 (in Chinese) (薛雨丽,毛 峡,Caleanu C D,等.遮挡条件下的鲁棒表情识别方法.北京航空航天大学学报, 2010, 36(4): 429-433) [7] Zhang L G, Tjondronegoro D W, Chandran V. Toward a More Robust Facial Expression Recognition in Occluded Images Using Randomly Sampled Gabor Based Templates // Proc of the IEEE International Conference on Multimedia and Expo. Barcelona, Spain, 2011: 1-6 [8] Wright J, Yang A Y, Ganesh A, et al. Robust Face Recognition via Sparse Representation. IEEE Trans on Pattern Analysis and Machine Intelligence, 2009, 31(2): 210-227 [9] Cotter S F. Sparse Representation for Accurate Classification of Corrupted and Occluded Facial Expressions // Proc of the IEEE International Conference on Acoustics, Speech and Signal Processing. Dallas, USA, 2010: 838-841 [10] Cotter S F. Recognition of Occluded Facial Expressions Using a Fusion of Localized Sparse Representation Classifiers // Proc of the IEEE Digital Signal Processing & Signal Processing Education Workshop. Sedona, USA, 2011: 437-442 [11] Wang Z, Ying Z L. Facial Expression Recognition Based on Local Phase Quantization and Sparse Representation // Proc of the 8th International Conference on Natural Computation. Chongqing, China, 2012: 222-225 [12] Chen T, Su F. Facial Expression Recognition via Gabor Wavelet and Structured Sparse Representation // Proc of the 3rd IEEE International Conference on Network Infrastructure and Digital Content. Beijing, China, 2012: 420-424 [13] Wang Z, Ying Z L. Facial Expression Recognition Based on Ada-ptive Local Binary Pattern and Sparse Representation // Proc of the IEEE International Conference on Computer Science and Automation Engineering. Zhangjiajie, China, 2012, II: 440-444 [14] Donoho D L, Tsaig Y. Fast Solution of l1-norm Minimization Pro-blems When the Solution May Be Sparse. IEEE Trans on Information Theory, 2008, 54(11): 4789-4812 [15] Kanade T, Cohn J F, Tian Y L. Comprehensive Database for Facial Expression Analysis // Proc of the 4th IEEE International Conference on Automatic Face and Gesture Recognition. Grenoble, USA, 2000: 46-53 [16] Lyons M, Akamatsu S, Kamachi M, et al. Coding Facial Expre-ssions with Gabor Wavelets // Proc of the 3rd IEEE International Conference on Automatic Face and Gesture Recognition. Nara, Japan, 1998: 200-205 [17] Yang J, Zhang D, Frangi A F, et al. Two-Dimensional PCA: A New Approach to Appearance-Based Face Representation and Re-cognition. IEEE Trans on Pattern Analysis and Machine Intelligence, 2004, 26(l): 131-137