Abstract Due to various applications in the areas of pattern recognition, image processing, computer vision, cognitive science etc., face recognition has drawn much attention in recent years. This paper presents an uptodate survey on the history and stateoftheart face recognition research, systematically classifying face recognition methods into several categories. Furthermore, this paper expatiates on the evolution of the recent algorithms which are used to deal with the illumination variation problem and the pose variation problem. In addition, several major issues for further exploration are also pointed out at the end of this paper.
[1] Zhao W, Chellappa R, Rosenfeld A, Phillips P J. Face Recognition: A Literature Survey.ACM Computing Surveys, 2003, 35(4): 399-458 [2] Phillips P J, Grother P, Micheals R J, Blackburn D M, Tabassi E, Bone J M. Face Recognition Vendor Test 2002: Evaluation Report. 2003. http://www.frvt.org/FRVT2002/documents.htm [3] Daugman J. Face and Gesture Recognition: Overview. IEEE Trans on Pattern Analysis and Machine Intelligence, 1997, 19(7): 675-676 [4] Phillips P J, Wechsler H, Huang J, Rauss P. The FERET Database and Evaluation Procedure for Face-Recognition Algorithms. Image and Vision Computing Journal, 1998, 16(5): 295-306 [5] Yang M H, Kriegman D J, Ahuja N. Detecting Faces in Images: A Survey. IEEE Trans on Pattern Analysis and Machine Intelligence, 2002, 24(1): 34-58 [6] Brunelli R, Poggio T. Face Recognition: Features Versus Templates. IEEE Trans on Pattern Analysis and Machine Intelligence, 1993, 15(10): 1042-1052 [7] Bledsoe W. Man-Machine Facial Recognition. Technical Report, PRI:22, Panoramic Research Inc., Palo Alto, USA, 1966 [8] Kanade T. Computer Recognition of Human Faces. Ph.D Dissertation. Kyoto University, Japan, 1974 [9] Samal A, Iyengar P A. Automatic Recognition and Analysis of Human Faces and Facial Expressions: A Survey. Pattern Recognition, 1992, 25(1): 65-77 [10] Nefian A V, Hayes M H. Hidden Markov Models for Face Recognition. In: Proc of the IEEE International Conference on Acoustics Speech and Signals Process. Seattle, USA, 1998, Ⅴ: 2721-2724 [11] Dempster A P, Laird N M, Rubin D B. Maximum Likelihood from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society-Series B: Methodological, 1977, 39(1): 1-38 [12] Cootes T F, Taylor C J, Cooper D H, Graham J. Active Shape Models-Their Training and Application. Computer Vision and Image Understanding, 1995, 61(1): 38-59 [13] Cootes T F, Edwards G J, Taylor C J. Active Appearance Models. IEEE Trans on Pattern Analysis and Machine Intelligence, 2001, 23(6): 681-685 [14] Matthews I, Baker S. Active Appearance Models Revisited. International Journal of Computer Vision, 2004, 60(2): 135-164 [15] Turk M, Pentland A. Eigenfaces for Recognition. Journal of Cognitive Neuroscience, 1991, 3(1): 71-86 [16] Jolliffe I T. Principal Component Analysis. New York, USA: Springer-Verlag, 1986 [17] Kirby M, Sirovich L. Application of the Karhunen-Loève Procedure for the Characterization of Human Faces. IEEE Trans on Pattern Analysis and Machine Intelligence, 1990, 12(1): 103-108 [18] Pentland A, Moghaddam B, Starner T. View-Based and Modular Eigenspaces for Face Recognition. In: Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Seattle, USA, 1994, 21-23 [19] Belhumeur P N, Hespanha J P, Kriegman D J. Eigenfaces vs Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans on Pattern Analysis and Machine Intelligence, 1997, 19(7): 711-720 [20] Moghaddam B, Jebara T, Pentland A. Bayesian Face Recognition. Pattern Recognition, 2000, 33(11): 1771-1782 [21] Hong Z Q. Algebraic Feature Extraction of Image for Recognition. Pattern Recognition, 1991, 24(3): 211-219 [22] Comon P. Independent Component Analysis-A New Concept? Signal Processing, 1994, 36(3): 287-314 [23] Draper B A, Baek K, Bartlett M S, Beveridge J R. Recognizing Faces with PCA and ICA. Computer Vision and Image Understanding, 2003, 91(1-2): 115-137 [24] Valentin D, Abdi H, O’Toole A J. Categorization and Identification of Human Face Images by Neural Networks: A Review of the Linear Autoassociative and Principal Component Approaches. Journal of Biological Systems, 1994, 2(3): 413-429 [25] Kohonen T. Self-Organization and Associative Memory. 2nd Edition. Berlin, Germany: Springer-Verlag, 1988 [26] Lades M, Vorbruggen J C, Buhmann J, et al. Distortion Invariant Object Recognition in the Dynamic Link Architecture. IEEE Trans on Computers, 1992, 42(3): 300-311 [27] Lawrence S, Giles C L, Tsoi A C, et al. Face Recognition: A Convolutional Neural Network Approach. IEEE Trans on Neural Networks, 1997, 8(1): 98-113 [28] Samaria F, Harter A. Parameterization of a Stochastic Model for Human Face Identification. In: Proc of 2nd IEEE Workshop on Applications of Computer Vision. Sarasota, USA, 1994, 245-248 [29] Lin S H, Kung S Y, Lin L J. Face Recognition/Detection by Probabilistic Decision-Based Neural Network. IEEE Trans on Neural Networks, 1997, 8(1): 114-132 [30] Dror I E, Florer F L. Neural Networks That Recognize Faces. Proc of SPIE, 1995, 2485: 123-128 [31] Ranganath S, Arun K. Face Recognition Using Transform Features and Neural Networks. Pattern Recognition, 1997, 30(10): 1615-1622 [32] Haywood K, Lebby G L, Ricanek K J. Hopfield Like Networks for Pattern Recognition with Applications to Face Recognition. In: Proc of the International Joint Conference on Neural Networks. Washington, USA, 1999, 3265-3269 [33] Gutta S, Wechsler H. Face Recognition Using Hybrid Classifier Systems. In: Proc of the International Conference on Neural Networks. Washington, USA, 1996, 1017-1022 [34] Huang F J, Zhou Z H, Zhang H J, Chen T. Pose Invariant Face Recognition. In: Proc of the 4th IEEE International Conference on Automatic Face and Gesture Recognition. Grenoble, France, 2000, 245-250 [35] Lü X G,Wang Y H, Jain A K. Combining Classifiers for Face Recognition. In: Proc of the IEEE International Conference on Multimedia and Expo. Baltimore, USA, 2003, Ⅲ: 13-16 [36] Chen H F, Belhumeur P N, Jacobs D W. In Search of Illumination Invariants. In: Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Hilton Head Island, USA, 2000, Ⅰ: 254-261 [37] Adini Y, Moses Y, Ullman S. Face Recognition: The Problem of Compensating for Changes in Illumination Direction. IEEE Trans on Pattern Analysis and Machine Intelligence, 1997, 19(7): 721-732 [38] Riklin-Raviv T. The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations. IEEE Trans on Pattern Analysis and Machine Intelligence, 2001, 23(2): 129-139 [39] Li W J, Wang C J, Xu D X, Chen S F. Illumination Invariant Face Recognition Based on Neural Network Ensemble. In: Proc of the 16th IEEE International Conference on Tools with Artificial Intelligence. Boca Raton, USA, 2004, 486-490 [40] Li W J, Wang C J, Xu D X, Luo B, Chen Z Q. A Study on Illumination Invariant Face Recognition Methods Based on Multiple Eigenspaces. In: Proc of the 2nd International Symposium on Neural Networks. Chongqing, China, 2005, 131-136 [41] Belhumeur P N, Kriegman D J. What is the Set of Images of an Object under All Possible Lighting Conditions? International Journal of Computer Vision, 1998, 28(3): 1-16 [42] Georghiades A S, Belhumeur P N, Kriegman D J. From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose. IEEE Trans on Pattern Analysis and Machine Intelligence, 2001, 23(6): 643-660 [43] Wang H T, Li S Z, Wang Y S, Zhang W W. Illumination Modeling and Normalization for Face Recognition. In: Proc of IEEE International Workshop on Analysis and Modeling of Faces and Gestures. Nice, France, 2003, 104-111 [44] Beymer D J. Face Recognition under Varying Pose. In: Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Seattle, USA, 1994, 756-761 [45] Vetter T, Poggio T. Linear Object Classes and Image Synthesis from a Single Example Image. IEEE Trans on Pattern Analysis and Machine Intelligence, 1997, 19(7): 733-741 [46] Murase H, Nayar S K. Visual Learning and Recognition of 3-D Objects from Appearance. International Journal of Computer Vision, 1995, 14(1): 5-24 [47] Wiskott L, Fellous J M, Kruger N, vonder Malsburg C. Face Recognition by Elastic Bunch Graph Matching. IEEE Trans on Pattern Analysis and Machine Intelligence, 1997, 19(7): 775-779 [48] Gross R, Matthews I, Baker S. Fisher Light-Fields for Face Recognition across Pose and Illumination. In: Proc of the German Symposium on Pattern Recognition. Pittsburgh, USA, 2002, 481-489 [49] Gross R, Matthews I, Baker S. Appearance-Based Face Recognition and Light-Fields. IEEE Trans on Pattern Analysis and Machine Intelligence, 2004, 26(4): 449-465 [50] Bowyer K W, Chang K C, Flynn P. A Survey of 3D and Multi-Modal 3D+2D Face Recognition. In: Proc of International Conference on Pattern Recognition. Cambridge, UK, 2004, 1-15 [51] Sim T, Baker S, Bsat M. The CMU Pose, Illumination, and Repression Database. IEEE Trans on Pattern Analysis and Machine Intelligence, 2003, 25(12): 1615-1618 [52] Blanz V, Thomas V. Face Recognition Based on Fitting a 3D Morphable Model. IEEE Trans on Pattern Analysis and Machine Intelligence, 2003, 25(9): 1063-1074 [53] Huang J, Heisele B, Blanz V. Component-Based Face Recognition with 3D Morphable Models. In: Proc of the 4th International Conference on Audio-and Video-Based Biometric Person Authentication. Guildford, UK, 2003, 187-194 [54] Heisele B, Ho P, Poggio T. Face Recognition with Support Vector Machines: Global Versus Component-Based Approach. In: Proc of the 8th International Conference on Computer Vision. Vanconver, Canada, 2001, Ⅱ: 688-694 [55] Cartoux J Y, Lapreste J T, Richetin M. Face Authentication or Recognition by Profile Extraction from Range Images. In: Proc of the Workshop on Interpretation of 3D Scenes. Austin, USA, 1989, 194-199 [56] Vapnik V N. The Nature of Statistical Learning Theory. Berlin, Germany: Springer-Verlag, 1995 [57] Moghaddam B. Principal Manifolds and Probabilistic Subspaces for Visual Recognition. IEEE Trans on Pattern Analysis and Machine Intelligence, 2002, 24(6): 780-788 [58] Fidaleo D, Trivedi M. Manifold Analysis of Facial Gestures for Face Recognition. In: Proc of the ACM SIGMM Workshop on Multimedia Biometrics Methods and Application. Berkeley, USA, 2003, 65-69 [59] Lu X, Colbry D, Jain A K. Matching 2.5D Scans for Face Recognition. In: Proc of International Conference on Biometric Authentication. Hong Kong, China, 2004, 30-36 [60] Lu X G, Colbry D, Jain A K. Three-Dimensional Model Based Face Recognition. In: Proc of International Conference on Pattern Recognition. Cambridge, UK, 2004, Ⅰ: 362-366
2006, Vol. 19 
