Review on Pedestrian Gait Feature Expression and Recognition
BEN Xian-Ye1, XU Sen2, WANG Ke-Jun3
1.School of Information Science and Engineering,Shandong University,Jinan 250100 2.School of Information Engineering,Yancheng Institute of Technology,Yancheng 224000 3.College of Automation,Harbin Engineering University,Harbin 150001
Abstract：Various methods for gait recognition are summarized by unique metods from anthropometry, spatial temporal, kinematics, kinetics, and video stream data forms. And video stream data are analyzed in detail. The expressions, meanings and characteristics including static, dynamic, and time-varying information among different energy image species methods are compared. Moreover, the fusion of gait features, gait and other biometric and extended gait recognition are reviewed. The assessment methods for gait recognition research are also presented. In addition, the future research directions of gait recognition are addressed.
贲晛烨，徐森，王科俊，. 行人步态的特征表达及识别综述[J]. 模式识别与人工智能, 2012, 25(1): 71-81.
BEN Xian-Ye, XU Sen, WANG Ke-Jun. Review on Pedestrian Gait Feature Expression and Recognition. , 2012, 25(1): 71-81.
[1] Little J,Boyd J E.Recognizing People by Their Gait: The Shape of Motion.Videre: Journal of Computer Vision Research,1998,1(2): 1-32 [2] Tanawongsuwan R,Bobick A.Performance Analysis of Time-Distance Gait Parameters under Different Speeds // Proc of the 4th International Conference on Audio- and Video-Based Biometric Person Authentication.Guildford,UK,2003: 715-724 [3] Cuntoor N,Kale A,Chellappa R.Combining Multiple Evidences for Gait Recognition // Proc of the International Conference on Acoustics,Speech and Signal Processing.Hong Kong,China,2003,III: 33-36 [4] Chalidabhongse T,Kruger V,Chellappa R.The UMD Database for Human Identification at a Distance.Technical Report.College Park,USA: University of Maryland,2001 [5] Gross R,Shi J.The CMU Motion of Body (MoBo) Database.Technical Report,CMU-RI-TR-01-18.Pittsburgh,USA: Carnegie Mellon University,2001 [6] Nixon M,Carter J,Shutler J,et al.Experimental Plan for Automatic Gait Recognition.Technical Report.Southampton,UK: University of Southampton,2001 [7] Sarkar S.The Human ID Gait Challenge Problem: Data Sets,Performance and Analysis.IEEE Trans on Pattern Analysis and Machine Intelligence,2005,27(2): 162-177 [8] Wang Liang,Tan Tieniu.Silhouette Analysis-Based Gait Recognition for Human Identification.IEEE Trans on Pattern Analysis and Machine Intelligence,2003,25(12): 1505-1518 [9] Yu Shiqi,Tan Daoliang,Tan Tieniu.A Framework for Evaluating the Effect of View Angle,Clothing and Carrying Condition on Gait Recognition // Proc of the 18th International Conference on Pattern Recognition.Hong Kong,China,2006: 441-444 [10] Tan Daoliang,Huang Kaiqi,Yu Shiqi,et al.Uniprojective Feature for Gait Recognition // Proc of the 2nd International Conference on Biometrics.Seoul,Korea,2007: 673-682 [11] Seely R D,Samangooei S,Lee M,et al.The University of Southampton Multi-Biometric Tunnel and Introducing a Novel 3D Gait Dataset // Proc of the 2nd IEEE International Conference on Biometrics: Theory,Applications and Systems.Washington,USA,2008: 1-6 [12] Nixon M S,Carter J N,Shutler J D,et al.New Advances in Automatic Gait Recognition.Information Security Technical Report,2002,7(4): 23-35 [13] Gafurov D.A Survey of Biometric Gait Recognition: Approaches,Security and Challenges // Proc of the Annual Norwegian Computer Science Conference.Oslo,Norway,2007: 19-31 [14] Xue Zhaojun,Jin Jingna,Ming Dong,et al.The Present State and Progress of Researches on Gait Recognition.Journal of Biomedical Engineering,2008,25(5): 1217-1221 (in Chinese) (薛召军,靳静娜,明 东,等.步态识别研究现状与进展.生物医学工程学杂志,2008,25(5): 1217-1221) [15] Jam J,Carla E.Using Ground Reaction Forces from Gait Analysis: Body Mass as a Weak Biometric // Proc of the 5th International Conference on Pervasive Computing.Toronto,Canada,2007: 251-267 [16] Peng Zhang,Wu Xiaojuan,Yang Jun.A Multi-View Method for Gait Recognition Based on the Length of Bodys Parts.Acta Automatica Sinica,2007,33(2): 210-213 (in Chinese) (彭 彰,吴晓娟,杨 军.基于肢体长度参数的多视角步态识别算法.自动化学报,2007,33(2): 210-213) [17] Wang Fang,Erik S,Dai Wenqing,et al.Gait Analysis and Validation Using Voxel Data // Proc of the 31st Annual International Conference of the IEEE Engineering in Medicine and Biology Society.Minneapolis,USA,2009: 6127-6130 [18] Thayaparan T,Stankovic L,Djurovic I.Micro-Doppler-Based Target Detection and Feature Extraction in Indoor and Outdoor Environments.Journal of the Franklin Institute,2008,345(6): 700-722 [19] Tanawongsuwan R,Bobick A.Gait Recognition from Time-Normalized Joint Angle Trajectories in the Walking Plane // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Kauai,USA,2001,II: 726-731 [20] Jean F,Albu A B,Bergevin R.Towards View-Invariant Gait Modeling: Computing View-Normalized Body Part Trajectories.Pattern Recognition,2009,42(11): 2936-2949 [21] Mu Tingting,Pataky T C,Findlow A H,et al.Automated Nonlinear Feature Generation and Classification of Foot Pressure Lesions.IEEE Trans on Information Technology in Biomedicine,2010,14(2): 418-424 [22] Bouchrika I,Nixon M S.Gait Recognition by Dynamic Cues // Proc of the 19th International Conference on Pattern Recognition.Tampa,USA,2008: 1-4 [23] Pan G,Zhang Y,Wu Z.Accelerometer-Based Gait Recognition via Voting by Signature Points.Electronics Letters,2009,45(22): 1116-1118 [24] Bae J,Kong K,Byl N,et al.A Mobile Gait Monitoring System for Gait Analysis // Proc of the 11th IEEE International Conference on Rehabilitation Robotics.Kyoto,Japan,2009: 73-79 [25] Moustakidis S P,Theocharis J B,Giakas G.Feature Extraction Based on a Fuzzy Complementary Criterion for Gait Recognition Using GRF Signals // Proc of the 17th Mediterranean Conference on Control and Automation.Thessaloniki,Greece,2009: 1456-1461 [26] BenAbdelkader C,Cutler R,Davis L.Motion-Based Recognition of People in Eigen Gait Space // Proc of the 5th IEEE International Conference on Automatic Face and Gesture Recognition.Washington,USA,2002: 267-272 [27] Yu Shiqi,Wang Liang,Huang Kaiqi,et al.Gait Analysis for Human Identification in Frequency Domain // Proc of the 3rd International Conference on Image and Graphics.Hong Kong,China,2004: 282-285 [28] Boulgouris N V,Plataniotis K N,Hatzinakos D.Gait Recognition Using Dynamic Time Warping // Proc of the IEEE International Symposium on Multimedia Signal Processing.Siena,Italy,2004: 263-266 [29] Boulgouris N V,Plataniotis K N,Hatzinakos D.Gait Recognition Using Linear Time Normalization.Pattern Recognition,2006,39(5): 969-979 [30] Chen Changhong,Liang Jimin,Zhu Xiuchang.Gait Recognition Based on Improved Dynamic Bayesian Networks.Pattern Recognition,2011,44(4): 988-995 [31] Chen Changhong,Zhao Heng,Hu Haihong,et al.Human Motion Analysis Based on Improved Dynamic Texture Model.Pattern Recognition and Artificial Intelligence,2010,23(2): 267-272 (in Chinese) (陈昌红,赵 恒,胡海虹,等.基于改进动态纹理模型的人体运动分析.模式识别与人工智能,2010,23(2): 267-272) [32] Wang Liang,Hu Weiming,Tan Tieniu.Gait-Based Human Identification.Chinese Journal of Computers,2003,26(3): 353-360 (in Chinese) (王 亮,胡卫明,谭铁牛.基于步态的身份识别.计算机学报,2003,26(3): 353-360) [33] Maricor S,Alessandra A,Caesar S.Curve Spreads-A Biometric from Front-View Gait Video.Pattern Recognition Letters,2004,25(14): 1595-1602 [34] Liu Haitao,Cao Yang,Wang Zengfu.Automatic Gait Recognition from a Distance // Proc of the Chinese Control and Decision Conference.Xuzhou,China,2010: 2777-2782 [35] Liu Haitao,Wang Zengfu,Cao Yang.3D Robust Gait Recognition Based on Manifold Learning.Pattern Recognition and Artificial Intelligence,2011,24(4): 464-472 (in Chinese) (刘海涛,汪增福,曹 洋.基于流形学习的三维步态鲁棒识别方法.模式识别与人工智能,2011,24(4): 464-472) [36] Shutler J D,Nixon M S,Harris C.Statistical Gait Description via Temporal Moments // Proc of the 4th IEEE Southwest Symposium on Image Analysis and Interpretation.Austin,USA,2000: 291-295 [37] Goffredo M,Carter J N,Nixon M S.Front View Gait Recognition // Proc of the 2nd IEEE International Conference on Biometrics: Theory,Applications and Systems.Washington,USA,2008: 1-6 [38] Ben Xianye.Research on Gait Recognition Based on Human Body Motion Analysis.Ph.D Dissertation.Harbin,China: Harbin Engineering University,2010 (in Chinese) (贲晛烨.基于人体运动分析的步态识别算法研究.博士学位论文.哈尔滨:哈尔滨工程大学,2010) [39] Wang Kejun,Ben Xianye,Liu Lili.Gait Recognition with Radon Transform and 2D Principal Component Analysis.CAAI Trans on Intelligent Systems,2010,5(3): 266-271 (in Chinese) (王科俊,贲晛烨,刘丽丽.采用Radon变换和二维主成分分析的步态识别算法.智能系统学报,2010,5(3): 266-271) [40] Ben Xianye,Xu Sen,Wang Kejun.Research on Gait Recognition Based on Trace Transform.Journal of Jilin University: Engineering and Technology Edition,2012,42(1): 156-160 (in Chinese) (贲晛烨,徐 森,王科俊.基于Trace变换的步态识别算法研究.吉林大学学报:工学版,2012,42(1): 156-160) [41] Bobick A F,Davis J W.The Recognition of Human Movement Using Temporal Templates.IEEE Trans on Pattern Analysis and Machine Intelligence,2001,23(3): 257-267 [42] Chen Shi,Gao Youxing.Gait Recognition with Wavelet Moments of Silhouette Change Images.Journal of Xian Jiaotong University,2009,43(1): 90-94 (in Chinese) (陈 实,高有行.一种轮廓变化图像小波矩的步态识别.西安交通大学学报,2009,43(1): 90-94) [43] Chen Shi,Ma Tianjun,Huang Wanhong,et al.A Multi-Layer Windows Method of Moments for Gait Recognition.Journal of Electronics & Information Technology,2009,31(1): 116-119 (in Chinese) (陈 实,马天骏,黄万红,等.用于步态识别的多层窗口图像矩.电子与信息学报,2009,31(1): 116-119) [44] Liu Jianyi,Zheng Nanning.Gait History Image: A Novel Temporal Template for Gait Recognition // Proc of the IEEE International Conference on Multimedia and Expo.Beijing,China,2007: 663-666 [45] Lam T,Lee R.A New Representation for Human Gait Recognition: Motion Silhouette Image MSI // Proc of the International Conference on Biometrics.Hong Kong,China,2006: 612-618 [46] Yang Jun,Wu Xiaojuan,Zhang Peng.Gait Recognition Based on Difference Motion Slice // Proc of the 8th International Conference on Signal Processing.Guilin,China,2006: 16-20 [47] Han J,Bhanu B.Individual Recognition Using Gait Energy Image.IEEE Trans on Pattern Analysis and Machine Intelligence,2006,28(2): 316-322 [48] Yang Xiaochao,Zhou Yue,Zhang Tianhao,et al.Gait Recognition Based on Dynamic Region Analysis.Signal Processing,2008,88(9): 2350-2356 [49] Huang Guochang,Wang Yunhong.Human Gait Recognition Based on X-T Plane Energy Images // Proc of the International Conference on Wavelet Analysis and Pattern Recognition.Beijing,China,2007,III: 1134-1138 [50] Bashir K,Tao Xiang,Gong Shaogang.Gait Recognition without Subject Cooperation.Pattern Recognition Letters,2010,31(13): 2052-2060 [51] Toby H W L,Cheung K H,James N K L.Gait Flow Image: A Silhouette-Based Gait Representation for Human Identification.Pattern Recognition,2011,44(4): 973-987 [52] Wang Kejun,Ben Xianye,Meng Wei,et al.Research on a Gait Recognition Algorithm Based on Generalized Principal Component Analysis.Journal of Harbin Engineering University,2009,30(9): 1022-1028 (in Chinese) (王科俊,贲晛烨,孟 玮,等.基于广义主成分分析的步态识别算法研究,哈尔滨工程大学学报,2009,30(9): 1022-1028) [53] Wang Kejun,Ben Xianye,Liu Lili,et al.Subpattern-Based Complete Two Dimensional Principal Component Analysis for Gait Recognition.Pattern Recognition and Artificial Intelligence,2009,22(6): 854-861 (in Chinese) (王科俊,贲晛烨,刘丽丽,等.基于子模式的完全二维主成分分析的步态识别算法.模式识别与人工智能,2009,22(6): 854-861) [54] Ben Xianye,An Shi,Meng Weixiao,et al.Subpattern Complete Two Dimensional Locality Preserving Principal Component Analysis and Its Application to Gait Recognition // Proc of the 6th International ICST Conference on Communications and Networking in China.Harbin,China,2011 [55] Ben Xianye,Meng Weixiao,Yan Rui.Dual-Ellipse Fitting Approach for Robust Gait Periodicity Detection.Neurocomputing,2012,79(1): 173-178 [56] Wang Kejun,Ben Xianye,Liu Lili,et al.Gait Recognition Using Information Fusion of Energy.Journal of Huazhong University of Science and Technology: Nature Science Edition,2009,37(5): 14-17 (in Chinese) (王科俊,贲晛烨,刘丽丽,等.基于能量的信息融合步态识别.华中科技大学学报:自然科学版,2009,37(5): 14-17) [57] Lu Haiping,Plataniotis K N,Venetsanopoulos A N.MPCA: Multilinear Principal Component Analysis of Tensor Objects.IEEE Trans on Neural Networks,2008,19(1): 18-39 [58] Lu Haiping,Plataniotis K N,Venetsanopoulos A N.Uncorrelated Multilinear Principal Component Analysis for Unsupervised Multilinear Subspace Learning.IEEE Trans on Neural Networks,2009,20(11): 1820-1836 [59] Lu Haiping,Plataniotis K N,Venetsanopoulos A N.Uncorrelated Multilinear Discriminant Analysis with Regularization and Aggregation for Tensor Object Recognition.IEEE Trans on Neural Networks,2009,20(1): 103-123 [60] Bouchrika I,Nixion M S.Exploratory Factor Analysis of Gait Recognition // Proc of the 8th IEEE International Conference on Automatic Face and Gesture Recognition.Amsterdam,Netherland,2008: 1-6 [61] Wang Kejun,Ben Xianye.Gait Recognition Using Linear Interpolation.Journal of Huazhong University of Science and Technology: Nature Science Edition,2010,38(2): 41-44 (in Chinese) (王科俊,贲晛烨.基于线性插值的步态识别算法,华中科技大学学报:自然科学版,2010,38(2): 41-44) [62] Lee C S,Elgammal A.Gait Style and Gait Content: Bilinear Models for Gait Recognition Using Gait Re-Sampling // Proc of the 6th IEEE International Conference on Automatic Face and Gesture Recognition.Southampton,UK,2004: 147-152 [63] Goffredo M,Bouchrika I,Carter J N,et al.Self-Calibrating View-Invariant Gait Biometrics.IEEE Trans on Systems,Man and Cybernetics,2010,40(4): 997-1008 [64] Sugiura K,Makihara Y,Yagi Y.Gait Identification Based on Multi-View Observation Using Omnidirectional Camera // Proc of the 11th International Conference on Computer Vision.Rio de Janeiro,Brazil,2007: 452-461 [65] Liu Nini,Lu Jiwen,Tan Y P.Joint Subspace Learning for View-Invariant Gait Recognition.IEEE Signal Processing Letters,2011,18(7): 431-434 [66] Zhang Junping,Pu Jian,Chen Changyou,et al.Low-Resolution Gait Recognition.IEEE Trans on Systems,Man and Cybernetics,2010,40(4): 986-996 [67] Shakhnarovich G,Lee L,Darrell T.Integrated Face and Gait Recognition from Multiple Views // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Kauai,USA,2001,I: 439-446 [68] Kale A,Roychowdhury A K,Chellappa R.Fusion of Gait and Face for Human Identification // Proc of the IEEE International Conference on Acoustics,Speech and Signal Processing.Montreal,Canada,2004: 901-904 [69] Zhou Xiaoli,Bhanu B.Feature Fusion of Face and Gait for Human Recognition at a Distance in Video // Proc of the 18th International Conference on Pattern Recognition.Hong Kong,China,2006: 529-532 [70] Zhou Xiaoli,Bhanu B.Integrating Face and Gait for Human Recognition at a Distance in Video.IEEE Trans on Systems,Man and Cybernetics,2007,37(5): 1119-1137 [71] Zhou Xiaoli,Bhanu B.Feature Fusion of Side Face and Gait for Video-Based Human Identification.Pattern Recognition,2008,41(3): 778-795 [72] Wang Kejun,Ben Xianye,Lin Tianwei,et al.Video-Based Automatic Front-View Human Identification System at a Distance // Progress of Artificial Intelligence in China.Shenzhen,China,2009: 359-365 (in Chinese) (王科俊,贲晛烨,林天威,等.远距离的视频下正面人体身份自动识别系统//中国人工智能进展.深圳,2009: 359-365) [73] Xin Geng,Kate S M,Liang Wang,et al.Context-Aware Fusion: A Case Study on Fusion of Gait and Face for Human Identification in Video.Pattern Recognition,2010,43(10): 3660-3673 [74] Zhang Tianhao,Li Xuelong,Tao Dacheng,et al.Multimodal Biometrics Using Geometry Preserving Projection.Pattern Recognition,2008,41(3): 805-813 [75] Yuan Yuan,Pang Yanwei,Li Xuelong.Footwear for Gender Recognition.IEEE Trans on Circuits and Systems for Video Technology,2010,20(1): 131-135 [76] Zhang De,Wang Yunhong.Investigating the Separability of Features from Different Views for Gait Based Gender Classification // Proc of the 19th International Conference on Pattern Recognition.Tampa,USA,2008: 1-4 [77] Hu Maodi,Wang Yunhong,Zhang Zhaoxiang,et al.Combining Spatial and Temporal Information for Gait Based Gender Classification // Proc of the 20th International Conference on Pattern Recognition.Istanbul,Turkey,2010: 3679-3682 [78] Thilo P,Marta F,Kevin P,et al.A Hidden Markov Model-Based Stride Segmentation Technique Applied to Equine Inertial Sensor Trunk Movement Data.Journal of Biomechanics,2008,41(1): 216-220 [79] Mimura S,Itoh K,Kobayashi T,et al.The Cow Gait Recognition Using CHLAC // Proc of the Conference on Bio-Inspired Learning and Intelligent Systems for Security.Edinburgh,UK,2008: 56-57 [80] Nima S,Khorsandian A,Abdolmaleki A,et al.An Optimized Gait Generator Based on Fourier Series towards Fast and Robust Biped Locomotion Involving Arms Swing // Proc of the IEEE International Conference on Automation and Logistics.Shenyang,China,2009: 2018-2023 [81] Wu Jianning,Wang Jue,Liu Li.Feature Extraction via KPCA for Classification of Gait Patterns.Human Movement Science,2007,26(3): 393-411 [82] Zhang De,Wang Yunhong,Bhanu B.Age Classification Based on Gait Using HMM // Proc of the 20th International Conference on Pattern Recognition.Istanbul,Turkey,2010: 3834-3837 [83] O Malley M J,Abel M F,Damiano D L,et al.Fuzzy Clustering of Children with Cerebral Palsy Based on Temporal Distance Gait Parameters.IEEE Trans on Rehabilitation Engineering,1997,5(4): 300-309 [84] Begg R,Kamruzzaman J.A Machine Learning Approach for Automated Recognition of Movement Patterns Using Basic,Kinetic and Kinematic Gait Data.Journal of Biomechanics,2005,38(3): 401-408 [85] Sebastian I W,Frank B,Dimitrios M,et al.Gait Analysis May Help to Distinguish Hereditary Spastic Paraplegia from Cerebral Palsy.Gait & Posture,2011,33(4): 556-561 [86] Jasper S,Jesse H,Liam S,et al.Automated Detection of Unusual Events on Stairs.Image and Vision Computing,2009,27(1): 153-166 [87] Hild M.Estimation of 3D Motion Trajectory and Velocity from Monocular Image Sequences in the Context of Human Gait Recognition // Proc of the 17th International Conference on Pattern Recognition.Cambridge,UK,2004,IV: 231-235 [88] Sazonov E S,Fulk G,Hill J,et al.Monitoring of Posture Allocations and Activities by a Shoe-Based Wearable Sensor.IEEE Trans on Biomedical Engineering,2011,58(4): 983-990 [89] Lee M,Roan M,Smith B,et al.Gait Analysis to Classify External Load Conditions Using Linear Discriminant Analysis.Human Movement Science,2009,28(2): 226-235 [90] Gafurov D,Snekkenes E,Bours P.Spoof Attacks on Gait Authentication System.IEEE Trans on Information Forensics and Security,2007,2(3): 491-502
2012, Vol. 25 
