Deep Human Pose Estimation Method Based on Mixture Articulated Limb Model
LIU Binghan1, 2, LI Zhenda1, 2, KE Xiao1, 2
1.College of Mathematics and Computer Science, Fuzhou University, Fuzhou 350116; 2.Fujian Provincial Key Laboratory of Networking Computing and Intelligent Information Processing, Fuzhou University, Fuzhou 350116
Abstract A flexible mixture model is proposed to solve the problems of human pose estimation. The model is composed of joint appearance and inner-joint relationship models, and it is trained through a deep convolutional neural network (DCNN). Firstly, a graphical model is constructed to represent joints and limbs of human body. Secondly, images are decomposed into several image blocks centered on the joints and used as training input data. Finally, a multiple classification DCNN network is obtained to perform human pose estimation.The proposed method is more flexible for human body representation, and the detection rate of joint points and the correct detection rate are effectively improved.
Fund:Supported by National Natural Science Foundation of China(No.61502105,61672159), Technology Guided Project of Fujian Province(No.2017H0015), College-University Cooperation Project of Fujian Province(No.2017H6008)
About author:: (LIU Binghan, master, professor. Her research interests include intelligent video processing and analysis.) (LI Zhenda, master student. His research interests include computer vision.) (KE Xiao(Corresponding author), Ph.D., associate professor. His research interests include computer vision and pattern recognition.)
[1] BARADEL F, WOLF C, MILLE J.Human Action Recognition: Pose-Based Attention Draws Focus to Hands // Proc of the IEEE International Conference on Computer Vision Workshop. Washington, USA: IEEE, 2017: 604-613. [2] VASILEIADIS M, MALASSIOTIS S, GIAKOUMIS D, et al. Robust Human Pose Tracking for Realistic Service Robot Applications // Proc of the IEEE International Conference on Computer Vision Workshop. Washington, USA: IEEE, 2017: 1363-1372. [3] GONG K, LIANG X D, ZHANG D Y, et al. Look into Person: Self-supervised Structure-Sensitive Learning and a New Benchmark for Human Parsing // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2017: 932-940. [4] YANG Y, RAMANAN D.Articulated Pose Estimation with Flexible Mixtures-of-Parts // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2011: 1385-1392. [5] CHEN X J, YUILLE A.Articulated Pose Estimation by a Gra-phical Model with Image Dependent Pairwise Relations // GHAHRAMANI Z, WELLING M, GORTES C, et al., eds. Advances in Neural Information Processing Systems 27. Cambridge, USA: The MIT Press, 2014: 1736-1744. [6] FISCHLER M A, ELSCHLAGER R A.The Representation and Matching of Pictorial Structures. IEEE Transactions on Computers, 1973, 22(1): 67-92. [7] JOHNSON S, EVERINGHAM M.Learning Effective Human Pose Estimation from Inaccurate Annotation // Proc of the 24th IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2011: 1465-1472. [8] TSOCHANTARIDIS I, HOFMANN T, JOACHIMS T, et al. Su-pport Vector Machine Learning for Interdependent and Structured Output Spaces // Proc of the 21st International Conference on Machine Learning. New York, USA: ACM, 2004. DOI:10.1145/1015330.1015341. [9] CHEN X J, YUILLE A L.Parsing Occluded People by Flexible Compositions // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2015: 3945-3954. [10] CHU X, OUYANG W L, LI H S, et al. Structured Feature Lear-ning for Pose Estimation // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2016: 4715-4723. [11] FAN X C, ZHENG K, LIN Y W, et al. Combining Local Appea-rance and Holistic View: Dual-Source Deep Neural Networks for Human Pose Estimation // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2015: 1347-1355. [12] OUYANG W L, CHU X, WANG X G.Multi-source Deep Lear-ning for Human Pose Estimation // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2014: 2337-2344. [13] TOSHEV A, SZEGEDY C.DeepPose: Human Pose Estimation via Deep Neural Networks // Proc of the IEEE Conference on Compu-ter Vision and Pattern Recognition. Washington, USA: IEEE, 2014: 1653-1660. [14] JOHNSON S, EVERINGHAM M. Clustered Pose and Nonlinear Appearance Models for Human Pose Estimation // Proc of the British Machine Vision Conference. Dundee, Britain: BMVA, 2010: 12.1-12.11. [15] SAPP B, TASKAR B.MODEC: Multimodal Decomposable Models for Human Pose Estimation // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2013: 3674-3681. [16] RAMANAN D.Learning to Parse Images of Articulated Bodies // SCHÖLKOPF B, PLATT J C, HOFFMAN T, eds. Advances in Neural Information Processing Systems 19. Cambridge, USA: The MIT Press, 2006: 1129-1136. [17] PISHCHULIN L, ANDRILUKA M, GEHLER P, et al. Poselet Conditioned Pictorial Structures // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2013: 588-595. [18] RAMAKRISHNA V, MUNOZ D, HEBERT M, ,et al. Pose Machines: Articulated Pose Estimation via Inference Machines // Proc of the 13th European Conference on Computer Vision. Berlin. Pose Machines: Articulated Pose Estimation via Inference Machines // Proc of the 13th European Conference on Computer Vision. Berlin, Germany: Springer, 2014, II: 33-47. [19] YANG W, OUYANG W L, LI H S, et al. End-to-End Learning of Deformable Mixture of Parts and Deep Convolutional Neural Networks for Human Pose Estimation // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2016: 3073-3082. [20] TOMPSON J J, JAIN A, LECUN Y, et al.Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation // GHAHRAMANI Z, WELLING M, CORTES C, et al., eds. Advances in Neural Information Processing Systems 27. Cambridge, USA: The MIT Press, 2014: 1799-1807.
2019, Vol. 32 
