模式识别与人工智能
Wednesday, Apr. 23, 2025 Home      About Journal      Editorial Board      Instructions      Ethics Statement      Contact Us                   中文
  2018, Vol. 31 Issue (10): 958-964    DOI: 10.16451/j.cnki.issn1003-6059.201810010
Researches and Applications Current Issue| Next Issue| Archive| Adv Search |
Action Recognition Fused with RGB-D Multi-modal Features and Radius-Margin Bounded Extreme Learning
LIU Tianliang1, CHEN Kehu1, DAI Xiubin1, LUO Jiebo2
1.Jiangsu Provincial Key Laboratory of Image Processing and Image Communication, Nanjing University of Posts and Telecommunications, Nanjing 210003
2.Department of Computer Science, University of Rochester, Rochester 14627

Download: PDF (653 KB)   HTML (1 KB) 
Export: BibTeX | EndNote (RIS)      
Abstract  

An exemplars multiple kernel learning-extreme learning machine(MKL-ELM) based human action recognition approach with multi-modal visual feature fusion from RGB-D videos is proposed to solve the problem of single modal visual feature with the limited discrimination ability for all categories of human actions. Firstly, the robust and dense moving pose features with human skeleton surface fitting and dense trajectories from human motion are extracted. The sparse histogram of oriented principal component(SHOPC) features of 3D body geometry with the normal plane of dense point clouds is perceived and the histogram of 3D gradient orientation(HOG3D) features embedded with human appearance textures on spatial temporal neighbor of body nodes in the given videos is extracted. The modified MKL-ELM with radius-margin bound is exploited to fuse the given multi-modal visual features. Then, the set of the representative exemplars for each human action is mined with the contrast data technique. Finally, each sample is hierarchically classified by the designed exemplars-MKL-ELM model with greedy prediction strategy to recognize the human actions with the fused features and the given exemplars. The experiments show that compared with the traditional methods, the proposed action recognition method has significant advantages with high classification accuracy and computational efficiency.

Received: 24 January 2018     
ZTFLH: TP 391.41  
Fund:

Supported by National Natural Science Foundation of China(No.61001152,31200747,61071091,61071166,61172118), Natural Science Foundation of Jiangsu Province(No.BK2012437), Natural Science Foundation of NJUPT(No.NY214037), China Scholarship Council Program

Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors
LIU Tianliang
CHEN Kehu
DAI Xiubin
LUO Jiebo
Cite this article:   
LIU Tianliang,CHEN Kehu,DAI Xiubin等. Action Recognition Fused with RGB-D Multi-modal Features and Radius-Margin Bounded Extreme Learning[J]. , 2018, 31(10): 958-964.
URL:  
http://manu46.magtech.com.cn/Jweb_prai/EN/10.16451/j.cnki.issn1003-6059.201810010      OR     http://manu46.magtech.com.cn/Jweb_prai/EN/Y2018/V31/I10/958
Copyright © 2010 Editorial Office of Pattern Recognition and Artificial Intelligence
Address: No.350 Shushanhu Road, Hefei, Anhui Province, P.R. China Tel: 0551-65591176 Fax:0551-65591176 Email: bjb@iim.ac.cn
Supported by Beijing Magtech  Email:support@magtech.com.cn