|
|
Lie Group Machine Learning Based on Sparse Dictionary |
XIONG Xiaodong1, LI Fanzhang1, WANG Bangjun1, LIANG Helan1 |
1. School of Computer Science and Technology, Soochow University, Suzhou 215006 |
|
|
Abstract Lie group machine learning(LML) theory is widely applied to data representation and processing in image set classification, and satisfactory results are obtained. Therefore, a method of Lie group dictionary learning based on sparse dictionary is proposed. Firstly, the covariance matrix is employed to model the image set, and the Lie group structure composed of covariance matrix is analyzed. Logarithmic map is applied to map the data into the linear space to obtain the distance matrix of the data. Then, landmark multi-dimensional scaling is employed to realize dimension reduction of data and reduce the computational cost. Finally, Fisher discriminant dictionary learning is applied for classification. The experiments on YTC dataset indicate the good performance of the proposed algorithm in robustness and accuracy.
|
Received: 24 September 2019
|
|
Fund:Supported by National Key Research and Development Program of China(No.2018YFA07070,2018YFA0701701) , National Na-tural Science Foundation of China(No.61373093,61402310,61672364,61672365) |
About author:: (XIONG Xiaodong, master student. His research interests include Lie group machine learning and feature extraction.);(LI Fanzhang(Corresponding author), master, professor. His research interests include dynamic fuzzy machine learning, lie group machine, neuromorphic synergy machine learning and multidimensional collaborative education.);(WANG Bangjun, Ph.D. candidate, lecturer. His research interests include machine learning and data mining.);(LIANG Helan, Ph.D. candidate, lectu-rer. Her research interests include enterprise modeling, workflow management and service computing.) |
|
|
|
[1] HUANG Z W, WANG R P, SHAN S G, et al. Log-Euclidean Me-tric Learning on Symmetric Positive Definite Manifold with Application to Image Set Classification // Proc of the 32nd International Conference on Machine Learning. New York, USA: ACM, 2015: 720-729. [2] GHIASI G, FOWLKES C C. Laplacian Pyramid Reconstruction and Refinement for Semantic Segmentation // Proc of the European Conference on Computer Vision. Berlin, Germany: Springer, 2016: 519-534. [3] LU J W, WANG G, MOULIN P. Image Set Classification Using Holistic Multiple Order Statistics Features and Localized Multi-kernel Metric Learning // Proc of the IEEE International Conference on Computer Vision. Washington, USA: IEEE, 2013: 329-336. [4] MAHMOOD A, MIAN A, OWENS R. Semi-supervised Spectral Clustering for Image Set Classification // Proc of the IEEE Confe-rence on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2014: 121-128. [5] KIM T K, KITTLER J, CIPOLLA R. Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(6): 1005-1018. [6] ARANDJELOVIC O, SHAKHNAROVICH G, FISHER J, et al. Face Recognition with Image Sets Using Manifold Density Divergence // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2005, I: 581-588. [7] WANG W, WANG R P, HUANG Z W, et al. Discriminant Analysis on Riemannian Manifold of Gaussian Distributions for Face Re-cognition with Image Sets // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2015: 2048-2057. [8] REN J Y, WU X J. Sparse Coding for Symmetric Positive Definite Matrices with Application to Image Set Classification // Proc of the International Conference on Intelligent Science and Big Data Engineering. Berlin, Germany: Springer, 2015: 637-646. [9] ARSIGNY V, FILLARD P, PENNEC X, et al. Fast and Simple Calculus on Tensors in the Log-Euclidean Framework // Proc of the International Conference on Medical Image Computing and Compu-ter-Assisted Intervention. Berlin, Germany: Springer, 2005: 115-122. [10] PENNEC X, FILLARD X, AYACHE N. A Riemannian Framework for Tensor Computing. International Journal of Computer Vision, 2006, 66(1): 41-66. [11] 王 锐,吴小俊.基于切空间判别学习的流形降维算法.软件学报, 2018, 29(12): 3786-3798. (WANG R, WU X J. Manifold Dimensional Reduction Algorithm Based on Tangent Space Discriminant Learning. Journal of Software, 2018, 29(12): 3786-3798.) [12] WANG R P, GUO H M, DAVIS L S, et al. Covariance Discriminative Learning: A Natural and Efficient Approach to Image Set Classification // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2012: 2496-2503. [13] CHERIAN A, SRA S. Riemannian Dictionary Learning and Sparse Coding for Positive Definite Matrices. IEEE Transactions on Neural Networks and Learning Systems, 2017, 28(12): 2859-2871. [14] ELAN M, AHARON M. Image Denoising via Sparse and Redundant Representations over Learned Dictionaries. IEEE Transactions on Image Processing, 2006, 15(12): 3736-3745. [15] LI Y Y, LU R Q. Locality Preserving Projection on SPD Matrix Lie Group: Algorithm and Analysis. Science China(Information Sciences), 2018, 61(9): 92-104. [16] LEE S, CHOI S. Landmark MDS Ensemble. Pattern Recognition,2009, 42(9): 2045-2053. [17] YANG M, ZHANG L, FENG X C, et al. Fisher Discrimination Dictionary Learning for Sparse Representation // Proc of the IEEE International Conference on Computer Vision. Washington, USA: IEEE, 2011: 543-550. [18] LI P H, WANG Q L, ZUO W M, et al. Log-Euclidean Kernels for Sparse Representation and Dictionary Learning // Proc of the IEEE International Conference on Computer Vision. Washington, USA: IEEE, 2013: 1601-1608. [19] WRIGHT J, YANG A Y, CANESH A, et al. Robust Face Recognition via Sparse Representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, 31(2): 210-227. [20] YANG M, ZHANG L, FENG X C, et al. Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Cla-ssification. International Journal of Computer Vision, 2014, 109: 209-232. [21] JAYASUMANA S, HARTLEY R, SALZMANN M, et al. Kernel Methods on the Riemannian Manifold of Symmetric Positive Definite Matrices // Proc of the IEEE International Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2013: 73-80. [22] LEE K C, HO J, YANG M H, et al. Video-Based Face Recognition Using Probabilistic Appearance Manifolds // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Re-cognition. Washington, USA: IEEE, 2003. DOI: 10.1109/CVPR.2003.1211369. [23] GROSS R, SHI J B. The CMU Motion of Body(Mobo) Database. Technical Report, CMU-RI-TR-01-18. Pittsburgh, USA: Carnegie Mellon University, 2001. [24] KYLBERG G, UPPSTRÖM M, SINTORN I M. Virus Texture Analy-sis Using Local Binary Patterns and Radial Density Profiles // Proc of the 16th Iberoamerican Congress on Pattern Recognition. Berlin, Germany: Springer, 2011: 573-580. [25] HUANG Z W, WANG R P, SHAN S G, et al. Projection Metric Learning on Grassmann Manifold with Application to Video Based Face Recognition // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2015: 140-149. [26] HAMM J, LEE D D. Grassmann Discriminant Analysis: A Uni-fying View on Subspace-Based Learning // Proc of the 25th International Conference on Machine Learning. New York, USA: ACM, 2008: 376-383. [27] HARANDI M, SALZMANN M, HARTLEY R. Dimensionality Reduction on SPD Manifolds: The Emergence of Geometry-Aware Methods. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40(1): 48-62. [28] 陈凯旋,吴小俊.面向图像集分类的切空间稀疏表示算法.中国图象图形学报, 2018, 23(7): 961-972. (CHEN K X, WU X J. Sparse Representation in Tangent Space for Image Set Classification. Journal of Image and Graphics, 2018, 23(7): 961-972.) [29] HUANG Z W, VAN GOOL L. A Riemannian Network for SPD Matrix Learning[C/OL]. [2019-08-25]. https://arxiv.org/pdf/1608.04233.pdf. [30] SUN H L, ZHEN X T, ZHENG Y J, et al. Learning Deep Match Kernels for Image-Set Classification // Proc of the IEEE Confe-rence on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2017: 3307-3316. [31] SHAH S A A, NADEEM U, BENNAMOUN M, et al. Efficient Image Set Classification Using Linear Regression Based Image Reconstruction // Proc of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. Washington, USA: IEEE, 2017: 99-108. |
|
|
|