|
|
|
| A Multi-Label Learning Algorithm Based on Sparse Representation |
| SONG Xiang-Fa, JIAO Li-Cheng |
| Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education,Xidian University,Xi′an 710071 |
|
|
|
|
Abstract To solve the problem of multi-label data classification, a multi-label learning algorithm based on sparse representation is proposed. The testing samples are treated as a sparse linear combination of training samples, and the sparsest coefficients are obtained by using l1-minimization. Then, the discriminating information of sparse coefficients is utilized to calculate membership function of the testing sample. Finally, the labels are ranked according to the membership function and the classification is completed. Extensive experiments are conducted on gene functional analysis, natural scene classification and web page categorization, and experimental results demonstrate the effectiveness of the proposed method. The results also show that the proposed method based on sparse representation achieves better results than other algorithms.
|
|
Received: 08 October 2010
|
|
|
|
|
|
[1] Schapire R E,Singer Y.Boostexter: A Boosting-Based System for Text Categorization.Machine Learning,2000,39(2/3): 135-168
[2] Elisseeff A,Weston J.A Kernel Method for Multi-Labelled Classification // Dietterich T G,Becker S,Ghahramani Z,eds.Advances in Neural Information Processing Systems.Cambridge,USA: MIT Press,2002,XIV: 681-687
[3] Boutell M R,Luo J,Shen X,et al.Learning Multi-Label Scene Classification.Pattern Recognition,2004,37 (9): 1757-1771
[4] de Comité F,Gilleron R,Tommasi M.Learning Multi-Label Alternating Decision Tree from Texts and Data∥Proc of the 3rd International Conference on Machine Learning and Data Mining in Pattern Recognition.Leipzig,Germany,2003: 35-49
[5] Zhang Minling,Zhou Zhihua.ML-KNN:A Lazy Learning Approach to Multi-Label Learning.Pattern Recognition,2007,40(7): 2038-2048
[6] Wright J,Yang A Y,Ganesh A,et al.Robust Face Recognition via Sparse Representation.IEEE Trans on Pattern Analysis and Machine Intelligence,2009,31(2): 201-227
[7] Candès E J,Romberg J,Tao T.Robust Uncertainty Principles: Exact Signal Reconstruction from Highly Incomplete Frequency Information.IEEE Trans on Information Theory,2006,52(2): 489-509
[8] Candès E J,Tao T.Near-Optimal Signal Recovery from Random Projections: Universal Encoding Strategies? IEEE Trans on Information Theory,2006,52(12): 5406-5425
[9] Donoho D.For Most Large Underdetermined Systems of Linear Equations the Minimal l1-norm Solution Is Also the Sparsest Solution.Communications on Pure and Applied Mathematics,2006,59 (6):797-829
[10] Zhao Ruizhen,Liu Xiaoyu,Li C C,et al.Sparse Representation-Based Wavelet De-Noising.Science China: Information Sciences,2010,40(1): 33-40 (in Chinese)
(赵瑞珍,刘晓宇,Li C C,等.基于稀疏表示的小波去噪.中国科学:信息科学,2010,40(1): 33-40)
[11] Cai Zemin,Lai Jianhuang.An Over-Complete Learned Dictionary-Based Image De-Noising Method.Acta Electronica Sinica,2009,37(2): 347-350 (in Chinese)
(蔡泽民,赖剑煌.一种基于超完备字典学习的图像去噪方法.电子学报,2009,37(2): 347-350)
[12] Qiao Lishan,Chen Songcan,Tan Xiaoyang.Sparsity Preserving Projection with Applications to Face Recognition.Pattern Recognition,2010,43(1): 331-341
[13] Cheng Bin,Yang Jianchao,Yan Shuicheng,et al.Learning with l1-Graph for Image Analysis.IEEE Trans on Image Processing,2010,19(4): 858-866
[14] Han Yahong,Wu Fei,Zhuang Yueting,et al.Multi-Label Transfer Learning with Sparse Representation. IEEE Trans on Circuits and Systems for Video Technology,2010,20(8): 1110-1121
[15] Figueiredo M,Nowak R,Wright S.Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems.IEEE Journal on Selected Topics in Signal Processing,2007,1(4): 586-598
[16] Li Hong,Xie Zheng,Xiang Yao,et al.Multi-Label Learning by LLE Dimension Reduction and Bayesian Classification.Journal of Systems Engineering and Electronics,2009,31(6): 1467-1472 (in Chinese)
(李 宏,谢 政,向 遥,等.一种采用LLE降维和贝叶斯分类的多类标学习算法.系统工程与电子技术,2009,31(6): 1467-1472) |
|
|
|
2012, Vol. 25 
