Abstract:Non-negative matrix factorization (NMF) is an effective image representation method and has considerable attention in pattern recognition. The NMF is an unsupervised learning algorithm which can not take into account the label information and the intrinsic geometry structure simultaneously. In this paper,a matrix decomposition method called graph-regularized constrained non-negative matrix factorization (GRCNMF) is proposed,which preserves the label information with resorting to hard constraints,and hence the discriminating ability is improved. Meanwhile,a neighbors graph preserves the intrinsic geometrical structure of the data. The clustering experiments on the COIL20 and ORL image database demonstrate the effectiveness of the GRCNMF compared to other approaches.
[1] Lee D D,Seung H S. Learning the Parts of Objects by Non-negative Matrix Factorization. Nature,1999,401(6755): 788-791 [2] Duda R O,Hart P E,Stork D G. Pattern Classification. New York: Wiley-Interscience,2000 [3] Belkin M,Niyogi P,Sinndhwani V. Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples. Journal of Machine Learning Research,2006,7(11): 2399-2434 [4] Zhou Dengyong,Bousquet O,Lal T N,et al. Learning with Local and Global Consistency // Thrun S,Saul L K,Schlkopf B,eds. Advances in Neural Information Processing Systems. Cambridge,USA: MIT Press,2003: 321-328 [5] Zhu Xiaojin,Ghahramani Z,Lafferty J. Semi- Supervised Learning Using Gaussian Fields and Harmonic Function // Proc of the 20th International Conference on Machine Learning. Washington,USA,2003: 912-919 [6] Cai Deng,He Xiaofei,Han Jiawei,et al. Graph Regularized Non-negative Matrix Factorization for Data Representation. IEEE Trans on Pattern Analysis and Machine Intelligence,2011,33(8): 1548- 1560 [7] Liu Haifeng,Wu Zhaohui,Li Xuelong,et al. Constrained Non-negative Matrix Factorization for Image Representation. IEEE Trans on Pattern Analysis and Machine Intelligence,2012,34(7): 1299- 1311 [8] Buciu I,Pitas I. Application of Non-Negative and Local Non-Negative Matrix Factorization to Facial Expression Recognition // Proc of the 17th International Conference on Pattern Recognition. Cambridge,UK,2004: 288- 291 [9] Zafeiriou S,Tefas A,Buciu I,et al. Exploiting Discriminate Information in Nonnegative Matrix Factorization with Application to Frontal Face Verification. IEEE Trans on Neural Network,2006,17(3): 683 -695
[10] Hoyer P O. Non-Negative Matrix Factorization with Sparseness Constraints. Journal of Machine Learning Research,2004,5: 1457-1469 [11] Lee D D,Seung H S. Algorithms for Non-negative Matrix Factorization // Leen T K,Dietterich T G,Tresp V,eds. Advances in Neural Information Processing Systems. Cambridge,USA: MIT Press,2001: 556-562 [12] Xu Wei,Liu Xin,Gong Yihong. Document Clustering Based on Non-negative Matrix Factorization // Proc of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York,USA,2003: 267- 273 [13] Cai Deng,He Xiaofei,Han Jiawei. Document Clustering Using Locality Preserving Indexing. IEEE Trans on Knowledge and Data Engineering,2005,17(12):1624-1637 [14] Shahnaza F,Berry M W,Pauca V P,et al. Document Clustering Using Nonnegative Matrix Factorization. Information Processing and Management,2006,42(2): 373-386 [15] Li S Z,Hou Xinwen,Zhang Hongjiang,et al. Learning Spatially Localized,Parts-Based Representation // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Hawaii,USA,2001: 207-212