Unsupervised Feature Selection Algorithm Based on Neighborhood Preserving Learning
LIU Yanfang1,2, YE Dongyi2
1.College of Mathematics and Information Engineering, Longyan University, Longyan 364012 2.College of Mathematics and Computer Science, Fuzhou University, Fuzhou 350116
Abstract：Since the sensitivity of neighborhood method for irrelevant features is high, an unsupervised feature selection algorithm based on neighborhood preserving learning(NPL) is proposed by utilizing the reconstruction coefficient of neighborhood to maintain the original data structure. Firstly, according to the similarity of each data and its neighborhood, the similarity matrix is constructed and a low dimensional space is built by introducing a mid-matrix. Secondly, an effective feature subset is selected by the Laplace multiplier method. Finally, the proposed algorithm is compared with six state-of-the-art feature selection methods on four publicly available datasets. Experimental results show the proposed method effectively identifies the representative features.
[1] HAN J W, KAMBER M, PEI J. Data Mining: Concepts and Techniques. 3rd Edition. San Francisco,USA: Morgan Kaufmann, 2012. [2] BASAK J, DE R K, PAL S K. Unsupervised Feature Selection Using a Neuro-Fuzzy Approach. Pattern Recognition Letters, 1998, 19(11): 997-1006. [3] DY J G, BRODLEY C E. Feature Selection for Unsupervised Lear-ning. Journal of Machine Learning Research, 2004, 5: 845-889. [4] MITRA P, MURTHY C A, PAL S K. Unsupervised Feature Selection Using Feature Similarity. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(3): 301-312. [5] DY J. Unsupervised Feature Selection // LIU H, MOTODA H, eds. Computational Methods of Feature Selection. Boca Raton, USA: CRC Press, 2008: 19-39. [6] HOU C P, NIE F P, LI X L, et al. Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection. IEEE Transactions on Cybernetics, 2014, 44(6): 793-804. [7] TANG C, LIU X W, LI M M, et al. Robust Unsupervised Feature Selection via Dual Self-representation and Manifold Regularization. Knowledge-Based Systems, 2018, 145: 109-120. [8] ZHU P F, ZHU W C, WANG W Z, et al. Non-convex Regularized Self-representation for Unsupervised Feature Selection. Image and Vision Computing, 2017, 60: 22-29. [9] HE X F, CAI D, NIYOGI P. Laplacian Score for Feature Selection // WEISS Y, SCHÖLKOPF B, PLATT J C, eds. Advances in Neural Information Processing Systems 18. Cambridge, USA: The MIT Press, 2006: 507-514. [10] CAI D, ZHANG C Y, HE X F. Unsupervised Feature Selection for Multi-cluster Data // Proc of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, USA: ACM, 2010: 333-342. [11] YANG Y, SHEN H T, MA Z G, et al. l2,1-norm Regularized Discriminative Feature Selection for Unsupervised Learning // Proc of the 22nd International Joint Conference on Artificial Intelligence. San Francisco, USA: Morgan Kaufmann, 2011: 1589-1594. [12] 简彩仁,陈晓云.基于局部保持投影和稀疏表示的无监督特征选择方法.模式识别与人工智能, 2015, 28(3): 247-252. (JIAN C R, CHEN X Y. Unsupervised Feature Selection Based on Locality Preserving Projection and Sparse Representation. Pattern Recognition and Artificial Intelligence, 2015, 28(3): 247-252.) [13] HE X F, NIYOGI P. Locality Preserving Projections // THRUN S, SAUL K L, SCHÖLKOPF B, eds. Advances in Neural Information Processing Systems 16. Cambridge, USA: The MIT Press, 2003: 153-160. [14] NATARAJAN B K. Sparse Approximate Solutions to Linear Systems. SIAM Journal on Computing, 1995, 24(2): 227-234. [15] 脱倩娟,赵 红.基于局部邻域嵌入的无监督特征选择.郑州大学学报(理学版), 2016, 48(3): 57-62. (TUO Q J, ZHAO H. Unsupervised Feature Selection Based on Local Neighborhood Embedding. Journal of Zhengzhou University(Natural Science Edition), 2016, 48(3): 57-62.) [16] ZHEN L L, PENG X, PENG D Z. Local Neighborhood Embedding for Unsupervised Nonlinear Dimension Reduction[J/OL]. [2018-05-22]. http://www.pengxi.me/wp-content/uploads/Papers/2013-LNE.pdf [17] NIE F P, ZHU W, LI X L. Unsupervised Feature Selection with Structured Graph Optimization // Proc of the 30th AAAI Confe-rence on Artificial Intelligence. Palo Alto, USA: AAAI Press, 2016: 1302-1308.
2018, Vol. 31 
