基于安全样本筛选的不平衡数据抽样方法

doi:10.16451/j.cnki.issn1003-6059.201906007

摘要
图/表
参考文献(36)
相关文章 (9)

全文: PDF (890 KB) HTML (1 KB)
输出: BibTeX | EndNote (RIS)

摘要

针对欠抽样可能导致有用信息的丢失,以及合成小类的过抽样技术(SMOTE)可能使大类和小类间类重叠更严重的问题,文中提出基于安全样本筛选的欠抽样和SMOTE结合的抽样方法(Screening_SMOTE).利用安全筛选规则,识别并丢弃大类中部分对确定决策边界无价值的实例和噪音实例,采用SMOTE对筛选后数据集进行过抽样.基于安全样本筛选的欠抽样既避免原始数据中有价值信息的丢失,又丢弃大类中的噪音实例,缓减过抽样数据集类重叠的问题.实验表明在处理不平衡数据集,特别是维数较高的不平衡数据集时Screening_SMOTE的有效性.

	服务

	把本文推荐给朋友
	加入我的书架
	加入引用管理器
	E-mail Alert
	RSS
	作者相关文章
	石洪波
	刘焱昕
	冀素琴

关键词 ：不平衡数据, 安全样本筛选, 欠抽样, 不平衡比率, 合成小类的过抽样技术(SMOTE)

Abstract：

The loss of valuable information may be caused by undersampling, and the class overlapping between the majority class and the minority class may be aggravated by the synthetic minority oversampling technique(SMOTE). A sampling method, Screening_SMOTE, is proposed in this paper, combining safe sample screening based undersampling with SMOTE. Parts of non-informative instances and noise instances in the majority class are identified and discarded by the undersampling method using safe screening rules. Then, the minority class instances generated by SMOTE are added into the screened dataset. The loss of informative information is avoided and the noise instances in the majority class are discarded using safe sample screening based undersampling, relieving the class overlapping. The experimental results show that Screening_SMOTE is an effective method of rebalancing imbalanced datasets, especially for high dimensional imbalanced datasets.

Key words： Imbalanced Data Safe Sample Screening Undersampling Imbalance Ratio Synthetic Minority Oversampling Technique(SMOTE)

收稿日期: 2019-01-29

ZTFLH:

TP 391

基金资助:

国家自然科学基金项目(No.61801279)、山西省自然科学基金项目(No.2014011022-2,201801D121115)资助

作者简介: 石洪波(通讯作者),博士,教授,主要研究方向为机器学习、人工智能.E-mail:shb710@163.com.刘焱昕,硕士研究生,主要研究方向为机器学习.E-mail:312464821@qq.com.冀素琴,硕士,副教授,主要研究方向为机器学习、数据挖掘.E-mail:jsq58@sina.com.

引用本文:

石洪波, 刘焱昕, 冀素琴. 基于安全样本筛选的不平衡数据抽样方法[J]. 模式识别与人工智能, 2019, 32(6): 545-556. SHI Hongbo, LIU Yanxin, JI Suqin. Safe Sample Screening Based Sampling Method for Imbalanced Data. , 2019, 32(6): 545-556.

链接本文:

http://manu46.magtech.com.cn/Jweb_prai/CN/10.16451/j.cnki.issn1003-6059.201906007 或 http://manu46.magtech.com.cn/Jweb_prai/CN/Y2019/V32/I6/545

[1] TSANG S, KOH Y S, DOBBIE G, et al. Detecting Online Auction Shilling Frauds Using Supervised Learning. Expert Systems with Applications, 2014, 41(6): 3027-3040.
[2] HASSAN A K I, ABRAHAM A. Modeling Insurance Fraud Detection Using Imbalanced Data Classification // PILLAY N, ENGELBRECHT A P, ABRAHAM A, et al., eds. Advances in Nature and Biologically Inspired Computing. Berlin, Germany: Springer, 2016: 117-127.
[3] ALMENDRA V. Finding the Needle: A Risk-Based Ranking of Product Listings at Online Auction Sites for Non-delivery Fraud Prediction. Expert Systems with Applications, 2013, 40(12): 4805-4811.
[4] YU L, ZHOU R T, TANG L, et al. A DBN-Based Resampling SVM Ensemble Learning Paradigm for Credit Classification with Imbalanced Data. Applied Soft Computing, 2018, 69(8): 192-202.
[5] TSAI C F, HSU Y F, LIN C Y, et al. Intrusion Detection by Machine Learning: A Review. Expert Systems with Applications, 2009, 36(10): 11994-12000.
[6] ZHOU C V, LECKIE C, KARUNASEKERA S. A Survey of Coordinated Attacks and Collaborative Intrusion Detection. Computer and Security, 2010, 29(1): 124-140.
[7] REN F L, CAO P, LI W, et al. Ensemble Based Adaptive Over-Sampling Method for Imbalanced Data Learning in Computer Aided Detection of Microaneurysm. Computerized Medical Imaging and Graphics, 2017, 55(1): 54-67.
[8] BLASZCZYNSKI J, STEFANOWSKI J. Neighbourhood Sampling in Bagging for Imbalanced Data. Neurocomputing, 2015, 150: 529-542.
[9] ZHANG J P, MANI I. KNN Approach to Unbalanced Data Distributions: A Case Study Involving Information Extraction // Proc of the 20th International Conference on Machine Learning. Washington, USA: IEEE, 2003: 42-48.
[10] YEN S J, LEE Y S. Cluster-Based Under-Sampling Approaches for Imbalanced Data Distributions. Expert Systems with Applications, 2009, 36(3): 5718-5727.
[11] LIN W C, TSAI C F, HU Y H, et al. Clustering-Based Undersampling in Class-Imbalanced Data. Information Sciences, 2017, 409/410: 17-26.
[12] OFEK N, ROKACH L, STERN R, et al. Fast-CBUS: A Fast Clustering-Based Undersampling Method for Addressing the Class Imbalance Problem. Neurocomputing, 2017, 243: 88-102.
[13] TSAI C F, LIN W C, HU Y H, et al. Under-Sampling Class Imbalanced Datasets by Combining Clustering Analysis and Instance Selection. Information Sciences, 2019, 477: 47-54.
[14] 熊冰妍,王国胤,邓维斌.基于样本权重的不平衡数据欠抽样方法.计算机研究与发展, 2016, 53(11): 2613-2622.
(XIONG B Y, WANG G Y, DENG W B. Under-Sampling Method Based on Sample Weight for Imbalanced Data. Journal of Computer Research and Development, 2016, 53(11): 2613-2622.)
[15] TAO X M, LI Q, GUO W J, et al. Self-adaptive Cost Weights-Based Support Vector Machine Cost-Sensitive Ensemble for Imba-lanced Data Classification. Information Sciences, 2019, 487: 31-56.
[16] BEYER K, GOLDSTEIN J, RAMAKRISHNAN R, et al. When is "Nearest Neighbor" Meaningful? // Proc of the International Conference on Database Theory. Berlin, Germany: Springer, 1999: 217-235.
[17] CHAWLA N V, BOWYER K W, HALL L O, et al. SMOTE: Synthetic Minority Over-Sampling Technique. Journal of Artificial Intelligence Research, 2002, 16: 321-357.
[18] MACIEJEWSKI T, STEFANOWSKI J. Local Neighbourhood Extension of SMOTE for Mining Imbalanced Data // Proc of the IEEE Symposium on Computational Intelligence and Data Mining. Wa-shington, USA: IEEE, 2011: 104-111.
[19] OGAWA K, SUZUKI Y, TAKEUCHI I. Safe Screening of Non-support Vectors in Pathwise SVM Computation[C/OL]. [2018-12-15]. http://proceedings.mlr.press/v28/ogawa13b.pdf.
[20] OGAWA K, SUZUKI Y, SUZUMURA S, et al. Safe Sample Screening for Support Vector Machines[J/OL]. [2018-12-15]. https://arxiv.org/pdf/1401.6740.pdf
[21] NAPIERALA K, STEFANOWSKI J. Types of Minority Class Examples and Their Influence on Learning Classifiers from Imbalanced Data. Journal of Intelligent Information Systems, 2016, 46(3): 563-597.
[22] HAN H, WANG W Y, MAO B H. Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning // Proc of the International Conference on Intelligent Computing. Berlin, Germany: Springer, 2005: 878-887.
[23] LI K W, FANG X H, ZHAI J P, et al. An Imbalanced Data Cla-ssification Method Driven by Boundary Samples-Boundary-Boost // Proc of the International Conference on Information Science and Control Engineering. Washington, USA: IEEE, 2016: 194-199.
[24] WANG J, WONKA P, YE J P. Scaling SVM and Least Absolute Deviations via Exact Data Reduction[C/OL]. [2018-12-15]. http://export.arxiv.org/pdf/1310.7048.
[25] SHIBAGAKI A, KARASUYAMA M, HATANO K, et al. Simultaneous Safe Screening of Features and Samples in Doubly Sparse Modeling[C/OL]. [2018-12-15]. https://arxiv.org/pdf/1602.02485.pdf.
[26] ZHANG W Z, HONG B, LIU W, et al. Scaling Up Sparse Support Vector Machine by Simultaneous Feature and Sample Reduction[C/OL]. [2018-12-15]. https://arxiv.org/pdf/1607.06996.pdf.
[27] WU G, CHANG E Y. Class-Boundary Alignment for Imbalanced Dataset Learning[C/OL]. [2018-12-15]. https://sci2s.ugr.es/keel/pdf/specific/congreso/Wu-final.pdf.
[28] 廖士中,王梅,赵志辉.正定矩阵支持向量机正则化路径算法.计算机研究与发展, 2013, 50(11): 2253-2261.
(LIAO S Z, WANG M, ZHAO Z H. Regularization Path Algorithm of SVM via Positive Definite Matrix. Journal of Computer Research and Development, 2013, 50(11): 2253-2261.)
[29] FARQUAD M A H, BOSE I. Preprocessing Unbalanced Data Using Support Vector Machine. Decision Support Systems, 2012, 53(1): 226-233.
[30] ALCALÁ-FDEZ J, FERNÁNDEZ A, LUENGO J, et al. KEEL
Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework. Journal of Multiple-Valued Logic and Soft Computing, 2011, 17(2): 255-287.
[31] VANHOEYVELD J, MARTENS D. Imbalanced Classification in Sparse and Large Behaviour Datasets. Data Mining and Knowledge Discovery, 2018, 32(1): 25-82.
[32] METZ C E. Basic Principles of ROC Analysis. Seminars in Nuc-lear Medicine, 1978, 8(4): 283-298.
[33] KUBAT M, HOLTE R, MATWIN S. Learning When Negative Examples Abound // Proc of the 9th European Conference on Machine Learning. Berlin, Germany: Springer, 1997: 146-153.
[34] HART P E. The Condensed Nearest Neighbour Rule. IEEE Transactions on Information Theory, 1968, 14(5): 515-516.
[35] BUNKHUMPORNPAT C, SINAPIROMSARAN K, LURSINSAP C. Safe-Level-SMOTE: Safe-Level-Synthetic Minority Over-Sampling Technique for Handling the Class Imbalanced Problem // Proc of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining. Berlin, Germany: Springer, 2009: 475-482.
[36] BATISTA G E A P A, PRATI R C, MONARD M C. A Study of the Behavior of Several Methods for Balancing Machine Learning Training Data. ACM SIGKDD Explorations Newsletter, 2004, 6(1): 20-29.