|
|
|
| User Credit Ranking Based on Structured Non-linear Ordinal Regression |
| REN Yonggong1, GUO Jiaqi1, ZHANG Jing1 |
| 1. School of Computer and Information Technology, Liaoning Normal University, Dalian 116081 |
|
|
|
|
Abstract The user fraud detection is realized by constructing the binary-classification model in the traditional methods, and therefore it is difficult to obtain the potential of applications. In this paper, an algorithm of user credit ranking based on structured non-linear ordinal regression and a robust structured non-linear ordinal regression model are proposed. Firstly, an adaptive global weight matrix is generated to solve overfitting and underfitting caused by the imbalanced distribution of samples. Then, the penalty constraint of ordered inter-categories is established to optimize the projection direction to avoid noises and enhance the robustness of the model. The user information from the actual internet applications is collected, and feature extraction and labelling of ordered categories are conducted. The experiment shows the proposed model achieves better performance.
|
|
Received: 19 May 2020
|
|
|
| Fund:National Natural Science Foundation of China(No.61902165,61976109), Natural Science Foundation of Liaoning Pro-vince(No.20180550542), Liaoning Provincial Department of Education Youth Foundation(No.LQ2019029), Dalian Science and Technology Innovation Fund (No.2018J12GX047), Dalian Key Laboratory Special Fund |
|
Corresponding Authors:
ZHANG Jing, Ph.D., lecturer. Her research interests include machine learning and pattern classification.
|
| About author:: REN Yonggong, Ph.D., professor. His research interests include data mining.GUO Jiaqi, master student. Her research interests include machine learning and pattern classification. |
|
|
|
[1] CHEN Y F, REN P J, WANG Y, et al. Bayesian Personalized Feature Interaction Selection for Factorization Machines // Proc of the 42nd International ACM SIGIR Conference on Research and Deve-lopment in Information Retrieval. New York, USA: ACM, 2019: 665-674.
[2] 张坚卿.互金行业中借贷用户信用评级模型研究.博士学位论文.上海:上海大学, 2018.
(ZHANG J Q. Research on the Rating Model of Users′ Credit in the Industry of Network Loan. Ph.D. Dissertation. Shanghai, China: Shanghai University, 2018)
[3] XU X L, XU G L. A Recommendation Ranking Model Based on Credit // Proc of the IEEE International Conference on Granular Computing. Washington, USA: IEEE, 2012. DOI: 10.1109/GrC.2012.6468700.
[4] GUTIÉRREZ P A, PEREZ-ORTIZ M, SÁNCHEZ-MONEDERO J, et al. Ordinal Regression Methods: Survey and Experimental Study. IEEE Transactions on Knowledge and Data Engineering, 2016, 28(1): 127-146.
[5] SEAH C W, TSANG I W, ONG Y S. Transductive Ordinal Regre-ssion. IEEE Transactions on Neural Networks and Learning Systems, 2012, 23(7): 1074-1086.
[6] ZENG J B, LIU Y, LENG B, et al. Dimensionality Reduction in Multiple Ordinal Regression. IEEE Transactions on Neural Networks and Learning Systems, 2018, 29(9): 4088-4101.
[7] HSU C W, LIN C J. A Comparison of Methods for Multiclass Su-pport Vector Machines. IEEE Transactions on Neural Networks, 2002, 13(2): 415-425.
[8] WAEGEMAN W, BOULLART L. An Ensemble of Weighted Su-pport Vector Machines for Ordinal Regression. International Journal of Computer Systems Science and Engineering, 2009, 3(1): 47-51.
[9] DENG W Y, ZHENG Q H, LIAN S G, et al. Ordinal Extreme Learning Machine. Neurocomputing, 2010, 74(1/2/3): 447-456.
[10] MCCULLAGH P. Regression Models for Ordinal Data. Journal of the Royal Statistical Society(Methodological), 1980, 42(2): 109-127.
[11] CHU W, KEERTHI S S. Support Vector Ordinal Regression. Neural Computation, 2007, 19(3): 792-815.
[12] SHASHUA A, LEVIN A. Ranking with Large Margin Principle: Two Approaches // THRUN S, SAUL L K, SCHLKOPF B, eds. Advances in Neural Information Processing Systems 16. Cambridge, USA: The MIT Press, 2003: 961-968.
[13] CHU W, KEERTHI S S. New Approaches to Support Vector Ordinal Regression // Proc of the 22nd International Conference on Machine Learning. New York, USA: ACM, 2005: 145-152.
[14] CARRIZOSA E, MARTIN-BARRAGAN B. Maximizing Upgrading and Downgrading Margins for Ordinal Regression. Mathematical Methods of Operations Research, 2011, 74(3): 381-407.
[15] ZHAO B, WANG F, ZHANG C S. Block-Quantized Support Vector Ordinal Regression. IEEE Transactions on Neural Networks, 2009, 20(5): 882-890.
[16] WANG H D, SHI Y, NIU L F, et al. Nonparallel Support Vector Ordinal Regression. IEEE Transactions on Cybernetics, 2017, 47(10): 3306-3317.
[17] GU B, SHENG V S, TAY K Y, et al. Incremental Support Vector Learning for Ordinal Regression. IEEE Transactions on Neural Networks and Learning Systems, 2015, 26(7): 1403-1416.
[18] LIN H T, LI L. Reduction from Cost-Sensitive Ordinal Ranking to Weighted Binary Classification. Neural Computation, 2012, 24(5): 1329-1367.
[19] MIKA S, RATSCH G, WESTON J, et al. Fisher Discriminant Analysis with Kernels // Proc of the IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing. Washington, USA: IEEE, 1999: 41-48.
[20] SUN B Y, LI J Y, WU D D, et al. Kernel Discriminant Learning for Ordinal Regression. IEEE Transactions on Knowledge and Data Engineering, 2010, 22(6): 906-910.
[21] JIANG W H. A New Discriminative Ordinal Regression Method. Procedia Computer Science, 2018, 139: 605-612.
[22] JAPKOWICZ N, STEPHEN S. The Class Imbalance Problem: A Systematic Study. Intelligent Data Analysis, 2002, 6(5): 429-449.
[23] CRUZ R, FERNANDES K, DE COSTA J P, et al. Combining Ranking with Traditional Methods for Ordinal Class Imbalance // Proc of the International Work-Conference on Artificial Neural Networks. Berlin, Germany: Springer, 2017: 538-548.
[24] ALI A, SHAMSUDDIN S M, RALESCU A L.Classification with
Class Imbalance Problem: A Review. International Journal of Advances in Soft Computing and Its Applications, 2015, 7(3): 176-204. |
|
|
|
2020, Vol. 33 
