|
|
Least Squares Semi-supervised Support Tensor Machine |
LU Chengtao, LI Fanzhang, ZHANG Li, ZHANG Zhao |
School of Computer Science and Technology, Soochow University, Suzhou 215006 |
|
|
Abstract Support tensor machine has a high computational complexity due to the iterative procedure. To overcome the shortcoming, the optimization is modified , the model is trained by solving a set of linear equations instead of solving a quadratic program problem. Additionally, transductive method is used to solve the semi-supervised problem, least squares semi-supervised support tensor machine is proposed. Some experiments on face recognition and time series classification are conducted to compare the proposed algorithm with the traditional algorithms. The results show that the proposed algorithm reduces the computation time and improves the recognition rate.
|
Received: 02 March 2016
|
|
About author:: LU Chengtao(Corresponding author),born in 1992,master student. His research interests include machine learning and pattern recognition.LI Fanzhang, born in 1964, master, professor. His research interests include Lie Group machine learning, data mining and dynamic fuzzy logicZHANG Li, born in 1975, Ph.D., professor. Her research interests include pattern recognition, machine learning and data mining.ZHANG Zhao, born in 1984, Ph.D., associate professor. His research interests include pattern recognition, machine learning, data mining and computer vision. |
|
|
|
[1] HAO Z F, HE L F, CHEN B Q, et al. A Linear Support Higher-Order Tensor Machine for Classification. IEEE Trans on Image Processing, 2013, 22(7): 2911-2920. [2] CAO X C, WEI X X, HAN Y H, et al. Robust Tensor Clustering with Non-greedy Maximization // Proc of the 23rd International Joint Conference on Artificial Intelligence. Palo Alto, USA: AAAI Press, 2013: 1254-1259. [3] GUO W W, KOTSIA I, PATRAS I. Tensor Learning for Regre-ssion. IEEE Trans on Image Processing, 2012, 21(2): 816-827. [4] SARKAR S, PHILLIPS P J, LIU Z Y, et al. The HumanID Gait Challenge Problem: Data Sets, Performance, and Analysis. IEEE Trans on Pattern Analysis and Machine Intelligence, 2005, 27(2):162-177. [5] CHANG S F. The Holy Grail of Content-Based Media Analysis. IEEE MultiMedia, 2002, 9(2): 6-10. [6] TAO D C, LI X L, WU X D, et al. Supervised Tensor Learning. Knowledge and Information Systems, 2007, 13(1): 1-42. [7] CAI D, HE X F, HAN J W, et al. Learning with Tensor Representation. Technical Report, UIUCDCS-R-2006-2716. Illinois, USA: University of Illinois at Urbana-Champaign, 2006. [8] HE X F, CAI D, NIYOGI P. Tensor Subspace Analysis // WEISS Y, SCHLKOPF B, PLATT J C, eds. Advances in Neural Information Processing Systems 18. Cambridge, USA: MIT Press, 2005: 499-506. [9] 李凡长,张 莉,杨季文,等.李群机器学习.合肥:中国科学技术大学出版社, 2013. (LI F Z, ZHANG L, YANG J W, et al. Lie Group Machine Lear-ning. Hefei, China: Press of University of Science and Technology of China, 2013.) [10] ZHANG X S, GAO X B, WANG Y. Twin Support Tensor Machines for MCs Detection. Journal of Electronics (China), 2009, 26(3): 318-325. [11] KOTSIA I, GUO W W, PATRAS I. Higher Rank Support Tensor Machines for Visual Recognition. Pattern Recognition, 2012, 45(12): 4192-4203. [12] JOACHIMS T. Transductive Inference for Text Classification Using Support Vector Machines // Proc of the 16th International Confe-rence on Machine Learning. San Francisco, USA: Morgan Kaufmann Publishers, 1999: 200-209. [13] COLLOBERT R, SINZ F, WESTON J, et al. Large Scale Transductive SVMs. Journal of Machine Learning Research, 2006, 7:1687-1712. [14] WU F, LIU Y N, ZHUANG Y T. Tensor-Based Transductive Learning for Multimodality Video Semantic Concept Detection. IEEE Trans on Multimedia, 2009, 11(5): 868-878. [15] LIU X L, GUO T J, HE L F, et al. A Low-Rank Approximation-Based Transductive Support Tensor Machine for Semisupervised Classification. IEEE Trans on Image Processing, 2015, 24(6): 1825-1838. [16] DE LATHAUWER L. Signal Processing Based on Multilinear Algebra. Ph.D Dissertation. Leuven, Belgium: Katholieke Universiteit Leuven, 1997. [17] KOLDA T G, BADER B W. Tensor Decompositions and Applications. SIAM Review, 2009, 51(3): 455-500. [18] VAPNIK V N. The Nature of Statistical Learning Theory. New York, USA: Springer-Verlag, 1995. [19] VAPNIK V N. Statistical Learning Theory. New York, USA: Wiley, 1998. [20] SUYKENS J A K, VAN DEWALLE J. Least Squares Support Vector Machine Classifiers. Neural Processing Letters, 1999, 9(3): 293-300. [21] SUYKENS J A K, VAN GESTEL T, DE BRABANTER J, et al. Basic Methods of Least Squares Support Vector Machines. Hackensack, USA: World Scientific, 2002. [22] GALL F L. Powers of Tensors and Fast Matrix Multiplication // Proc of the 39th International Symposium on Symbolic and Algeb-raic Computation. New York, USA: ACM, 2014: 296-303. [23] BURGES C J C. A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, 1998, 2(2): 121-167. [24] NIE F P, XIANG S M, LIU Y, et al. A General Graph-Based Semi-supervised Learning with Novel Class Discovery. Neural Computing and Applications, 2010, 19(4): 549-555. [25] CHEN J H, YE J P, LI Q. Integrating Global and Local Stru-ctures: A Least Squares Framework for Dimensionality Reduction // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. New York, USA: IEEE, 2007.DOI:10.1109/CVPR.2007.383040. [26] ZHU X J, GHAHRAMANI Z, LAFFERTY J D. Semi-supervised Learning Using Gaussian Fields and Harmonic Functions // Proc of the 20th International Conference on Machine Learning. Menlo Park, USA: AAAI Press, 2003, III: 912-919. |
|
|
|