|
|
|
| Fuzzy Support Vector Machine Method Based on Border Vector Extraction |
| WU Qing, LIU San-Yang, DU Zhe |
| Department of Mathematical Sciences, Xidian University, Xi’an 710071 |
|
|
|
|
Abstract A fuzzy support vector machine (SVM) based on border vector extraction is presented. It overcomes the disadvantage of the sensitivity to noises and the outliers in the training samples. Border vectors, which are possible support vectors, are selected as new samples to train SVMs. The number of training samples is reduced and thus the training speed is improved. The fuzzy membership is defined according to the distance from border vectors and outliers to their hypersphere centers. Consequently the effect of noises and outliers is weakened and support vectors are improved to design a classifier. Experimental results show that by the proposed method the machine is less sensitive to noises and outliers than by the traditional SVMs and the fuzzy SVMs based on the distance between a sample and its cluster center. Furthermore, the proposed method has better generalization ability and higher learning speed than the others.
|
|
Received: 18 May 2007
|
|
|
|
|
|
[1] Burges C J C. A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, 1998, 2(2): 121-167
[2] Vapnik V N. Statistical Learning Theory. New York, USA: John Wiley & Sons, 1998
[3] Bian Zhaoqi, Zhang Xuegong. Pattern Recognition. Beijing, China: Tsinghua University Press, 2000 (in Chinese)
(边肇祺,张学工.模式识别.北京:清华大学出版社, 2000)
[4] Zhang Xuegong. Using Class-Center Vectors to Built Support Vector Machines // Proc of the IEEE Signal Processing Society Workshop on Neural Network for Signal Processing. Wisconsin, USA, 1999: 3-11
[5] Lin Chunfu, Wang Shengde. Fuzzy Support Vector Machines. IEEE Trans on Neural Networks, 2002, 13(2): 464-471
[6] Lin Chunfu, Wang Shengde. Training Algorithm for Fuzzy Support Vector Machines with Noisy Date. Pattern Recognition Letters, 2004, 25(14):1647-1656
[7] Huang Hanpang, Liu Yihong. Fuzzy Support Vector Machines for Pattern Recognition and Data Mining. International Journal of Fuzzy Systems, 2002, 4(3): 826-835
[8] Zhang Xiang, Xiao Xiaoling, Xu Guangyou. Fuzzy Support Vector Machine Based on Affinity among Samples. Journal of Software, 2006, 17(5): 951-958 (in Chinese)
(张 翔,肖小玲,徐光祐.基于样本之间紧密度的模糊支持向量机方法.软件学报, 2006, 17(5): 951-958)
[9] Chiang J H, Hao Peiyi. A New Kernel-Based Fuzzy Clustering Approach: Support Vector Clustering with Cell Growing. IEEE Trans on Fuzzy Systems, 2003, 11(4): 518-527
[10] Tax D M J, Duin R P W. Support Vector Domain Description. Pattern Recognition Letters, 1999, 20(11/12/13): 1191-1199
[11] Tao Qing, Wu Gaowei, Wang Feiyue, et al. Posterior Probability Support Vector Machines for Unbalanced Data. IEEE Trans on Neural Networks, 2005, 16(6): 1561- 1573
[12] Ratsh G. Benchmark Repository [DB/OL]. [2007-04-22]. http://users. Rsise.anu.edu/an/~raetsch/ data |
|
|
|
2008, Vol. 21 
