Pseudo Gradient and Dynamic Step Optimization Algorithm for RBF-SVM Parameter Search
doi: 10.3969/j.issn.1001-0548.2010.04.010
- Received Date: 2009-01-04
- Rev Recd Date: 2009-09-30
- Publish Date: 2010-08-15
-
Key words:
- dynamic step /
- gradient /
- hyper-parameter /
- support vector machines
Abstract: To the issue of hyper-parameter selection for radial basis function (RBF) based support vector machines (SVM), a new algorithm named as pseudo gradient and dynamic step optimization is proposed. Based on the characteristics of RBF, the kernel parameter is pre-estimated according to the distribution of the train set and the logarithmic scale is employed for the parameter space. The search direction is estimated with the changing of classification accuracy and by tuning the search step accordingly. At last, comparative experiments with Grid approach and PSO algorithm indicate the validity of the proposed algorithm.
Citation: | ZHANG Hong-da, WANG Xiao-dan, XU Hai-long. Pseudo Gradient and Dynamic Step Optimization Algorithm for RBF-SVM Parameter Search[J]. Journal of University of Electronic Science and Technology of China, 2010, 39(4): 523-527,555. doi: 10.3969/j.issn.1001-0548.2010.04.010 |