Journal of South China University of Technology (Natural Science Edition) ›› 2015, Vol. 43 ›› Issue (5): 78-85.doi: 10.3969/j.issn.1000-565X.2015.05.013

• Computer Science & Technology • Previous Articles     Next Articles

A Non-Sparse Multi-Kernel Learning Method Based on Primal Problem

Hu Qing-hui1,2 Ding Li-xin1 Liu Xiao-gang2 Li Zhao-kui1   

  1. 1. School of Computer//State Key Laboratory of Software Engineering,Wuhan University,Wuhan 430072,Hubei,China;
    2. Guangxi Colleges and Universities Key Laboratory Breeding Base of Robot and Welding Technology,Guilin University of Aerospace Technology,Guilin 541004,Guangxi,China
  • Received:2014-09-19 Revised:2015-01-25 Online:2015-05-25 Published:2015-05-07
  • Contact: 丁立新(1967-),男,教授,博士生导师,主要从事机器学习、智能计算及其理论研究. E-mail:lxding@whu.edu.cn
  • About author:胡庆辉(1976-),男,在职博士生,桂林航天工业学院副教授,主要从事多核学习、监督学习、半监督学习及数据挖 掘研究. E-mail: huqinghui2004@126. com
  • Supported by:
    Supported by the National Natural Science Foundation of China(11301106) and the Natural Science Foundation of Guangxi Province(2014GXNSFAA1183105)

Abstract: Traditional multi-kernel learning (MKL) methods mainly solve primal problems in the dual. However,the solving in the primal may result in better convergence property. In this paper,a novel L p -norm-constraint non-sparse MKL method,which optimizes the modal in the primal,is proposed. In this method,firstly,support vector machine (SVM) is solved by means of subgradient and improved quasi-Newton method. Then,basic kernel weights are obtained via simple calculations. As quasi-Newton method is of second-order convergence property and acquires inverse Hessian matrix without computing the second-order derivative,the proposed method is of higher convergence speed than that of conventional ones. Simulated results show that the proposed method is of comparable classifica-tion accuracy,strong generalization capability,high convergence speed and good scalability.

Key words: multi-kernel learning, quasi-Newton method, alternating optimization, support vector machines

CLC Number: