收稿日期: 2008-12-30
修回日期: 2009-04-26
网络出版日期: 2010-01-25
基金资助
广东省-教育部产学研结合项目(2007B090400031);广东省科技计划项目(2008B080701005)
Semi-Supervised Classification Based on Regularization of Minimum Entropy
Received date: 2008-12-30
Revised date: 2009-04-26
Online published: 2010-01-25
Supported by
广东省-教育部产学研结合项目(2007B090400031);广东省科技计划项目(2008B080701005)
关键词: 半监督学习; 条件Havrda-Charvat’s structual α-熵; 拟牛顿法; 分类
刘小兰 郝志峰 杨晓伟 马献恒 . 基于最小熵正则化的半监督分类[J]. 华南理工大学学报(自然科学版), 2010 , 38(1) : 87 -91 . DOI: 10.3969/j.issn.1000-565X.2010.01.017
As the generative model needs modelling complex joint probability density and evaluating many parameters, a discriminant semi-supervised classification algorithm based on the regularization of minimum entropy is proposed. This algorithm uses Havrda-Charvat's structural α-entropy as the regularization item of the objective and employs the quasi-Newton method to solve the objective, which makes the algorithm discriminative and inductive and reduces the dependence of the algorithm on the model. At the same time, the algorithm can predict the labels of the out-of-sample data points easily. Simulated results of several UCI datasets demonstrate that the proposed algorithm is of low classification error even with few labeled data.
/
| 〈 |
|
〉 |