Incremental extreme learning machine based on deep feature embedded

doi:10.1007/s13042-015-0419-5

	Incremental extreme learning machine based on deep feature embedded
	Zhang, Jian 1,2; Ding, Shifei 1,2; Zhang, Nan 1,2; Shi, Zhongzhi 2
	2016-02-01
发表期刊	INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS
ISSN	1868-8071
卷号	7 期号:1 页码:111-120
摘要	Extreme learning machine (ELM) algorithm is used to train Single-hidden Layer Feed forward Neural Networks. And Deep Belief Network (DBN) is based on Restricted Boltzmann Machine (RBM). The conventional DBN algorithm has some insufficiencies, i.e., Contrastive Divergence (CD) Algorithm is not an ideal approximation method to Maximum Likelihood Estimation. And bad parameters selected in RBM algorithm will produce a bad initialization in DBN model so that we will spend more training time and get a low classification accuracy. To solve the problems above, we summarize the features of extreme learning machine and deep belief networks, and then propose Incremental extreme learning machine based on Deep Feature Embedded algorithm which combines the deep feature extracting ability of Deep Learning Networks with the feature mapping ability of extreme learning machine. Firstly, we introduce Manifold Regularization to our model to attenuate the complexity of probability distribution. Secondly, we introduce the semi-restricted Boltzmann machine (SRBM) to our algorithm, and build a deep belief network based on SRBM. Thirdly, we introduce the thought of incremental feature mapping in ELM to the classifier of DBN model. Finally, we show validity of the algorithm by experiments.
关键词	RBM SRBM Manifold Regularization ELM Incremental feature mapping
DOI	10.1007/s13042-015-0419-5
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61379101] ; National Key Basic Research Program of China[2013CB329502]
WOS研究方向	Computer Science
WOS类目	Computer Science, Artificial Intelligence
WOS记录号	WOS:000368167400008
出版者	SPRINGER HEIDELBERG
引用统计	被引频次：36[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/8977
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Ding, Shifei
作者单位	1.China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Zhang, Jian,Ding, Shifei,Zhang, Nan,et al. Incremental extreme learning machine based on deep feature embedded[J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS,2016,7(1):111-120.
APA	Zhang, Jian,Ding, Shifei,Zhang, Nan,&Shi, Zhongzhi.(2016).Incremental extreme learning machine based on deep feature embedded.INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS,7(1),111-120.
MLA	Zhang, Jian,et al."Incremental extreme learning machine based on deep feature embedded".INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS 7.1(2016):111-120.