Supervised feature extraction algorithm based on improved polynomial entropy

doi:10.1177/0165551506064363

	Supervised feature extraction algorithm based on improved polynomial entropy
	Ding, Shifei ; Shi, Zhongzhi
	2006
发表期刊	JOURNAL OF INFORMATION SCIENCE
ISSN	0165-5515
卷号	32 期号:4 页码:309-315
摘要	Based on information entropy theory, a novel feature extraction algorithm based on improved polynomial entropy (IPE) is set up. Firstly, the concepts and their properties of information entropy and cross entropy (CE) are analysed and studied. On this foundation, we prove that symmetrical cross entropy (SCE) proposed here based on I E satisfies three axioms of the distance, i.e. nonnegativity, symmetry and triangle inequation. So SCE is a kind of distance measure, which can be used to measure the degree of variation between two random variables. Secondly, for convenience, we propose a new concept of improved polynomial entropy (IPE) based on polynomial entropy (PE), and explain that WE is equivalent to SCE. Thirdly, we make IPE separability criterion of the classes for feature extraction, and design a novel feature extraction algorithm based on IPE. Fianlly, the experimental results demonstrate that the algorithm proposed here is valid and reliable, and it provides a new research approach for feature extraction, data mining and pattern recognition.
关键词	information entropy theory cross entropy (CE) symmetrical cross entropy (SCE) polynomial entropy (PE) improved polynomial entropy (IPE) supervised feature extraction
DOI	10.1177/0165551506064363
收录类别	SCI
语种	英语
WOS研究方向	Computer Science ; Information Science & Library Science
WOS类目	Computer Science, Information Systems ; Information Science & Library Science
WOS记录号	WOS:000241280300002
出版者	SAGE PUBLICATIONS LTD
引用统计	被引频次：4[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/10439
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Ding, Shifei
作者单位	1.Shandong Agr Univ, Coll Informat Sci & Engn, Tai An 271018, Peoples R China 2.Chinese Acad Sci, Key Lab Intelligent Informat Proc, Inst Comp Technol, Beijing 100080, Peoples R China
推荐引用方式 GB/T 7714	Ding, Shifei,Shi, Zhongzhi. Supervised feature extraction algorithm based on improved polynomial entropy[J]. JOURNAL OF INFORMATION SCIENCE,2006,32(4):309-315.
APA	Ding, Shifei,&Shi, Zhongzhi.(2006).Supervised feature extraction algorithm based on improved polynomial entropy.JOURNAL OF INFORMATION SCIENCE,32(4),309-315.
MLA	Ding, Shifei,et al."Supervised feature extraction algorithm based on improved polynomial entropy".JOURNAL OF INFORMATION SCIENCE 32.4(2006):309-315.