Information entropy, rough entropy and knowledge granulation in incomplete information systems

doi:10.1080/03081070600687668

	Information entropy, rough entropy and knowledge granulation in incomplete information systems
	Liang, J.; Shi, Z.; Li, D.; Wierman, M. J.
	2006-12-01
发表期刊	INTERNATIONAL JOURNAL OF GENERAL SYSTEMS
ISSN	0308-1079
卷号	35 期号:6 页码:641-654
摘要	Rough set theory is a relatively new mathematical tool for use in computer applications in circumstances that are characterized by vagueness and uncertainty. Rough set theory uses a table called an information system, and knowledge is defined as classifications of an information system. In this paper, we introduce the concepts of information entropy, rough entropy, knowledge granulation and granularity measure in incomplete information systems, their important properties are given, and the relationships among these concepts are established. The relationship between the information entropy E( A) and the knowledge granulation GK(A) of knowledge A can be expressed as E(A) + GK(A) = 1, the relationship between the granularity measure G(A) and the rough entropy E-r(A) of knowledge A can be expressed as G(A) + E-r(A) = log(2)vertical bar U vertical bar. The conclusions in Liang and Shi (2004) are special instances in this paper. Furthermore, two inequalities -log(2)GK(A) <= G(A) and E-r(A) <= log(2)(vertical bar U vertical bar(1 - E(A))) about the measures GK, G, E and E-r are obtained. These results will be very helpful for understanding the essence of uncertainty measurement, the significance of an attribute, constructing the heuristic function in a heuristic reduct algorithm and measuring the quality of a decision rule in incomplete information systems.
关键词	incomplete information systems rough sets information entropy rough entropy knowledge granulation
DOI	10.1080/03081070600687668
收录类别	SCI
语种	英语
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Theory & Methods ; Ergonomics
WOS记录号	WOS:000241819200002
出版者	TAYLOR & FRANCIS LTD
引用统计	被引频次：238[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/10703
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Liang, J.
作者单位	1.Shanxi Univ, Sch Comp & Informat Technol, Minist Educ, Key Lab Computat Intelligence & Chinese Informat, Taiyuan 030006, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100080, Peoples R China 3.Creighton Univ, Omaha, NE 68005 USA
推荐引用方式 GB/T 7714	Liang, J.,Shi, Z.,Li, D.,et al. Information entropy, rough entropy and knowledge granulation in incomplete information systems[J]. INTERNATIONAL JOURNAL OF GENERAL SYSTEMS,2006,35(6):641-654.
APA	Liang, J.,Shi, Z.,Li, D.,&Wierman, M. J..(2006).Information entropy, rough entropy and knowledge granulation in incomplete information systems.INTERNATIONAL JOURNAL OF GENERAL SYSTEMS,35(6),641-654.
MLA	Liang, J.,et al."Information entropy, rough entropy and knowledge granulation in incomplete information systems".INTERNATIONAL JOURNAL OF GENERAL SYSTEMS 35.6(2006):641-654.