Rényi Entropy Rate of Stationary Ergodic Processes

doi:10.1109/TIT.2023.3318265

	Rényi Entropy Rate of Stationary Ergodic Processes
	Wu, Chengyu 1; Li, Yonglong 2,3; Xu, Li 4; Han, Guangyue 5
	2024
发表期刊	IEEE TRANSACTIONS ON INFORMATION THEORY
ISSN	0018-9448
卷号	70 期号:1 页码:1-15
摘要	In this paper, we examine the R & eacute;nyi entropy rate of stationary ergodic processes. For a special class of stationary ergodic processes, we prove that the R & eacute;nyi entropy rate always exists and can be approximated by its defining sequence at most polynomially; moreover, using the Markov approximation method, we show that the R & eacute;nyi entropy rate can be exponentially approximated by that of the Markov approximating sequence, as the Markov order goes to infinity. For the general case, by constructing a counterexample, we disprove the conjecture that the R & eacute;nyi entropy rate of a general stationary ergodic process always converges to its Shannon entropy rate as alpha goes to 1.
关键词	R & eacute ergodic processes hidden Markov models hidden Markov models cutting and stacking method nyi entropy rate
DOI	10.1109/TIT.2023.3318265
收录类别	SCI
语种	英语
资助项目	Research Grants Council of the Hong Kong Special Administrative Region, China
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Information Systems ; Engineering, Electrical & Electronic
WOS记录号	WOS:001134299300036
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/38404
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Wu, Chengyu
作者单位	1.Univ British Columbia, Dept Math, Vancouver, BC V6T 1Z2, Canada 2.Natl Univ Singapore, Dept Elect & Comp Engn ECE, Singapore 117583, Singapore 3.Natl Univ Singapore, Ctr Quantum Technol CQT, Singapore 117583, Singapore 4.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China 5.Univ Hong Kong, Dept Math, Hong Kong, Peoples R China
推荐引用方式 GB/T 7714	Wu, Chengyu,Li, Yonglong,Xu, Li,et al. Rényi Entropy Rate of Stationary Ergodic Processes[J]. IEEE TRANSACTIONS ON INFORMATION THEORY,2024,70(1):1-15.
APA	Wu, Chengyu,Li, Yonglong,Xu, Li,&Han, Guangyue.(2024).Rényi Entropy Rate of Stationary Ergodic Processes.IEEE TRANSACTIONS ON INFORMATION THEORY,70(1),1-15.
MLA	Wu, Chengyu,et al."Rényi Entropy Rate of Stationary Ergodic Processes".IEEE TRANSACTIONS ON INFORMATION THEORY 70.1(2024):1-15.