Video super-resolution with registration-reliability regulation and adaptive total variation

doi:10.1016/j.jvcir.2015.04.002

	Video super-resolution with registration-reliability regulation and adaptive total variation
	Zhang, Xinfeng 1; Xiong, Ruiqin 2; Ma, Siwei 2; Li, Ge 3; Gao, Wen 2
	2015-07-01
发表期刊	JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION
ISSN	1047-3203
卷号	30 页码:181-190
摘要	In super-resolution that constructs a high-resolution (HR) image from a set of low-resolution (LR) reference images, it is crucial to align the LR reference images in order to efficiently exploit the pixels therein. However, due to the existence of complex local motion, ideal registration is difficult to acquire. In this paper, we present a robust video super-resolution scheme with registration-reliability regulation and content adaptive total variation regularization, which make the scheme resilient to registration failures. In order to handle ill-registered pixels, we propose a registration-reliability regulated data-fidelity term, which assigns smaller weights to the pixels with larger locally-averaged registration residuals. In addition, a content adaptive total variation based on structure tensor, which is used to estimate image local structures, is proposed to regularize the super-resolved images. The structure tensor is derived not only from the gradients of local patches but also the nonlocal similar patches. Experimental results show that the proposed scheme can remarkably improve both the objective and subjective quality of the video super-resolution results. (C) 2015 Elsevier Inc. All rights reserved.
关键词	Super-resolution Registration reliability Regularization Total variation Nonlocal similarity Structure tensor Interpolation Optical flow
DOI	10.1016/j.jvcir.2015.04.002
收录类别	SCI
语种	英语
资助项目	National Science Foundation of China[61322106] ; National Science Foundation of China[61370114] ; National Basic Research Program of China (973 Program)[2015CB351800]
WOS研究方向	Computer Science
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering
WOS记录号	WOS:000357761900016
出版者	ACADEMIC PRESS INC ELSEVIER SCIENCE
引用统计	被引频次：10[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/9553
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Xiong, Ruiqin
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China 2.Peking Univ, Inst Digital Media, Beijing 100871, Peoples R China 3.Peking Univ, Shenzhen Grad Sch, Sch Elect & Comp Engn, Shenzhen 518005, Peoples R China
推荐引用方式 GB/T 7714	Zhang, Xinfeng,Xiong, Ruiqin,Ma, Siwei,et al. Video super-resolution with registration-reliability regulation and adaptive total variation[J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION,2015,30:181-190.
APA	Zhang, Xinfeng,Xiong, Ruiqin,Ma, Siwei,Li, Ge,&Gao, Wen.(2015).Video super-resolution with registration-reliability regulation and adaptive total variation.JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION,30,181-190.
MLA	Zhang, Xinfeng,et al."Video super-resolution with registration-reliability regulation and adaptive total variation".JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION 30(2015):181-190.