Depth perceptual region-of-interest based multiview video coding

doi:10.1016/j.jvcir.2010.03.002

	Depth perceptual region-of-interest based multiview video coding
	Zhang, Yun 1,2,3; Jiang, Gangyi 1,2; Yu, Mei 1; Yang, You 2; Peng, Zongju 1; Chen, Ken 1
	2010-07-01
发表期刊	JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION
ISSN	1047-3203
卷号	21 期号:5-6 页码:498-512
摘要	MultiView Video (MVV) has attracted considerable attention recently since it is capable of providing users with three-dimensional perception and interactive functionalities. However, these MVV data require large mount of storage and bandwidth in network transmission. In this paper, we present a novel Depth Perceptual Region-Of-Interest (DP-ROI) based Multiview Video Coding (RMVC) scheme to extensively improve data compression efficiency by exploiting redundancies in depth perception. Firstly, we define DP-ROI according to the three-dimensional depth sensation of human visual system. Then, a framework of RMVC is developed to improve compression efficiency by properly segmenting the MW into different macroblock wise DP-ROIs and encoding them separately. And then, we propose three fast depth based DP-ROI extraction and tracking algorithms by jointly using motion, texture, depth as well as previous extracted DP-ROIs. Finally, on the basis of the extracted DP-ROI, bit allocation optimization model is proposed to allocate more bits on DP-ROIs for high image quality and fewer bits on background regions for high compression ratio. Experimental results show that the presented RMVC scheme achieves significant coding gains at high rate while comparing with original joint multiview video model. To be specific, up to 14.22-23.32% bit-rate are saved while 0.16-0.68 dB coding gains are achieved in DP-ROIs at the cost of the image quality degradation in background. Crown Copyright (C) 2010 Published by Elsevier Inc. All rights reserved.
关键词	Three-dimensional television Multiview video coding Multiview video plus depth Depth perceptual region-of-interest Bit allocation Inter-view correlation Hierarchical B picture Human visual system
DOI	10.1016/j.jvcir.2010.03.002
收录类别	SCI
语种	英语
WOS研究方向	Computer Science
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering
WOS记录号	WOS:000278970600012
出版者	ACADEMIC PRESS INC ELSEVIER SCIENCE
引用统计	被引频次：12[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/12173
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Jiang, Gangyi
作者单位	1.Ningbo Univ, Fac Informat Sci & Engn, Ningbo 315211, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China 3.Chinese Acad Sci, Grad Sch, Beijing 100080, Peoples R China
推荐引用方式 GB/T 7714	Zhang, Yun,Jiang, Gangyi,Yu, Mei,et al. Depth perceptual region-of-interest based multiview video coding[J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION,2010,21(5-6):498-512.
APA	Zhang, Yun,Jiang, Gangyi,Yu, Mei,Yang, You,Peng, Zongju,&Chen, Ken.(2010).Depth perceptual region-of-interest based multiview video coding.JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION,21(5-6),498-512.
MLA	Zhang, Yun,et al."Depth perceptual region-of-interest based multiview video coding".JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION 21.5-6(2010):498-512.