Depth-Preserving Warping for Stereo Image Retargeting

doi:10.1109/TIP.2015.2431441

	Depth-Preserving Warping for Stereo Image Retargeting
	Li, Bing 1,2,3; Duan, Ling-Yu 2,3; Lin, Chia-Wen 4,5; Huang, Tiejun 2,3; Gao, Wen 2,3
	2015-09-01
发表期刊	IEEE TRANSACTIONS ON IMAGE PROCESSING
ISSN	1057-7149
卷号	24 期号:9 页码:2811-2826
摘要	The popularity of stereo images and various display devices poses the need of stereo image retargeting techniques. Existing warping-based retargeting methods can well preserve the shape of salient objects in a retargeted stereo image pair. Nevertheless, these methods often incur depth distortion, since they attempt to preserve depth by maintaining the disparity of a set of sparse correspondences, rather than directly controlling the warping. In this paper, by considering how to directly control the warping functions, we propose a warping-based stereo image retargeting approach that can simultaneously preserve the shape of salient objects and the depth of 3D scenes. We first characterize the depth distortion in terms of warping functions to investigate the impact of a warping function on depth distortion. Based on the depth distortion model, we then exploit binocular visual characteristics of stereo images to derive region-based depth-preserving constraints which directly control the warping functions so as to faithfully preserve the depth of 3D scenes. Third, with the region-based depth-preserving constraints, we present a novel warping-based stereo image retargeting framework. Since the depth-preserving constraints are derived regardless of shape preservation, we relax the depth-preserving constraints to fulfill a tradeoff between shape preservation and depth preservation. Finally, we propose a quad-based implementation of the proposed framework. The results demonstrate the efficacy of our method in both depth and shape preservation for stereo image retargeting.
关键词	Stereo image retargeting image warping optimization depth preservation
DOI	10.1109/TIP.2015.2431441
收录类别	SCI
语种	英语
资助项目	Natural Science Foundation of China[61271311] ; Natural Science Foundation of China[61390515] ; Natural Science Foundation of China[61421062] ; National High-Tech Research and Development Program of China (863 Program)[2015AA016302]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:000355760300005
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：41[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/9714
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Duan, Ling-Yu
作者单位	1.Chinese Acad Sci, Key Lab Intelligent Informat Proc, Inst Comp Technol, Beijing 100190, Peoples R China 2.Peking Univ, Inst Digital Media, Sch Elect Engn & Comp Sci, Beijing 100871, Peoples R China 3.Cooperat Medianet Innovat Ctr, Beijing, Peoples R China 4.Natl Tsing Hua Univ, Hsinchu 30013, Taiwan 5.Asia Univ, Taichung 41351, Taiwan
推荐引用方式 GB/T 7714	Li, Bing,Duan, Ling-Yu,Lin, Chia-Wen,et al. Depth-Preserving Warping for Stereo Image Retargeting[J]. IEEE TRANSACTIONS ON IMAGE PROCESSING,2015,24(9):2811-2826.
APA	Li, Bing,Duan, Ling-Yu,Lin, Chia-Wen,Huang, Tiejun,&Gao, Wen.(2015).Depth-Preserving Warping for Stereo Image Retargeting.IEEE TRANSACTIONS ON IMAGE PROCESSING,24(9),2811-2826.
MLA	Li, Bing,et al."Depth-Preserving Warping for Stereo Image Retargeting".IEEE TRANSACTIONS ON IMAGE PROCESSING 24.9(2015):2811-2826.