Temporal Upsampling of Depth Maps Using a Hybrid Camera

doi:10.1109/TVCG.2018.2812879

	Temporal Upsampling of Depth Maps Using a Hybrid Camera
	Yuan, Ming-Ze 1,2; Gao, Lin 1; Fu, Hongbo 3; Xia, Shihong 1
	2019-03-01
发表期刊	IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
ISSN	1077-2626
卷号	25 期号:3 页码:1591-1602
摘要	In recent years, consumer-level depth cameras have been adopted for various applications. However, they often produce depth maps at only a moderately high frame rate (approximately 30 frames per second), preventing them from being used for applications such as digitizing human performance involving fast motion. On the other hand, low-cost, high-frame-rate video cameras are available. This motivates us to develop a hybrid camera that consists of a high-frame-rate video camera and a low-frame-rate depth camera and to allow temporal interpolation of depth maps with the help of auxiliary color images. To achieve this, we develop a novel algorithm that reconstructs intermediate depth maps and estimates scene flow simultaneously. We test our algorithm on various examples involving fast, non-rigid motions of single or multiple objects. Our experiments show that our scene flow estimation method is more precise than a tracking-based method and the state-of-the-art techniques.
关键词	Hybrid camera scene flow estimation depth upsampling
DOI	10.1109/TVCG.2018.2812879
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61502453] ; National Natural Science Foundation of China[61772499] ; National Natural Science Foundation of China[61611130215] ; Royal Society-Newton Mobility Grant[IE150731] ; Science and Technology Service Network Initiative of Chinese Academy of Sciences[KFJ-STS-ZDTP-017] ; Knowledge Innovation Program of the Institute of Computing Technology of the Chinese Academy of Sciences[ICT20166040] ; Hong Kong Research Grants Council[CityU CityU 11237116] ; ACIM-SCM
WOS研究方向	Computer Science
WOS类目	Computer Science, Software Engineering
WOS记录号	WOS:000457824500012
出版者	IEEE COMPUTER SOC
引用统计	被引频次：10[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/3441
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Gao, Lin; Xia, Shihong
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100190, Peoples R China 3.City Univ Hong Kong, Sch Creat Media, Hong Kong, Peoples R China
推荐引用方式 GB/T 7714	Yuan, Ming-Ze,Gao, Lin,Fu, Hongbo,et al. Temporal Upsampling of Depth Maps Using a Hybrid Camera[J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS,2019,25(3):1591-1602.
APA	Yuan, Ming-Ze,Gao, Lin,Fu, Hongbo,&Xia, Shihong.(2019).Temporal Upsampling of Depth Maps Using a Hybrid Camera.IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS,25(3),1591-1602.
MLA	Yuan, Ming-Ze,et al."Temporal Upsampling of Depth Maps Using a Hybrid Camera".IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 25.3(2019):1591-1602.