Templateless Non-Rigid Reconstruction and Motion Tracking With a Single RGB-D Camera

doi:10.1109/TIP.2017.2740624

	Templateless Non-Rigid Reconstruction and Motion Tracking With a Single RGB-D Camera
	Wang, Kangkan 1,2; Zhang, Guofeng 3; Xia, Shihong 2
	2017-12-01
发表期刊	IEEE TRANSACTIONS ON IMAGE PROCESSING
ISSN	1057-7149
卷号	26 期号:12 页码:5966-5979
摘要	We present a novel templateless approach for nonrigid reconstruction and motion tracking using a single RGB-D camera. Without any template prior, our system achieves accurate reconstruction and tracking for considerably deformable objects. To robustly register the input sequence of partial depth scans with dynamic motion, we propose an efficient local-to-global hierarchical optimization framework inspired by the idea of traditional structure-from-motion. Our proposed framework mainly consists of two stages, local nonrigid bundle adjustment and global optimization. To eliminate error accumulation during the nonrigid registration of loop motion sequences, we split the full sequence into several segments and apply local nonrigid bundle adjustment to align each segment locally. Global optimization is then adopted to combine all segments and handle the drift problem through loop-closure constraint. By fitting to the input partial data, a deforming 3D model sequence of dynamic objects is finally generated. Experiments on both synthetic and real test data sets and comparisons with state of the art demonstrate that our approach can handle considerable motions robustly and efficiently, and reconstruct high-quality 3D model sequences without drift.
关键词	Templateless non-rigid reconstruction motion tracking
DOI	10.1109/TIP.2017.2740624
收录类别	SCI
语种	英语
资助项目	Natural Science Foundation of China[61602444] ; Natural Science Foundation of China[61672457] ; Knowledge Innovation Program of the Institute of Computing Technology of the Chinese Academy of Sciences[ICT20166040] ; Science and Technology Service Network Initiative of Chinese Academy of Sciences[KFJ-STS-ZDTP-017]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:000412433000026
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：19[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/6766
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Wang, Kangkan
作者单位	1.Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Jiangsu, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China 3.Zhejiang Univ, State Key Lab CAD&CG, Hangzhou 310058, Zhejiang, Peoples R China
推荐引用方式 GB/T 7714	Wang, Kangkan,Zhang, Guofeng,Xia, Shihong. Templateless Non-Rigid Reconstruction and Motion Tracking With a Single RGB-D Camera[J]. IEEE TRANSACTIONS ON IMAGE PROCESSING,2017,26(12):5966-5979.
APA	Wang, Kangkan,Zhang, Guofeng,&Xia, Shihong.(2017).Templateless Non-Rigid Reconstruction and Motion Tracking With a Single RGB-D Camera.IEEE TRANSACTIONS ON IMAGE PROCESSING,26(12),5966-5979.
MLA	Wang, Kangkan,et al."Templateless Non-Rigid Reconstruction and Motion Tracking With a Single RGB-D Camera".IEEE TRANSACTIONS ON IMAGE PROCESSING 26.12(2017):5966-5979.