Panoramic Light Field From Hand-Held Video and Its Sampling for Real-Time Rendering

doi:10.1109/TCSVT.2019.2900051

	Panoramic Light Field From Hand-Held Video and Its Sampling for Real-Time Rendering
	Zhao, Qiang 1; Dai, Feng 1; Lv, Jing 1; Ma, Yike 1; Zhang, Yongdong 2
	2020-04-01
发表期刊	IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
ISSN	1051-8215
卷号	30 期号:4 页码:1011-1021
摘要	By providing angular and spatial information of light rays, light field images are widely used in many applications. To capture large field of view light field, existing approaches either stitch small field of view light fields, whose apertures are also small, or leverage specialized equipments, which are not accessible to ordinary users. In this paper, we present a method to extract fully 360 degrees field of view panoramic light fields from densely sampled hand-held videos. Unlike previous works, our method handles the large exposure variation and motion blur problems, which are common in the panoramic capture and hand-held videos. To provide real-time rendering performance, our method applies light field sampling to the extracted panoramic light field. Based on the unstructured representation, our method can sample the light field without explicit parameterization. We formulate the sampling problem into a set multicover problem and solve it globally using integer linear programming. Compared with the greedy based method, our approach can use much less video frames to represent the panoramic light field, but still can get better rendering results.
关键词	Cameras Rendering (computer graphics) Streaming media Light fields Real-time systems Apertures Integer linear programming Panoramic light field hand-held sampling set multicover problem integer linear programming
DOI	10.1109/TCSVT.2019.2900051
收录类别	SCI
语种	英语
资助项目	National Key R&D Program of China[2018YFB0804203] ; National Natural Science Foundation of China[61525206] ; National Natural Science Foundation of China[61702479] ; National Natural Science Foundation of China[61771458] ; Beijing Municipal Science and Technology Project[Z181100008918006] ; Science and Technology Service Network Initiative of the Chinese Academy of Sciences[KFJ-STSZDTP-070]
WOS研究方向	Engineering
WOS类目	Engineering, Electrical & Electronic
WOS记录号	WOS:000561099300009
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：5[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/15781
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Dai, Feng
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China 2.Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230026, Peoples R China
推荐引用方式 GB/T 7714	Zhao, Qiang,Dai, Feng,Lv, Jing,et al. Panoramic Light Field From Hand-Held Video and Its Sampling for Real-Time Rendering[J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,2020,30(4):1011-1021.
APA	Zhao, Qiang,Dai, Feng,Lv, Jing,Ma, Yike,&Zhang, Yongdong.(2020).Panoramic Light Field From Hand-Held Video and Its Sampling for Real-Time Rendering.IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,30(4),1011-1021.
MLA	Zhao, Qiang,et al."Panoramic Light Field From Hand-Held Video and Its Sampling for Real-Time Rendering".IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 30.4(2020):1011-1021.