Free-Viewpoint Navigation of Indoor Scene with 360ffi Field of View

doi:10.3390/electronics12081954

	Free-Viewpoint Navigation of Indoor Scene with 360ffi Field of View
	Xu, Hang 1; Zhao, Qiang 2; Ma, Yike 2; Wang, Shuai 1,3; Yan, Chenggang 1,3; Dai, Feng 2
	2023-04-01
发表期刊	ELECTRONICS
卷号	12 期号:8 页码:16
摘要	By providing a 360 degrees field of view, spherical panoramas can convey vivid visual impressions. Thus, they are widely used in virtual reality systems and street view services. However, due to bandwidth or storage limitations, existing systems only provide sparsely captured panoramas and have limited interaction modes. Although there are methods that can synthesize novel views based on captured panoramas, the generated novel views all lie on the lines connecting existing views. Therefore these methods do not support free-viewpoint navigation. In this paper, we propose a new panoramic image-based rendering method for novel view generation. Our method represents each input panorama with a set of spherical superpixels and warps each superpixel individually so the method can deal with the occlusion and disocclusion problem. The warping is dominated by a two-term constraint, which can preserve the shape of the superpixel and ensure it is warped to the correct position determined by the 3D reconstruction of the scene. Our method can generate novel views that are far from input camera positions. Thus, it supports freely exploring the scene with a 360 degrees field of view. We compare our method with three previous methods on datasets captured by ourselves and by others. Experiments show that our method can obtain better results.
关键词	viewpoint navigation 360 degrees field of view multi-view stereo real-time rendering
DOI	10.3390/electronics12081954
收录类别	SCI
语种	英语
资助项目	National Key R&D Program of China[2022YFD2001601] ; National Nature Science Foundation of China[62072438] ; National Nature Science Foundation of China[U21B2024] ; National Nature Science Foundation of China[61931008] ; National Nature Science Foundation of China[62071415] ; Strategic Priority Research Program of Chinese Academy of Sciences[XDA28040000] ; Strategic Priority Research Program of Chinese Academy of Sciences[XDA28120000] ; Natural Science Foundation of Shandong Province[ZR2021MF094] ; Key R&D Plan of Shandong Province[2020CXGC010804] ; Central Leading Local Science and Technology Development Special Fund Project[YDZX2021122] ; Science & Technology Specific Projects in Agricultural High-tech Industrial Demonstration Area of the Yellow River Delta[2022SZX11]
WOS研究方向	Computer Science ; Engineering ; Physics
WOS类目	Computer Science, Information Systems ; Engineering, Electrical & Electronic ; Physics, Applied
WOS记录号	WOS:000980913600001
出版者	MDPI
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/21462
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Ma, Yike
作者单位	1.Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Beijing 100086, Peoples R China 3.Hangzhou Dianzi Univ, Lishui Inst, Lishui 323000, Peoples R China
推荐引用方式 GB/T 7714	Xu, Hang,Zhao, Qiang,Ma, Yike,et al. Free-Viewpoint Navigation of Indoor Scene with 360ffi Field of View[J]. ELECTRONICS,2023,12(8):16.
APA	Xu, Hang,Zhao, Qiang,Ma, Yike,Wang, Shuai,Yan, Chenggang,&Dai, Feng.(2023).Free-Viewpoint Navigation of Indoor Scene with 360ffi Field of View.ELECTRONICS,12(8),16.
MLA	Xu, Hang,et al."Free-Viewpoint Navigation of Indoor Scene with 360ffi Field of View".ELECTRONICS 12.8(2023):16.