Hyperspectral Light Field stereo Matching

doi:10.1109/TPAMI.2018.2827049

	Hyperspectral Light Field stereo Matching
	Zhu, Kang 1,2; Xue, Yujia 3; Fu, Qiang 1; Kang, Sing Bing 4; Chen, Xilin 2; Yu, Jingyi 1,5
	2019-05-01
发表期刊	IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
ISSN	0162-8828
卷号	41 期号:5 页码:1131-1143
摘要	In this paper, we describe how scene depth can be extracted using a hyperspectral light field capture (H-LF) system. Our H-LF system consists of a 5 x 6 array of cameras, with each camera sampling a different narrow band in the visible spectrum. There are two parts to extracting scene depth. The first part is our novel cross-spectral pairwise matching technique, which involves a new spectral-invariant feature descriptor and its companion matching metric we call bidirectional weighted normalized cross correlation (BWNCC). The second part, namely, H-LF stereo matching, uses a combination of spectral-dependent correspondence and defocus cues. These two new cost terms are integrated into a Markov Random Field (MRF) for disparity estimation. Experiments on synthetic and real H-LF data show that our approach can produce high-quality disparity maps. We also show that these results can be used to produce the complete plenoptic cube in addition to synthesizing all-focus and defocused color images under different sensor spectral responses.
关键词	Hyperspectral light fields stereo matching spectral-invariant feature descriptor spectral-aware defocus cues
DOI	10.1109/TPAMI.2018.2827049
收录类别	SCI
语种	英语
资助项目	STCSM[17XD1402900] ; STCSM[17JC1403800]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:000463607400008
出版者	IEEE COMPUTER SOC
引用统计	被引频次：19[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/4286
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Yu, Jingyi
作者单位	1.Shanghai Tech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China 2.Chinese Acad Sci, Key Lab Intelligent Informat Proc, Inst Comp Technol, Beijing 100864, Peoples R China 3.Plex VR Inc, Shanghai 201203, Peoples R China 4.Microsoft Res, Redmond, WA 98052 USA 5.Univ Delaware, Dept Comp & Informat Sci, Newark, DE 19716 USA
推荐引用方式 GB/T 7714	Zhu, Kang,Xue, Yujia,Fu, Qiang,et al. Hyperspectral Light Field stereo Matching[J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,2019,41(5):1131-1143.
APA	Zhu, Kang,Xue, Yujia,Fu, Qiang,Kang, Sing Bing,Chen, Xilin,&Yu, Jingyi.(2019).Hyperspectral Light Field stereo Matching.IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,41(5),1131-1143.
MLA	Zhu, Kang,et al."Hyperspectral Light Field stereo Matching".IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 41.5(2019):1131-1143.