TSAR-MVS: Textureless-aware segmentation and correlative refinement guided multi-view stereo

doi:10.1016/j.patcog.2024.110565

	TSAR-MVS: Textureless-aware segmentation and correlative refinement guided multi-view stereo
	Yuan, Zhenlong 1; Cao, Jiakai 1; Wang, Zhaoqi 1; Li, Zhaoxin 2,3
	2024-10-01
发表期刊	PATTERN RECOGNITION
ISSN	0031-3203
卷号	154 页码:15
摘要	The reconstruction of textureless areas has long been a challenging problem in MVS due to lack of reliable pixel correspondences between images. In this paper, we propose the Textureless -aware Segmentation And Correlative Refinement guided Multi -View Stereo (TSAR-MVS), a novel method that effectively tackles challenges posed by textureless areas in 3D reconstruction through filtering, refinement and segmentation. First, we implement the joint hypothesis filtering, a technique that merges a confidence estimator with a disparity discontinuity detector to eliminate incorrect depth estimations. Second, to spread the pixels with confident depth, we introduce an iterative correlation refinement strategy that leverages RANSAC to generate 3D planes based on superpixels, succeeded by a weighted median filter for broadening the influence of accurately determined pixels. Finally, we present a textureless -aware segmentation method that leverages edge detection and line detection for accurately identify large textureless regions for further depth completion. Experiments on ETH3D, Tanks & Temples and Strecha datasets demonstrate the superior performance and strong generalization capability of our proposed method.
关键词	Multi-view stereo 3D reconstruction Filtering Superpixel Segmentation
DOI	10.1016/j.patcog.2024.110565
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[62172392] ; Strategic Priority Research Program of the Chinese Academy of Sciences[XDA0450203] ; Innovation Research Program of ICT[E261070]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:001242660300001
出版者	ELSEVIER SCI LTD
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/40019
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Li, Zhaoxin
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China 2.Chinese Acad Agr Sci, Agr Informat Inst, Beijing 100081, Peoples R China 3.Minist Agr & Rural Affairs, Key Lab Agr Big Data, Beijing 100081, Peoples R China
推荐引用方式 GB/T 7714	Yuan, Zhenlong,Cao, Jiakai,Wang, Zhaoqi,et al. TSAR-MVS: Textureless-aware segmentation and correlative refinement guided multi-view stereo[J]. PATTERN RECOGNITION,2024,154:15.
APA	Yuan, Zhenlong,Cao, Jiakai,Wang, Zhaoqi,&Li, Zhaoxin.(2024).TSAR-MVS: Textureless-aware segmentation and correlative refinement guided multi-view stereo.PATTERN RECOGNITION,154,15.
MLA	Yuan, Zhenlong,et al."TSAR-MVS: Textureless-aware segmentation and correlative refinement guided multi-view stereo".PATTERN RECOGNITION 154(2024):15.