Viewpoint Alignment and Discriminative Parts Enhancement in 3D Space for Vehicle ReID

doi:10.1109/TMM.2022.3154102

	Viewpoint Alignment and Discriminative Parts Enhancement in 3D Space for Vehicle ReID
	Meng, Dechao 1; Li, Liang 1; Liu, Xuejing 1; Gao, Lin 4; Huang, Qingming 2,3
	2023
发表期刊	IEEE TRANSACTIONS ON MULTIMEDIA
ISSN	1520-9210
卷号	25 页码:2954-2965
摘要	Vehicle Re-Identification is to find the same vehicle from images captured in different views under cross-camera scenarios. Traditional methods focus on depicting the holistic appearance of a vehicle, but they suffer from the hard samples with the same vehicle type and color. Recent works leverage the discriminative visual cues to solve this problem, where three challenges exist as follows. First, vehicle features are misaligned and distorted because of the viewpoint variance. Second, the discriminative visual cues are usually subtle, which is easy to be diluted by the large area of non-discriminative regions in subsequent average pooling modules. Third, these discriminative visual cues are dynamic for the same image when it compares with different vehicle images. To tackle the above problems, we project the vehicle images from 2D to 3D space and rotate them to the same view, and leverage the viewpoint aligned features to enhance the discriminative parts for vehicle ReID. In detail, our method consists of three sub-modules, 1) The 3D viewpoint alignment module restores the 3D information of the vehicle from a single vehicle image, and then rotates and re-renders it under fixed viewpoints. It enables fine-grained viewpoint alignment and relieves the distortion of the vehicle caused by the viewpoint variation. 2) The discriminative parts enhancement module performs feature enhancement guided by the prior distribution of distinctive parts. 3) The adaptive duplicated parts suppression module guides the network to focus on the most discriminative parts, which not only prevents the dilution of the high responses but also provides explainable evidence. The experimental results reveal our method achieves new state-of-the-art on large scale vehicle ReID dataset.
关键词	3D reconstruction feature enhancement vehicle ReID viewpoint alignment
DOI	10.1109/TMM.2022.3154102
收录类别	SCI
语种	英语
资助项目	National Key Ramp;D Program of China[2018AAA0102000] ; National Natural Science Foundation of China[61732007] ; Youth Innovation Promotion Association of Chinese Academy of Sciences[2020108] ; CCF-Baidu Open Fund[2021PP15002000] ; CAAI-Huawei MindSpore Open Fund
WOS研究方向	Computer Science ; Telecommunications
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
WOS记录号	WOS:001045742200001
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：5[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/21352
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Li, Liang
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 3.Univ Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China 4.Univ Chinese Acad Sci, Inst Comp Technol, Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Meng, Dechao,Li, Liang,Liu, Xuejing,et al. Viewpoint Alignment and Discriminative Parts Enhancement in 3D Space for Vehicle ReID[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2023,25:2954-2965.
APA	Meng, Dechao,Li, Liang,Liu, Xuejing,Gao, Lin,&Huang, Qingming.(2023).Viewpoint Alignment and Discriminative Parts Enhancement in 3D Space for Vehicle ReID.IEEE TRANSACTIONS ON MULTIMEDIA,25,2954-2965.
MLA	Meng, Dechao,et al."Viewpoint Alignment and Discriminative Parts Enhancement in 3D Space for Vehicle ReID".IEEE TRANSACTIONS ON MULTIMEDIA 25(2023):2954-2965.