Motion Feature Aggregation for Video-Based Person Re-Identification

doi:10.1109/TIP.2022.3175593

	Motion Feature Aggregation for Video-Based Person Re-Identification
	Gu, Xinqian 1,2; Chang, Hong 1,2; Ma, Bingpeng 3; Shan, Shiguang 3,4,5
	2022
发表期刊	IEEE TRANSACTIONS ON IMAGE PROCESSING
ISSN	1057-7149
卷号	31 页码:3908-3919
摘要	Most video-based person re-identification (re-id) methods only focus on appearance features but neglect motion features. In fact, motion features can help to distinguish the target persons that are hard to be identified only by appearance features. However, most existing temporal information modeling methods cannot extract motion features effectively or efficiently for v ideo-based re-id. In this paper, we propose a more efficient Motion Feature Aggregation (MFA) method to model and aggregate motion information in the feature map level for video-based re-id. The proposed MFA consists of (i) a coarse-grained motion learning module, which extracts coarse-grained motion features based on the position changes of body parts over time, and (ii) a fine-grained motion learning module, which extracts fine-grained motion features based on the appearance changes of body parts over time. These two modules can model motion information from different granularities and are complementary to each other. It is easy to combine the proposed method with existing network architectures for end-to-end training. Extensive experiments on four widely used datasets demonstrate that the motion features extracted by MFA are crucial complements to appearance features for video-based re-id, especially for the scenario with large appearance changes. Besides, the results on LS-VID, the current largest publicly available video-based re-id dataset, surpass the state-of-the-art methods by a large margin. The code is available at: https://github.com/guxinqian/Simple-ReID.
关键词	Feature extraction Optical imaging Computational modeling Spatiotemporal phenomena Data mining Training Tracking Video-based person re-identification temporal information modeling motion feature extraction
DOI	10.1109/TIP.2022.3175593
收录类别	SCI
语种	英语
资助项目	National Key Research and Development Program of China[2017YFA0700800] ; Natural Science Foundation of China (NSFC)[61876171] ; Natural Science Foundation of China (NSFC)[61976203]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:000809404700003
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：12[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/19611
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Chang, Hong
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci UCAS, Sch Comp Sci & Technol, Beijing, Peoples R China 3.UCAS, Sch Comp Sci & Technol, Beijing 100049, Peoples R China 4.Chinese Acad Sci, Key Lab Intelligent Informat Proc, Inst Comp Technol, Beijing 100190, Peoples R China 5.Peng Chong Lab, Shenzhen 518055, Peoples R China
推荐引用方式 GB/T 7714	Gu, Xinqian,Chang, Hong,Ma, Bingpeng,et al. Motion Feature Aggregation for Video-Based Person Re-Identification[J]. IEEE TRANSACTIONS ON IMAGE PROCESSING,2022,31:3908-3919.
APA	Gu, Xinqian,Chang, Hong,Ma, Bingpeng,&Shan, Shiguang.(2022).Motion Feature Aggregation for Video-Based Person Re-Identification.IEEE TRANSACTIONS ON IMAGE PROCESSING,31,3908-3919.
MLA	Gu, Xinqian,et al."Motion Feature Aggregation for Video-Based Person Re-Identification".IEEE TRANSACTIONS ON IMAGE PROCESSING 31(2022):3908-3919.