Institute of Computing Technology, Chinese Academy IR
Incorporating texture and silhouette for video-based person re-identification | |
Bai, Shutao1,2; Chang, Hong1,2; Ma, Bingpeng2 | |
2024-12-01 | |
发表期刊 | PATTERN RECOGNITION |
ISSN | 0031-3203 |
卷号 | 156页码:13 |
摘要 | Silhouette is an effective modality in video-based person re-identification (ReID) since it contains features (e.g., e . g ., stature and gait) complementary to the RGB modality. However, recent silhouette-assisted methods have not fully explored the spatial-temporal relations within each modality or considered the cross-modal complementarity in fusion. To address these two issues, we propose a Complete Relational Framework that includes two key components. The first component, Spatial-Temporal Relational Module (STRM), explores the spatiotemporal relations. STRM decomposes the video's spatiotemporal context into local/fine-grained and global/semantic aspects, modeling them sequentially to enhance the representation of each modality. The second component, Modality-Channel Relational Module (MCRM), explores the complementarity between RGB and silhouette videos. MCRM aligns two modalities semantically and multiplies them to capture complementary interrelations. With these two modules focusing on intra- and cross-modal relationships, our method achieves superior results across multiple benchmarks with minimal additional parameters and FLOPs. Code and models are available at https://github.com/baist/crf. |
关键词 | Silhouette Relational modeling Decomposition |
DOI | 10.1016/j.patcog.2024.110759 |
收录类别 | SCI |
语种 | 英语 |
资助项目 | National Natural dation of China (NSFC)[62276246] ; Fundamental Funds for the Central Universities |
WOS研究方向 | Computer Science ; Engineering |
WOS类目 | Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic |
WOS记录号 | WOS:001282438900001 |
出版者 | ELSEVIER SCI LTD |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://119.78.100.204/handle/2XEOYT63/39698 |
专题 | 中国科学院计算技术研究所期刊论文_英文 |
通讯作者 | Ma, Bingpeng |
作者单位 | 1.Chinese Acad Sci, CAS, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China |
推荐引用方式 GB/T 7714 | Bai, Shutao,Chang, Hong,Ma, Bingpeng. Incorporating texture and silhouette for video-based person re-identification[J]. PATTERN RECOGNITION,2024,156:13. |
APA | Bai, Shutao,Chang, Hong,&Ma, Bingpeng.(2024).Incorporating texture and silhouette for video-based person re-identification.PATTERN RECOGNITION,156,13. |
MLA | Bai, Shutao,et al."Incorporating texture and silhouette for video-based person re-identification".PATTERN RECOGNITION 156(2024):13. |
条目包含的文件 | 条目无相关文件。 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论