Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning

doi:10.1109/TPAMI.2019.2891584

	Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning
	Han, Hu 1,2,3; Li, Jie 1,3; Jain, Anil K.4; Shan, Shiguang 1,3,5; Chen, Xilin 1,3
	2019-10-01
发表期刊	IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
ISSN	0162-8828
卷号	41 期号:10 页码:2333-2348
摘要	The explosive growth of digital images in video surveillance and social media has led to the significant need for efficient search of persons of interest in law enforcement and forensic applications. Despite tremendous progress in primary biometric traits (e.g., face and fingerprint) based person identification, a single biometric trait alone can not meet the desired recognition accuracy in forensic scenarios. Tattoos, as one of the important soft biometric traits, have been found to be valuable for assisting in person identification. However, tattoo search in a large collection of unconstrained images remains a difficult problem, and existing tattoo search methods mainly focus on matching cropped tattoos, which is different from real application scenarios. To close the gap, we propose an efficient tattoo search approach that is able to learn tattoo detection and compact representation jointly in a single convolutional neural network (CNN) via multi-task learning. While the features in the backbone network are shared by both tattoo detection and compact representation learning, individual latent layers of each sub-network optimize the shared features toward the detection and feature learning tasks, respectively. We resolve the small batch size issue inside the joint tattoo detection and compact representation learning network via random image stitch and preceding feature buffering. We evaluate the proposed tattoo search system using multiple public-domain tattoo benchmarks, and a gallery set with about 300K distracter tattoo images compiled from these datasets and images from the Internet. In addition, we also introduce a tattoo sketch dataset containing 300 tattoos for sketch-based tattoo search. Experimental results show that the proposed approach has superior performance in tattoo detection and tattoo search at scale compared to several state-of-the-art tattoo retrieval algorithms.
关键词	Large-scale tattoo search joint detection and representation learning sketch based search multi-task learning
DOI	10.1109/TPAMI.2019.2891584
收录类别	SCI
语种	英语
资助项目	Natural Science Foundation of China[61732004] ; Natural Science Foundation of China[61672496] ; Natural Science Foundation of China[61650202] ; Strategic Priority Research Program of CAS[XDB02070004] ; External Cooperation Program of CAS[GJHZ1843]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:000489763000005
出版者	IEEE COMPUTER SOC
引用统计	被引频次：28[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/4625
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Han, Hu
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China 2.Peng Cheng Lab, Shenzhen, Peoples R China 3.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 4.Michigan State Univ, Dept Comp Sci & Engn, E Lansing, MI 48824 USA 5.Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Han, Hu,Li, Jie,Jain, Anil K.,et al. Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning[J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,2019,41(10):2333-2348.
APA	Han, Hu,Li, Jie,Jain, Anil K.,Shan, Shiguang,&Chen, Xilin.(2019).Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning.IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,41(10),2333-2348.
MLA	Han, Hu,et al."Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning".IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 41.10(2019):2333-2348.