Gated Object-Attribute Matching Network for Detailed Image Caption

doi:10.1155/2020/9562587

	Gated Object-Attribute Matching Network for Detailed Image Caption
	Yun, Jing 1,2; Xu, ZhiWei 3; Gao, GuangLai 1
	2020-01-13
发表期刊	MATHEMATICAL PROBLEMS IN ENGINEERING
ISSN	1024-123X
卷号	2020 页码:11
摘要	Image caption enables computers to generate a text description of images automatically. However, the generated description is not good enough recently. Computers can describe what objects are in the image but cannot give more details about these objects. In this study, we present a novel image caption approach to give more details when describing objects. In detail, a visual attention-based LSTM is used to find the objects, as well as a semantic attention-based LSTM is used for giving semantic attributes. At last, a gated object-attribute matching network is used to match the objects to their semantic attributes. The experiments on the public datasets of Flickr30k and MSCOCO demonstrate that the proposed approach improved the quality of the image caption, compared with the most advanced methods at present.
DOI	10.1155/2020/9562587
收录类别	SCI
语种	英语
资助项目	Natural Science Foundation of Education Department Inner Mongolian Autonomous Region[NJZY19083]
WOS研究方向	Engineering ; Mathematics
WOS类目	Engineering, Multidisciplinary ; Mathematics, Interdisciplinary Applications
WOS记录号	WOS:000510035000007
出版者	HINDAWI LTD
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/14740
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Yun, Jing
作者单位	1.Inner Mongolia Univ, Dept Comp Sci, Hohhot 010021, Peoples R China 2.Inner Mongolia Univ Technol, Coll Data Sci & Applicat, Hohhot 010080, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, Beijing 100080, Peoples R China
推荐引用方式 GB/T 7714	Yun, Jing,Xu, ZhiWei,Gao, GuangLai. Gated Object-Attribute Matching Network for Detailed Image Caption[J]. MATHEMATICAL PROBLEMS IN ENGINEERING,2020,2020:11.
APA	Yun, Jing,Xu, ZhiWei,&Gao, GuangLai.(2020).Gated Object-Attribute Matching Network for Detailed Image Caption.MATHEMATICAL PROBLEMS IN ENGINEERING,2020,11.
MLA	Yun, Jing,et al."Gated Object-Attribute Matching Network for Detailed Image Caption".MATHEMATICAL PROBLEMS IN ENGINEERING 2020(2020):11.