Affective Visualization and Retrieval for Music Video

doi:10.1109/TMM.2010.2059634

	Affective Visualization and Retrieval for Music Video
	Zhang, Shiliang 1; Huang, Qingming 2; Jiang, Shuqiang 1; Gao, Wen 1; Tian, Qi 3
	2010-10-01
发表期刊	IEEE TRANSACTIONS ON MULTIMEDIA
ISSN	1520-9210
卷号	12 期号:6 页码:510-522
摘要	In modern times, music video (MV) has become an important favorite pastime to people because of its conciseness, convenience, and the ability to bring both audio and visual experiences to audiences. As the amount of MVs is explosively increasing, it has become an important task to develop new techniques for effective MV analysis, retrieval, and management. By stimulating the human affective response mechanism, affective video content analysis extracts the affective information contained in videos, and, with the affective information, natural, user-friendly, and effective MV access strategies could be developed. In this paper, a novel integrated system (i.MV) is proposed for personalized MV affective analysis, visualization, and retrieval. In i.MV, we not only perform the personalized MV affective analysis, which is a challenging and insufficiently covered problem in current affective content analysis field, but also propose novel affective visualization to convert the abstract affective states intuitive and friendly to users. Based on the affective analysis and visualization, affective information based MV retrieval is achieved. Both comprehensive experiments and subjective user studies on a large MV dataset demonstrate that our personalized affective analysis is more effective than the previous algorithms. In addition, affective visualization is proved to be more suitable for affective information-based MV retrieval than the commonly used affective state representation strategies.
关键词	Affective content analysis affective visualization dimensional affective model support vector regression
DOI	10.1109/TMM.2010.2059634
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[60833006] ; National Natural Science Foundation of China[60702035] ; National Hi-Tech Development Program under the 863 Program of China[2006AA01Z117] ; Beijing Natural Science Foundation[4092042]
WOS研究方向	Computer Science ; Telecommunications
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
WOS记录号	WOS:000283291900005
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：62[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/12113
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Zhang, Shiliang
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China 2.Chinese Acad Sci, Grad Univ, Beijing 100190, Peoples R China 3.Univ Texas San Antonio, Dept Comp Sci, San Antonio, TX 78249 USA
推荐引用方式 GB/T 7714	Zhang, Shiliang,Huang, Qingming,Jiang, Shuqiang,et al. Affective Visualization and Retrieval for Music Video[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2010,12(6):510-522.
APA	Zhang, Shiliang,Huang, Qingming,Jiang, Shuqiang,Gao, Wen,&Tian, Qi.(2010).Affective Visualization and Retrieval for Music Video.IEEE TRANSACTIONS ON MULTIMEDIA,12(6),510-522.
MLA	Zhang, Shiliang,et al."Affective Visualization and Retrieval for Music Video".IEEE TRANSACTIONS ON MULTIMEDIA 12.6(2010):510-522.