Scalable storyboards in handheld devices: applications and evaluation metrics

doi:10.1007/s11042-014-2421-4

	Scalable storyboards in handheld devices: applications and evaluation metrics
	Herranz, Luis; Jiang, Shuqiang
	2016-10-01
发表期刊	MULTIMEDIA TOOLS AND APPLICATIONS
ISSN	1380-7501
卷号	75 期号:20 页码:12597-12625
摘要	Summaries are an essential component of video retrieval and browsing systems. Most research in video summarization has focused on content analysis to obtain compact yet comprehensive representations of video items. However, important aspects such as how they can be effectively integrated in mobile interfaces and how to predict the quality and usability of the summaries have not been investigated. Conventional summaries are limited to a single instance with certain length (i.e. a single scale). In contrast, scalable summaries target representations with multiple scales, that is, a set of summaries with increasing length in which longer summaries include more information about the video. Thus, scalability provides high flexibility that can be exploited in devices such as smartphones or tablets to provide versions of the summary adapted to the limited visualization area. In this paper, we explore the application of scalable storyboards to summary adaptation and zoomable video navigation in handheld devices. By introducing a new adaptation dimension related with the summarization scale, we can formulate navigation and adaptation in a two-dimensional adaptation space, where different navigation actions modify the trajectory in that space. We also describe the challenges to evaluate scalable summaries and some usability issues that arise from having multiple scales, proposing some objective metrics that can provide useful insight about their potential quality and usability without requiring very costly user studies. Experimental results show a reasonable agreement with the trends shown in subjective evaluations. Experiments also show that content-based scalable storyboards are less redundant and useful than the content-blind baselines.
关键词	Scalable storyboards Video browsing Usability Quality metrics
DOI	10.1007/s11042-014-2421-4
收录类别	SCI
语种	英语
资助项目	National Basic Research Program of China (973 Program)[2012CB316400] ; National Natural Science Foundation of China[61322212] ; National Natural Science Foundation of China[61035001] ; National Natural Science Foundation of China[61350110237] ; National Hi-Tech Development Program (863 Program) of China[2014AA015202] ; Chinese Academy of Sciences Fellowships for Young International Scientists[2011Y1GB05] ; Lenovo Outstanding Young Scientists Program (LOYS)
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Information Systems ; Computer Science, Software Engineering ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS记录号	WOS:000382994700018
出版者	SPRINGER
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/8188
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Herranz, Luis
作者单位	Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Herranz, Luis,Jiang, Shuqiang. Scalable storyboards in handheld devices: applications and evaluation metrics[J]. MULTIMEDIA TOOLS AND APPLICATIONS,2016,75(20):12597-12625.
APA	Herranz, Luis,&Jiang, Shuqiang.(2016).Scalable storyboards in handheld devices: applications and evaluation metrics.MULTIMEDIA TOOLS AND APPLICATIONS,75(20),12597-12625.
MLA	Herranz, Luis,et al."Scalable storyboards in handheld devices: applications and evaluation metrics".MULTIMEDIA TOOLS AND APPLICATIONS 75.20(2016):12597-12625.