Learning prototypes and similes on Grassmann manifold for spontaneous expression recognition

doi:10.1016/j.cviu.2015.08.006

	Learning prototypes and similes on Grassmann manifold for spontaneous expression recognition
	Liu, Mengyi; Wang, Ruiping; Shan, Shiguang; Chen, Xilin
	2016-06-01
发表期刊	COMPUTER VISION AND IMAGE UNDERSTANDING
ISSN	1077-3142
卷号	147 页码:95-101
摘要	Video-based spontaneous expression recognition is a challenging task due to the large inter-personal variations of both the expressing manners and the executing rates for the same expression category. One of the key is to explore robust representation method which can effectively capture the facial variations as well as alleviate the influence of personalities. In this paper, we propose to learn a kind of typical patterns that can be commonly shared by different subjects when performing expressions, namely "prototypes". Specifically, we first apply a statistical model (i.e. linear subspace) on facial regions to generate the specific expression patterns for each video. Then a clustering algorithm is employed on all these expression patterns and the cluster means are regarded as the "prototypes". Accordingly, we further design "simile" features to measure the similarities of personal specific patterns to our learned "prototypes". Both techniques are conducted on Grassmann manifold, which can enrich the feature encoding manners and better reveal the data structure by introducing intrinsic geodesics. Extensive experiments are conducted on both posed and spontaneous expression databases. All results show that our method outperforms the state-of-the-art and also possesses good transferable ability under cross-database scenario. (C) 2015 Elsevier Inc. All rights reserved.
关键词	Expression prototype Simile representation Grassmann manifold Spontaneous expression recognition
DOI	10.1016/j.cviu.2015.08.006
收录类别	SCI
语种	英语
资助项目	973 Program[2015CB351802] ; Natural Science Foundation of China[61390511] ; Natural Science Foundation of China[61222211] ; Natural Science Foundation of China[61379083] ; Youth Innovation Promotion Association CAS[2015085]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:000377052000010
出版者	ACADEMIC PRESS INC ELSEVIER SCIENCE
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/8397
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Shan, Shiguang
作者单位	Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Liu, Mengyi,Wang, Ruiping,Shan, Shiguang,et al. Learning prototypes and similes on Grassmann manifold for spontaneous expression recognition[J]. COMPUTER VISION AND IMAGE UNDERSTANDING,2016,147:95-101.
APA	Liu, Mengyi,Wang, Ruiping,Shan, Shiguang,&Chen, Xilin.(2016).Learning prototypes and similes on Grassmann manifold for spontaneous expression recognition.COMPUTER VISION AND IMAGE UNDERSTANDING,147,95-101.
MLA	Liu, Mengyi,et al."Learning prototypes and similes on Grassmann manifold for spontaneous expression recognition".COMPUTER VISION AND IMAGE UNDERSTANDING 147(2016):95-101.