4D facial analysis: A survey of datasets, algorithms and applications

doi:10.1016/j.cag.2023.07.014

	4D facial analysis: A survey of datasets, algorithms and applications
	Liu, Yong-Jin 1; Wang, Baodong 2; Gao, Lin 3; Zhao, Junli 2; Yi, Ran 4; Yu, Minjing 5; Pan, Zhenkuan 2; Gu, Xianfeng 6
	2023-10-01
发表期刊	COMPUTERS & GRAPHICS-UK
ISSN	0097-8493
卷号	115 页码:423-445
摘要	Facial information plays an important role in human communication, e.g., rich and nuanced facial expressions effectively convey emotions. Traditional data such as 2D facial images and videos are susceptible to perturbation from lighting and occlusion, while 3D static data such as mesh models lack the temporal information which is necessary to describe facial dynamics. Therefore, researches on 4D facial data (3D facial models together with time as the fourth dimension) have received considerable attention in recent years. 4D data can simultaneously reflect the complex facial temporal and space information. To fully explore these characteristics, we present a systematic overview of the 4D facial research in this paper. We give a review in terms of historical development of 4D facial datasets, acquisition process of these datasets, related algorithms and applications, and discussion of outstanding issues. We also analyze the 4D facial research works by summarizing and comparing them; in particular, we present the results on three kinds of tasks conducted on the 4D facial datasets, i.e., expression-related tasks (AU detection, expression recognition and retrieval), generation tasks (3D facial reconstruction, facial expression and facial animation generation), and other tasks (facial registration, facial recognition and facial disease diagnosis). Finally, we summarize the future research directions.& COPY; 2023 Elsevier Ltd. All rights reserved.
关键词	4D facial datasets 4D face analysis Dynamic facial expressions
DOI	10.1016/j.cag.2023.07.014
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[62172247] ; National Natural Science Foundation of China[61702293] ; National Natural Science Foundation of China[3R01LM012434-05S1] ; NIH[NIH1R21EB029733-01A1] ; NIH[FAIN-2115095] ; NSF[L222008] ; Beijing Natural Science Foundation[22YF1420300] ; Shanghai Sailing Program[2022QNRC001] ; Young Elite Scientists Sponsorship Program by CAST[ZR2019LZH002] ; Natural Science Foundation of Shandong Province ; [62002258]
WOS研究方向	Computer Science
WOS类目	Computer Science, Software Engineering
WOS记录号	WOS:001056672800001
出版者	PERGAMON-ELSEVIER SCIENCE LTD
引用统计	被引频次：5[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/21380
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Zhao, Junli; Gu, Xianfeng
作者单位	1.Tsinghua Univ, Dept Comp Sci & Technol, MOE Key Lab Pervas Comp, BNRist, Beijing 100084, Peoples R China 2.Qingdao Univ, Coll Comp Sci & Technol, Qingdao 266071, Peoples R China 3.Chinese Acad Sci, Beijing Key Lab Mobile Comp & Pervas Device, Inst Comp Technol, Beijing 100190, Peoples R China 4.Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China 5.Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China 6.SUNY Stony Brook, Dept Comp Sci, Stony Brook, NY 11790 USA
推荐引用方式 GB/T 7714	Liu, Yong-Jin,Wang, Baodong,Gao, Lin,et al. 4D facial analysis: A survey of datasets, algorithms and applications[J]. COMPUTERS & GRAPHICS-UK,2023,115:423-445.
APA	Liu, Yong-Jin.,Wang, Baodong.,Gao, Lin.,Zhao, Junli.,Yi, Ran.,...&Gu, Xianfeng.(2023).4D facial analysis: A survey of datasets, algorithms and applications.COMPUTERS & GRAPHICS-UK,115,423-445.
MLA	Liu, Yong-Jin,et al."4D facial analysis: A survey of datasets, algorithms and applications".COMPUTERS & GRAPHICS-UK 115(2023):423-445.