Generation of virtual digital human for customer service industry

doi:10.1016/j.cag.2023.07.018

	Generation of virtual digital human for customer service industry
	Sun, Yanan 1; Sun, Zhiyao 1; Wen, Yu-Hui 2; Ye, Sheng 1; Lv, Tian 1; Yu, Minjing 3; Yi, Ran 4; Gao, Lin 5; Liu, Yong-Jin 1
	2023-10-01
发表期刊	COMPUTERS & GRAPHICS-UK
ISSN	0097-8493
卷号	115 页码:359-370
摘要	With the widespread development of digital technology, individuals' daily activities are inseparable from interaction with electronic devices. Researchers have become interested in developing novel methods, to enable users to experience social and emotional satisfaction that traditional face-to-face interaction provides. In this study, we propose a novel deep learning-based pipeline to generate virtual digital humans for customer service industry. Specifically, we propose a method to construct a database with template service actions. Furthermore, we propose a two-stage method for generating 2D virtual human videos with gestures and emotional lip-sync expressions. We have conducted qualitative and quantitative experiments on the proposed 2D virtual human video generation method. The results demonstrate that the method effectively generates high-quality virtual digital humans for the customer service industry.& COPY; 2023 Elsevier Ltd. All rights reserved.
关键词	2D virtual humans Service gestures Emotion editing Gesture generation
DOI	10.1016/j.cag.2023.07.018
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[62202257] ; National Natural Science Foundation of China[62002258] ; Beijing Jiaotong University Youth Elite Project[2023XKRC045] ; Shanghai Sailing Program[22YF1420300] ; Young Elite Scientists Sponsorship Program by CAST[2022QNRC001]
WOS研究方向	Computer Science
WOS类目	Computer Science, Software Engineering
WOS记录号	WOS:001047235200001
出版者	PERGAMON-ELSEVIER SCIENCE LTD
引用统计	被引频次：4[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/21346
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Wen, Yu-Hui; Yu, Minjing; Liu, Yong-Jin
作者单位	1.Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China 2.Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing Key Lab Traff Data Anal & Min, Beijing 100044, Peoples R China 3.Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China 4.Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China 5.Chinese Acad Sci, Inst Comp Technol, Beijing 100864, Peoples R China
推荐引用方式 GB/T 7714	Sun, Yanan,Sun, Zhiyao,Wen, Yu-Hui,et al. Generation of virtual digital human for customer service industry[J]. COMPUTERS & GRAPHICS-UK,2023,115:359-370.
APA	Sun, Yanan.,Sun, Zhiyao.,Wen, Yu-Hui.,Ye, Sheng.,Lv, Tian.,...&Liu, Yong-Jin.(2023).Generation of virtual digital human for customer service industry.COMPUTERS & GRAPHICS-UK,115,359-370.
MLA	Sun, Yanan,et al."Generation of virtual digital human for customer service industry".COMPUTERS & GRAPHICS-UK 115(2023):359-370.