Multi-View Facial Expressions Analysis of Autistic Children in Social Play

doi:10.1109/TAFFC.2025.3557458

	Multi-View Facial Expressions Analysis of Autistic Children in Social Play
	Zeng, Jiabei 1,2; Yuan, Yujian 1,2; Qu, Lu 3; Chang, Fei 1,2,4; Sun, Xuran 1,2; Gong, Jinqiuyu 2; Han, Xuling 5; Liu, Min 3,5; Zhao, Hang 5; Liu, Qiaoyun 3,5; Shan, Shiguang 1,2; Chen, Xilin 1,2
	2025-07-01
发表期刊	IEEE TRANSACTIONS ON AFFECTIVE COMPUTING
ISSN	1949-3045
卷号	16 期号:3 页码:2200-2214
摘要	Atypical facial expressions during interaction are among the early symptoms of autism spectrum disorder (ASD) and are included in standard diagnostic assessments. However, current methods rely on subjective human judgments, introducing bias and limiting objectivity. This paper proposes an automated framework for objective and quantitative assessment of autistic children's facial expressions during social play. Initially, we utilize four synchronized cameras to record interactions between ASD children and teachers during structured activities dominated by the teacher. To address challenges posed by head movements and occluded faces, we introduce a multi-view facial expression recognition strategy. Its effectiveness is demonstrated by experiments in real-world applications. To quantify the patterns of affect status and the dynamic complexity of facial expressions, we use the temporally accumulated distribution of the basic facial expressions and the multi-dimensional multi-scale entropy of the facial expression sequence. Analysis of these features revealed significant differences between ASD and TD groups. Experimental results, derived from our quantified features, confirm conclusions drawn from previous research and experiential observations. With these facial expression features, ASD and typically developing (TD) children are accurately classified (accuracy 92.1%, precision 94.4%, 89.5% sensitivity, 94.7% specificity) in empirical experiments, suggesting the potential of our framework for improved ASD assessment.
关键词	Face recognition Autism Faces Feature extraction Cameras Accuracy Pediatrics Complexity theory Software Magnetic heads Multi-view facial expression recognition facial expression quantification facial expression analysis autism spectrum disorder assessment multi-scale entropy
DOI	10.1109/TAFFC.2025.3557458
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[62176248] ; Science Foundation of the Shanghai Education Commission: Major Program[2023SKZD07] ; China Postdoctoral Science Foundation[2023M731103]
WOS研究方向	Computer Science
WOS类目	Computer Science, Artificial Intelligence ; Computer Science, Cybernetics
WOS记录号	WOS:001566959000024
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/41719
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Liu, Qiaoyun; Shan, Shiguang
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 101408, Peoples R China 3.East China Normal Univ, Shanghai Inst Artificial Intelligence Educ, Shanghai 200062, Peoples R China 4.Pengcheng Lab, Shenzhen 518055, Guangdong, Peoples R China 5.East China Normal Univ, Dept Rehabil Sci, Shanghai 200062, Peoples R China
推荐引用方式 GB/T 7714	Zeng, Jiabei,Yuan, Yujian,Qu, Lu,et al. Multi-View Facial Expressions Analysis of Autistic Children in Social Play[J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING,2025,16(3):2200-2214.
APA	Zeng, Jiabei.,Yuan, Yujian.,Qu, Lu.,Chang, Fei.,Sun, Xuran.,...&Chen, Xilin.(2025).Multi-View Facial Expressions Analysis of Autistic Children in Social Play.IEEE TRANSACTIONS ON AFFECTIVE COMPUTING,16(3),2200-2214.
MLA	Zeng, Jiabei,et al."Multi-View Facial Expressions Analysis of Autistic Children in Social Play".IEEE TRANSACTIONS ON AFFECTIVE COMPUTING 16.3(2025):2200-2214.