Happiness detection with facial physiological measurement from hyperspectral imaging

doi:10.1016/j.compeleceng.2022.108332

	Happiness detection with facial physiological measurement from hyperspectral imaging
	Hao, Min 1,2; Zhang, Huiling 3; Liu, Guangyuan 1,2; Gokhale, Anu 4; Xu, Ya 5; Cai, Jing 5; Xie, Desheng
	2022-10-01
发表期刊	COMPUTERS & ELECTRICAL ENGINEERING
ISSN	0045-7906
卷号	103 页码:15
摘要	Hyperspectral imaging technology (HSI) can be used to remotely detect emotion levels in humans based on the tissue oxygen saturation (StO2) from their faces. Our prior research demonstrated some significant differences among the variations of StO2 in different facial regions of interest (ROIs) when the subjects are truly happy. Experiment is conducted for data collection with HSI where the subjects (a total of fifty participants, who rigidly conform to the research protocol) are required to show spontaneous emotions (calm, happy, and unhappy: angry). Based on the comprehensive analysis of musculoskeletal anatomy and facial action coding system (FACS), 19 ROIs have been determined. Consequently, a 19 dimensional StO2 vector is constructed as a feature input instead of employing the entire facial region. Lastly, experimental results through basic K-Nearest Neighbor (KNN) report an average accuracy rate of 83.32% when only considering fewer StO2 features. In addition, some experiments using other advanced machine learning methods also validate its effective recognition performance with facial StO2 as an affective indicator. Our findings demonstrate the possible practical feasibility of StO2 in happiness detection.
关键词	Facial analysis Happiness detection Hyperspectral imaging Spectral Reflectance Tissue oxygen saturation
DOI	10.1016/j.compeleceng.2022.108332
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61872301] ; National Natural Science Foundation of China[4112100917] ; Chongqing Key Laboratory of Non-linear Circuit and Intelligent Information Processing
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Hardware & Architecture ; Computer Science, Interdisciplinary Applications ; Engineering, Electrical & Electronic
WOS记录号	WOS:000865448600005
出版者	PERGAMON-ELSEVIER SCIENCE LTD
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/19761
专题	中国科学院计算技术研究所期刊论文
通讯作者	Liu, Guangyuan
作者单位	1.Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China 2.Chongqing Key Lab Nonlinear Circuit & Intelligent, Chongqing, Peoples R China 3.Chinese Acad Sci, Shenzhen Inst Adv Technol, Ctr High Performance Comp, Shenzhen 518055, Peoples R China 4.Illinois State Univ, Dept Technol, Normal, IL 61790 USA 5.Suson Co Ltd, Suzhou, Sichuan, Peoples R China
推荐引用方式 GB/T 7714	Hao, Min,Zhang, Huiling,Liu, Guangyuan,et al. Happiness detection with facial physiological measurement from hyperspectral imaging[J]. COMPUTERS & ELECTRICAL ENGINEERING,2022,103:15.
APA	Hao, Min.,Zhang, Huiling.,Liu, Guangyuan.,Gokhale, Anu.,Xu, Ya.,...&Xie, Desheng.(2022).Happiness detection with facial physiological measurement from hyperspectral imaging.COMPUTERS & ELECTRICAL ENGINEERING,103,15.
MLA	Hao, Min,et al."Happiness detection with facial physiological measurement from hyperspectral imaging".COMPUTERS & ELECTRICAL ENGINEERING 103(2022):15.