Gaze estimation with semi-supervised eye landmark detection as an auxiliary task

doi:10.1016/j.patcog.2023.109980

	Gaze estimation with semi-supervised eye landmark detection as an auxiliary task
	Sun, Yunjia 1,2; Zeng, Jiabei 1; Shan, Shiguang 1,2
	2024-02-01
发表期刊	PATTERN RECOGNITION
ISSN	0031-3203
卷号	146 页码:11
摘要	The changes in gaze are often reflected in the movements of eye landmarks, highlighting the relevance of eye landmark learning for accurate gaze estimation. To leverage eye landmarks, we propose a gaze estimation framework that incorporates eye landmark detection as an auxiliary task. However, obtaining eye landmark annotations for real-world gaze datasets is challenging. To address this, we exploit synthetic data, which provides precise eye landmark labels, by jointly training an eye landmark detector using labeled synthetic data and unlabeled real-world data in a semi-supervised manner. To reduce the influence of discrepancy between synthetic and real-world data, we improve the generalization ability of the landmark detector by performing a self-supervised learning strategy on a large scale of unlabeled real-world images. The proposed method outperforms other state-of-the-art gaze estimation methods on three gaze datasets, indicating the effectiveness of leveraging eye landmark detection as an auxiliary task to enhance gaze estimation performance.
关键词	Computer vision Gaze estimation Semi-supervised learning
DOI	10.1016/j.patcog.2023.109980
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[62176248]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:001097845200001
出版者	ELSEVIER SCI LTD
引用统计	被引频次：3[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/38112
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Zeng, Jiabei
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China
推荐引用方式 GB/T 7714	Sun, Yunjia,Zeng, Jiabei,Shan, Shiguang. Gaze estimation with semi-supervised eye landmark detection as an auxiliary task[J]. PATTERN RECOGNITION,2024,146:11.
APA	Sun, Yunjia,Zeng, Jiabei,&Shan, Shiguang.(2024).Gaze estimation with semi-supervised eye landmark detection as an auxiliary task.PATTERN RECOGNITION,146,11.
MLA	Sun, Yunjia,et al."Gaze estimation with semi-supervised eye landmark detection as an auxiliary task".PATTERN RECOGNITION 146(2024):11.