Meta-Wrapper: Differentiable Wrapping Operator for User Interest Selection in CTR Prediction

doi:10.1109/TPAMI.2021.3103741

	Meta-Wrapper: Differentiable Wrapping Operator for User Interest Selection in CTR Prediction
	Cao, Tianwei 1; Xu, Qianqian 2; Yang, Zhiyong 1; Huang, Qingming 2,3,4
	2022-11-01
发表期刊	IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
ISSN	0162-8828
卷号	44 期号:11 页码:8449-8464
摘要	Click-through rate (CTR) prediction, whose goal is to predict the probability of the user to click on an item, has become increasingly significant in the recommender systems. Recently, some deep learning models with the ability to automatically extract the user interest from his/her behaviors have achieved great success. In these work, the attention mechanism is used to select the user interested items in historical behaviors, improving the performance of the CTR predictor. Normally, these attentive modules can be jointly trained with the base predictor by using gradient descents. In this paper, we regard user interest modeling as a feature selection problem, which we call user interest selection. For such a problem, we propose a novel approach under the framework of the wrapper method, which is named Meta-Wrapper. More specifically, we use a differentiable module as our wrapping operator and then recast its learning problem as a continuous bilevel optimization. Moreover, we use a meta-learning algorithm to solve the optimization and theoretically prove its convergence. Meanwhile, we also provide theoretical analysis to show that our proposed method 1) efficiencies the wrapper-based feature selection, and 2) achieves better resistance to overfitting. Finally, extensive experiments on three public datasets manifest the superiority of our method in boosting the performance of CTR prediction.
关键词	Feature extraction Predictive models Wrapping Frequency modulation Computational modeling Training Recommender systems Click-through rate prediction recommender system bilevel optimization meta-learning
DOI	10.1109/TPAMI.2021.3103741
收录类别	SCI
语种	英语
资助项目	National Key R&D Program of China[2018AAA0102003] ; National Natural Science Foundation of China[61931008] ; National Natural Science Foundation of China[61620106009] ; National Natural Science Foundation of China[61836002] ; National Natural Science Foundation of China[61976202] ; Fundamental Research Funds for the Central Universities ; Youth Innovation Promotion Association CAS ; Strategic Priority Research Program of Chinese Academy of Sciences[XDB28000000] ; National Postdoctoral Program for Innovative Talents[BX2021298]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:000864325900082
出版者	IEEE COMPUTER SOC
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/19775
专题	中国科学院计算技术研究所期刊论文
通讯作者	Xu, Qianqian; Huang, Qingming
作者单位	1.Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 101408, Peoples R China 2.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China 3.Univ Chinese Acad Sci, Sch Comp Sci & Technol, Key Lab Big Data Min & Knowledge Management BDKM, Beijing 101408, Peoples R China 4.Peng Cheng Lab, Shenzhen 518055, Peoples R China
推荐引用方式 GB/T 7714	Cao, Tianwei,Xu, Qianqian,Yang, Zhiyong,et al. Meta-Wrapper: Differentiable Wrapping Operator for User Interest Selection in CTR Prediction[J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,2022,44(11):8449-8464.
APA	Cao, Tianwei,Xu, Qianqian,Yang, Zhiyong,&Huang, Qingming.(2022).Meta-Wrapper: Differentiable Wrapping Operator for User Interest Selection in CTR Prediction.IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,44(11),8449-8464.
MLA	Cao, Tianwei,et al."Meta-Wrapper: Differentiable Wrapping Operator for User Interest Selection in CTR Prediction".IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 44.11(2022):8449-8464.