Domain-incremental learning without forgetting based on random vector functional link networks

doi:10.1016/j.patcog.2024.110430

	Domain-incremental learning without forgetting based on random vector functional link networks
	Liu, Chong 1,3; Wang, Yi 1,3; Li, Dong 1; Wang, Xizhao 2
	2024-07-01
发表期刊	PATTERN RECOGNITION
ISSN	0031-3203
卷号	151 页码:12
摘要	Incremental learning is a paradigm that extends knowledge by learning from new data, often used to add new classes to an existing model or to learn a new domain. It imposes strict limitations on the model's access to data from previous tasks, making it similar to the human learning process. The main challenge of incremental learning is catastrophic forgetting, where previous knowledge is severely forgotten while learning new tasks. In this work, we propose a novel approach for domain -incremental learning. Inspired by the Normal Equation , we accumulate the Gram Matrix from each task's hidden layer output to update a simplified RVFL model. This algorithm achieves performance comparable to joint training while strictly adhering to privacy restrictions. With issues such as forgetting, storage requirements and privacy protection be addressed, this algorithm has the potential to play a crucial role in the field of edge computing and other related fields.
关键词	Incremental learning Domain-incremental learning RVFL network Catastrophic forgetting Privacy preservation
DOI	10.1016/j.patcog.2024.110430
收录类别	SCI
语种	英语
资助项目	National Natural Sci-ence Foundation of China[61976141] ; State Key Laboratory of Computer Architecture, ICT, CAS[CARCH5203]
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:001223736800001
出版者	ELSEVIER SCI LTD
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/38963
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Wang, Xizhao
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China 2.Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen, Guangdong, Peoples R China 3.Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Liu, Chong,Wang, Yi,Li, Dong,et al. Domain-incremental learning without forgetting based on random vector functional link networks[J]. PATTERN RECOGNITION,2024,151:12.
APA	Liu, Chong,Wang, Yi,Li, Dong,&Wang, Xizhao.(2024).Domain-incremental learning without forgetting based on random vector functional link networks.PATTERN RECOGNITION,151,12.
MLA	Liu, Chong,et al."Domain-incremental learning without forgetting based on random vector functional link networks".PATTERN RECOGNITION 151(2024):12.