Intelligent Page Migration on Heterogeneous Memory by Using Transformer

doi:10.1007/s10766-024-00776-x

	Intelligent Page Migration on Heterogeneous Memory by Using Transformer
	Pei, Songwen 1,2; Qin, Wei 1; Li, Jianan 1; Tan, Junhao 1; Tang, Jie 3; Gaudiot, Jean-Luc 4
	2024-12-01
发表期刊	INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING
ISSN	0885-7458
卷号	52 期号:5-6 页码:380-399
摘要	Locality-based migration strategies are widely used in existing memory space management. Such type of strategies are consistently confronts with challenges in efficiently managing pages migration within constrained memory space, especially when new architecture such as hybrid of DRAM and NVM are emerging. Here we propose TransMigrator, an innovative predictive page migration model based on transformer architecture, which obtains a qualitative leap in the breadth and accuracy of prediction compared with traditional local-based methods. TransMigrator utilizes an end-to-end neural network to learn memory access behavior and page migration record in the long-term history and predict the most likely next page to fetch. Furthermore, a migration-management mechanism is designed to support the page-feeding from predictor, which in another way enhance the model robustness. The model achieves an average prediction accuracy better than 0.72, and saves an average of 0.24 access time overhead compared to strategies such as AC-CLOCK, THMigrator, and VC-HMM.
DOI	10.1007/s10766-024-00776-x
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61975124] ; State Key Laboratory of Computer Architecture (ICT, CAS)[CARCHA202111] ; Engineering Research Center of Software/Hardware Co-design Technology and Application, Ministry of Education East China Normal University[OP202202] ; Shanghai Natural Science Foundation[20ZR1438500]
WOS研究方向	Computer Science
WOS类目	Computer Science, Theory & Methods
WOS记录号	WOS:001320804500001
出版者	SPRINGER/PLENUM PUBLISHERS
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/39546
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Pei, Songwen; Qin, Wei
作者单位	1.Univ Shanghai Sci & Technol, Shanghai 200093, Peoples R China 2.Chinese Acad Sci, State Key Lab Comp Architecture, Inst Comp Technol, Beijing 100190, Peoples R China 3.South China Univ Technol, Guangzhou 510641, Peoples R China 4.Univ Calif Irvine, Irvine, CA 92617 USA
推荐引用方式 GB/T 7714	Pei, Songwen,Qin, Wei,Li, Jianan,et al. Intelligent Page Migration on Heterogeneous Memory by Using Transformer[J]. INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING,2024,52(5-6):380-399.
APA	Pei, Songwen,Qin, Wei,Li, Jianan,Tan, Junhao,Tang, Jie,&Gaudiot, Jean-Luc.(2024).Intelligent Page Migration on Heterogeneous Memory by Using Transformer.INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING,52(5-6),380-399.
MLA	Pei, Songwen,et al."Intelligent Page Migration on Heterogeneous Memory by Using Transformer".INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING 52.5-6(2024):380-399.