GLIM-Net: Chronic Glaucoma Forecast Transformer for Irregularly Sampled Sequential Fundus Images

doi:10.1109/TMI.2023.3243692

	GLIM-Net: Chronic Glaucoma Forecast Transformer for Irregularly Sampled Sequential Fundus Images
	Hu, Xiaoyan 1; Zhang, Ling-Xiao 1; Gao, Lin 1,2; Dai, Weiwei 3; Han, Xiaoguang 4; Lai, Yu-Kun 5; Chen, Yiqiang 1,2
	2023-06-01
发表期刊	IEEE TRANSACTIONS ON MEDICAL IMAGING
ISSN	0278-0062
卷号	42 期号:6 页码:1875-1884
摘要	Chronic Glaucoma is an eye disease with progressive optic nerve damage. It is the second leading cause of blindness after cataract and the first leading cause of irreversible blindness. Glaucoma forecast can predict future eye state of a patient by analyzing the historical fundus images, which is helpful for early detection and intervention of potential patients and avoiding the outcome of blindness. In this paper, we propose a GLaucoma forecast transformer based on Irregularly saMpled fundus images named GLIM-Net to predict the probability of developing glaucoma in the future. The main challenge is that the existing fundus images are often sampled at irregular times, making it difficult to accurately capture the subtle progression of glaucoma over time. We therefore introduce two novel modules, namely time positional encoding and time-sensitive MSA (multi-head self-attention) modules, to address this challenge. Unlike many existing works that focus on prediction for an unspecified future time, we also propose an extended model which is further capable of prediction conditioned on a specific future time. The experimental results on the benchmark dataset SIGF show that the accuracy of our method outperforms the state-of-the-art models. In addition, the ablation experiments also confirm the effectiveness of the two modules we propose, which can provide a good reference for the optimization of Transformer models.
关键词	Transformers Feature extraction Predictive models Image segmentation Deep learning Biomedical imaging Task analysis Glaucoma forecast transformer attention mechanism fundus image
DOI	10.1109/TMI.2023.3243692
收录类别	SCI
语种	英语
资助项目	Science and Technology Service Network Initiative of the Chinese Academy of Sciences[KFJ-STS-QYZD-2021-11-001] ; Beijing Municipal Natural Science Foundation for Distinguished Young Scholars[JQ21013] ; Royal Society Newton Advanced Fellowship[NAF\R2\192151] ; Science and Technology Innovation Program of Hunan Province[2021GK4015] ; Youth Innovation Promotion Association of the Chinese Academy of Sciences
WOS研究方向	Computer Science ; Engineering ; Imaging Science & Photographic Technology ; Radiology, Nuclear Medicine & Medical Imaging
WOS类目	Computer Science, Interdisciplinary Applications ; Engineering, Biomedical ; Engineering, Electrical & Electronic ; Imaging Science & Photographic Technology ; Radiology, Nuclear Medicine & Medical Imaging
WOS记录号	WOS:001002656700024
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：6[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/21248
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Gao, Lin; Chen, Yiqiang
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing Key Lab Mobile Comp & Pervas Device, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing 100049, Peoples R China 3.Changsha Aier Eye Hosp, Changsha 410000, Hunan, Peoples R China 4.Chinese Univ Hong Kong, Sch Sci & Engn SSE, Shenzhen 518172, Peoples R China 5.Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF10 3AT, Wales
推荐引用方式 GB/T 7714	Hu, Xiaoyan,Zhang, Ling-Xiao,Gao, Lin,et al. GLIM-Net: Chronic Glaucoma Forecast Transformer for Irregularly Sampled Sequential Fundus Images[J]. IEEE TRANSACTIONS ON MEDICAL IMAGING,2023,42(6):1875-1884.
APA	Hu, Xiaoyan.,Zhang, Ling-Xiao.,Gao, Lin.,Dai, Weiwei.,Han, Xiaoguang.,...&Chen, Yiqiang.(2023).GLIM-Net: Chronic Glaucoma Forecast Transformer for Irregularly Sampled Sequential Fundus Images.IEEE TRANSACTIONS ON MEDICAL IMAGING,42(6),1875-1884.
MLA	Hu, Xiaoyan,et al."GLIM-Net: Chronic Glaucoma Forecast Transformer for Irregularly Sampled Sequential Fundus Images".IEEE TRANSACTIONS ON MEDICAL IMAGING 42.6(2023):1875-1884.