LLM-led vision-spectral fusion: A zero-shot approach to temporal fruit image classification

doi:10.1016/j.neunet.2025.108155

	LLM-led vision-spectral fusion: A zero-shot approach to temporal fruit image classification
	Wu, Huyu 1; Jia, Bowen 2,3; Yuan, Xue-Ming 4,5
	2026-02-01
发表期刊	NEURAL NETWORKS
ISSN	0893-6080
卷号	194 页码:10
摘要	A zero-shot multimodal framework for temporal image classification is proposed, targeting automated fruit quality assessment. The approach leverages large language models for expert-level semantic description generation, which guides zero-shot object detection and segmentation through GLIP and SAM models. Visual features and spectral data are fused to capture both external appearance and internal biochemical properties of fruits. Experiments on the newly constructed Avocado Freshness Temporal-Spectral dataset-comprising daily synchronized images and spectral measurements across the full spoilage lifecycle-demonstrate reductions in mean squared error by up to 33% and mean absolute error by up to 17% compared to established baselines. These results validate the effectiveness and generalizability of the framework for temporal image analysis in smart agriculture and food quality monitoring.
关键词	Temporally relevant images Multimodal classification Large language models Zero-shot segmentation Vision-spectral fusion
DOI	10.1016/j.neunet.2025.108155
收录类别	SCI
语种	英语
资助项目	Ministry of Education, Singapore[MOE-2019-T3-1-010] ; Fundamental Research Funds for the Central Universities of China[2024ZY-SXT4]
WOS研究方向	Computer Science ; Neurosciences & Neurology
WOS类目	Computer Science, Artificial Intelligence ; Neurosciences
WOS记录号	WOS:001591693900002
出版者	PERGAMON-ELSEVIER SCIENCE LTD
引用统计
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/41667
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Jia, Bowen
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China 2.Sichuan Univ, Business Sch, Chengdu, Peoples R China 3.Sichuan Huashi Centralized Procurement & E commerc, Digital Res & Dev Dept, Chengdu, Peoples R China 4.Natl Univ Singapore, Inst Operat Res & Analyt, Singapore City, Singapore 5.Natl Univ Singapore, Business Sch, Singapore City, Singapore
推荐引用方式 GB/T 7714	Wu, Huyu,Jia, Bowen,Yuan, Xue-Ming. LLM-led vision-spectral fusion: A zero-shot approach to temporal fruit image classification[J]. NEURAL NETWORKS,2026,194:10.
APA	Wu, Huyu,Jia, Bowen,&Yuan, Xue-Ming.(2026).LLM-led vision-spectral fusion: A zero-shot approach to temporal fruit image classification.NEURAL NETWORKS,194,10.
MLA	Wu, Huyu,et al."LLM-led vision-spectral fusion: A zero-shot approach to temporal fruit image classification".NEURAL NETWORKS 194(2026):10.