Automatic evaluation of summary on fidelity, conciseness and coherence for text summarization based on semantic link network

doi:10.1016/j.eswa.2022.117777

	Automatic evaluation of summary on fidelity, conciseness and coherence for text summarization based on semantic link network
	Cao, Mengyun 1,2,3; Zhuge, Hai 2,3,4
	2022-11-15
发表期刊	EXPERT SYSTEMS WITH APPLICATIONS
ISSN	0957-4174
卷号	206 页码:21
摘要	Automatic evaluation of summary is one of the basic problems of automatic text summarization research. The commonly used approaches evaluate the informativeness, conciseness and coherence of summary separately based on different representations with weak semantics such as n-gram and vector of words. By transforming text into semantic link network, this paper proposes a general framework for automatically evaluating summary from the following aspects: (1) fidelity, the extent of a summary that conveys the core of its source text; (2) conciseness, the extent of non-redundancy within summary and, (3) coherence, the extent of relatedness between representations within summary, which are based on a uniform semantic representation of text. Experiments on the evaluation of the summarization of scientific papers and news show that the proposed framework achieves comparable or higher correlations with human judgments than the popular evaluation models. This research also verifies the role of the semantic link network in representing and analysing texts.
关键词	Text Summarization Evaluation method Semantic link network Text modelling Nature language processing
DOI	10.1016/j.eswa.2022.117777
收录类别	SCI
语种	英语
资助项目	National Science Foundation of China[61876048] ; National Science Foundation of China[61640212] ; Jimei University ; International Research Network on Cyber-Physical-Social Intelligence based on Great Bay University ; Computing Technology at Chinese Academy of Sciences ; Aston University
WOS研究方向	Computer Science ; Engineering ; Operations Research & Management Science
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic ; Operations Research & Management Science
WOS记录号	WOS:000832965100003
出版者	PERGAMON-ELSEVIER SCIENCE LTD
引用统计	被引频次：3[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/19477
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Zhuge, Hai
作者单位	1.JiMei Univ, Coll Comp Engn, Xiamen 360121, Peoples R China 2.Great Bay Univ, Lab Cyber Phys Social Intelligence, Dongguan 523808, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China 4.Aston Univ, Lab Semant, Birmingham B4 7ET, W Midlands, England
推荐引用方式 GB/T 7714	Cao, Mengyun,Zhuge, Hai. Automatic evaluation of summary on fidelity, conciseness and coherence for text summarization based on semantic link network[J]. EXPERT SYSTEMS WITH APPLICATIONS,2022,206:21.
APA	Cao, Mengyun,&Zhuge, Hai.(2022).Automatic evaluation of summary on fidelity, conciseness and coherence for text summarization based on semantic link network.EXPERT SYSTEMS WITH APPLICATIONS,206,21.
MLA	Cao, Mengyun,et al."Automatic evaluation of summary on fidelity, conciseness and coherence for text summarization based on semantic link network".EXPERT SYSTEMS WITH APPLICATIONS 206(2022):21.