Machine Translation Evaluation Metric Based on Dependency Parsing Model

doi:10.1145/3312573

	Machine Translation Evaluation Metric Based on Dependency Parsing Model
	Yu, Hui 1; Xu, Weizhi 2; Lin, Shouxun 3; Liu, Qun 4
	2019-08-01
发表期刊	ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING
ISSN	2375-4699
卷号	18 期号:4 页码:15
摘要	Most of the syntax-based metrics obtain the similarity by comparing the sub-structures extracted from the trees of hypothesis and reference. These sub-structures cannot represent all the information in the trees because their lengths are limited. To sufficiently use the reference syntax information, a new automatic evaluation metric is proposed based on the dependency parsing model. First, a dependency parsing model is trained using the reference dependency tree for each sentence. Then, the hypothesis is parsed by this dependency parsing model and the corresponding hypothesis dependency tree is generated. The quality of hypothesis can be judged by the quality of the hypothesis dependency tree. Unigram F-score is included in the new metric so that lexicon similarity is obtained. According to experimental results, the proposed metric can perform better than METEOR and BLEU on system level and get comparable results with METEOR on sentence level. To further improve the performance, we also propose a combined metric which gets the best performance on the sentence level and on the system level.
关键词	Automatic evaluation metric dependency parsing model machine translation
DOI	10.1145/3312573
收录类别	SCI
语种	英语
资助项目	Science Foundation Ireland as part of the ADAPT Centre[13/RC/2106] ; NSFC[61379086] ; NSFC[61602284] ; NSFC[61602285] ; NSFC[61602282] ; Shandong Provincial Natural Science Foundation, China[ZR2015FQ009]
WOS研究方向	Computer Science
WOS类目	Computer Science, Artificial Intelligence
WOS记录号	WOS:000495430700011
出版者	ASSOC COMPUTING MACHINERY
引用统计	被引频次：3[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://119.78.100.204/handle/2XEOYT63/14815
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Yu, Hui
作者单位	1.Shandong Normal Univ, Business Sch, 88 East Wenhua Rd, Jinan 250014, Shandong, Peoples R China 2.Shandong Normal Univ, Sch Informat Sci & Engn, Jinan, Shandong, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China 4.Huawei Noahs Ark Lab, Hong Kong, Peoples R China
推荐引用方式 GB/T 7714	Yu, Hui,Xu, Weizhi,Lin, Shouxun,et al. Machine Translation Evaluation Metric Based on Dependency Parsing Model[J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING,2019,18(4):15.
APA	Yu, Hui,Xu, Weizhi,Lin, Shouxun,&Liu, Qun.(2019).Machine Translation Evaluation Metric Based on Dependency Parsing Model.ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING,18(4),15.
MLA	Yu, Hui,et al."Machine Translation Evaluation Metric Based on Dependency Parsing Model".ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING 18.4(2019):15.