Document Constrained Translation Quality Estimation Model

doi:10.13209/j.0479-8023.2022.067

Acta Scientiarum Naturalium Universitatis Pekinensis ›› 2023, Vol. 59 ›› Issue (1): 39-47.DOI: 10.13209/j.0479-8023.2022.067

Previous Articles Next Articles

Document Constrained Translation Quality Estimation Model

FENG Qin, GONG Zhengxian^†, YE Heng, ZHOU Guodong

Department of Computer Science and Technology, Soochow University, Soochow 215000

Received:2022-05-12 Revised:2022-08-12 Online:2023-01-20 Published:2023-01-20
Contact: GONG Zhengxian, E-mail: zhxgong(at)suda.edu.cn

篇章约束的译文质量评估模型

冯勤, 贡正仙^†, 叶恒, 周国栋

苏州大学计算机科学与技术学院, 苏州 215000

通讯作者: 贡正仙, E-mail: zhxgong(at)suda.edu.cn
基金资助:
国家自然科学基金(61976148)资助

Abstract

Abstract:

This paper proposes a new translation quality estimation model that does not rely on the reference translation to score the translation of each sentence in the source language. The authors model the sentence-level semantic difference and word-level referential difference between the source and translation and design additional loss function to make the model constrain the differences as much as possible when predicting scores. The experimental results show that proposed method can effectively improve the performance of quality estimation model. Compared with the baseline system, the proposed method improves the Pearson correlation coefficient by up to 6.68 percentage points.

Key words: document, semantic difference, referential difference, translation quality estimation

摘要：

提出一种新的篇章约束辅助的译文质量评估模型, 不依赖参考译文, 为源文篇章中的每条句子的译文进行打分。首先从句子级别的语义表示和词级别的指代特征的角度建模源文和译文上下文之间的差异, 然后设计额外的损失函数, 使得模型在预测分数的同时, 尽可能地约束两者之间的差异。实验结果表明, 所提方法能有效提高译文质量评估的性能, 在Pearson相关系数上较基线系统最高可提升6.68个百分点。

关键词: 篇章, 语义差异, 指代差异, 译文质量评估

FENG Qin, GONG Zhengxian, YE Heng, ZHOU Guodong. Document Constrained Translation Quality Estimation Model[J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2023, 59(1): 39-47.

冯勤, 贡正仙, 叶恒, 周国栋. 篇章约束的译文质量评估模型[J]. 北京大学学报自然科学版, 2023, 59(1): 39-47.

[1]	ZHOU Bohan, CAO Jian, WANG Yuan. A Transformer-based Syntax Tree Decoder for Handwritten Mathematical Expression Recognition [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2023, 59(6): 909-914.
[2]	WU Ruiying, KONG Fang. Event Coreference Resolution with Document Representation [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2020, 56(1): 82-88.
[3]	LI Lanjun, ZHOU Junsheng, GU Yanhui, Qü Weiguang. Similar Legal Case Retrieval Based on Improved Siamese Network [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2019, 55(1): 84-90.
[4]	WU Huanqin, ZHANG Hongyang, LI Jingmei, ZHU Junguo, YANG Muyun, LI Sheng. Training Machine Translation Quality Estimation Model Based on Pseudo Data [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2018, 54(2): 279-285.
[5]	Lilin ZHANG, Maoxi LI, Wenyan XIAO, Jianyi WAN, Mingwen WANG. Improve Automatic Evaluation of Machine Translation Using Specific-Domain Paraphrase [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2017, 53(2): 230-238.
[6]	LI Sida, GAO Liangcai, TANG Zhi, YU Yinyan. Footnote Identification within a PDF Document [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2015, 51(6): 1017-1021.
[7]	LI Ning,LIU Yin,LIANG Qi,FENG Xue. Research on Reversible Transformation from Re-flowable Document into Fixed-layout Document [J]. , 2015, 51(2): 203-212.
[8]	LIN Xiaoyan,GAO Liangcai,TANG Zhi. Research on Mathematical Formula Identification in Digital Chinese Documents [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2014, 50(1): 17-24.
[9]	LIU Jiangming,XU Jin’an,ZHANG Yujie. Summarization Based on Hidden Topic Markov Model with Multi-features [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2014, 50(1): 187-193.
[10]	GONG Zhengxian,LI Liangyou. Document-Level Automatic Machine Translation Evaluation Based on Weighted Lexical Cohesion [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2014, 50(1): 173-179.
[11]	HUANG Xiaojiang,WAN Xiaojun,XIAO Jianguo. Comparative News Summarization Using Co-ranking Graph Model [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2013, 49(1): 31-38.
[12]	FANG Jing,GAO Liangcai,QIU Ruiheng,TANG Zhi. Automatic Table Boundary Detection and Performance Evaluation in Fixed-Layout Documents [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2013, 49(1): 45-53.
[13]	GAO Liangcai,TANG Zhi,LIN Xiaofan,YU Yinyan,FANG Jing. A Table of Content Recognition Method of Book Documents Based on Clustering Techniques [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2010, 46(4): 531-538.

Document Constrained Translation Quality Estimation Model

篇章约束的译文质量评估模型

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 13

Recommended Articles

Metrics