Statistical Machine Translation Model Pruning Based on Translation Log

Acta Scientiarum Naturalium Universitatis Pekinensis

Previous Articles Next Articles

Statistical Machine Translation Model Pruning Based on Translation Log

LIU Kai¹, Lü Yajuan¹, JIANG Wenbin¹, LIU Qun^1,2

1. Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, University of Chinese Academy of Sciences, Beijing 100190; 2. Dublin City University DCU, Dublin 9;

Received:2013-06-15 Online:2014-01-20 Published:2014-01-20

基于翻译日志的统计机器翻译模型剪枝

刘凯¹,吕雅娟¹,姜文斌¹,刘群^1,2

1. 中国科学院大学计算技术研究所, 智能信息处理重点实验室, 北京 100190; 2. Dublin City University DCU, Dublin 9;

Abstract

Abstract: The authors propose a novel translation log based translation rule pruning method, which prunes translation rules according to the translation rule hit counts pairs. Experiment results show that the proposed method requires only 1% - 3% translation rules without significantly difference compared to the full model.

Key words: statistical machine translation, model pruning, translation log

摘要： 提出一种基于翻译日志的统计机器翻译模型的剪枝方法。该方法利用翻译规则在翻译日志中的命中频数对机器翻译规则进行过滤, 保留当前机器翻译模型所需的最小规则表。实验表明, 该方法能够在仅保留原有模型1%~3%翻译规则的前提下达到原有模型的翻译效果。

关键词: 统计机器翻译, 模型剪枝, 翻译日志

CLC Number:

TP391

LIU Kai,Lü Yajuan,JIANG Wenbin,LIU Qun. Statistical Machine Translation Model Pruning Based on Translation Log[J]. Acta Scientiarum Naturalium Universitatis Pekinensis.

刘凯,吕雅娟,姜文斌,刘群. 基于翻译日志的统计机器翻译模型剪枝[J]. 北京大学学报（自然科学版）.

Add to citation manager EndNote|Ris|BibTeX

URL: https://xbna.pku.edu.cn/EN/

https://xbna.pku.edu.cn/EN/Y2014/V50/I1/167

[1]	LI Fang, CAO Jian, LI Pu, XIE Hao, ZHAO Xiongbo, WANG Yuan, ZHANG Xing. Design and Implementation of Object Detection Acceleration Module Based on an ARM+FPGA Heterogeneous Platform [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2022, 58(6): 1035-1041.
[2]	SUN Wenyu, CAO Jian, LI Pu, LIU Rui. Pruning and Fine-tuning Optimization Method of Convolutional Neural Network Based on Global Information [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2021, 57(4): 790-794.
[3]	Nan WANG, Jin’an XU, Fang MING, Yufeng CHEN, Yujie ZHANG. Integrating Voice Features into Japanese-English Hierarchical Phrase Based Model [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2017, 53(2): 305-313.
[4]	LI Qiang, LI Mu, ZHANG Dongdong, ZHU Jingbo. Research on Example-Based Phrase Pairs in Statistical Machine Translation [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2016, 52(1): 113-119.
[5]	ZHAO Ziyu,XU Jin’an,ZHANG Yujie,LIU Jiangming. Japanese Time Expression Recognition and Translation [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2014, 50(1): 180-186.
[6]	LUO Wei. Research on Fast Incremental Training Algorithm for Word Alignment [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2013, 49(1): 88-94.

Statistical Machine Translation Model Pruning Based on Translation Log

基于翻译日志的统计机器翻译模型剪枝

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 6

Recommended Articles

Metrics