北京大学学报自然科学版 ›› 2022, Vol. 58 ›› Issue (1): 54-60.DOI: 10.13209/j.0479-8023.2021.112

上一篇    下一篇

面向问答领域的数据增强方法

丁家杰, 肖康, 叶恒, 周夏冰†, 张民   

  1. 苏州大学计算机科学与技术学院, 苏州 215000
  • 收稿日期:2021-06-08 修回日期:2021-08-14 出版日期:2022-01-20 发布日期:2022-01-20
  • 通讯作者: 周夏冰, E-mail: zhouxiabing(at)suda.edu.cn
  • 基金资助:
    国家自然科学基金(62176174)资助

Data Augmentation Method for Question Answering

DING Jiajie, XIAO Kang, YE Heng, ZHOU Xiabing†, ZHANG Min   

  1. School of Computer Science and Technology, Soochow University, Suzhou 21500
  • Received:2021-06-08 Revised:2021-08-14 Online:2022-01-20 Published:2022-01-20
  • Contact: ZHOU Xiabing, E-mail: zhouxiabing(at)suda.edu.cn

PDF

摘要：

针对当前自动问答数据增强方法需要大量外部数据的问题, 提出一个面向问答模型缺陷的数据增强方法。首先, 在训练集上训练好问答模型、问题生成模型以及问答匹配模型; 然后, 获取问答模型在训练集上预测的所有答案, 并选取其中预测错误的答案; 再后, 使用问题生成模型对这些答案生成相应问题; 最后, 通过问答匹配模型对生成的问答对进行过滤, 保留其中质量较高的数据作为最终的增强数据。该方法不需要额外的数据与领域知识, 同时能够针对模型构造特定数据, 耗费较少的训练代价就能使模型性能提升。实验结果表明, 所提出的数据增强方法对R-Net, Bert-Base以及Luke均有效, 与其他数据增强方法相比, 在较少的增强数据规模下, 问答模型获得更好的性能提升。

关键词: 数据增强, 问题生成模型, 自动问答模型, 质量控制

Abstract:

Aiming at the problem that the current data augmentation method for automatic question answering requires a large amount of external data, a new method oriented to the defects of the question answering model is proposed. Firstly, the question answering (QA) model, question generating (QG) model and question answering matching (QAMatch) model are trained on the training set. Secondly, all the answers predicted by the QA model on the training set are obtained and the wrong ones are selected. Then, the QG model is used to generate corresponding questions for these answers. Finally, the question-answer pairs are filtered by the QAMatch model and the high-quality data are retained as the final augmented data. This method does not require additional data and domain knowledge, and can construct specific data for QA model, improving the performance with less training cost. Experimental results show that the proposed data augmentation method is effective for R-NET, Bert-Base and Luke. Compared with other methods, the QA model achieves better performance improvement with less data scale.

Key words: data augmentation, question answering model, question generation model, quality control

版权所有 © 《北京大学学报（自然科学版）》编辑部
技术支持：北京玛格泰克科技发展有限公司