北京大学学报(自然科学版)

基于逗号的汉语子句识别研究

李艳翠1,2,冯文贺3,周国栋1,朱坤华2   

  1. 1. 苏州大学计算机科学与技术学院, 苏州 215006; 2. 河南科技学院信息工程学院, 新乡 453003; 3. 河南科技学院人文学院, 新乡 453003;
  • 收稿日期:2012-05-30 出版日期:2013-01-20 发布日期:2013-01-20

Research of Chinese Clause Identificiton Based on Comma

LI Yancui1,2, FENG Wenhe3, ZHOU Guodong1, ZHU Kunhua2   

  1. 1. Department of Computer Science and Technology, Soochow University, Suzhou 215006; 2. School of InformationEngineering, Henan Institute of Science and Technology, Xinxiang 453003; 3. School of Humanities, Henan Institute of Science and Technology, Xinxiang 453003;
  • Received:2012-05-30 Online:2013-01-20 Published:2013-01-20

摘要: 根据篇章分析的任务和实践, 结合传统研究, 提出汉语的基本篇章单位为子句, 并从结构、功能、形式等方面给出其定义。分析了逗号与子句的关系, 并在标注语料上进行了基于逗号的汉语子句识别研究。首先手工标注了CTB6.0中前100篇文档的逗号是否为子句边界的信息, 在标注结果中抽取句法、词汇、长度等特征进行实验, 子句识别准确率为90%。然后利用信息增益选出贡献最大的9个特征, 使用它们也可获得较高的子句识别准确率。最后仅使用词法信息, 子句识别准确率可达84.5%。实验证明子句的定义合理, 基于逗号的子句识别在理论上和实验上均可行。

关键词: 逗号, 汉语子句, 子句识别

Abstract: According to the task of Chinese discourse analysis and practice, combined with traditional study, the authors propose clause as basic discourse unit and give its definition from the structure, function, form etc. The authors analyse the relationship between the comma and clause, and research clause identification using comma on annotation corpus. The corpus labeled whether each comma can be regarded as clause boundary information extract from CTB6.0, and have total of 2171 commas in 1348 sentences. The authors extract syntax, vocabulary, length features for experiment, and clauses identification accuracy can reach 90%. Nine greatest contribution features are chosen by information gain, they can obtain high clauses identification accuracy. Finally only using morphology feature, the accuracy can reach 84.5%. Experiments show that the definition of clause is reasonable and identification clause based on the comma is feasible.

Key words: comma, Chinese clause, clause identification

中图分类号: