Acta Scientiarum Naturalium Universitatis Pekinensis

Previous Articles     Next Articles

Expanding Training Dataset with Class Hierarchy in Hierarchical Text Categorization

LI Baoli   

  1. Department of Computer Science, Henan University of Technology, Zhenghou 450001;
  • Received:2014-07-27 Online:2015-03-20 Published:2015-03-20

基于类别层次结构的多层文本分类样本扩展策略

李保利   

  1. 河南工业大学计算机科学系, 郑州 450001;

Abstract: As the number of classes is quite large in a hierarchical text categorization problem, it usually costs much to obtain a training dataset of reasonable size and sample distribution. Several strategies are proposed and compared to generate new training samples from the class hierarchy in a hierarchical text classification problem. These solutions try to make full use of the class hierarchy (including class names, their descriptions if any, and relationships between them), and derive new pseudo training samples based on connotations and extensions of classes. Experiments on the dataset of the first large scale Chinese News Categorization at NLPCC 2014 show that the localized expanding strategy based on class extensions performs better. The proposed official system achieved MacroF1 0.8413 and 0.7139 at level 1 and level 2 respectively, which ranked the proposed system the second place among the 10 participating systems.

Key words: hierarchical text classification, large scale Chinese news categorization, classification of news in Chinese, class hierarchy

摘要: 针对大规模多层文本分类训练样本获取代价高、类别分布不均衡等问题, 提出并比较几种基于类别层次结构的大规模多层文本分类样本扩展策略, 即利用类别层次体系中蕴含的类别名称、描述以及类别间的层次结构关系, 从内涵和外延两方面入手构造或扩展类别训练样本。在首次大规模中文新闻信息多层分类评测数据集上, 基于外延的局部样本扩展策略取得较好的性能。参测系统在第一级类别和第二级类别上宏平均F1分别为0.8413和0.7139, 在10个参赛系统中位列第二。

关键词: 多层文本分类, 大规模中文新闻分类, 中文新闻信息分类, 类别层次体系

CLC Number: