Distant Supervision for Relation Extraction with Gate Mechanism

doi:10.13209/j.0479-8023.2019.101

Acta Scientiarum Naturalium Universitatis Pekinensis ›› 2020, Vol. 56 ›› Issue (1): 39-44.DOI: 10.13209/j.0479-8023.2019.101

Previous Articles Next Articles

Distant Supervision for Relation Extraction with Gate Mechanism

LI Xingya, CHEN Yufeng^†, XU Jin’an, ZHANG Yujie

School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044

Received:2019-05-23 Revised:2019-09-25 Online:2020-01-20 Published:2020-01-20
Contact: CHEN Yufeng, E-mail: chenyf(at)bjtu.edu.cn

融合门控机制的远程监督关系抽取方法

李兴亚, 陈钰枫^†, 徐金安, 张玉洁

北京交通大学计算机与信息技术学院, 北京 100044

通讯作者: 陈钰枫, E-mail: chenyf(at)bjtu.edu.cn
基金资助:
国家自然科学基金(61976016, 61473294, 61370130, 61876198)、北京市自然科学基金(4172047)和科学技术部国际科技合作计划(K11F100010)资助

Abstract

Abstract:

A piecewise convolutional neural network with gating mechanism is proposed, which would automatically filter positive correlation features at word-level. Moreover, the idea of soft-label is introduced to the gating mechanism to weaken the impact of hard labels on noise filtering. Combined with sentence-level noise filtering, the overall performance of the model is improved. The experimental results on the public dataset show that the proposed model has a significant improvement compared to the sentence-level noise filtering methods.

Key words: relation extraction, distant supervision, gate mechanism, convolutional neural network

摘要：

提出一种融合门控机制的远程监督关系抽取方法。首先在词级别上自动选择正相关特征, 过滤与关系标签无关的词级别噪声; 然后在门控机制内引入软标签的思想, 弱化硬标签对噪声过滤的影响; 最后结合句子级别的噪声过滤, 提升模型的整体性能。在公开数据集上的实验结果表明, 相对于句子级别噪声过滤方法, 所提方法的性能有显著提高。

关键词: 关系抽取, 远程监督, 门控机制, 卷积神经网络

LI Xingya, CHEN Yufeng, XU Jin’an, ZHANG Yujie. Distant Supervision for Relation Extraction with Gate Mechanism[J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2020, 56(1): 39-44.

李兴亚, 陈钰枫, 徐金安, 张玉洁. 融合门控机制的远程监督关系抽取方法[J]. 北京大学学报自然科学版, 2020, 56(1): 39-44.

Add to citation manager EndNote|Ris|BibTeX

URL: https://xbna.pku.edu.cn/EN/10.13209/j.0479-8023.2019.101

https://xbna.pku.edu.cn/EN/Y2020/V56/I1/39

[1]	LIU Xiangcheng, CAO Jian, YAO Hongyi, XU Pengtao, ZHANG Yuan, WANG Yuan. AdaPruner: Adaptive Channel Pruning and Effective Weights Inheritance [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2023, 59(5): 764-772.
[2]	ZHOU Xiangyu, MAO Shanjun, LI Mei. Bearing Fault Diagnosis Method Based on Down-Sampling in Frequency Domain and CNN [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2023, 59(2): 251-260.
[3]	DUAN Jianyong, DAI Shiwei, WANG Hao, HE Li, LI Xin. Exploration of Knowledge Driven Event Hyperbolic Embedding Temporal Relation Extraction Method [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2023, 59(1): 76-82.
[4]	ZHAO Dandan, ZHANG Junpeng, MENG Jiana, ZHANG Zhihao, SU Wen. Medical Entity Relation Extraction Based on Pre-trained Model and Hybrid Neural Network [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2023, 59(1): 65-75.
[5]	XIE Hao, CAO Jian, LI Pu, ZHAO Xiongbo, ZHANG Xing. A Hardware Accelerator for SSD Object Detection Algorithm Based on FPGA [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2022, 58(6): 1015-1022.
[6]	XU Pengtao, CAO Jian, CHEN Weiqian, LIU Shengrong, WANG Yuan, ZHANG Xing. Post Training Quantization Preprocessing Method of Convolutional Neural Network via Outlier Removal [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2022, 58(5): 808-812.
[7]	XU Pengtao, CAO Jian, SUN Wenyu, LI Pu, WANG Yuan, ZHANG Xing. Layer Pruning via Fusible Residual Convolutional Block for Deep Neural Networks [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2022, 58(5): 801-807.
[8]	XU Yang, JIANG Yuru, ZHANG Yuyao, HE Weikai. Research on Dialogue Entity Relation Extraction with Enhancing Character Information [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2022, 58(1): 13-20.
[9]	SUN Wenyu, CAO Jian, LI Pu, LIU Rui. Pruning and Fine-tuning Optimization Method of Convolutional Neural Network Based on Global Information [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2021, 57(4): 790-794.
[10]	ZHANG Qinglin, DU Jiachen, XU Ruifeng. Sarcasm Detection Based on Adversarial Learning [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2019, 55(1): 29-36.
[11]	XU Haoliang, LI Yanqun, HE Yunqi, QIAN Longhua. Research on Chinese Nested Named Entity Relation Extraction [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2019, 55(1): 8-14.
[12]	LUO Fan, WANG Houfeng. Chinese Text Sentiment Classification by H-RNN-CNN [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2018, 54(3): 459-465.
[13]	Wenhao YING, Xinyan XIAO, Sujian LI, Yajuan LÜ, Zhifang SUI. Improving Query-Focused Summarization with CNN-Based Similarity [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2017, 53(2): 197-203.
[14]	RAO Qi,WANG Peiyan,ZHANG Guiping. Text Feature Analysis on SAO Structure Extraction from Chinese Patent Literatures [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2015, 51(2): 349-356.
[15]	SONG Wenjie,GU Yanhui,ZHOU Junsheng,SUN Yujie,YAN Jie,QU Weiguang. Multi-strategies Extraction of Chinese Synonyms [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2015, 51(2): 301-306.

Distant Supervision for Relation Extraction with Gate Mechanism

融合门控机制的远程监督关系抽取方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics