Bi-Attention Text-Keyword Matching for Law Recommendation

doi:10.13209/j.0479-8023.2023.077

Acta Scientiarum Naturalium Universitatis Pekinensis ›› 2024, Vol. 60 ›› Issue (1): 79-88.DOI: 10.13209/j.0479-8023.2023.077

Previous Articles Next Articles

Bi-Attention Text-Keyword Matching for Law Recommendation

DING Na¹, LIU Peng^{2, †}, SHAO Huipeng³, WANG Xuekui⁴

1. School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116 2. National Joint Engineering Laboratory of Internet Applied Technology of Mines, Xuzhou 221008 3. Legal Team of Tongshan Branch of Xuzhou Public Security Bureau, Xuzhou 221100 4. Alibaba Group, Hangzhou 311121

Received:2023-05-18 Revised:2023-07-31 Online:2024-01-20 Published:2024-01-20
Contact: LIU Peng, E-mail: liupeng(at)cumt.edu.cn

双向注意力文本关键词匹配法条推荐

丁娜¹, 刘鹏^2,†, 邵惠鹏³, 王学奎⁴

1. 中国矿业大学信息与控制工程学院, 徐州 221116 2. 矿山互联网应用技术国家地方联合工程实验室, 徐州 221008 3. 江苏省徐州市铜山区公安局法制大队, 徐州 221100 4. 阿里巴巴集团有限公司, 杭州 311121

通讯作者: 刘鹏, E-mail: liupeng(at)cumt.edu.cn
基金资助:
中国矿业大学研究生创新计划(2023WLJCRCZL111)资助

Abstract

Abstract:

This paper proposed a bi-directional attention based text-keyword matching model for law recommendation (BiAKLaw). In this model, BERT is utilized as a basic matching model, bi-directional attention mechanism is implemented to extract token-level alignment features and keyword-level differential features, and these features are fused with keyword attentive semantic representations for a better matching effect. The experimental results on the traffic accident and intentional injury datasets demonstrate that, compared with BERT, the proposed model increases F1 evaluation metric by 3.74% and 3.43% respectively.

Key words: law recommendation, case fact, text matching, attention mechanism

摘要：

提出一种双向注意力文本关键词匹配的法条推荐模型(BiAKLaw)。该模型以预训练语言模型 BERT 作为基础匹配模型, 利用双向注意力机制提取字符级对齐特征和关键词差异特征, 融合对齐特征、差异特征和关键词语义表征来提升匹配效果。在裁判文书交通肇事和故意伤害数据集上的实验结果表明, 与BERT模型相比, BiAKLaw在评价指标F1上分别提升3.74%和3.43%。

关键词: 法条推荐, 案件事实, 文本匹配, 注意力机制

DING Na, LIU Peng, SHAO Huipeng, WANG Xuekui. Bi-Attention Text-Keyword Matching for Law Recommendation[J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2024, 60(1): 79-88.

丁娜, 刘鹏, 邵惠鹏, 王学奎. 双向注意力文本关键词匹配法条推荐[J]. 北京大学学报自然科学版, 2024, 60(1): 79-88.

[1]	WANG Rui, LIANG Jianguo, HUA Rong. Radiology Report Generation Method Based on Multi-scale Feature Parsing [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2024, 60(1): 71-78.
[2]	LI Chao, HOU Xia, QIAO Xiuming. A Low-Resource Named Entity Recognition Method for Cultural Heritage Field Incorporating Knowledge Fusion [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2024, 60(1): 13-22.
[3]	TIAN Yuan, PANG Xiao, ZHAO Wenyi, CHANG Xiaoyin, CHENG Chuyun, ZOU Pei, CAO Xiaocheng. A Transformer-Based Model for Short-Term Landslide Displacement Prediction [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2023, 59(2): 197-210.
[4]	ZHANG Wenhui, WANG Meiling, HOU Zhirong. A Short Text Matching Model Incorporating Contextual Semantic Differences [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2023, 59(1): 30-38.
[5]	GAO Xiaoqian, ZHOU Xiabing, ZHANG Min. A Multi-information Perception Based Method for Question Answering in Multi-party Conversation [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2023, 59(1): 21-29.
[6]	SU Fenglong, SUN Chengzhe, JING Ning. A Context-Fusion Method for Entity Extraction Based on Residual Gated Convolution Neural Network [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2022, 58(1): 69-76.
[7]	WANG Yinmiao, HAN Zhimin. Knowledge Bases Completion Based on Multi-hop Paths [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2022, 58(1): 7-12.
[8]	WAN Zhang, ZHANG Yujie, LIU Mingtong, XU Jin’an, CHEN Yufeng. Object Space Relation Mechanism Fused Image Caption Method [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2021, 57(1): 75-82.
[9]	WU Ruiying, KONG Fang. Event Coreference Resolution with Document Representation [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2020, 56(1): 82-88.
[10]	JIA Yunlong, HAN Donghong, LIN Haiyuan, WANG Guoren, XIA Li. Consumption Intent Recognition Algorithms for Weibo Users [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2020, 56(1): 68-74.
[11]	LIU Mingtong, ZHANG Yujie, ZHANG Shu, MENG Yao, XU Jin’an, CHEN Yufeng. A Multi-Mechanism Fused Paraphrase Generation Model with Joint Auto-Encoding Learning [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2020, 56(1): 53-60.
[12]	HUANG Yan, SUN Haili, XU Ke, YU Xiaoyang, WANG Tongyang, ZHANG Xinfang, LU Songfeng. Discourse-Level Text Generation Method Based on Topical Constraint [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2020, 56(1): 9-15.
[13]	LI Lanjun, ZHOU Junsheng, GU Yanhui, Qü Weiguang. Similar Legal Case Retrieval Based on Improved Siamese Network [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2019, 55(1): 84-90.
[14]	ZHANG Qinglin, DU Jiachen, XU Ruifeng. Sarcasm Detection Based on Adversarial Learning [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2019, 55(1): 29-36.
[15]	ZHOU Botong, SUN Chengjie, LIN Lei, LIU Bingquan. LSTM Based Question Answering for Large Scale Knowledge Base [J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2018, 54(2): 286-292.

Bi-Attention Text-Keyword Matching for Law Recommendation

双向注意力文本关键词匹配法条推荐

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics