模式识别与人工智能
Friday, Apr. 11, 2025 Home      About Journal      Editorial Board      Instructions      Ethics Statement      Contact Us                   中文
Pattern Recognition and Artificial Intelligence  2022, Vol. 35 Issue (9): 849-857    DOI: 10.16451/j.cnki.issn1003-6059.202209008
Researches and Applications Current Issue| Next Issue| Archive| Adv Search |
Citation Intent Classification Method Based on MPNet Pretraining and Multi-head Attention Feature Fusion
QI Ruihua1,2, SHAO Zhen1,2, GUAN Jinghua1, GUO Xu1
1. Research Center for Language Intelligence, Dalian University of Foreign Languages, Dalian 116044;
2. School of Software, Dalian University of Foreign Languages, Dalian 116044

Download: PDF (714 KB)   HTML (1 KB) 
Export: BibTeX | EndNote (RIS)      
Abstract  

Automatic citation intent classification is one of hot issues in the field of bibliometrics.The existing citation intention classification models engender the limitations in extracting textual features and fusing citation contextual features and citation external features. Therefore, a citation intent classification method based on MPNet pretraining and multi-head attention feature fusion is proposed. The position compensation structure is introduced to improve the masked language model and permuted Language model.The syntactic word-frequency features and structure features of citations are combined. A feature extraction method is proposed for citation intent classification task. The multi-head attention mechanism is introduced for feature fusion to improve the classification accuracy. The experimental results on ACL-ARC datasets demonstrate that the proposed method achieves better performance in citation intent classification task with robustness on the unbalanced data.

Key wordsCitation Intent Classification      Feature Fusion      Pretraining Model      Feature Extraction      Multi-head Attention Mechanism     
Received: 16 August 2021     
ZTFLH: TP 391.1  
Fund:

Supported by National Social Science Fund of China(No.15BYY028), Innovative Talents Project of Universities in Liaoning Pro-vince(No.WR2019005), Research and Innovation Team of Dalian University of Foreign Languages(No.2016CXTD06)

Corresponding Authors: QI Ruihua, Ph.D., professor. Her research interests include na-tural language processing and text mining.   
About author:: SHAO Zhen, master student. His research interests include natural language proce-ssing. GUAN Jinghua, Ph.D., associate professor. Her research interests include natural language processing.GUO Xu, master, lecturer. His research interests include natural language proce-ssing.
Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors
QI Ruihua
SHAO Zhen
GUAN Jinghua
GUO Xu
Cite this article:   
QI Ruihua,SHAO Zhen,GUAN Jinghua等. Citation Intent Classification Method Based on MPNet Pretraining and Multi-head Attention Feature Fusion[J]. Pattern Recognition and Artificial Intelligence, 2022, 35(9): 849-857.
URL:  
http://manu46.magtech.com.cn/Jweb_prai/EN/10.16451/j.cnki.issn1003-6059.202209008      OR     http://manu46.magtech.com.cn/Jweb_prai/EN/Y2022/V35/I9/849
Copyright © 2010 Editorial Office of Pattern Recognition and Artificial Intelligence
Address: No.350 Shushanhu Road, Hefei, Anhui Province, P.R. China Tel: 0551-65591176 Fax:0551-65591176 Email: bjb@iim.ac.cn
Supported by Beijing Magtech  Email:support@magtech.com.cn