Contrastive Learning Based Multi-view Feature Fusion Model for Aspect-Based Sentiment Analysis
WU Xing1, XIA Hongbin1,2, LIU Yuan1,2
1. School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi 214122; 2. Jiangsu Key University Laboratory of Software and Media Tech-nology under Human-Computer Cooperation, Jiangnan Univer-sity, Wuxi 214122
摘要 当前方面级情感分析方法大多通过依赖树和注意力机制提取情感特征,容易受上下文无关信息的噪声干扰,往往忽略对句子全局情感特征的建模,难以处理隐含表达情感的句子.为了解决该问题,文中提出基于对比学习的多视角特征融合方面级情感分析模型(Contrastive Learning Based Multi-view Feature Fusion Model for Aspect-Based Sentiment Analysis, CLMVFF).首先,使用图卷积网络编码依赖图、成分图和语义图中的信息,并在每个图中构建全局情感节点,学习全局情感特征,同时引入外部知识嵌入,丰富情感特征.然后,通过对比学习减少噪声的负面影响,并结合相似度分离增强情感特征.最后,融合依赖图表示、成分图表示、语义图表示和外部知识嵌入,得到多视角特征增强表示.在3个数据集上的实验表明,CLMVFF的性能取得一定提升.
Abstract：Current aspect-based sentiment analysis methods typically extract sentiment features through dependency tree and attention mechanism. These methods are susceptible to noise from irrelevant contextual information and often neglect to model the global sentiment features of sentences, making it difficult to process sentences that implicitly express sentiment. To address these problems, a contrastive learning based multi-view feature fusion model for aspect-based sentiment analysis(CLMVFF) is proposed. First, graph convolutional networks are utilized to encode information in dependency graph, constituent graph and semantic graph. The global sentiment node is constructed in each graph to learn global sentiment features while introducing external knowledge embedding to enrich sentiment features. Second, contrastive learning is exploited to mitigate the negative influence of noise. Combined with the similarity separation, the sentiment features are enhanced. Finally, the dependency graph representation, constituent graph representation, semantic graph representation and external knowledge embeddings are fused. Experimental results on three datasets demonstrate that CLMVFF achieves the improvement of performance.
[1] TANG S Y, CHAI H Y, YAO Z Y, et al. Affective Knowledge Enhanced Multiple-Graph Fusion Networks for Aspect-Based Sentiment Analysis // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2022: 5352-5362. [2] CHEN C H, TENG Z Y, WANG Z Q, ,et al. Discrete Opinion Tree Induction for Aspect-Based Sentiment Analysis // Proc of the 60th Annual Meeting of the Association for Computational Linguistics(Long Papers). Stroudsburg, USA: ACL, 2022, I: 2051-2064. [3] LI R F, CHEN H, FENG F X, et al. Dual Graph Convolutional Networks for Aspect-Based Sentiment Analysis // Proc of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Proce-ssing(Long Papers). Stroudsburg, USA: ACL, 2021, I: 6319-6329. [4] TAN X W, CAI Y, ZHU C X.Recognizing Conflict Opinions in Aspect-Level Sentiment Classification with Dual Attention Networks // Proc of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Stroudsburg, USA: ACL, 2019: 3426-3431. [5] 张文轩,殷雁君.用于方面级情感分析的图指导的差异化注意力网络.中文信息学报, 2023, 37(7): 102-113. (ZHANG W X, YIN Y J.Graph-Guided Differentiated Attention Network for Aspect-Level Sentiment Analysis. Journal of Chinese Information Processing, 2023, 37(7): 102-113.) [6] OH S, LEE D, WHANG T, ,et al. Deep Context and Relation-Aware Learning for Aspect-Based Sentiment Analysis // Proc of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Proce-ssing(Short Papers). Stroudsburg, USA: ACL, 2021, II: 495-503. [7] ZHOU Y X, LIAO L J, GAO Y, et al. To Be Closer: Learning to Link up Aspects with Opinions // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2021: 3899-3909. [8] CHEN C H, TENG Z Y, ZHANG Y.Inducing Target-Specific Latent Structures for Aspect Sentiment Classification // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2020: 5596-5607. [9] WANG K, SHEN W Z, YANG Y Y, et al. Relational Graph Attention Network for Aspect-Based Sentiment Analysis // Proc of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: ACL, 2020: 3229-3238. [10] CHAI H Y, YAO Z Y, TANG S Y, et al. Aspect-to-Scope Oriented Multi-view Contrastive Learning for Aspect-Based Sentiment Analysis // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2023: 10902-10913. [11] ZHAO X W, ZHOU Y, XU X J, et al. Extensible Multi-granularity Fusion Network for Aspect-Based Sentiment Analysis[C/OL].[2024-08-20]. https://arxiv.org/pdf/2402.07787. [12] ZHONG Q H, DING L, LIU J H, et al. Knowledge Graph Augmented Network towards Multiview Representation Learning for Aspect-Based Sentiment Analysis. IEEE Transactions on Knowledge and Data Engineering, 2023, 35(10): 10098-10111. [13] WANG H N, LU Y, ZHAI C X.Latent Aspect Rating Analysis without Aspect Keyword Supervision // Proc of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, USA: ACM, 2011: 618-626. [14] JIANG L, YU M, ZHOU M, et al. Target-Dependent Twitter Sentiment Classification // Proc of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Techno-logies. Stroudsburg, USA: ACL, 2011: 151-160. [15] HU M T, ZHAO S W, ZHANG L, et al. CAN: Constrained Attention Networks for Multi-aspect Sentiment Analysis // Proc of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Stroudsburg, USA: ACL, 2019: 4601-4610. [16] FAN F F, FENG Y S, ZHAO D Y.Multi-grained Attention Network for Aspect-Level Sentiment Classification // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2018: 3433-3442. [17] SONG Y W, WANG J H, JIANG T, et al. Targeted Sentiment Classification with Attentional Encoder Network // Proc of the 28th International Conference on Artificial Neural Networks. Berlin, Germany: Springer, 2019: 93-103. [18] LIU X Y, HOU R, GAN Y F, et al. Aspect-Oriented Opinion Alignment Network for Aspect-Based Sentiment Classification[C/OL].[2024-08-20]. https://arxiv.org/pdf/2308.11447. [19] SUN K, ZHANG R C, MENSAH S, et al. Aspect-Level Sentiment Analysis via Convolution over Dependency Tree // Proc of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Proce-ssing. Stroudsburg, USA: ACL, 2019: 5679-5688. [20] LIANG B, YIN R D, GUI L, et al. Jointly Learning Aspect-Focused and Inter-Aspect Relations with Graph Convolutional Networks for Aspect Sentiment Analysis // Proc of the 28th International Conference on Computational Linguistics. Stroudsburg, USA: ACL, 2020: 150-161. [21] ZHAO P L, HOU L L, WU O.Modeling Sentiment Dependencies with Graph Convolutional Networks for Aspect-Level Sentiment Classi-fication. Knowledge-Based Systems, 2020, 193. DOI: 10.1016/j.knosys.2019.105443. [22] TIAN Y H, CHEN G M, SONG Y.Aspect-Based Sentiment Ana-lysis with Type-Aware Graph Convolutional Networks and Layer Ensemble // Proc of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg, USA: ACL, 2021: 2910-2922. [23] JIANG T Y, WANG Z L, YANG M, et al. Aspect-Based Sentiment Analysis with Dependency Relation Weighted Graph Attention. Information, 2023, 14(3). DOI: 10.3390/info14030185. [24] FENG S, WANG B, YANG Z Y, et al. Aspect-Based Sentiment Analysis with Attention-Assisted Graph andVariational Sentence Representation. Knowledge-Based Systems, 2022, 258. DOI: 10.1016/j.knosys.2022.109975. [25] WANG Z H, ZHANG B, YANG R, et al. DAGCN: Distance-Based and Aspect-Oriented Graph Convolutional Network for Aspect-Based Sentiment Analysis // Proc of the Annual Conference of the North American Chapter of the Association for Computational Linguistics. Stroudsburg, USA: ACL, 2024: 1863-1876. [26] CHEN B F, OUYANG Q H, LUO Y Q, et al. S2GSL: Incorporating Segment to Syntactic Enhanced Graph Structure Learning for Aspect-Based Sentiment Analysis // Proc of the 62nd Annual Meeting of the Association for Computational Linguistics(Long Papers). Stroudsburg, USA: ACL, 2024: 13366-13379. [27] DEVLIN J, CHANG M W, LEE K, ,et al. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding // Proc of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies(Long and Short Papers). Stroudsburg, USA: ACL, 2019, I: 4171-4186. [28] VAN DER OORD A, LI Y Z, VINYALS O. Representation Lear-ning with Contrastive Predictive Coding[C/OL].[2024-08-20]. https://arxiv.org/pdf/1807.03748. [29] DONG L, WEI F R, TAN C Q, ,et al. Adaptive Recursive Neural Network for Target-Dependent Twitter Sentiment Classification // Proc of the 52nd Annual Meeting of the Association for Computational Linguistics(Short Papers). Stroudsburg, USA: ACL, 2014, II: 49-54. [30] YIN S, ZHONG G Q.TextGT: A Double-View Graph Transformer on Text for Aspect-Based Sentiment Analysis. Proceedings of the AAAI Conference on Artificial Intelligence, 2024, 38(17): 19404-19412.
2024, Vol. 37 
