Session-Based Recommendation Model with Self Contrastive Graph Neural Network and Dual Predictor
ZHANG Yusong1, XIA Hongbin1,2, LIU Yuan1,2
1. School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi 214122; 2. Jiangsu Key University Laboratory of Software and Media Te-chnology under Human-Computer Cooperation, Jiangnan University, Wuxi 214122
摘要 基于会话的推荐旨在利用短时匿名会话预测用户行为.现有结合图神经网络与对比学习的会话推荐模型大多采用联合优化交叉熵损失与对比学习损失的方法,但二者所起作用相似,同时需要构建大量复杂的正负样本,为模型带来负担.此外,简单的线性预测器不能较好地预测带有用户随机行为的数据.针对上述问题,文中提出结合自对比图神经网络与双预测器的会话推荐模型(Session-Based Recommendation Model with Self Contrastive Graph Neural Network and Dual Predictor, SCGNN).首先,使用双视图建模原始会话,采用改进的图神经网络学习物品嵌入与会话嵌入,并通过自对比学习优化物品表示.然后,提出用户行为感知因子,应对用户随机行为带来的影响.最后,采用决策森林预测器与线性预测器对物品进行预测,并提出软标签生成策略,通过协同过滤与当前会话类似的历史会话以辅助预测.在Tmall、Diginetica、Nowplaying数据集上的实验表明文中模型的有效性.
Abstract:Session-based recommendation aims to predict user behavior based on short-term anonymous sessions. In most of the existing session-based recommendation models using graph neural network and contrastive learning, joint optimization of cross-entropy loss and contrastive learning loss is typically adopted. However, these two methods play similar roles and require the construction of a large number of complex positive and negative samples, bringing a burden to the model. Moreover, simple linear predictor struggles to predict the data with random behaviors of users. To solve the problems, a session-based recommendation model with self contrastive graph neural network and dual predictor is proposed(SCGNN). Firstly, the original session is built into two views, an improved graph neural network is employed to learn item and session embeddings, and item representation is optimized by self-contrastive learning. Then, a user behavior-aware factor is introduced to mitigate the impact of user random behaviors. Finally, the decision forest predictor and linear predictor are both utilized to predict the items, and soft label generation strategy is proposed for assist prediction by collaboratively filtering the historical sessions similar to the current session. Experiments on three benchmark datasets, Tmall, Diginetica and Nowplaying, validate the effectiveness of SCGNN.
[1] LOPS P, DE GEMMIS M, SEMERARO G.Content-Based Reco-mmender Systems: State of the Art and Trends // RICCI F, ROKA-CH L, SHAPIRA B, eds. Recommender Systems Handbook. Berlin, Germany: Springer, 2011: 73-105. [2] SCHAFER J B, FRANKOWSKI D, HERLOCKER J,et al. Colla-borative Filtering Recommender Systems // BRUSILOVSKY P, KOB-SA A, NEJDL W, eds. The Adaptive Web. Berlin, Germany: Sprin-ger, 2007: 291-324. [3] 于蒙,何文涛,周绪川,等.推荐系统综述.计算机应用, 2022, 42(6): 1898-1913. (YU M, HE W T, ZHOU X C, et al. Review of Recommendation System. Journal of Computer Applications, 2022, 42(6): 1898-1913.) [4] GAO C, ZHENG Y, HE X N, et al. Graph Neural Networks for Recommender Systems: Challenges, Methods, and Directions // Proc of the 15th ACM International Conference on Web Search and Data Mining. New York,USA: ACM, 2022: 1623-1625. [5] WANG S J, CAO L B, WANG Y, et al. A Survey on Session-Based Recommender Systems. ACM Computing Surveys, 2021, 54(7). DOI: 10.1145/3465401. [6] SHANI G, HECKERMAN D, BRAFMAN R I, et al. An MDP-Based Recommender System. Journal of Machine Learning Research, 2005, 6: 1265-1295. [7] ZHANG Z Y, NASRAOUI O.Efficient Hybrid Web Recommendations Based on Markov Clickstream Models and Implicit Search // Proc of the IEEE/WIC/ACM International Conference on Web Inte-lligence. Washington, USA: IEEE, 2007: 621-627. [8] RENDLE S, FREUDENTHALER C, SCHMIDT-THIEME L.Facto-rizing Personalized Markov Chains for Next-Basket Recommendation // Proc of the 19th International Conference on World Wide Web. New York,USA: ACM, 2010: 811-820. [9] GARG D, GUPTA P, MALHOTRA P, et al. Sequence and Time Aware Neighborhood for Session-Based Recommendations // Proc of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. New York,USA: ACM, 2019: 1069-1072. [10] WANG M R, REN P J, MEI L, et al. A Collaborative Session-Based Recommendation Approach with Parallel Memory Modules // Proc of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. New York,USA: ACM, 2019: 345-354. [11] TAN Y K, XU X X, LIU Y.Improved Recurrent Neural Networks for Session-Based Recommendations // Proc of the 1st Workshop on Deep Learning for Recommender Systems. New York,USA: ACM, 2016: 17-22. [12] LI J, REN P J, CHEN Z M, et al. Neural Attentive Session-Based Recommendation // Proc of the ACM Conference on Information and Knowledge Management. New York,USA: ACM, 2017: 1419-1428. [13] LIU Q, ZENG Y F, MOKHOSI R, et al. STAMP: Short-Term Atten-tion/Memory Priority Model for Session-Based Recommendation // Proc of the 24th ACM SIGKDD International Conference on Know-ledge Discovery and Data Mining. New York,USA: ACM, 2018: 1831-1839. [14] WU S, TANG Y Y, ZHU Y Q, et al. Session-Based Recommendation with Graph Neural Networks. Proceedings of the AAAI Confe-rence on Artificial Intelligence, 2019, 33(1): 346-353. [15] WANG Z Y, WEI W, CONG G, et al. Global Context Enhanced Graph Neural Networks for Session-Based Recommendation // Proc of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. New York,USA: ACM, 2020: 169-178. [16] CHEN T W, WONG R C W. Handling Information Loss of Graph Neural Networks for Session-Based Recommendation // Proc of the 26th ACM SIGKDD International Conference on Knowledge Disco-very and Data Mining. New York,USA: ACM, 2020: 1172-1180. [17] GUO J Y, YANG Y M, SONG X C, et al. Learning Multi-granularity Consecutive User Intent Unit for Session-Based Recommendation // Proc of the 15th ACM International Conference on Web Search and Data Mining. New York,USA: ACM, 2022: 343-352. [18] XIE X, SUN F, LIU Z Y, et al. Contrastive Pre-Training for Sequential Recommendation[C/OL].[2024-01-09]. https://arxiv.org/pdf/2010.14395v1.pdf. [19] XIA X, YIN H Z, YU J J, et al. Self-Supervised Hypergraph Convolutional Networks for Session-Based Recommendation. Proceed-ings of the AAAI Conference on Artificial Intelligence, 2021, 35(5): 4503-4511. [20] XIA X, YIN H Z, YU J L, et al. Self-Supervised Graph Co-trai-ning for Session-Based Recommendation // Proc of the 30th ACM International Conference on Information and Knowledge Management. New York,USA: ACM, 2021: 2180-2190. [21] HAN T D, XIE W D, ZISSERMAN A. Self-Supervised Co-training for Video Representation Learning // Proc of the 34th International Conference on Neural Information Processing Systems. Cambridge, USA: MIT Press, 2020: 5679-5690. [22] PAN Z Q, CAI F, CHEN W Y, et al. Collaborative Graph Lear-ning for Session-Based Recommendation. ACM Transactions on Information Systems, 2022, 40(4). DOI: 10.1145/3490479. [23] HE X N, DENG K, WANG X, et al. LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation // Proc of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. New York,USA: ACM, 2020: 639-648. [24] VASWANI A, SHAZEER N, PARMAR N, et al.Attention Is All You Need // Proc of the 31st International Conference on Neural Information Processing Systems. Cambridge, USA: MIT Press, 2017: 6000-6010. [25] VAN DER OORD A, LI Y Z, VINYALS O. Representation Lear-ning with Contrastive Predictive Coding[C/OL].[2024-01-09]. https://arxiv.org/pdf/1807.03748.pdf. [26] SHI Z X, WANG X, LIPANI A.Self Contrastive Learning for Se-ssion-Based Recommendation // Proc of the European Conference on Information Retrieval. Berlin, Germany: Springer, 2024: 3-20. [27] CHARIKAR M S.Similarity Estimation Techniques from Rounding Algorithms // Proc of the 34th Annual ACM Symposium on Theory of Computing. New York,USA: ACM, 2002: 380-388. [28] WANG R D, WONG R C W, TAN W L. SR-PredictAO: Session-Based Recommendation with High-Capability Predictor Add-On[C/OL].[2024-01-09]. https://arxiv.org/pdf/2309.12218.pdf. [29] LOH W Y.Classification and Regression Trees. WIREs: Data Mi- ning and Knowledge Discovery, 2011, 1(1): 14-23. [30] XU C F, ZHAO P P, LIU Y C, et al. Graph Contextualized Self-Attention Network for Session-Based Recommendation // Proc of the 28th International Joint Conference on Artificial Intelligence. New York,USA: ACM, 2019: 3940-3946. [31] LI A S, CHENG Z Y, LIU F, et al. Disentangled Graph Neural Networks for Session-Based Recommendation. IEEE Transactions on Knowledge and Data Engineering, 2023, 35(8): 7870-7882. [32] LIU X, LI Z, GAO Y F, et al. Enhancing User Intent Capture in Session-Based Recommendation with Attribute Patterns[C/OL].[2024-01-09]. https://openreview.net/pdf?id=AV3iZlDrzF.