Proceedings

Joint Multi-Modal Multi-Interest Profiling and Preference-Grounded Reasoning for Explainable Recommendation

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 3052-3060.

https://doi.org/10.24963/ijcai.2026/339

Abstract

Explainable Recommendation (ER) aims to enhance recommendation transparency and prediction accuracy by providing faithful and persuasive explanations. However, Multi-Modal Multi-Interest Explainable Recommendation (MMER) is particularly challenging in two aspects: effectively utilizing diverse multi-modal information to construct reliable semantic evidence and precisely identifying the most relevant user interest to generate faithful explanations. Most previous methods fail to effectively exploit visual information to provide reliable evidence and primarily rely on a single unified representation of user preferences, making it difficult to distinguish diverse user interests and generate faithful explanations. To fill this gap, we propose Joint Multi-Modal Multi-Interest Profiling and Preference-Grounded Reasoning (PRIME) for solving the MMER problem. Specifically, PRIME first organizes items into interest-aware clusters to facilitate interest disentanglement. Based on these clusters, it constructs explicit multi-modal multi-interest user profiles and a comprehensive global item profile to capture fine-grained preferences and distinguish diverse user interests. Furthermore, PRIME performs preference-grounded reasoning by retrieving the most relevant user interest for each item, enabling faithful explanations and accurate predictions. Our experiments on three real-world datasets demonstrate that PRIME outperforms the state-of-the-art methods.

  1. [Bai et al., 2023] Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, et al. Qwen technical report. arXiv preprint arXiv:2309.16609, 2023.
  2. [Dettmers et al., 2024] Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. Qlora: Efficient finetun- ing of quantized llms. In Advances in Neural Information Processing Systems (NeurIPS), volume 36, 2024.
  3. [Fang et al., 2025] Yi Fang, Wenjie Wang, Yang Zhang, Fengbin Zhu, Qifan Wang, Fuli Feng, and Xiangnan He. Reason4rec: Large language models for recommenda- tion with deliberative user preference alignment. arXiv preprint arXiv:2502.02061, 2025.
  4. [Geng et al., 2022] Shijie Geng, Shuchang Liu, Zuohui Fu, Yingqiang Ge, and Yongfeng Zhang. Recommendation as language processing (rlp): A unified pretrain, personal- ized prompt & predict paradigm (p5). In Proceedings of the 16th ACM conference on recommender systems, pages 299-315, 2022.
  5. [Hao et al., 2025] Qingbo Hao, Chundong Wang, Yingyuan Xiao, and Wenguang Zheng. Iregnn: Implicit review- enhanced graph neural network for explainable recom- mendation. Knowledge-Based Systems, 311:113113, 2025.
  6. [Hoffman and Johnson, 2016] Matthew D Hoffman and Matthew J Johnson. Elbo surgery: yet another way to carve up the variational evidence lower bound. In Work- shop in Advances in Approximate Bayesian Inference, NIPS, volume 1, 2016.
  7. [Hu et al., 2018] Guangneng Hu, Yu Zhang, and Qiang Yang. Conet: Collaborative cross networks for cross- domain recommendation. In Proceedings of the 27th ACM international conference on information and knowledge management, pages 667-676, 2018.
  8. [Hua et al., 2025] Yu Hua, Weiming Liu, Gui Xu, Yaqing Hou, Yew-Soon Ong, and Qiang Zhang. Deterministic-to- stochastic diverse latent feature mapping for human mo- tion synthesis. In Proceedings of the Computer Vision and Pattern Recognition Conference, pages 22724-22734, 2025.
  9. [Hurst et al., 2024] Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Rad- ford, et al. Gpt-4o system card. arXiv preprint arXiv:2410.21276, 2024.
  10. [Jang et al., 2016] Eric Jang, Shixiang Shane Gu, and Ben Poole. Categorical reparameterization with gumbel- softmax. ArXiv, abs/1611.01144, 2016.
  11. [Ji et al., 2023] Yitong Ji, Aixin Sun, Jie Zhang, and Chen- liang Li. A critical study on data leakage in recommender system offline evaluation. ACM Transactions on Informa- tion Systems, 41(3):1-27, 2023.
  12. [Kim et al., 2025] Jieyong Kim, Hyunseo Kim, Hyunjin Cho, SeongKu Kang, Buru Chang, Jinyoung Yeo, and Dongha Lee. Review-driven personalized preference rea- soning with large language models for recommendation. corr, abs/2408.06276, 2024. doi: 10.48550. arXiv preprint ARXIV.2408.06276, 2025.
  13. [Koren et al., 2009] Yehuda Koren, Robert Bell, and Chris Volinsky. Matrix factorization techniques for recom- mender systems. Computer, 42(8):30-37, 2009.
  14. [Li et al., 2017] Piji Li, Zihao Wang, Zhaochun Ren, Lidong Bing, and Wai Lam. Neural rating regression with abstrac- tive tips generation for recommendation. In Proceedings of the 40th International ACM SIGIR conference on Re- search and Development in Information Retrieval, pages 345-354, 2017.
  15. [Li et al., 2021] Lei Li, Yongfeng Zhang, and Li Chen. Per- sonalized transformer for explainable recommendation. arXiv preprint arXiv:2105.11601, 2021.
  16. [Li et al., 2023] Lei Li, Yongfeng Zhang, and Li Chen. Per- sonalized prompt learning for explainable recommenda- tion. ACM Transactions on Information Systems, 41(4):1- 26, 2023.
  17. [Li et al., 2025] Yuhan Li, Xinni Zhang, Linhao Luo, Heng Chang, Yuxiang Ren, Irwin King, and Jia Li. G-refer: Graph retrieval-augmented large language model for ex- plainable recommendation. In Proceedings of the ACM on Web Conference 2025, pages 240-251, 2025.
  18. [Liu et al., 2025a] Weiming Liu, Jun Dan, Fan Wang, Xint- ing Liao, Junhao Dong, Hua Yu, Shunjie Dong, and Liany- ong Qi. Distinguish then exploit: Source-free open set do- main adaptation via weight barcode estimation and sparse label assignment. In Proceedings of the Computer Vision and Pattern Recognition Conference, pages 4927-4938, 2025.
  19. [Liu et al., 2025b] Weiming Liu, Xinting Liao, Jun Dan, Fan Wang, Hua Yu, Junhao Dong, Shunjie Dong, Lianyong Qi, and Yew-Soon Ong. Solving discrete (semi) unbalanced optimal transport with equivalent transformation mecha- nism and kkt-multiplier regularization. In The Thirty-ninth Annual Conference on Neural Information Processing Sys- tems, 2025.
  20. [Liu et al., 2025c] Yuwen Liu, Lianyong Qi, Xingyuan Mao, Weiming Liu, Shichao Pei, Fan Wang, Xuyun Zhang, Amin Beheshti, and Xiaokang Zhou. Variational graph auto-encoder driven graph enhancement for sequential rec- ommendation. In Proceedings of the Thirty-Fourth Inter- national Joint Conference on Artificial Intelligence, pages 3144-3152, 2025. IJCAI
  21. [Liu et al., 2025d] Yuwen Liu, Lianyong Qi, Xingyuan Mao, Weiming Liu, Fan Wang, Xiaolong Xu, Xuyun Zhang, Wanchun Dou, Xiaokang Zhou, and Amin Beheshti. Hy- perbolic variational graph auto-encoder for next poi rec- ommendation. In Proceedings of the ACM on Web Con- ference 2025, pages 3267-3275, 2025.
  22. [Liu et al., 2026] Yuwen Liu, Lianyong Qi, Xingyuan Mao, Weiming Liu, Xuhui Fan, Qiang Ni, Xuyun Zhang, Yang Zhang, Yuan Tian, and Amin Beheshti. Hyperbolic- enhanced mixture-of-experts mamba for sequential recom- mendation. In Proceedings of the AAAI Conference on Ar- tificial Intelligence, volume 40, pages 15403-15411, 2026.
  23. [Loshchilov and Hutter, 2017] Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017.
  24. [Ma et al., 2024] Qiyao Ma, Xubin Ren, and Chao Huang. Xrec: Large language models for explainable recommen- dation. arXiv preprint arXiv:2406.02377, 2024.
  25. [Radford et al., 2021] Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agar- wal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from nat- ural language supervision. In International conference on machine learning, pages 8748-8763. PmLR, 2021.
  26. [Sabouri et al., 2025] Milad Sabouri, Masoud Mansoury, Kun Lin, and Bamshad Mobasher. Towards explainable temporal user profiling with llms. In Adjunct Proceedings of the 33rd ACM Conference on User Modeling, Adapta- tion and Personalization, pages 219-227, 2025.
  27. [Sellam et al., 2020] Thibault Sellam, Dipanjan Das, and Ankur Parikh. Bleurt: Learning robust metrics for text generation. In Proceedings of the 58th annual meeting of the association for computational linguistics, pages 7881- 7892, 2020.
  28. [Song et al., 2025] Te Song, Lianyong Qi, Weiming Liu, Fan Wang, Xiaolong Xu, Hongsheng Hu, Yang Cao, Xuyun Zhang, and Amin Beheshti. Boosting guided diffusion with large language models for multimodal sequential rec- ommendation. In Proceedings of the 33rd ACM Interna- tional Conference on Multimedia, pages 6203-6212, 2025.
  29. [Sun et al., 2025] Ying Sun, Yang Ji, Hengshu Zhu, Fuzhen Zhuang, Qing He, and Hui Xiong. Market-aware long- term job skill recommendation with explainable deep re- inforcement learning. ACM Transactions on Information Systems, 43(2):1-35, 2025.
  30. [Takama et al., 2024] Yasufumi Takama, Makito Inada, and Hiroki Shibata. Proposal on virtual user profile generation for explainable recommendation. In International Sympo- sium on Computational Intelligence and Industrial Appli- cations, pages 200-213. Springer, 2024.
  31. [Touvron et al., 2023] Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288, 2023.
  32. [Tran and Lauw, 2025] Nhu-Thuat Tran and Hady W Lauw. Parameter-efficient variational autoencoder for multi- modal multi-interest recommendation. In Proceedings of the 33rd ACM International Conference on Multimedia, pages 6412-6420, 2025.
  33. [Wardatzky et al., 2025] Kathrin Wardatzky, Oana Inel, Luca Rossetto, and Abraham Bernstein. Whom do ex- planations serve? a systematic literature survey of user characteristics in explainable recommender systems eval- uation. ACM Transactions on Recommender Systems, 3(4):1-35, 2025.
  34. [Xie et al., 2021] Jianye Xie, Haotong Sun, Junsheng Zhou, Weiguang Qu, and Xinyu Dai. Event detection as graph parsing. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 1630-1640, 2021.
  35. [Xie et al., 2026a] Jianye Xie, Chunhua Hu, Lianyong Qi, Fan Wang, Xiaolong Xu, Haolong Xiang, Xuyun Zhang, Shichao Pei, Amin Beheshti, Wanchun Dou, et al. Plikd: Prompt learning with instance-aware knowledge distilla- tion for web-scale semantic image classification. In Pro- ceedings of the ACM Web Conference 2026, pages 3788- 3799, 2026.
  36. [Xie et al., 2026b] Jianye Xie, Lianyong Qi, Weiming Liu, Anqi Wang, Xiaolong Xu, Haolong Xiang, Xuyun Zhang, Wenwen Gong, Yang Zhang, Amin Beheshti, et al. Joint similar user exploration and informative behavior guid- ance for multi-modal new item recommendation. In Pro- ceedings of the ACM Web Conference 2026, pages 6218- 6229, 2026.
  37. [Xie et al., 2026c] Jianye Xie, Lianyong Qi, Fan Wang, Anqi Wang, Wenjuan Gong, Danxin Wang, Wanchun Dou, Yang Cao, Shichao Pei, and Xiaokang Zhou. Retrieval- driven reasoning for deliberative visual classification. In Proceedings of the AAAI Conference on Artificial Intelli- gence, volume 40, pages 11060-11068, 2026.
  38. [Zhang et al., 2021] Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Shu Wu, Shuhui Wang, and Liang Wang. Mining latent structures for multimedia recommendation. In Pro- ceedings of the 29th ACM international conference on multimedia, pages 3872-3880, 2021.
  39. [Zhang et al., 2025] Yang Zhang, Fuli Feng, Jizhi Zhang, Keqin Bao, Qifan Wang, and Xiangnan He. Collm: In- tegrating collaborative embeddings into large language models for recommendation. IEEE Transactions on Knowledge and Data Engineering, 2025.
  40. [Zhou et al., 2025] Peilin Zhou, Chao Liu, Jing Ren, Xin- feng Zhou, Yueqi Xie, Meng Cao, Zhongtao Rao, You- Liang Huang, Dading Chong, Junling Liu, et al. When large vision language models meet multimodal sequential recommendation: An empirical study. In Proceedings of the ACM on Web Conference 2025, pages 275-292, 2025.
  41. [Zhu et al., 2022] Jihua Zhu, Yujiao He, Guoshuai Zhao, Xuxiao Bu, and Xueming Qian. Joint reason genera- tion and rating prediction for explainable recommenda- tion. IEEE Transactions on Knowledge and Data Engi- neering, 35(5):4940-4953, 2022.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards