Proceedings

Critical Node-aware Augmentation for Hypergraph Contrastive Learning

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 5671-5679.

https://doi.org/10.24963/ijcai.2025/631

Abstract

Hypergraph contrastive learning enables effective representation learning for hypergraphs without requiring labels. However, existing methods typically rely on randomly deleting or replacing nodes during hypergraph augmentation, which may lead to the absence of critical nodes and further disrupt the higher-order structural relationships within augmented hypergraphs. To address this issue, we propose a Critical Node-aware hypergraph contrastive learning method, which is the first attempt to leverage hyperedge prediction to retain critical nodes and accordingly maintain the reliable higher-order structural relationships within augmented hypergraphs. Specifically, we first employ contrastive learning to align the augmented hypergraphs, and then generate hyperedge embeddings to characterize node representations and their structural correlations. During the hyperedge embedding encoding process, we introduce a hyperedge prediction discriminator to score these embeddings, which quantifies the nodes' contributions to identify the critical nodes and maintain the higher-order structural relationships within augmented hypergraphs. Compared with previous studies, our proposed method can effectively alleviate the erroneous deletion or replacement of critical nodes and steadily maintain the inherent structural relationships between original hypergraph and augmented hypergraphs, naturally guiding better hypergraph representations for downstream tasks. Extensive experiments on various tasks demonstrate that our method is significantly superior to state-of-the-art methods.

  1. [Bai et al., 2021] Song Bai, Feihu Zhang, and Philip H.S. Torr. Hypergraph convolution and hypergraph attention. Pattern Recognition, 110:107637, 2021.
  2. [Chien et al., 2022] Eli Chien, Chao Pan, Jianhao Peng, and Olgica Milenkovic. You are allset: A multiset function framework for hypergraph neural networks. In Interna- tional Conference on Learning Representations, pages 1- 24, 2022.
  3. [Feng et al., 2019] Yifan Feng, Haoxuan You, Zizhao Zhang, Rongrong Ji, and Yue Gao. Hypergraph neural net- works. In AAAI conference on artificial intelligence, pages 3558-3565, 2019.
  4. [Grover and Leskovec, 2016] Aditya Grover and Jure Leskovec. node2vec: Scalable feature learning for networks. In ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 855-864, 2016.
  5. [Han et al., 2024] Jiadi Han, Yufei Tang, Qian Tao, Yuhan Xia, and Liming Zhang. Dual homogeneity hypergraph motifs with cross-view contrastive learning for multiple social recommendations. ACM Transactions on Knowl- edge Discovery from Data, 18(6):1-24, 2024.
  6. [Huang and Yang, 2021] Jing Huang and Jie Yang. Unignn: a unified framework for graph and hypergraph neural net- works. In International Joint Conference on Artificial In- telligence, pages 2563-2569, 2021. IJCAI
  7. [Hwang et al., 2022] Hyunjin Hwang, Seungwoo Lee, Chanyoung Park, and Kijung Shin. Ahp: Learning to negative sample for hyperedge prediction. In International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 2237-2242, 2022.
  8. [Kipf and Welling, 2017] Thomas N. Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In International Conference on Learning Rep- resentations, pages 1-14, 2017.
  9. [Lee and Chae, 2024] Jongsoo Lee and Dong-Kyu Chae. Multi-view mixed attention for contrastive learning on hy- pergraphs. In International ACM SIGIR Conference on Re- search and Development in Information Retrieval, pages 2543-2547, 2024.
  10. [Lee and Shin, 2023] Dongjin Lee and Kijung Shin. I'm me, we're us, and i'm us: Tri-directional contrastive learning on hypergraphs. In AAAI Conference on Artificial Intelli- gence, pages 8456-8464, 2023.
  11. [Lee et al., 2024] Geon Lee, Soo Yong Lee, and Kijung Shin. Villain: Self-supervised learning on homogeneous hypergraphs without features via virtual label propagation. In ACM on Web Conference, pages 594-605, 2024.
  12. [Lin et al., 2021] Zhuoyi Lin, Lei Feng, Rui Yin, Chi Xu, and Chee Keong Kwoh. Glimg: Global and local item graphs for top-n recommender systems. Information Sci- ences, 580:1-14, 2021.
  13. [Qian et al., 2024] Yiyue Qian, Tianyi Ma, Chuxu Zhang, and Yanfang Ye. Dual-level hypergraph contrastive learn- ing with adaptive temperature enhancement. In ACM Web Conference, page 859-862, 2024.
  14. [Ren et al., 2024] Guojing Ren, Xiao Ding, Xiao-Ke Xu, and Hai-Feng Zhang. Link prediction in multilayer networks via cross-network embedding. In AAAI Conference on Ar- tificial Intelligence, pages 8939-8947, 2024.
  15. [Saifuddin et al., 2023] Khaled Mohammed Saifuddin, Bri- ana Bumgardner, Farhan Tanvir, and Esra Akbas. Hygnn: Drug-drug interaction prediction via hypergraph neural network. In International Conference on Data Engineer- ing, pages 1503-1516, 2023.
  16. [Veličković et al., 2019] Petar Veličković, William Fedus, William L. Hamilton, Pietro Liò, Yoshua Bengio, and R Devon Hjelm. Deep graph infomax. In Interna- tional Conference on Learning Representations, pages 1- 17, 2019.
  17. [Wan et al., 2023] Sheng Wan, Yibing Zhan, Shuo Chen, Shirui Pan, Jian Yang, Dacheng Tao, and Chen Gong. Boosting graph contrastive learning via adaptive sampling. IEEE Transactions on Neural Networks and Learning Sys- tems, 35(11):1-13, 2023.
  18. [Wang et al., 2023] Chenxu Wang, Xin Wang, Zhao Li, Zirui Chen, and Jianxin Li. Hyconve: A novel embedding model for knowledge hypergraph link prediction with convolu- tional neural networks. In ACM Web Conference, pages 188-198, 2023.
  19. [Wei et al., 2022] Tong Wei, Hai Wang, Weiwei Tu, and Yufeng Li. Robust model selection for positive and un- labeled learning with constraints. Science China Informa- tion Sciences, 65(11):212101, 2022.
  20. [Wu et al., 2024] Hanrui Wu, Nuosi Li, Jia Zhang, Sentao Chen, Michael K Ng, and Jinyi Long. Collaborative con- trastive learning for hypergraph node classification. Pat- tern Recognition, 146:109995, 2024.
  21. [Xu et al., 2023] Jie Xu, Shuo Chen, Yazhou Ren, Xi- aoshuang Shi, Hengtao Shen, Gang Niu, and Xiaofeng Zhu. Self-weighted contrastive learning among multiple views for mitigating representation degeneration. In Ad- vances in Neural Information Processing Systems, pages 1119-1131, 2023.
  22. [Yadati et al., 2019] Naganand Yadati, Madhav Nimishakavi, Prateek Yadav, Vikram Nitin, Anand Louis, and Partha Talukdar. Hypergcn: A new method for training graph convolutional networks on hypergraphs. Advances in Neural Information Processing Systems, 32:850, 2019.
  23. [Yadati et al., 2020] Naganand Yadati, Vikram Nitin, Mad- hav Nimishakavi, Prateek Yadav, Anand Louis, and Partha Talukdar. Nhp: Neural hypergraph link prediction. In ACM International Conference on Information & Knowl- edge Management, page 1705-1714, 2020.
  24. [You et al., 2020] Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, and Yang Shen. Graph con- trastive learning with augmentations. In Advances in Neu- ral Information Processing Systems, pages 5812-5823, 2020.
  25. [Zhang et al., 2020] Ruochi Zhang, Yuesong Zou, and Jian Ma. Hyper-sagnn: a self-attention based graph neural network for hypergraphs. In International Conference on Learning Representations, pages 1-7, 2020.
  26. [Zhu et al., 2020] Yanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu, Shu Wu, and Liang Wang. Deep graph contrastive representation learning. In ICML Workshop on Graph Representation Learning and Beyond, pages 1-17, 2020.
  27. [Zhu et al., 2023] Jianian Zhu, Weixin Zeng, Junfeng Zhang, Jiuyang Tang, and Xiang Zhao. Cross-view graph con- trastive learning with hypergraph. Information Fusion, 99:101867, 2023.
  28. [Zhu et al., 2024] Yonghua Zhu, Lei Feng, Zhenyun Deng, Yang Chen, Robert Amor, and Michael Witbrock. Ro- bust node classification on graph data with graph and label noise. In AAAI conference on artificial intelligence, pages 17220-17227, 2024.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards