RoSA: A Robust Self-Aligned Framework for Node-Node Graph Contrastive Learning

RoSA: A Robust Self-Aligned Framework for Node-Node Graph Contrastive Learning

Yun Zhu, Jianhao Guo, Fei Wu, Siliang Tang

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence
Main Track. Pages 3795-3801. https://doi.org/10.24963/ijcai.2022/527

Graph contrastive learning has gained significant progress recently. However, existing works have rarely explored non-aligned node-node contrasting. In this paper, we propose a novel graph contrastive learning method named RoSA that focuses on utilizing non-aligned augmented views for node-level representation learning. First, we leverage the earth mover's distance to model the minimum effort to transform the distribution of one view to the other as our contrastive objective, which does not require alignment between views. Then we introduce adversarial training as an auxiliary method to increase sampling diversity and enhance the robustness of our model. Experimental results show that RoSA outperforms a series of graph contrastive learning frameworks on homophilous, non-homophilous and dynamic graphs, which validates the effectiveness of our work. To the best of our awareness, RoSA is the first work focuses on the non-aligned node-node graph contrastive learning problem. Our codes are available at: https://github.com/ZhuYun97/RoSA
Keywords:
Machine Learning: Sequence and Graph Learning
Machine Learning: Self-supervised Learning
Machine Learning: Representation learning
Machine Learning: Robustness