Proceedings

Robust Heterophilic Graph Learning against Label Noise for Anomaly Detection

Download BibTeX Cite

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence. Main Track. Pages 2451-2459.

https://doi.org/10.24963/ijcai.2024/271

Abstract

Given clean labels, Graph Neural Networks (GNNs) have shown promising abilities for graph anomaly detection. However, real-world graphs are inevitably noisy labeled, which drastically degrades the performance of GNNs. To alleviate it, some studies follow the local consistency (a.k.a homophily) assumption to conduct neighborhood-based label noise correction, and to dense raw graphs using raw features or representations learned by poisoned labels. But for the anomaly detection task, the graph is not always homophilic but more likely to be heterophilic, which would corrupt the above assumption due to complicating connection patterns and impairing the effects of message passing. To this end, we propose a novel label noise-resistant graph learning (NRGL) framework, which facilitates robust graph learning from the perspectives of structure augmentation and fine-grained label governance. Specifically, we first present an investigation to verify that increasing graph homophily could help resist label noise. Based on the observation, an unsupervised contrastive learning paradigm is then introduced so well that it cannot only adaptively extract the dual views from the raw graph as structure augmentation, but also enhance the robustness of node representations. Next, given robust node representations, the noisy labels are divided into three candidate sets based on the small-loss criterion for fine-grained noise governance. Furthermore, a node sampler is designed to take structure importance, class frequency, and confidence score into consideration, which helps select reliable and important nodes for training. Extensive experiments on real-world datasets demonstrate the effectiveness of our method.

  1. [Arpit et al., 2017] Devansh Arpit, Stanislaw Jastrzebski, Nicolas Ballas, David Krueger, Emmanuel Bengio, Maxinder S Kanwal, Tegan Maharaj, Asja Fischer, Aaron Courville, Yoshua Bengio, et al. A closer look at memo- rization in deep networks. In Proceedings of International conference on machine learning(ICLR), pages 233-242.
  2. PMLR, 2017.
  3. [Chai et al., 2022] Ziwei Chai, Siqi You, Yang Yang, Shil- iang Pu, Jiarong Xu, Haoyang Cai, and Weihao Jiang. Can abnormality be detected by graph neural networks. In Pro- ceedings of the 29th International Joint Conference on Ar- tificial Intelligence (IJCAI), pages 23-29, 2022. IJCAI
  4. [Dai et al., 2021] Enyan Dai, Charu Aggarwal, and Suhang Wang. Nrgnn: Learning a label noise resistant graph neu- ral network on sparsely and noisily labeled graphs. In Pro- ceedings of the 27th ACM SIGKDD Conference on Knowl- edge Discovery and Data Mining, pages 227-236, 2021.
  5. [Ghosh et al., 2017] Aritra Ghosh, Himanshu Kumar, and P Shanti Sastry. Robust loss functions under label noise for deep neural networks. In Proceedings of the AAAI con- ference on artificial intelligence, pages 1919-1925, 2017.
  6. [Goldberger and Ben-Reuven, 2016] Jacob Goldberger and Ehud Ben-Reuven. Training deep neural-networks using a noise adaptation layer. In Proceedings of International conference on learning representations, pages 1-9, 2016.
  7. [Hamilton et al., 2017] Will Hamilton, Zhitao Ying, and Jure Leskovec. Inductive representation learning on large graphs. In Proceedings of Advances in neural information processing systems, pages 1024-1034, 2017.
  8. [Han et al., 2018] Bo Han, Quanming Yao, Xingrui Yu, Gang Niu, Miao Xu, Weihua Hu, Ivor Tsang, and Masashi Sugiyama. Co-teaching: Robust training of deep neural networks with extremely noisy labels. In Proceedings of Advances in neural information processing systems, pages 8536-8546, 2018.
  9. [Huang et al., 2019] Jinchi Huang, Lie Qu, Rongfei Jia, and Binqiang Zhao. O2u-net: A simple noisy label detection approach for deep neural networks. In Proceedings of the IEEE/CVF international conference on computer vision, pages 3326-3334, 2019.
  10. [Jiang et al., 2018] Lu Jiang, Zhengyuan Zhou, Thomas Le- ung, Li-Jia Li, and Li Fei-Fei. Mentornet: Learning data- driven curriculum for very deep neural networks on cor- rupted labels. In Proceedings of International conference on machine learning, pages 2304-2313. PMLR, 2018.
  11. [Jin et al., 2023] Di Jin, Bingdao Feng, Siqi Guo, Xiaobao Wang, Jianguo Wei, and Zhen Wang. Local-global de- fense against unsupervised adversarial attacks on graphs. In Proceedings of the AAAI Conference on Artificial Intel- ligence, pages 8105-8113, 2023.
  12. [Kipf and Welling, 2017] Thomas N Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In Proceedings of 5th International Conference on Learning Representations(ICLR), pages 1-14, 2017.
  13. [Li et al., 2022] Kuan Li, Yang Liu, Xiang Ao, Jianfeng Chi, Jinghua Feng, Hao Yang, and Qing He. Reliable represen- tations make a stronger defender: Unsupervised structure refinement for robust gnn. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 925-935, 2022.
  14. [Li et al., 2024] Xianxian Li, Qiyu Li, Haodong Qian, Jinyan Wang, et al. Contrastive learning of graphs under label noise. Neural Networks, 172:1-12, 2024.
  15. [Liu et al., 2021] Yang Liu, Xiang Ao, Zidi Qin, Jianfeng Chi, Jinghua Feng, Hao Yang, and Qing He. Pick and choose: a gnn-based imbalanced learning approach for fraud detection. In Proceedings of International World Wide Web Conferences, pages 3168-3177, 2021.
  16. [NT et al., 2019] Hoang NT, Choong Jun Jin, and Tsuyoshi Murata. Learning graph neural networks with noisy labels. arXiv preprint arXiv:1905.01591, pages 1-5, 2019.
  17. [Patrini et al., 2017] Giorgio Patrini, Alessandro Rozza, Aditya Krishna Menon, Richard Nock, and Lizhen Qu. Making deep neural networks robust to label noise: A loss correction approach. In Proceedings of the IEEE confer- ence on computer vision and pattern recognition, pages 1944-1952, 2017.
  18. [Qian et al., 2023] Siyi Qian, Haochao Ying, Renjun Hu, Jingbo Zhou, Jintai Chen, Danny Z Chen, and Jian Wu. Robust training of graph neural networks via noise gover- nance. In Proceedings of the 16th ACM International Con- ference on Web Search and Data Mining (WSDM), pages 607-615, 2023.
  19. [Rayana and Akoglu, 2015] Shebuti Rayana and Leman Akoglu. Collective opinion spam detection: Bridging re- view networks and metadata. In Proceedings of the 21th ACM SIGKDD International CSonference on Knowledge Discovery and Data Mining, pages 985-994, 2015.
  20. [Tang et al., 2022] Jianheng Tang, Jiajin Li, Ziqi Gao, and Jia Li. Rethinking graph neural networks for anomaly de- tection. In Proceedings of International Conference on Machine Learning, pages 21076-21089. PMLR, 2022.
  21. [Wang et al., 2019] Yisen Wang, Xingjun Ma, Zaiyi Chen, Yuan Luo, Jinfeng Yi, and James Bailey. Symmetric cross entropy for robust learning with noisy labels. In Proceed- ings of the IEEE/CVF international conference on com- puter vision, pages 322-330, 2019.
  22. [Weber et al., 2019] Mark Weber, Giacomo Domeniconi, Jie Chen, Daniel Karl I Weidele, Claudio Bellei, Tom Robin- son, and Charles Leiserson. Anti-money laundering in bit- coin: Experimenting with graph convolutional networks for financial forensics. In ACM SIGKDD International Conference on Knowledge Discovery and Data Mining in Finance Workshop, pages 1-7, 2019.
  23. [Wu et al., 2022] Shiwen Wu, Fei Sun, Wentao Zhang, Xu Xie, and Bin Cui. Graph neural networks in rec- ommender systems: a survey. ACM Computing Surveys, 55(5):1-37, 2022.
  24. [Yu et al., 2019] Xingrui Yu, Bo Han, Jiangchao Yao, Gang Niu, Ivor Tsang, and Masashi Sugiyama. How does dis- agreement help generalization against label corruption? In Proceedings of International Conference on Machine Learning, pages 7164-7173. PMLR, 2019.
  25. [Yuan et al., 2023] Jingyang Yuan, Xiao Luo, Yifang Qin, Yusheng Zhao, Wei Ju, and Ming Zhang. Learning on graphs under label noise. In Proceedings of International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1-5. IEEE, 2023.
  26. [Zhang and Sabuncu, 2018] Zhilu Zhang and Mert Sabuncu. Generalized cross entropy loss for training deep neural networks with noisy labels. In Proceedings of Advances in neural information processing systems, pages 8792-8802, 2018.
  27. [Zhang et al., 2021] Ge Zhang, Jia Wu, Jian Yang, Amin Beheshti, Shan Xue, Chuan Zhou, and Quan Z Sheng. Fraudre: Fraud detection dual-resistant to graph inconsis- tency and imbalance. In Proceedings of International Con- ference on Data Mining (ICDM), pages 867-876. IEEE, 2021.
  28. [Zhao et al., 2023] Ruoyan Zhao, Zhou Shao, Wenhu Zhang, Jiachen Zhang, and Chunming Wu. A multi-channel multi- tower gnn model for job transfer prediction based on aca- demic social network. Applied Soft Computing, 142:1-10, 2023.
  29. [Zheng et al., 2023] Wen Zheng, Bingbing Xu, Emiao Lu, Yang Li, Qi Cao, Xuan Zong, and Huawei Shen. Midlg: Mutual information based dual level gnn for transaction fraud complaint verification. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 5685-5694, 2023.
  30. [Zhu et al., 2020] Jiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann, Leman Akoglu, and Danai Koutra. Be- yond homophily in graph neural networks: Current limita- tions and effective designs. In Proceedings of Advances in neural information processing systems, pages 7793-7804, 2020.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards