Proceedings

CONC: Complex-noise-resistant Open-set Node Classification with Adaptive Noise Detection

Download BibTeX Cite

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence. Main Track. Pages 5481-5489.

https://doi.org/10.24963/ijcai.2024/606

Abstract

As a popular task in graph learning, node classification seeks to assign labels to nodes, taking into account both their features and connections. However, an important challenge for its application in real-world scenarios is the presence of newly-emerged out-of-distribution samples and noisy samples, which affect the quality and robustness of learned classifiers. Out-of-distribution (OOD) samples are often found in both the training and testing phases. Such samples don’t belong to any known categories. These OOD samples are considered as outliers (OOD noise) when they appear during training, and are recognized as open-set samples during the testing. Meanwhile, in-distribution (IND) noisy data, i.e., known class samples with wrong labels, are also prevalent and inevitably degrade a model’s performance. The challenge of open-set learning with complex IND and OOD noise remains largely unexplored, particularly when dealing with non-IID graph data. To address these challenges, this paper introduces a novel complex-noise-resistant open-set node classification approach, designed for open-set graph data containing both IND and OOD noisy nodes. Specifically, a trustworthiness learner is adopted to learn the trustworthiness rates of the feature and label for each node while a decoder and an open-set classifier are trained to reconstruct the structure of a node and to predict its category simultaneously with the guidance of node trustworthiness. The experimental results demonstrate the superiority of our method.

  1. [Bendale and Boult, 2016] Abhijit Bendale and Terrance E Boult. Towards open set deep networks. In IEEE con- ference on computer vision and pattern recognition, pages 1563-1572, 2016.
  2. [Chereda et al., 2019] Hryhorii Chereda, Annalen Bleck- mann, Frank Kramer, Andreas Leha, and Tim Beissbarth. Utilizing molecular network information via graph con- volutional neural networks to predict metastatic event in breast cancer. In GMDS, pages 181-186, 2019.
  3. [Denouden et al., 2018] Taylor Denouden, Rick Salay, Krzysztof Czarnecki, Vahdat Abdelzad, Buu Phan, and Sachin Vernekar. Improving reconstruction autoencoder out-of-distribution detection with mahalanobis distance. arXiv preprint arXiv:1812.02765, 2018.
  4. [Gilmer et al., 2017] Justin Gilmer, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E Dahl. Neu- ral message passing for quantum chemistry. In Interna- tional conference on machine learning, pages 1263-1272.
  5. PMLR, 2017.
  6. [Hamilton et al., 2017] Will Hamilton, Zhitao Ying, and Jure Leskovec. Inductive representation learning on large graphs. Neural information processing systems, 30, 2017.
  7. [Han et al., 2018] Bo Han, Quanming Yao, Xingrui Yu, Gang Niu, Miao Xu, Weihua Hu, Ivor Tsang, and Masashi Sugiyama. Co-teaching: Robust training of deep neural networks with extremely noisy labels. Advances in neural information processing systems, 31, 2018.
  8. [Hu et al., 2020] Weihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong, Hongyu Ren, Bowen Liu, Michele Catasta, and Jure Leskovec. Open graph benchmark: Datasets for machine learning on graphs. Advances in neural informa- tion processing systems, 33:22118-22133, 2020.
  9. [Huang et al., 2022] Hongzhi Huang, Yu Wang, Qinghua Hu, and Ming-Ming Cheng. Class-specific semantic re- construction for open set recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, pages 4214 -4228, 2022.
  10. [Jiang et al., 2018] Lu Jiang, Zhengyuan Zhou, Thomas Le- ung, Li-Jia Li, and Li Fei-Fei. Mentornet: Learning data- driven curriculum for very deep neural networks on cor- rupted labels. In International conference on machine learning, pages 2304-2313. PMLR, 2018.
  11. [Kipf and Welling, 2016] Thomas N Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907, 2016.
  12. [Lee et al., 2019] Kimin Lee, Sukmin Yun, Kibok Lee, Honglak Lee, Bo Li, and Jinwoo Shin. Robust inference via generative classifiers for handling noisy labels. In In- ternational conference on machine learning, pages 3763- 3772. PMLR, 2019.
  13. [Liang et al., 2017] Shiyu Liang, Yixuan Li, and Rayadurgam Srikant. Enhancing the reliability of out-of-distribution image detection in neural networks. arXiv preprint arXiv:1706.02690, 2017.
  14. [Liu et al., 2021] Zemin Liu, Yuan Fang, Chenghao Liu, and Steven CH Hoi. Relative and absolute location embedding for few-shot node classification on graph. In AAAI Con- ference on Artificial Intelligence, volume 35, pages 4267- 4275, 2021.
  15. [Malach and Shalev-Shwartz, 2017] Eran Malach and Shai Shalev-Shwartz. Decoupling" when to update" from" how to update". Advances in neural information processing systems, 30, 2017.
  16. [Natarajan et al., 2013] Nagarajan Natarajan, Inderjit S Dhillon, Pradeep K Ravikumar, and Ambuj Tewari. Learn- ing with noisy labels. Advances in neural information pro- cessing systems, 26, 2013.
  17. [Patrini et al., 2017] Giorgio Patrini, Alessandro Rozza, Aditya Krishna Menon, Richard Nock, and Lizhen Qu. Making deep neural networks robust to label noise: A loss correction approach. In Proceedings of the IEEE confer- ence on computer vision and pattern recognition, pages 1944-1952, 2017.
  18. [Reed et al., 2014] Scott Reed, Honglak Lee, Dragomir Anguelov, Christian Szegedy, Dumitru Erhan, and Andrew Rabinovich. Training deep neural networks on noisy la- bels with bootstrapping. arXiv preprint arXiv:1412.6596, 2014.
  19. [Ren et al., 2018] Mengye Ren, Wenyuan Zeng, Bin Yang, and Raquel Urtasun. Learning to reweight examples for robust deep learning. In International conference on ma- chine learning, pages 4334-4343. PMLR, 2018.
  20. [Song et al., 2019] Hwanjun Song, Minseok Kim, and Jae- Gil Lee. Selfie: Refurbishing unclean samples for robust deep learning. In International Conference on Machine Learning, pages 5907-5915. PMLR, 2019.
  21. [Sun et al., 2020a] Xin Sun, Zhenning Yang, Chi Zhang, Keck-Voon Ling, and Guohao Peng. Conditional gaussian distribution learning for open set recognition. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13480-13489, 2020.
  22. [Sun et al., 2020b] Zeren Sun, Xian-Sheng Hua, Yazhou Yao, Xiu-Shen Wei, Guosheng Hu, and Jian Zhang. Crssc: salvage reusable samples from noisy data for robust learn- ing. In Proceedings of the 28th ACM International Con- ference on Multimedia, pages 92-101, 2020.
  23. [Sun et al., 2022] Zeren Sun, Fumin Shen, Dan Huang, Qiong Wang, Xiangbo Shu, Yazhou Yao, and Jinhui Tang. Pnp: Robust learning from noisy labels by probabilistic noise prediction. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, pages 5311-5320, 2022.
  24. [Tang et al., 2022] Mingyue Tang, Carl Yang, and Pan Li. Graph auto-encoder via neighborhood wasserstein recon- struction. arXiv preprint arXiv:2202.09025, 2022.
  25. [Veličković et al., 2017] Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. Graph attention networks. arXiv preprint arXiv:1710.10903, 2017.
  26. [Wang et al., 2018] Yisen Wang, Weiyang Liu, Xingjun Ma, James Bailey, Hongyuan Zha, Le Song, and Shu-Tao Xia. Iterative learning with open-set noisy labels. In Proceed- ings of the IEEE conference on computer vision and pat- tern recognition, pages 8688-8696, 2018.
  27. [Wei et al., 2020] Hongxin Wei, Lei Feng, Xiangyu Chen, and Bo An. Combating noisy labels by agreement: A joint training method with co-regularization. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 13726-13735, 2020.
  28. [Wong et al., 2021] Randy Yee Man Wong, Christy MK Cheung, Bo Xiao, and Jason Bennett Thatcher. Standing up or standing by: Understanding bystanders' proactive re- porting responses to social media harassment. Information Systems Research, 32(2):561-581, 2021.
  29. [Wu et al., 2020] Man Wu, Shirui Pan, and Xingquan Zhu. Openwgl: Open-world graph learning. In IEEE interna- tional conference on data mining, pages 681-690, 2020.
  30. [Wu et al., 2021] Zhi-Fan Wu, Tong Wei, Jianwen Jiang, Chaojie Mao, Mingqian Tang, and Yu-Feng Li. Ngc: A unified framework for learning with open-world noisy data. In Proceedings of the IEEE/CVF International Con- ference on Computer Vision, pages 62-71, 2021.
  31. [Wu et al., 2024] Man Wu, Xin Zheng, Qin Zhang, Xiao Shen, Xiong Luo, Xingquan Zhu, and Shirui Pan. Graph learning under distribution shifts: A comprehensive sur- vey on domain adaptation, out-of-distribution, and contin- ual learning. arXiv preprint arXiv:2402.16374, 2024.
  32. [Yang et al., 2022] Yijun Yang, Ruiyuan Gao, and Qiang Xu. Out-of-distribution detection with semantic mismatch un- der masking. In Computer Vision-ECCV 2022: 17th Eu- ropean Conference, Tel Aviv, Israel, October 23-27, 2022, Proceedings, Part XXIV, pages 373-390. Springer, 2022.
  33. [Yao et al., 2021] Yazhou Yao, Zeren Sun, Chuanyi Zhang, Fumin Shen, Qi Wu, Jian Zhang, and Zhenmin Tang. Jo- src: A contrastive approach for combating noisy labels. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5192-5201, 2021.
  34. [Yu et al., 2017] Yang Yu, Wei-Yang Qu, Nan Li, and Zimin Guo. Open-category classification by adversarial sample generation. In International Joint Conference on Artificial Intelligence, pages 3357-3363, 2017. IJCAI
  35. [Zhang et al., 2018] Qinzhe Zhang, Jia Wu, Qin Zhang, Peng Zhang, Guodong Long, and Chengqi Zhang. Dual influence embedded social recommendation. World Wide Web, 21:849-874, 2018.
  36. [Zhang et al., 2021] Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals. Understand- ing deep learning (still) requires rethinking generalization. Communications of the ACM, 64(3):107-115, 2021.
  37. [Zhang et al., 2022a] Qin Zhang, Shangsi Chen, Dongkuan Xu, Qingqing Cao, Xiaojun Chen, Trevor Cohn, and Meng Fang. A survey for efficient open domain question answer- ing. arXiv preprint arXiv:2211.07886, 2022.
  38. [Zhang et al., 2022b] Qin Zhang, Qincai Li, Xiaojun Chen, Peng Zhang, Shirui Pan, Philippe Fournier-Viger, and Joshua Zhexue Huang. A dynamic variational framework for open-world node classification in structured sequences. In 2022 IEEE International Conference on Data Mining (ICDM), pages 703-712. IEEE, 2022.
  39. [Zhang et al., 2023] Qin Zhang, Zelin Shi, Xiaolin Zhang, Xiaojun Chen, Philippe Fournier-Viger, and Shirui Pan. G 2 pxy: Generative open-set node classification on graphs with proxy unknowns. arXiv preprint arXiv:2308.05463, 2023.
  40. [Zhang et al., 2024] Qin Zhang, Hao Ge, Xiaojun Chen, and Meng Fang. Unsupervised multiple choices ques- tion answering via universal corpus. arXiv preprint arXiv:2402.17333, 2024.
  41. [Zheng et al., 2020] Chuanpan Zheng, Xiaoliang Fan, Cheng Wang, and Jianzhong Qi. Gman: A graph multi-attention network for traffic prediction. In AAAI Conference on Artificial Intelligence, volume 34, pages 1234-1241, 2020.
  42. [Zhu et al., 2022] Qi Zhu, Chao Zhang, Chanyoung Park, Carl Yang, and Jiawei Han. Shift-robust node classifi- cation via graph adversarial clustering. arXiv preprint arXiv:2203.15802, 2022.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards