Proceedings

MolHFCNet: Enhancing Molecular Graph Representations with Hierarchical Feature Combining and Hybrid Pretraining

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. AI4Tech: AI Enabling Technologies. Pages 9313-9321.

https://doi.org/10.24963/ijcai.2025/1035

Abstract

Efficient molecular property prediction is crucial in bioinformatics and cheminformatics, with applications in drug discovery, materials science, and chemical engineering. This paper introduces MolHFCNet, a graph neural network designed to enhance molecular representation learning. At its core, the n-Hierarchical Features Combining (n-HFC) module aggregates information across multiple hierarchical feature spaces, effectively capturing both local and global graph structures. Unlike conventional models, n-HFC maintains computational complexity comparable to a single full-dimensional graph layer while supporting either 2D or 3D molecular graphs, ensuring flexibility across tasks. Furthermore, we propose a novel graph pretraining strategy that integrates predictive and contrastive learning, enabling the model to capture local chemical interactions and global molecular contexts for robust embeddings. Experimental results on benchmark datasets demonstrate MolHFCNet’s superior accuracy and efficiency compared to state-of-the-art methods, highlighting the potential of high-order hierarchical feature learning for advancing molecular graph analysis. Our code is available at https://github.com/ndlongvn/MolHFCNet.

  1. [Alberga et al., 2024] Domenico Alberga, Giuseppe Lamanna, Giovanni Graziano, Pietro Delre, Maria Cristina Lomuscio, et al. DeLA-DrugSelf: Empowering multi- objective de novo design through SELFIES molecular representation. Computers in Biology and Medicine, 175:108486, 2024.
  2. [Baek et al., 2021] Jinheon Baek, Minki Kang, and Sung Ju Hwang. Accurate learning of graph representations with graph multiset pooling. arXiv:2102.11533, 2021.
  3. [Chen et al., 2020] Ting Chen, Simon Kornblith, Moham- mad Norouzi, and Geoffrey Hinton. A simple framework for contrastive learning of visual representations. In Inter- national Conference on Machine Learning, pages 1597- 1607. PMLR, 2020.
  4. [Chithrananda et al., 2020] Seyone Chithrananda, Gabriel Grand, and Bharath Ramsundar. ChemBERTa: Large- scale self-supervised pretraining for molecular property prediction. arXiv:2010.09885, 2020.
  5. [Danel et al., 2020] Tomasz Danel, Przemysław Spurek, Jacek Tabor, Marek Śmieja, Łukasz Struski, Agnieszka Słowik, and Łukasz Maziarka. Spatial graph convolutional networks. In International Conference on Neural Informa- tion Processing, pages 668-675. Springer, 2020.
  6. [Davies and Bouldin, 1979] David L Davies and Donald W Bouldin. A cluster separation measure. IEEE Trans- actions on Pattern Analysis and Machine Intelligence, PAMI-1(2):224-227, 1979.
  7. [Duan et al., 2022] Keyu Duan, Zirui Liu, Peihao Wang, Wenqing Zheng, Kaixiong Zhou, Tianlong Chen, Xia Hu, and Zhangyang Wang. A comprehensive study on large-scale graph training: Benchmarking and rethink- ing. Advances in Neural Information Processing Systems, 35:5376-5389, 2022.
  8. [Gasteiger et al., 2020] Johannes Gasteiger, Shankari Giri, Johannes T. Margraf, and Stephan Günnemann. Fast and uncertainty-aware directional message passing for non- equilibrium molecules. arXiv:2011.14115, 2020.
  9. [Gilmer et al., 2017] Justin Gilmer, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E Dahl. Neu- ral message passing for quantum chemistry. In Inter- national Conference on Machine Learning, pages 1263- 1272. PMLR, 2017.
  10. [Hu et al., 2016] Ye Hu, Dagmar Stumpfe, and Jürgen Ba- jorath. Computational exploration of molecular scaffolds in medicinal chemistry. Journal of Medicinal Chemistry, 59(9):4062-4076, 2016.
  11. [Hu et al., 2020] Weihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik, Percy Liang, Vijay Pande, and Jure Leskovec. Strategies for pre-training graph neural net- works. In International Conference on Learning Repre- sentations, 2020.
  12. [Kim et al., 2020] Sunghwan Kim, Jie Chen, Tiejun Cheng, Asta Gindulyte, Jia He, Siqian He, Qingliang Li, Ben- jamin A Shoemaker, Paul A Thiessen, Bo Yu, Leonid Za- slavsky, Jian Zhang, and Evan E Bolton. PubChem in 2021: new data content and improved web interfaces. Nu- cleic Acids Research, 49(D1):D1388-D1395, 2020.
  13. [Kipf and Welling, 2017] Thomas N. Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In International Conference on Learning Rep- resentations, 2017.
  14. [Klicpera et al., 2021] Johannes Klicpera, Florian Becker, and Stephan Günnemann. GemNet: Universal directional graph neural networks for molecules. In Proceedings of the 35th International Conference on Neural Information Processing Systems, pages 6790-6802, 2021.
  15. [Landrum et al., 2024] Greg Landrum, Paolo Tosco, Brian Kelley, Ricardo Rodriguez, David Cosgrove, et al. RD- Kit: A software suite for cheminformatics, computational chemistry, and predictive modeling, 2024.
  16. [Li et al., 2020] Pengyong Li, Jun Wang, Yixuan Qiao, Hao Chen, Yihuan Yu, Xiaojun Yao, Peng Gao, Guotong Xie, and Sen Song. Learn molecular representations from large-scale unlabeled molecules for drug discovery. arXiv:2012.11175, 2020.
  17. [Li et al., 2021] Pengyong Li, Yuquan Li, Chang-Yu Hsieh, Shengyu Zhang, Xianggen Liu, Huanxiang Liu, Sen Song, and Xiaojun Yao. TrimNet: learning molecular represen- tation from triplet messages for biomedicine. Briefings in Bioinformatics, 22(4):bbaa266, 2021.
  18. [Liu et al., 2022a] Shengchao Liu, Hongyu Guo, and Jian Tang. Molecular geometry pretraining with SE (3)- invariant denoising distance matching. arXiv:2206.13602, 2022.
  19. [Liu et al., 2022b] Shengchao Liu, Hanchen Wang, Weiyang Liu, Joan Lasenby, Hongyu Guo, and Jian Tang. Pre- training molecular graph representation with 3D geometry. In International Conference on Learning Representations, 2022.
  20. [Nguyen et al., 2024] Long D. Nguyen, Quang H. Nguyen, Quang H. Trinh, and Binh P. Nguyen. From SMILES to enhanced molecular property prediction: A unified multi- modal framework with predicted 3D conformers and con- trastive learning techniques. Journal of Chemical Infor- mation and Modeling, 64(24):9173-9195, 2024.
  21. [Nguyen-Vo et al., 2024] Thanh-Hoang Nguyen-Vo, Trang T. T. Do, and Binh P. Nguyen. ResGAT: Residual graph attention networks for molecular property predic- tion. Memetic Computing, 16:491-503, 2024.
  22. [Nigam et al., 2020] AkshatKumar Nigam, Pascal Friederich, Mario Krenn, and Alan Aspuru-Guzik. Augmenting genetic algorithms with deep neural net- works for exploring the chemical space. In International Conference on Learning Representations, 2020.
  23. [Orosz et al., 2022] Álmos Orosz, Károly Héberger, and Anita Rácz. Comparison of descriptor-and fingerprint sets in machine learning models for ADME-Tox targets. Fron- tiers in Chemistry, 10:852893, 2022.
  24. [Rao et al., 2022] Yongming Rao, Wenliang Zhao, Yansong Tang, Jie Zhou, Ser Nam Lim, and Jiwen Lu. HorNet: Ef- ficient high-order spatial interactions with recursive gated convolutions. In Advances in Neural Information Process- ing Systems, volume 35, pages 10353-10366, 2022.
  25. [Schütt et al., 2017] Kristof Schütt, Pieter-Jan Kindermans, Huziel Enoc Sauceda Felix, Stefan Chmiela, Alexan- dre Tkatchenko, and Klaus-Robert Müller. SchNet: A continuous-filter convolutional neural network for model- ing quantum interactions. Advances in Neural Information Processing Systems, 30, 2017.
  26. [Schütt et al., 2021] Kristof Schütt, Oliver Unke, and Michael Gastegger. Equivariant message passing for the prediction of tensorial properties and molecular spectra. In International Conference on Machine Learning, pages 9377-9388. PMLR, 2021.
  27. [Shahapure and Nicholas, 2020] Ketan Rajshekhar Shaha- pure and Charles Nicholas. Cluster quality analysis us- ing silhouette score. In 2020 IEEE 7th International Con- ference on Data Science and Advanced Analytics (DSAA), pages 747-748. IEEE, 2020.
  28. [Shi et al., 2020] Yunsheng Shi, Zhengjie Huang, Shikun Feng, Hui Zhong, Wenjin Wang, and Yu Sun. Masked label prediction: Unified message passing model for semi- supervised classification. arXiv:2009.03509, 2020.
  29. [Sterling and Irwin, 2015] Teague Sterling and John J Irwin. ZINC 15-ligand discovery for everyone. Journal of Chem- ical Information and Modeling, 55(11):2324-2337, 2015.
  30. [Thiede et al., 2022] Luca A. Thiede, Mario Krenn, Ak- shatKumar Nigam, and Alán Aspuru-Guzik. Curiosity in exploring chemical spaces: intrinsic rewards for molecu- lar reinforcement learning. Machine Learning: Science and Technology, 3(3):035008, 2022.
  31. [Townshend et al., 2020] Raphael JL Townshend, Martin Vögele, Patricia Suriana, Alexander Derry, Alexan- der Powers, Yianni Laloudakis, Sidhika Balachandar, Bowen Jing, Brandon Anderson, Stephan Eismann, et al. Atom3D: Tasks on molecules in three dimensions. arXiv:2012.04035, 2020.
  32. [Van der Maaten and Hinton, 2008] Laurens Van der Maaten and Geoffrey Hinton. Visualizing data using t-SNE. Jour- nal of Machine Learning Research, 9(11), 2008.
  33. [Veličković et al., 2018] Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. Graph attention networks. In Interna- tional Conference on Learning Representations, 2018.
  34. [Wang et al., 2019] Sheng Wang, Yuzhi Guo, Yuhong Wang, Hongmao Sun, and Junzhou Huang. SMILES-BERT: Large scale unsupervised pre-training for molecular prop- erty prediction. In Proceedings of the 10th ACM Interna- tional Conference on Bioinformatics, Computational Biol- ogy and Health Informatics, BCB '19. ACM, 2019.
  35. [Wang et al., 2022] Yuyang Wang, Jianren Wang, Zhonglin Cao, and Amir Barati Farimani. Molecular contrastive learning of representations via graph neural networks. Na- ture Machine Intelligence, 4(3):279-287, 2022.
  36. [Wu et al., 2018] Zhenqin Wu, Bharath Ramsundar, Evan N. Feinberg, Joseph Gomes, Caleb Geniesse, Aneesh S. Pappu, Karl Leswing, and Vijay Pande. MoleculeNet: a benchmark for molecular machine learning. Chemical Sci- ence, 9(2):513-530, 2018.
  37. [Xiong et al., 2019] Zhaoping Xiong, Dingyan Wang, Xiao- hong Liu, Feisheng Zhong, et al. Pushing the boundaries of molecular representation for drug discovery with the graph attention mechanism. Journal of Medicinal Chem- istry, 63(16):8749-8760, 2019.
  38. [Xu et al., 2019] Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. How powerful are graph neural net- works? In International Conference on Learning Rep- resentations, 2019.
  39. [Yang et al., 2019] Kevin Yang, Kyle Swanson, Wengong Jin, Connor Coley, Philipp Eiden, et al. Analyzing learned molecular representations for property prediction. Journal of Chemical Information and Modeling, 59(8):3370-3388, 2019.
  40. [Yüksel et al., 2023] Atakan Yüksel, Erva Ulusoy, Atabey Ünlü, and Tunca Dogan. SELFormer: molecular represen- tation learning via SELFIES language models. Machine Learning: Science and Technology, 4(2):025035, 2023.
  41. [Zang et al., 2023] Xuan Zang, Xianbing Zhao, and Buzhou Tang. Hierarchical molecular graph self-supervised learn- ing for property prediction. Communications Chemistry, 6(1):34, 2023.
  42. [Zhou et al., 2023] Gengmo Zhou, Zhifeng Gao, Qiankun Ding, Hang Zheng, Hongteng Xu, Zhewei Wei, Linfeng Zhang, and Guolin Ke. Uni-Mol: A universal 3D molec- ular representation learning framework. In International Conference on Learning Representations, 2023.
  43. [Zhu et al., 2022] Weimin Zhu, Yi Zhang, Duancheng Zhao, Jianrong Xu, and Ling Wang. HiGNN: A hierarchical informative graph neural network for molecular property prediction equipped with feature-wise attention. Jour- nal of Chemical Information and Modeling, 63(1):43-55, 2022.
  44. [Zhu et al., 2023] Jinhua Zhu, Yingce Xia, Lijun Wu, Shu- fang Xie, Wengang Zhou, Tao Qin, Houqiang Li, and Tie- Yan Liu. Dual-view molecular pre-training. In Proceed- ings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD '23. ACM, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards