Proceedings

Dynamic Many-Objective Molecular Optimization: Unfolding Complexity with Objective Decomposition and Progressive Optimization

Download BibTeX Cite

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence. Main Track. Pages 6026-6034.

https://doi.org/10.24963/ijcai.2024/666

Abstract

Molecular discovery has received significant attention across various scientific fields by enabling the creation of novel chemical compounds. In recent years, the majority of studies have approached this process as a multi-objective optimization problem. Despite notable advancements, most methods optimize only up to four molecular objectives and are mainly designed for scenarios with a predetermined number of objectives. However, in real-world applications, the number of molecular objectives can be more than four (many-objective) and additional objectives may be introduced over time (dynamic-objective). To fill this gap, we propose DyMol, the first method designed to tackle the dynamic many-objective molecular optimization problem by utilizing a novel divide-and-conquer approach combined with a decomposition strategy. Additionally, we comprehensively integrate convergence, Pareto diversity, and structural diversity into the optimization process to provide efficient exploration of the search space. We validate the superior performance of our method using the practical molecular optimization (PMO) benchmark. The source code and supplementary material are available online.

  1. [Aldeghi et al., 2022] Matteo Aldeghi, David E Graff, Nathan Frey, Joseph A Morrone, Edward O Pyzer-Knapp, Kirk E Jordan, and Connor W Coley. Roughness of molecular property landscapes and its impact on modella- bility. Journal of Chemical Information and Modeling, 62(19):4660-4671, 2022.
  2. [Bemis and Murcko, 1996] Guy W Bemis and Mark A Mur- cko. The properties of known drugs. 1. molecular frame- works. Journal of medicinal chemistry, 39(15):2887- 2893, 1996.
  3. [Bengio et al., 2021] Emmanuel Bengio, Moksh Jain, Maksym Korablyov, Doina Precup, and Yoshua Bengio. Flow network based generative models for non-iterative diverse candidate generation. Advances in Neural Information Processing Systems, 34:27381-27394, 2021.
  4. [Bilodeau et al., 2022] Camille Bilodeau, Wengong Jin, Tommi Jaakkola, Regina Barzilay, and Klavs F Jensen. Generative models for molecular discovery: Recent ad- vances and challenges. Wiley Interdisciplinary Reviews: Computational Molecular Science, 12(5):e1608, 2022.
  5. [Brattka et al., 2012] Vasco Brattka, Guido Gherardi, and Alberto Marcone. The Bolzano-Weierstrass theorem is the jump of weak kőnig's lemma. Annals of Pure and Applied Logic, 163(6):623-655, 2012.
  6. [Brockhoff et al., 2012] Dimo Brockhoff, Tobias Wagner, and Heike Trautmann. On the properties of the r2 indica- tor. In Proceedings of the 14th annual conference on Ge- netic and evolutionary computation, pages 465-472, 2012.
  7. [Darrow et al., 2020] Jonathan J Darrow, Jerry Avorn, and Aaron S Kesselheim. Fda approval and regulation of phar- maceuticals, 1983-2018. Jama, 323(2):164-176, 2020.
  8. [Deb and Jain, 2013] Kalyanmoy Deb and Himanshu Jain. An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting ap- proach, part i: solving problems with box con- straints. IEEE transactions on evolutionary computation, 18(4):577-601, 2013.
  9. [Ding et al., 2018] Jinliang Ding, Cuie Yang, Qiong Xiao, Tianyou Chai, and Yaochu Jin. Dynamic evolutionary multiobjective optimization for raw ore allocation in min- eral processing. IEEE Transactions on Emerging Topics in Computational Intelligence, 3(1):36-48, 2018.
  10. [Eichfelder, 2009] Gabriele Eichfelder. Scalarizations for adaptively solving multi-objective optimization problems. Computational Optimization and Applications, 44:249- 273, 2009.
  11. [Fromer and Coley, 2023] Jenna C Fromer and Connor W Coley. Computer-aided multi-objective optimization in small molecule discovery. Patterns, 4(2), 2023.
  12. [Fu et al., 2021] Tianfan Fu, Cao Xiao, Xinhao Li, Lu- cas M Glass, and Jimeng Sun. Mimosa: Multi-constraint molecule sampling for molecule optimization. In Proceed- ings of the AAAI Conference on Artificial Intelligence, vol- ume 35, pages 125-133, 2021.
  13. [Gao et al., 2022] Wenhao Gao, Tianfan Fu, Jimeng Sun, and Connor Coley. Sample efficiency matters: a bench- mark for practical molecular optimization. Advances in Neural Information Processing Systems, 35:21342-21357, 2022.
  14. [Gómez-Bombarelli et al., 2018] Rafael Gómez- Bombarelli, Jennifer N Wei, David Duvenaud, José Miguel Hernández-Lobato, Benjamín Sánchez- Lengeling, Dennis Sheberla, Jorge Aguilera-Iparraguirre, Timothy D Hirzel, Ryan P Adams, and Alán Aspuru- Guzik. Automatic chemical design using a data-driven continuous representation of molecules. ACS central science, 4(2):268-276, 2018.
  15. [Gunantara, 2018] Nyoman Gunantara. A review of multi- objective optimization: Methods and its applications. Co- gent Engineering, 5(1):1502242, 2018.
  16. [Guo and Schwaller, 2024] Jeff Guo and Philippe Schwaller. Augmented memory: Sample-efficient generative molecu- lar design with reinforcement learning. JACS Au, 2024.
  17. [Hager, 1979] William W Hager. Lipschitz continuity for constrained processes. SIAM Journal on Control and Op- timization, 17(3):321-338, 1979.
  18. [Huang et al., 2021] Kexin Huang, Tianfan Fu, Wenhao Gao, Yue Zhao, Yusuf Roohani, Jure Leskovec, Connor W Coley, Cao Xiao, Jimeng Sun, and Marinka Zitnik. Ther- apeutics data commons: Machine learning datasets and tasks for drug discovery and development. arXiv preprint arXiv:2102.09548, 2021.
  19. [Hughes, 2005] Evan J Hughes. Evolutionary many- objective optimisation: many once or one many? In 2005 IEEE congress on evolutionary computation, volume 1, pages 222-227. IEEE, 2005.
  20. [Jensen, 2019] Jan H Jensen. A graph-based genetic algo- rithm and generative model/monte carlo tree search for the exploration of chemical space. Chemical science, 10(12):3567-3572, 2019.
  21. [Jin et al., 2020] Wengong Jin, Regina Barzilay, and Tommi Jaakkola. Multi-objective molecule generation using in- terpretable substructures. In International conference on machine learning, pages 4849-4859. PMLR, 2020.
  22. [Laumanns and Ocenasek, 2002] Marco Laumanns and Jiri Ocenasek. Bayesian optimization algorithms for multi- objective optimization. In International Conference on Parallel Problem Solving from Nature, pages 298-307. Springer, 2002.
  23. [Lin et al., 2022] Xi Lin, Zhiyuan Yang, Xiaoyuan Zhang, and Qingfu Zhang. Pareto set learning for expensive multi- objective optimization. Advances in Neural Information Processing Systems, 35:19231-19247, 2022.
  24. [Liu et al., 2021] Ruochen Liu, Ping Yang, and Jiangdi Liu. A dynamic multi-objective optimization evolutionary al- gorithm for complex environmental changes. Knowledge- Based Systems, 216:106612, 2021.
  25. [Luukkonen et al., 2023] Sohvi Luukkonen, Helle W van den Maagdenberg, Michael TM Emmerich, and Gerard JP van Westen. Artificial intelligence in multi- objective drug design. Current Opinion in Structural Biology, 79:102537, 2023.
  26. [Marler and Arora, 2004] R Timothy Marler and Jasbir S Arora. Survey of multi-objective optimization methods for engineering. Structural and multidisciplinary optimiza- tion, 26:369-395, 2004.
  27. [Mathur and Hoskins, 2017] Sunil Mathur and Clare Hoskins. Drug development: Lessons from nature. Biomedical reports, 6(6):612-614, 2017.
  28. [Olivecrona et al., 2017] Marcus Olivecrona, Thomas Blaschke, Ola Engkvist, and Hongming Chen. Molecular de-novo design through deep reinforcement learning. Journal of cheminformatics, 9(1):1-14, 2017.
  29. [Quan et al., 2022] Zhen Quan, Yan Wang, and Zhicheng Ji. Multi-objective optimization scheduling for manufactur- ing process based on virtual workflow models. Applied Soft Computing, 122:108786, 2022.
  30. [Shin et al., 2024] Dong-Hee Shin, Young-Han Son, Jun-Mo Kim, Hee-Jun Ahn, Jun-Ho Seo, Chang-Hoon Ji, Ji-Wung Han, Byung-Jun Lee, Dong-Ok Won, and Tae-Eui Kam. MARS: Multiagent reinforcement learning for spatial- spectral and temporal feature selection in EEG-based BCI. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2024.
  31. [Son et al., 2024] Young-Han Son, Dong-Hee Shin, and Tae- Eui Kam. FTMMR: Fusion transformer for integrat- ing multiple molecular representations. IEEE Journal of Biomedical and Health Informatics, 2024.
  32. [Stanton et al., 2022] Samuel Stanton, Wesley Maddox, Nate Gruver, Phillip Maffettone, Emily Delaney, Peyton Greenside, and Andrew Gordon Wilson. Accelerating bayesian optimization for biological sequence design with denoising autoencoders. In International Conference on Machine Learning, pages 20459-20478. PMLR, 2022.
  33. [Sterling and Irwin, 2015] Teague Sterling and John J Irwin. Zinc 15-ligand discovery for everyone. Journal of chemi- cal information and modeling, 55(11):2324-2337, 2015.
  34. [Sun et al., 2022] Mengying Sun, Jing Xing, Han Meng, Huijun Wang, Bin Chen, and Jiayu Zhou. Molsearch: search-based multi-objective molecular generation and property optimization. In Proceedings of the 28th ACM SIGKDD conference on knowledge discovery and data mining, pages 4724-4732, 2022.
  35. [Tripp et al., 2021] Austin Tripp, Gregor NC Simm, and José Miguel Hernández-Lobato. A fresh look at de novo molecular design benchmarks. In NeurIPS 2021 AI for Science Workshop, 2021.
  36. [Tseng and others, 1988] Paul Tseng et al. Coordinate as- cent for maximizing nondifferentiable concave functions. 1988. [Tušar and Filipič, 2014] Tea Tušar and Bogdan Filipič. Vi- sualization of pareto front approximations in evolutionary multiobjective optimization: A critical review and the pro- section method. IEEE Transactions on Evolutionary Com- putation, 19(2):225-245, 2014.
  37. [Verhellen, 2022] Jonas Verhellen. Graph-based molecu- lar pareto optimisation. Chemical Science, 13(25):7526- 7535, 2022.
  38. [Walters and Namchuk, 2003] W Patrick Walters and Mark Namchuk. Designing screens: how to make your hits a hit. Nature reviews Drug discovery, 2(4):259-266, 2003.
  39. [Wang et al., 2006] Mingliang Wang, Xiangqian Hu, David N Beratan, and Weitao Yang. Designing molecules by optimizing potentials. Journal of the American Chemical Society, 128(10):3228-3232, 2006.
  40. [Xie et al., 2021] Yutong Xie, Chence Shi, Hao Zhou, Yuwei Yang, Weinan Zhang, Yong Yu, and Lei Li. Mars: Markov molecular sampling for multi-objective drug discovery. arXiv preprint arXiv:2103.10432, 2021.
  41. [Yuan et al., 2015] Yuan Yuan, Hua Xu, Bo Wang, Bo Zhang, and Xin Yao. Balancing convergence and diversity in decomposition-based many-objective optimiz- ers. IEEE Transactions on Evolutionary Computation, 20(2):180-198, 2015.
  42. [Zhang and Li, 2007] Qingfu Zhang and Hui Li. MOEA/D: A multiobjective evolutionary algorithm based on decom- position. IEEE Transactions on evolutionary computation, 11(6):712-731, 2007.
  43. [Zhu et al., 2023] Yiheng Zhu, Jialu Wu, Chaowen Hu, Ji- ahuan Yan, Chang-Yu Hsieh, Tingjun Hou, and Jian Wu. Sample-efficient multi-objective molecular optimization with GFlownets. In Thirty-seventh Conference on Neural Information Processing Systems, 2023.
  44. [Zitzler et al., 2003] Eckart Zitzler, Lothar Thiele, Marco Laumanns, Carlos M Fonseca, and Viviane Grunert Da Fonseca. Performance assessment of multiobjective optimizers: An analysis and review. IEEE Transactions on evolutionary computation, 7(2):117-132, 2003.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards