Proceedings

Theoretical Analysis of Multi-Objective Evolutionary Algorithms on Integer Spaces with Local Optima

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 6352-6360.

https://doi.org/10.24963/ijcai.2026/707

Abstract

Multi-objective evolutionary algorithms (MOEAs) are popular tools for multi-objective optimization (MOO), and have been successfully applied to many real-world MOO problems. However, the theoretical study has lagged behind their practical success and remains largely confined to synthetic pseudo-Boolean functions. To close this gap, this paper--drawing inspiration from a class of popular continuous problems with real-world relevance--introduces a multi-objective benchmark defined on an integer space, featuring an analyzable landscape and the presence of local optima. We conduct a running time analysis on the proposed benchmark and derive several theoretical results. Specifically, we prove that a widely-studied MOEA, GSEMO, using unit-step mutation can be trapped in local optimal regions and fail to identify the Pareto front. Fortunately, we find that this difficulty can be overcome either by incorporating an ageing mechanism or using heavy-tailed mutations that allow multi-valued changes along each dimension of an individual. In addition, we demonstrate the extendability of the proposed benchmark to more complex landscapes with numerous local optima, resembling well-established problems in the field (e.g., those from the ZDT and DTLZ suites). We hope this work is a step forward for the theoretical study of MOEAs on problems that are closely related to those commonly investigated in empirical research.

  1. [Auger and Doerr, 2011] Anne Auger and Benjamin Doerr. Theory of Randomized Search Heuristics -Foundations and Recent Developments. World Scientific, 2011.
  2. [Beume et al., 2007] Nicola Beume, Boris Naujoks, and Michael Emmerich. SMS-EMOA: Multiobjective se- lection based on dominated hypervolume. EJOR, 181(3):1653-1669, 2007.
  3. [Bian et al., 2024] Chao Bian, Shengjie Ren, Miqing Li, and Chao Qian. An archive can bring provable speed-ups in multi-objective evolutionary algorithms. In IJCAI, Jeju Is- land, South Korea, 2024. IJCAI
  4. [Bian et al., 2025] Chao Bian, Yawen Zhou, Miqing Li, and Chao Qian. Stochastic population update can provably be helpful in multi-objective evolutionary algorithms. AIJ, 341:104308, 2025. IJCAI
  5. [Cerf et al., 2023] Sacha Cerf, Benjamin Doerr, Benjamin Hebras, Yakob Kahane, and Simon Wietheger. The first proven performance guarantees for the non-dominated sorting genetic algorithm II (NSGA-II) on a combinato- rial optimization problem. In IJCAI, Macao, SAR, China, 2023. IJCAI
  6. [Corus et al., 2019] Dogan Corus, Pietro S. Oliveto, and Donya Yazdani. Artificial immune systems can find arbi- trarily good approximations for the NP-hard number par- titioning problem. AIJ, 274:180-196, 2019.
  7. [Corus et al., 2021] Dogan Corus, Pietro S. Oliveto, and Donya Yazdani. Fast immune system-inspired hypermu- tation operators for combinatorial optimization. IEEE TEVC, 25(5):956-970, 2021.
  8. [Corus et al., 2025] Dogan Corus, Pietro S. Oliveto, and Donya Yazdani. Fast contiguous somatic hypermutations for single-objective optimisation and multi-objective opti- misation via decomposition. In AAAI, Philadelphia, 2025.
  9. [Dang et al., 2023] Duc-Cuong Dang, Andre Opris, Bahare Salehi, and Dirk Sudholt. A proof that using crossover can guarantee exponential speed-ups in evolutionary multi- objective optimisation. In AAAI, Washington, DC, 2023.
  10. [Dang et al., 2024a] Duc-Cuong Dang, Andre Opris, and Dirk Sudholt. Crossover can guarantee exponential speed- ups in evolutionary multi-objective optimisation. AIJ, 330:104098, 2024.
  11. [Dang et al., 2024b] Duc-Cuong Dang, Andre Opris, and Dirk Sudholt. Illustrating the efficiency of popular evolu- tionary multi-objective algorithms using runtime analysis. In GECCO, Melbourne, Australia, 2024.
  12. [Deb et al., 2002] Kalyanmoy Deb, Amrit Pratap, Sameer Agarwal, and T. Meyarivan. A fast and elitist multiobjec- tive genetic algorithm: NSGA-II. IEEE TEVC, 6(2):182- 197, 2002.
  13. [Deb et al., 2005] Kalyanmoy Deb, Lothar Thiele, Marco Laumanns, and Eckart Zitzler. Scalable test problems for evolutionary multiobjective optimization. In Evolutionary Multiobjective Optimization: Theoretical Advances and Applications, pages 105-145. Springer, 2005.
  14. [Deb, 2001] Kalyanmoy Deb. Multi-objective Optimization using Evolutionary Algorithms. Wiley, 2001.
  15. [Doerr and Neumann, 2020] Benjamin Doerr and Frank Neumann, editors. Theory of Evolutionary Computation: Recent Developments in Discrete Optimization. Springer, 2020.
  16. [Doerr and Qu, 2023] Benjamin Doerr and Zhongdi Qu. Runtime analysis for the NSGA-II: Provable speed-ups from crossover. In AAAI, Washington, DC, 2023.
  17. [Doerr and Zheng, 2021] Benjamin Doerr and Weijie Zheng. Theoretical analyses of multi-objective evolutionary algo- rithms on multi-modal objectives. In AAAI, Virtual, 2021.
  18. [Doerr et al., 2017] Benjamin Doerr, Huu Phuoc Le, Régis Makhmara, and Ta Duy Nguyen. Fast genetic algorithms. In GECCO, Berlin, Germany, 2017.
  19. [Doerr et al., 2025a] Benjamin Doerr, Tudor Ivan, and Mar- tin S. Krejca. Speeding up the NSGA-II with a simple tie-breaking rule. In AAAI, Philadelphia, PA, 2025.
  20. [Doerr et al., 2025b] Benjamin Doerr, Martin S Krejca, and Günter Rudolph. Runtime analysis for multi-objective evolutionary algorithms in unbounded integer spaces. In AAAI, Philadelphia, PA, 2025.
  21. [Droste et al., 2002] Stefan Droste, Thomas Jansen, and Ingo Wegener. On the analysis of the (1+1) evolutionary algorithm. TCS, 276(1-2):51-81, 2002.
  22. [Fieldsend et al., 2021] Jonathan E Fieldsend, Tinkle Chugh, Richard Allmendinger, and Kaisa Miettinen. A visualiz- able test problem generator for many-objective optimiza- tion. IEEE TEVC, 26(1):1-11, 2021.
  23. [Giel and Lehre, 2010] Oliver Giel and Per Kristian Lehre. On the effect of populations in evolutionary multi- objective optimisation. ECJ, 18(3):335-356, 2010.
  24. [Giel, 2003] Oliver Giel. Expected runtimes of a simple multi-objective evolutionary algorithm. In CEC, Canberra, Australia, 2003.
  25. [He and Yao, 2001] Jun He and Xin Yao. Drift analysis and average time complexity of evolutionary algorithms. AIJ, 127(1):57-85, 2001.
  26. [Horoba et al., 2009] Christian Horoba, Thomas Jansen, and Christine Zarges. Maximal age in randomized search heuristics with aging. In GECCO, Montreal, Canada, 2009.
  27. [Horoba, 2009] Christian Horoba. Analysis of a simple evo- lutionary algorithm for the multiobjective shortest path problem. In FOGA, Orlando, FL, 2009.
  28. [Ishibuchi et al., 2010] Hisao Ishibuchi, Yasuhiro Hitot- suyanagi, Noritaka Tsukamoto, and Yusuke Nojima. Many-objective test problems to visually examine the be- havior of multiobjective evolution in a decision space. In PPSN, Krakow, Poland, 2010.
  29. [Jansen and Zarges, 2011] Thomas Jansen and Christine Zarges. On the role of age diversity for effective aging operators. Evolutionary Intelligence, 4(2):99-125, 2011.
  30. [Köppen and Yoshida, 2007] Mario Köppen and Kaori Yoshida. Substitute distance assignments in NSGA-II for handling many-objective optimization problems. In EMO, Matsushima, Japan, 2007.
  31. [Lapucci et al., 2023] Matteo Lapucci, Pierluigi Mansueto, and Fabio Schoen. A memetic procedure for global multi- objective optimization. Mathematical Programming Com- putation, 15(2):227-267, 2023.
  32. [Laumanns et al., 2004a] Marco Laumanns, Lothar Thiele, and Eckart Zitzler. Running time analysis of evolutionary algorithms on a simplified multiobjective knapsack prob- lem. Natural Computing, 3(1):37-51, 2004.
  33. [Laumanns et al., 2004b] Marco Laumanns, Lothar Thiele, and Eckart Zitzler. Running time analysis of multiobjec- tive evolutionary algorithms on pseudo-Boolean functions. IEEE TEVC, 8(2):170-182, 2004.
  34. [Li et al., 2015] Yuan-Long Li, Yu-Ren Zhou, Zhi-Hui Zhan, and Jun Zhang. A primary theoretical study on decomposition-based multiobjective evolutionary algo- rithms. IEEE TEVC, 20(4):563-576, 2015.
  35. [Li et al., 2025] Mingfeng Li, Weijie Zheng, and Benjamin Doerr. Scalable speed-ups for the SMS-EMOA from a simple aging strategy. In IJCAI, Montreal, Canada, 2025. IJCAI
  36. [Liang and Li, 2025] Zimin Liang and Miqing Li. On the problem characteristics of multi-objective pseudo-Boolean functions in runtime analysis. In FOGA, Leiden, The Netherlands, 2025.
  37. [Liang and Li, 2026] Zimin Liang and Miqing Li. Random is faster than systematic in multi-objective local search. In AAAI, Singapore, 2026.
  38. [Liang et al., 2024] Zimin Liang, Zhiji Cui, and Miqing Li. Pareto landscape: Visualising the landscape of multi- objective optimisation problems. In PPSN, Hagenberg, Austria, 2024.
  39. [Lu et al., 2019] Zhichao Lu, Ian Whalen, Vishnu Bod- deti, Yashesh Dhebar, Kalyanmoy Deb, Erik Goodman, and Wolfgang Banzhaf. NSGA-Net: Neural architec- ture search using multi-objective genetic algorithm. In GECCO, Prague, Czech Republic, 2019.
  40. [Neumann and Witt, 2010] Frank Neumann and Carsten Witt. Bioinspired Computation in Combinatorial Opti- mization -Algorithms and Their Computational Complex- ity. Springer, 2010.
  41. [Ojstersek et al., 2020] Robert Ojstersek, Miran Brezocnik, and Borut Buchmeister. Multi-objective optimization of production scheduling with evolutionary computation: A review. International Journal of Industrial Engineering Computations, 11(3):359-376, 2020.
  42. [Oliveto and Sudholt, 2014] Pietro S. Oliveto and Dirk Sud- holt. On the runtime analysis of stochastic ageing mecha- nisms. In GECCO, Vancouver, BC, Canada, 2014.
  43. [Opris, 2025] Andre Opris. A first runtime analysis of NSGA-III on a many-objective multimodal problem: Provable exponential speedup via stochastic population update. In IJCAI, Montreal, Canada, 2025. IJCAI
  44. [Ren et al., 2024] Shengjie Ren, Chao Bian, Miqing Li, and Chao Qian. A first running time analysis of the strength Pareto evolutionary algorithm 2 (SPEA2). In PPSN, Ha- genberg, Austria, 2024.
  45. [Ren et al., 2025] Shengjie Ren, Zimin Liang, Miqing Li, and Chao Qian. A theoretical perspective on why stochas- tic population update needs an archive in evolutionary multi-objective optimization. In IJCAI, Montreal, Canada, 2025. IJCAI
  46. [Ren et al., 2026] Shengjie Ren, Zimin Liang, Miqing Li, and Chao Qian. Not just for archiving: Provable bene- fits of reusing the archive in evolutionary multi-objective optimization. In AAAI, Singapore, 2026.
  47. [Rudolph, 1994] Günter Rudolph. An evolutionary algo- rithm for integer programming. In PPSN, Jerusalem, Is- rael, 1994.
  48. [Rudolph, 1997] Günter Rudolph. Convergence properties of evolutionary algorithms. In Verlag Dr Kovac, 1997.
  49. [Rudolph, 2023] Günter Rudolph. Runtime analysis of (1+1)-EA on a biobjective test function in unbounded in- teger search space. In SSCI, Mexico City, Mexico, 2023.
  50. [Wietheger and Doerr, 2024a] Simon Wietheger and Ben- jamin Doerr. A mathematical runtime analysis of the non- dominated sorting genetic algorithm III (NSGA-III). In GECCO, Melbourne, Australia, 2024.
  51. [Wietheger and Doerr, 2024b] Simon Wietheger and Ben- jamin Doerr. Near-tight runtime guarantees for many- objective evolutionary algorithms. In PPSN, Hagenberg, Austria, 2024.
  52. [Zhang and Li, 2007] Qingfu Zhang and Hui Li. MOEA/D: A multiobjective evolutionary algorithm based on decom- position. IEEE TEVC, 11(6):712-731, 2007.
  53. [Zheng et al., 2022] Weijie Zheng, Yufei Liu, and Benjamin Doerr. A first mathematical runtime analysis of the non- dominated sorting genetic algorithm II (NSGA-II). In AAAI, Virtual, 2022.
  54. [Zhou et al., 2019] Zhi-Hua Zhou, Yang Yu, and Chao Qian. Evolutionary Learning: Advances in Theories and Algo- rithms. Springer, 2019.
  55. [Zitzler et al., 2000] Eckart Zitzler, Kalyanmoy Deb, and Lothar Thiele. Comparison of multiobjective evolutionary algorithms: Empirical results. ECJ, 8(2):173-195, 2000.
  56. [Zitzler et al., 2001] Eckart Zitzler, Marco Laumanns, and Lothar Thiele. SPEA2: Improving the strength pareto evo- lutionary algorithm. TIK report, 103, 2001.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards