Proceedings

Scalable Speed-ups for the SMS-EMOA from a Simple Aging Strategy

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 8885-8893.

https://doi.org/10.24963/ijcai.2025/988

Abstract

Different from single-objective evolutionary algorithms, where non-elitism is an established concept, multi-objective evolutionary algorithms almost always select the next population in a greedy fashion. In the only notable exception, a stochastic selection mechanism was recently proposed for the SMS-EMOA and was proven to speed up computing the Pareto front of the bi-objective jump benchmark with problem size n and gap parameter k by a factor of max{1,2^(k/4)/n}. While this constitutes the first proven speed-up from non-elitist selection, suggesting a very interesting research direction, it has to be noted that a true speed-up only occurs for k ≥ 4log(n), where the runtime is super-polynomial, and that the advantage reduces for larger numbers of objectives as shown in a later work. In this work, we propose a different non-elitist selection mechanism based on aging, which exempts individuals younger than a certain age from a possible removal. This remedies the two shortcomings of stochastic selection: We prove a speed-up by a factor of max{1,Θ(k)^(k-1)}, regardless of the number of objectives. In particular, a positive speed-up can already be observed for constant k, the only setting for which polynomial runtimes can be witnessed. Overall, this result supports the use of non-elitist selection schemes, but suggests that aging-based mechanisms can be considerably more powerful than stochastic selection mechanisms.

  1. [Alghouass et al., 2025] Yasser Alghouass, Benjamin Doerr, Martin S. Krejca, and Mohammed Lagmah. Proven ap- proximation guarantees in multi-objective optimization: SPEA2 beats NSGA-II. In International Joint Conference on Artificial Intelligence, IJCAI 2025. ijcai.org, 2025. Ac- cepted. IJCAI
  2. [Auger and Doerr, 2011] Anne Auger and Benjamin Doerr, editors. Theory of Randomized Search Heuristics. World Scientific Publishing, 2011.
  3. [Bambury et al., 2024] Henry Bambury, Antoine Bultel, and Benjamin Doerr. An extended jump functions benchmark for the analysis of randomized search heuristics. Algorith- mica, 86:1-32, 2024.
  4. [Beume et al., 2007] Nicola Beume, Boris Naujoks, and Michael Emmerich. SMS-EMOA: Multiobjective selec- tion based on dominated hypervolume. European Journal of Operational Research, 181:1653-1669, 2007.
  5. [Bian and Qian, 2022] Chao Bian and Chao Qian. Better running time of the non-dominated sorting genetic algo- rithm II (NSGA-II) by using stochastic tournament selec- tion. In Parallel Problem Solving From Nature, PPSN 2022, pages 428-441. Springer, 2022.
  6. [Bian et al., 2023] Chao Bian, Yawen Zhou, Miqing Li, and Chao Qian. Stochastic population update can provably be helpful in multi-objective evolutionary algorithms. In In- ternational Joint Conference on Artificial Intelligence, IJ- CAI 2023, pages 5513-5521. ijcai.org, 2023. IJCAI
  7. [Corus et al., 2019] Dogan Corus, Pietro S. Oliveto, and Donya Yazdani. Artificial immune systems can find arbi- trarily good approximations for the NP-hard number par- titioning problem. Artificial Intelligence, 274:180-196, 2019.
  8. [Corus et al., 2020] Dogan Corus, Pietro S. Oliveto, and Donya Yazdani. When hypermutations and ageing enable artificial immune systems to outperform evolutionary al- gorithms. Theoretical Computer Science, 832:166-185, 2020.
  9. [Dang et al., 2023] Duc-Cuong Dang, Andre Opris, Bahare Salehi, and Dirk Sudholt. A proof that using crossover can guarantee exponential speed-ups in evolutionary multi- objective optimisation. In Conference on Artificial In- telligence, AAAI 2023, pages 12390-12398. AAAI Press, 2023.
  10. [Deb and Jain, 2014] Kalyanmoy Deb and Himanshu Jain. An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting ap- proach, part I: solving problems with box con- straints. IEEE Transactions on Evolutionary Computation, 18:577-601, 2014.
  11. [Deb et al., 2002] Kalyanmoy Deb, Amrit Pratap, Sameer Agarwal, and T. Meyarivan. A fast and elitist multiob- jective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation, 6:182-197, 2002.
  12. [Deng et al., 2025] Renzhong Deng, Weijie Zheng, and Ben- jamin Doerr. The first theoretical approximation guaran- tees for the non-dominated sorting genetic algorithm III (NSGA-III). In International Joint Conference on Artifi- cial Intelligence, IJCAI 2025. ijcai.org, 2025. Accepted. IJCAI
  13. [Dinot et al., 2023] Matthieu Dinot, Benjamin Doerr, Ulysse Hennebelle, and Sebastian Will. Runtime analyses of multi-objective evolutionary algorithms in the presence of noise. In International Joint Conference on Artificial In- telligence, IJCAI 2023, pages 5549-5557. ijcai.org, 2023. IJCAI
  14. [Doerr and Neumann, 2020] Benjamin Doerr and Frank Neumann, editors. Theory of Evolutionary Computation- Recent Developments in Discrete Optimization. Springer, 2020. Also available at http://www.lix.polytechnique.fr/ Labo/Benjamin.Doerr/doerr neumann book.html. Link
  15. [Doerr and Qu, 2023a] Benjamin Doerr and Zhongdi Qu. A first runtime analysis of the NSGA-II on a multimodal problem. IEEE Transactions on Evolutionary Computa- tion, 27:1288-1297, 2023.
  16. [Doerr and Qu, 2023b] Benjamin Doerr and Zhongdi Qu. From understanding the population dynamics of the NSGA-II to the first proven lower bounds. In Conference on Artificial Intelligence, AAAI 2023, pages 12408-12416. AAAI Press, 2023.
  17. [Doerr and Qu, 2023c] Benjamin Doerr and Zhongdi Qu. Runtime analysis for the NSGA-II: provable speed-ups from crossover. In Conference on Artificial Intelligence, AAAI 2023, pages 12399-12407. AAAI Press, 2023.
  18. [Doerr and Zheng, 2021] Benjamin Doerr and Weijie Zheng. Theoretical analyses of multi-objective evolutionary algo- rithms on multi-modal objectives. In Conference on Artifi- cial Intelligence, AAAI 2021, pages 12293-12301. AAAI Press, 2021.
  19. [Doerr et al., 2025] Benjamin Doerr, Tudor Ivan, and Mar- tin S. Krejca. Speeding up the NSGA-II with a simple tie-breaking rule. In Conference on Artificial Intelligence, AAAI 2025, pages 26964-26972. AAAI Press, 2025.
  20. [Droste et al., 2002] Stefan Droste, Thomas Jansen, and Ingo Wegener. On the analysis of the (1+1) evolution- ary algorithm. Theoretical Computer Science, 276:51-81, 2002.
  21. [Horoba et al., 2009] Christian Horoba, Thomas Jansen, and Christine Zarges. Maximal age in randomized search heuristics with aging. In Proceedings of the 11th An- nual conference on Genetic and evolutionary computation, pages 803-810, 2009.
  22. [Jansen and Zarges, 2009] Thomas Jansen and Christine Zarges. Comparing different aging operators. In Artificial Immune Systems: 8th International Conference, ICARIS 2009, York, UK, August 9-12, 2009. Proceedings 8, pages 95-108. Springer, 2009.
  23. [Jansen and Zarges, 2010a] Thomas Jansen and Christine Zarges. Aging beyond restarts. In Genetic and Evolution- ary Computation Conference, GECCO 2010, pages 705- 712, 2010.
  24. [Jansen and Zarges, 2010b] Thomas Jansen and Christine Zarges. On the benefits of aging and the importance of details. In International Conference on Artificial Immune Systems, pages 61-74. Springer, 2010.
  25. [Jansen and Zarges, 2011a] Thomas Jansen and Christine Zarges. On benefits and drawbacks of aging strategies for randomized search heuristics. Theoretical Computer Sci- ence, 412:543-559, 2011.
  26. [Jansen and Zarges, 2011b] Thomas Jansen and Christine Zarges. On the role of age diversity for effective aging operators. Evolutionary Intelligence, 4:99-125, 2011.
  27. [Li et al., 2025] Mingfeng Li, Weijie Zheng, and Benjamin Doerr. Scalable speed-ups for the SMS-EMOA from a simple aging strategy. In International Joint Conference on Artificial Intelligence, IJCAI 2025. ijcai.org, 2025. Ac- cepted.
  28. [Oliveto and Sudholt, 2014] Pietro S. Oliveto and Dirk Sud- holt. On the runtime analysis of stochastic ageing mecha- nisms. In Conference on Genetic and Evolutionary Com- putation, GECCO 2014, pages 113-120, 2014.
  29. [Opris et al., 2024] Andre Opris, Duc Cuong Dang, Frank Neumann, and Dirk Sudholt. Runtime analyses of NSGA- III on many-objective problems. In Genetic and Evolution- ary Computation Conference, GECCO 2024, pages 1596- 1604. ACM, 2024.
  30. [Opris, 2025a] Andre Opris. A first runtime analysis of NSGA-III on a many-objective multimodal problem: provable exponential speedup via stochastic population update. In International Joint Conference on Artificial In- telligence, IJCAI 2025. ijcai.org, 2025. Accepted. IJCAI
  31. [Opris, 2025b] Andre Opris. A many-objective problem where crossover is provably indispensable. In Conference on Artificial Intelligence, AAAI 2025, pages 27108-27116. AAAI Press, 2025.
  32. [Ren et al., 2024] Shengjie Ren, Chao Bian, Miqing Li, and Chao Qian. A first running time analysis of the Strength Pareto Evolutionary Algorithm 2 (SPEA2). In Parallel Problem Solving from Nature, PPSN 2024, Part III, pages 295-312. Springer, 2024.
  33. [Wang et al., 2024] Shouda Wang, Weijie Zheng, and Ben- jamin Doerr. Choosing the right algorithm with hints from complexity theory. Information and Computation, 296:105125, 2024. IJCAI
  34. [Wietheger and Doerr, 2023] Simon Wietheger and Ben- jamin Doerr. A mathematical runtime analysis of the non- dominated sorting genetic algorithm III (NSGA-III). In International Joint Conference on Artificial Intelligence, IJCAI 2023, pages 5657-5665. ijcai.org, 2023.
  35. [Wietheger and Doerr, 2024] Simon Wietheger and Ben- jamin Doerr. Near-tight runtime guarantees for many- objective evolutionary algorithms. In Parallel Problem Solving from Nature, PPSN 2024, Part IV, pages 153-168. Springer, 2024.
  36. [Zarges, 2020] Christine Zarges. Theoretical foundations of immune-inspired randomized search heuristics for opti- mization. Theory of Evolutionary Computation: Recent Developments in Discrete Optimization, pages 443-474, 2020.
  37. [Zheng and Doerr, 2023a] Weijie Zheng and Benjamin Do- err. Mathematical runtime analysis for the non-dominated sorting genetic algorithm II (NSGA-II). Artificial Intelli- gence, 325:104016, 2023.
  38. [Zheng and Doerr, 2023b] Weijie Zheng and Benjamin Do- err. Runtime analysis of the SMS-EMOA for many- objective optimization. CoRR, abs/2312.10290, 2023.
  39. [Zheng and Doerr, 2024a] Weijie Zheng and Benjamin Do- err. Runtime analysis for the NSGA-II: proving, quan- tifying, and explaining the inefficiency for many objec- tives. IEEE Transactions on Evolutionary Computation, 28:1442-1454, 2024.
  40. [Zheng and Doerr, 2024b] Weijie Zheng and Benjamin Do- err. Runtime analysis of the SMS-EMOA for many- objective optimization. In Conference on Artificial In- telligence, AAAI 2024, pages 20874-20882. AAAI Press, 2024.
  41. [Zheng et al., 2022] Weijie Zheng, Yufei Liu, and Benjamin Doerr. A first mathematical runtime analysis of the non- dominated sorting genetic algorithm II (NSGA-II). In Conference on Artificial Intelligence, AAAI 2022, pages 10408-10416. AAAI Press, 2022.
  42. [Zheng et al., 2024a] Weijie Zheng, Yao Gao, and Benjamin Doerr. A crowding distance that provably solves the diffi- culties of the nsga-ii in many-objective optimization. arXiv preprint arXiv:2407.17687, 2024.
  43. [Zheng et al., 2024b] Weijie Zheng, Mingfeng Li, Renzhong Deng, and Benjamin Doerr. How to use the Metropolis algorithm for multi-objective optimization? In Conference on Artificial Intelligence, AAAI 2024, pages 20883-20891. AAAI Press, 2024.
  44. [Zhou et al., 2011] Aimin Zhou, Bo-Yang Qu, Hui Li, Shi- Zheng Zhao, Ponnuthurai Nagaratnam Suganthan, and Qingfu Zhang. Multiobjective evolutionary algorithms: A survey of the state of the art. Swarm and Evolutionary Computation, 1:32-49, 2011.
  45. [Zhou et al., 2019] Zhi-Hua Zhou, Yang Yu, and Chao Qian. Evolutionary Learning: Advances in Theories and Algo- rithms. Springer, 2019.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards