Proceedings

LLM-guided Cutting-plane Management for Mixed-integer Linear Programming

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. AI4Tech: AI Enabling Technologies. Pages 6617-6625.

https://doi.org/10.24963/ijcai.2026/736

Abstract

Cutting planes are central to mixed-integer linear programming (MILP) solving, yet their effectiveness hinges on expert tuning of separator configurations and hard-crafted cut-selection heuristics, creating a high barrier for non-specialists. Learning-based methods can reduce manual effort, but typically require large training datasets and often generalize poorly beyond the instance classes they are trained on. We propose an LLM-guided cutting-plane management framework that integrates large language models into the MILP solving pipeline. First, using chain-of-thought (CoT) prompting, the LLM infers an instance-specific separator configuration, deciding which separators to activate and how to set key parameters from the problem type and structural features. Then, it translates the evolving branch-and-bound state in natural language to perform stage-aware cut selection, choosing a high-quality subset of cuts that tightens the relaxation and improves overall solver performance. Leveraging the LLM's reasoning capabilities and rich background knowledge, our work removes dependence on domain-specific training data and substantially reduces reliance on expert-crafted configurations. Experiments show consistent improvements over SCIP's default settings, hard-crafted heuristics, and recent learning-based cut selection baselines.

  1. [Achterberg, 2007] Tobias Achterberg. Constraint integer programming. PhD thesis, Berlin Institute of Technology, 2007.
  2. [Andrade-Pineda et al., 2017] José Luis Andrade-Pineda, David Canca, and Pedro L. Gonzalez-R. On modelling non-linear quantity discounts in a supplier selection prob- lem by mixed linear integer optimization. Ann. Oper. Res., 258(2):301-346, 2017.
  3. [Atamtürk, 2003] Alper Atamtürk. On the facets of the mixed-integer knapsack polyhedron. Math. Program., 98(1-3):145-175, 2003.
  4. [Balas and Ho, 2009] Egon Balas and Andrew Ho. Set cov- ering algorithms using cutting planes, heuristics, and sub- gradient optimization: a computational study. In Combi- natorial optimization, pages 37-60. 2009.
  5. [Balcan et al., 2018] Maria-Florina Balcan, Travis Dick, Tuomas Sandholm, and Ellen Vitercik. Learning to branch. In Proceedings of the 35th International Confer- ence on Machine Learning, ICML 2018, pages 353-362, 2018.
  6. [Balcan et al., 2021] Maria-Florina Balcan, Siddharth Prasad, Tuomas Sandholm, and Ellen Vitercik. Sam- ple complexity of tree search configuration: Cutting planes and beyond. In Advances in Neural Information Processing Systems, NeurIPS 2021, pages 4015-4027, 2021.
  7. [Bengio et al., 2021] Yoshua Bengio, Andrea Lodi, and An- toine Prouvost. Machine learning for combinatorial opti- mization: A methodological tour d'horizon. Eur. J. Oper. Res., 290(2):405-421, 2021.
  8. [Bergman et al., 2016] David Bergman, André A. Ciré, Willem-Jan van Hoeve, and John N. Hooker. Decision Di- agrams for Optimization. Artificial Intelligence: Founda- tions, Theory, and Algorithms. 2016.
  9. [Bestuzheva et al., 2023] Ksenia Bestuzheva, Mathieu Besanc ¸on, Weikun Chen, Antonia Chmiela, Tim Donkiewicz, Jasper van Doornmalen, Leon Eifler, Oliver Gaul, Gerald Gamrath, Ambros M. Gleixner, Leona Gottwald, Christoph Graczyk, Katrin Halbig, Alexander Hoen, Christopher Hojny, Rolf van der Hulst, Thorsten Koch, Marco E. Lübbecke, Stephen J. Maher, Frederic Matter, Erik Mühmer, Benjamin Müller, Marc E. Pfetsch, Daniel Rehfeldt, Steffan Schlein, et al. Enabling research through the SCIP optimization suite 8.0. ACM Trans. Math. Softw., 49(2):22:1-22:21, 2023.
  10. [Caselli et al., 2022] Giulia Caselli, Giomaria Columbu, Manuel Iori, and Carlo Alberto Magni. Mixed integer linear programming for CO2 emissions minimization in a waste transfer facility location problem. In Proceedings of the 10th International Network Optimization Conference, INOC 2022, pages 1-6, 2022.
  11. [Chen, 2010] Zhi-Long Chen. Integrated production and out- bound distribution scheduling: Review and extensions. Oper. Res., 58(1):130-148, 2010.
  12. [Edmunds and Bard, 1992] Thomas A. Edmunds and Jonathan F. Bard. An algorithm for the mixed-integer nonlinear bilevel programming problem. Ann. Oper. Res., 34:149-162, 1992.
  13. [Gasse et al., 2019] Maxime Gasse, Didier Chételat, Nicola Ferroni, Laurent Charlin, and Andrea Lodi. Exact combi- natorial optimization with graph convolutional neural net- works. In Advances in Neural Information Processing Sys- tems, NeurIPS 2019, pages 15554-15566, 2019.
  14. [Gasse et al., 2021] Maxime Gasse, Simon Bowly, Quentin Cappart, Jonas Charfreitag, Laurent Charlin, Didier Chételat, Antonia Chmiela, Justin Dumouchelle, Am- bros M. Gleixner, Aleksandr M. Kazachkov, Elias B. Khalil, et al. The machine learning for combinatorial op- timization competition (ML4CO): results and insights. In NeurIPS 2021 Competitions and Demonstrations Track, 6- 14 December 2021, pages 220-231, 2021.
  15. [Gomes et al., 2008] Carla P. Gomes, Willem Jan van Hoeve, and Ashish Sabharwal. Connections in networks: A hy- brid approach. In Integration of AI and OR Techniques in Constraint Programming for Combinatorial Optimization Problems, 5th International Conference, CPAIOR 2008, pages 303-307, 2008.
  16. [He et al., 2014] He He, Hal Daumé III, and Jason Eisner. Learning to search in branch and bound algorithms. In Ad- vances in Neural Information Processing Systems, NIPS 2014, pages 3293-3301, 2014.
  17. [Hendel et al., 2018] Gregor Hendel, Matthias Miltenberger, and Jakob Witzig. Adaptive algorithmic behavior for solv- ing mixed integer programs using bandit algorithms. In Operations Research Proceedings 2018, pages 513-519, 2018.
  18. [Huang et al., 2022] Zeren Huang, Kerong Wang, Furui Liu, Hui-Ling Zhen, Weinan Zhang, Mingxuan Yuan, Jianye Hao, Yong Yu, and Jun Wang. Learning to select cuts for efficient mixed-integer programming. Pattern Recognit., 123:108353, 2022.
  19. [Huang et al., 2025] Chenyu Huang, Zhengyang Tang, Shixi Hu, Ruoqing Jiang, Xin Zheng, Dongdong Ge, Benyou Wang, and Zizhuo Wang. ORLM: A customizable frame- work in training large models for automated optimization modeling. Oper. Res., 73(6):2986-3009, 2025.
  20. [Jiang et al., 2025a] Shuo Jiang, Min Xie, and Jianxi Luo. Large language models for combinatorial optimization of design structure matrix. Proceedings of the Design Soci- ety, 5:2201-2210, 2025.
  21. [Jiang et al., 2025b] Xia Jiang, Yaoxin Wu, Minshuo Li, Zhiguang Cao, and Yingqian Zhang. Large language models as end-to-end combinatorial optimization solvers. In Advances in Neural Information Processing Systems, NeurIPS 2025, 2025.
  22. [Khalil et al., 2016] Elias Boutros Khalil, Pierre Le Bodic, Le Song, George L. Nemhauser, and Bistra Dilkina. Learning to branch in mixed integer programming. In Pro- ceedings of the Thirtieth Conference on Artificial Intelli- gence, AAAI 2016, pages 724-731, 2016.
  23. [Khalil et al., 2017] Elias B. Khalil, Bistra Dilkina, George L. Nemhauser, Shabbir Ahmed, and Yufen Shao. Learning to run heuristics in tree search. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, pages 659-666, 2017. IJCAI
  24. [Lawless et al., 2025] Connor Lawless, Yingxi Li, Anders Wikum, Madeleine Udell, and Ellen Vitercik. Llms for cold-start cutting plane separator configuration. In Inte- gration of Constraint Programming, Artificial Intelligence, and Operations Research, CPAIOR 2025, pages 51-69, 2025.
  25. [Li et al., 2023] Sirui Li, Wenbin Ouyang, Max B. Paulus, and Cathy Wu. Learning to configure separators in branch- and-cut. In Advances in Neural Information Processing Systems 36, NeurIPS 2023, 2023.
  26. [Liu et al., 2024] Fei Liu, Xialiang Tong, Mingxuan Yuan, Xi Lin, Fu Luo, Zhenkun Wang, Zhichao Lu, and Qingfu Zhang. Evolution of heuristics: Towards efficient auto- matic algorithm design using large language model. In Forty-first International Conference on Machine Learning, ICML 2024, 2024.
  27. [Mahmoud et al., 2023] Ayman Mahmoud, Mo- hammed Hichame Benbitour, Zied Jemaï, Evren Sahin, and Marc Baratte. Integrated shipment and production planning: A mixed-integer linear programming approach with multiple suppliers and due dates. In IEEE Interna- tional Conference on Networking, Sensing and Control, ICNSC 2023, pages 1-6, 2023.
  28. [Mhiri, 2024] Mariem Mhiri. A mixed-integer programming model for the bin packing problem with piecewise linear loading cost and time windows. In IEEE International Conference on Industrial Engineering and Engineering Management, IEEM 2024, pages 395-399, 2024.
  29. [Mitchell, 2002] John E. Mitchell. Branch-and-cut algo- rithms for combinatorial optimization problems. In Hand- book of Applied Optimization, pages 65-77. 2002.
  30. [Paulus et al., 2022] Max B. Paulus, Giulia Zarpellon, An- dreas Krause, Laurent Charlin, and Chris J. Maddison. Learning to cut by looking ahead: Cutting plane selection via imitation learning. In International Conference on Ma- chine Learning, ICML 2022, pages 17584-17600, 2022.
  31. [Sabharwal et al., 2012] Ashish Sabharwal, Horst Samu- lowitz, and Chandra Reddy. Guiding combinatorial op- timization with UCT. In Integration of AI and OR Tech- niques in Contraint Programming for Combinatorial Op- timzation Problems CPAIOR 2012, pages 356-361, 2012.
  32. [Scavuzzo et al., 2022] Lara Scavuzzo, Feng Yang Chen, Di- dier Chételat, Maxime Gasse, Andrea Lodi, Neil Yorke- Smith, and Karen I. Aardal. Learning to branch with tree mdps. In Advances in Neural Information Processing Sys- tems, NeurIPS 2022, 2022.
  33. [Shi et al., 2025] Yiding Shi, Jianan Zhou, Wen Song, Jieyi Bi, Yaoxin Wu, and Jie Zhang. Generalizable heuris- tic generation through large language models with meta- optimization. CoRR, abs/2505.20881, 2025.
  34. [Tang et al., 2020] Yunhao Tang, Shipra Agrawal, and Yuri Faenza. Reinforcement learning for integer program- ming: Learning to cut. In Proceedings of the 37th Inter- national Conference on Machine Learning, ICML 2020, pages 9367-9376, 2020.
  35. [Turner et al., 2023] Mark Turner, Thorsten Koch, Felipe Serrano, and Michael Winkler. Adaptive cut selection in mixed-integer linear programming. Open J. Math. Optim., 4:1-28, 2023.
  36. [Wang et al., 2023] Zhihai Wang, Xijun Li, Jie Wang, Yufei Kuang, Mingxuan Yuan, Jia Zeng, Yongdong Zhang, and Feng Wu. Learning cut selection for mixed-integer lin- ear programming via hierarchical sequence model. In The Eleventh International Conference on Learning Represen- tations, ICLR 2023, 2023.
  37. [Wu et al., 2025] Xuan Wu, Di Wang, Chunguo Wu, Lijie Wen, Chunyan Miao, Yubin Xiao, and You Zhou. Efficient heuristics generation for solving combinatorial optimiza- tion problems using large language models. In Proceed- ings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD 2025, pages 3228- 3239, 2025.
  38. [Ye et al., 2025] Huigen Ye, Hua Xu, An Yan, and Yaoyang Cheng. Large language model-driven large neighborhood search for large-scale MILP problems. In Forty-second In- ternational Conference on Machine Learning, ICML 2025, 2025.
  39. [Yuan et al., 2024] Haofeng Yuan, Lichang Fang, and Shiji Song. A reinforcement-learning-based multiple-column selection strategy for column generation. In Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, pages 8209-8216, 2024.
  40. [Zarpellon et al., 2021] Giulia Zarpellon, Jason Jo, Andrea Lodi, and Yoshua Bengio. Parameterizing branch-and- bound search trees to learn branching policies. In Thirty- Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, pages 3931-3939, 2021.
  41. [Zhang and Luo, 2025] Bowen Zhang and Pengcheng Luo. Or-llm-agent: Automating modeling and solving of oper- ations research optimization problem with reasoning large language model. CoRR, abs/2503.10009, 2025.
  42. [Zheng et al., 2025] Zhi Zheng, Zhuoliang Xie, Zhenkun Wang, and Bryan Hooi. Monte carlo tree search for com- prehensive exploration in llm-based automatic heuristic design. In Forty-second International Conference on Ma- chine Learning, ICML 2025, 2025.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards