Proceedings

LP-Based Weighted Model Integration over Non-Linear Real Arithmetic

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 9040-9048.

https://doi.org/10.24963/ijcai.2025/1005

Abstract

Weighted model integration (WMI) is a relatively recent formalism that has received significant interest as a technique for solving probabilistic inference tasks with complicated weight functions. Existing methods and tools are mostly focused on linear and polynomial functions and provide limited support for WMI of rational or radical functions, which naturally arise in several applications. In this work, we present a novel method for approximate WMI, which provides more effective support for the wide class of semi-algebraic functions that includes rational and radical functions, with literals defined over non-linear real arithmetic. Our algorithm leverages Farkas’ lemma and Handelman's theorem from real algebraic geometry to reduce WMI to solving a number of linear programming (LP) instances. The algorithm provides formal guarantees on the error bound of the obtained approximation and can reduce it to any user-defined value epsilon. Furthermore, our approach is perfectly parallelizable. Finally, we present extensive experimental results, demonstrating the superior performance of our method on a range of WMI tasks for rational and radical functions when compared to state-of-the-art tools for WMI, in terms of both applicability and tightness.

  1. [Abboud et al., 2022] Ralph Abboud, İsmail İlkan Ceylan, and Radoslav Dimitrov. Approximate weighted model in- tegration on DNF structures. Artif. Intell., 311:103753, 2022.
  2. [Akshay et al., 2024a] S Akshay, Supratik Chakraborty, Amir Kafshdar Goharshady, R Govind, Harshit J Mot- wani, and Sai Teja Varanasi. Automated synthesis of de- cision lists for polynomial specifications over integers. In Conference on Logic for Programming, Artificial Intelli- gence and Reasoning (LPAR 2024), 2024.
  3. [Akshay et al., 2024b] S Akshay, Supratik Chakraborty, Amir Kafshdar Goharshady, R Govind, Harshit Jitendra Motwani, and Sai Teja Varanasi. Practical approximate quantifier elimination for non-linear real arithmetic. In In- ternational Symposium on Formal Methods, pages 111- 130. Springer, 2024.
  4. [Akshay et al., 2025a] S. Akshay, Supratik Chakraborty, Soroush Farokhnia, Amir Goharshady, Harshit Jitendra Motwani, and Djordje Zikelic. Lp-based weighted model integration over non-linear real arithmetic. extended ver- sion. (hal-05071513), 2025.
  5. [Akshay et al., 2025b] S. Akshay, Supratik Chakraborty, Soroush Farokhnia, Amir Goharshady, Harshit Jitendra Motwani, and Djordje Zikelic. Tool -WMI-LP: Weighted model integration using linear programming. https:// github.com/destrat18/wmilp, 2025. Link
  6. [Albarghouthi et al., 2017] Aws Albarghouthi, Loris D'Antoni, Samuel Drews, and Aditya V Nori. Fairsquare: probabilistic verification of program fairness. Pro- ceedings of the ACM on Programming Languages, 1(OOPSLA):1-30, 2017.
  7. [Belle et al., 2015] Vaishak Belle, Andrea Passerini, and Guy Van den Broeck. Probabilistic inference in hybrid domains by weighted model integration. In Qiang Yang and Michael J. Wooldridge, editors, Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI 2015, Buenos Aires, Argentina, July 25-31, 2015, pages 2770-2776. AAAI Press, 2015. IJCAI
  8. [Beutner et al., 2022] Raven Beutner, C-H Luke Ong, and Fabian Zaiser. Guaranteed bounds for posterior inference in universal probabilistic programming. In Proceedings of the 43rd ACM SIGPLAN International Conference on Pro- gramming Language Design and Implementation, pages 536-551, 2022.
  9. [Bouchaud and Potters, 2003] Jean-Philippe Bouchaud and Marc Potters. Theory of financial risk and derivative pric- ing: from statistical physics to risk management. Cam- bridge university press, 2003.
  10. [Chakraborty et al., 2016] Supratik Chakraborty, Kuldeep S. Meel, and Moshe Y. Vardi. Algorithmic improvements in approximate counting for probabilistic inference: From linear to logarithmic SAT calls. In Subbarao Kambham- pati, editor, Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI 2016, New York, NY, USA, 9-15 July 2016, pages 3569-3576. IJCAI/AAAI Press, 2016. IJCAI
  11. [Chalkis and Fisikopoulos, 2020] Apostolos Chalkis and Vissarion Fisikopoulos. volesti: Volume approximation and sampling for convex polytopes in r. arXiv preprint arXiv:2007.01578, 2020.
  12. [Chatterjee et al., 2025] Krishnendu Chatterjee, Ehsan Kaf- shdar Goharshady, Mehrdad Karrabi, Harshit J Motwani, Maximilian Seeliger, and Djordje Zikelic. Quantified lin- ear and polynomial arithmetic satisfiability via template- based skolemization. In Proceedings of the AAAI Confer- ence on Artificial Intelligence, volume 39, pages 11158- 11166, 2025.
  13. [Chavira and Darwiche, 2008] Mark Chavira and Adnan Darwiche. On probabilistic inference by weighted model counting. Artif. Intell., 172(6-7):772-799, 2008.
  14. [Cimatti et al., 2013] Alessandro Cimatti, Alberto Griggio, Bastiaan Joost Schaafsma, and Roberto Sebastiani. The mathsat5 smt solver. In International Conference on Tools and Algorithms for the Construction and Analysis of Sys- tems, pages 93-107. Springer, 2013.
  15. [Colón et al., 2003] Michael A Colón, Sriram Sankara- narayanan, and Henny B Sipma. Linear invariant gener- ation using non-linear constraint solving. In Computer Aided Verification: 15th International Conference, CAV 2003, Boulder, CO, USA, July 8-12, 2003. Proceedings 15, pages 420-432. Springer, 2003.
  16. [De Loera et al., 2004] Jesús A De Loera, Raymond Hem- mecke, Jeremiah Tauzer, and Ruriko Yoshida. Effective lattice point counting in rational convex polytopes. Jour- nal of symbolic computation, 38(4):1273-1302, 2004.
  17. [Dehnert et al., 2015] Christian Dehnert, Sebastian Junges, Nils Jansen, Florian Corzilius, Matthias Volk, Harold Bru- intjes, Joost-Pieter Katoen, and Erika Ábrahám. Proph- esy: A probabilistic parameter synthesis tool. In Com- puter Aided Verification: 27th International Conference, CAV 2015, San Francisco, CA, USA, July 18-24, 2015, Proceedings, Part I 27, pages 214-231. Springer, 2015.
  18. [Dos Martires et al., 2019] Pedro Zuidberg Dos Martires, Anton Dries, and Luc De Raedt. Exact and approximate weighted model integration with probability density func- tions using knowledge compilation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33, pages 7825-7833, 2019.
  19. [Farkas, 1902] Julius Farkas. Theory of simple inequalities. Journal for pure and applied mathematics (Crelles Jour- nal), 1902(124):1-27, 1902.
  20. [Gehr et al., 2016] Timon Gehr, Sasa Misailovic, and Mar- tin Vechev. Psi: Exact symbolic inference for probabilis- tic programs. In Computer Aided Verification: 28th In- ternational Conference, CAV 2016, Toronto, ON, Canada, July 17-23, 2016, Proceedings, Part I 28, pages 62-83. Springer, 2016.
  21. Gurobi Optimization, LLC. Gurobi Optimizer Reference Manual, 2023.
  22. [Handelman, 1988] David Handelman. Representing poly- nomials by positive linear functions on compact convex polyhedra. Pacific Journal of Mathematics, 132(1):35-62, 1988.
  23. [Harris et al., 2020] Charles R. Harris, K. Jarrod Millman, Stéfan J. van der Walt, Ralf Gommers, Pauli Virtanen, David Cournapeau, Eric Wieser, Julian Taylor, Sebas- tian Berg, Nathaniel J. Smith, Robert Kern, Matti Pi- cus, Stephan Hoyer, Marten H. van Kerkwijk, Matthew Brett, Allan Haldane, Jaime Fernández del Río, Mark Wiebe, Pearu Peterson, Pierre Gérard-Marchant, Kevin Sheppard, Tyler Reddy, Warren Weckesser, Hameer Ab- basi, Christoph Gohlke, and Travis E. Oliphant. Array programming with NumPy. Nature, 2020.
  24. [Henrion et al., 2009] Didier Henrion, Jean B Lasserre, and Carlo Savorgnan. Approximate volume and integration for basic semialgebraic sets. SIAM review, 51(4):722-743, 2009.
  25. [Humphries et al., 2010] Nicolas E Humphries, Nuno Queiroz, Jennifer RM Dyer, Nicolas G Pade, Michael K Musyl, Kurt M Schaefer, Daniel W Fuller, Juerg M Brunnschweiler, Thomas K Doyle, Jonathan DR Houghton, et al. Environmental context explains lévy and brownian movement patterns of marine predators. Nature, 465(7301):1066-1069, 2010.
  26. [Lairez et al., 2019] Pierre Lairez, Marc Mezzarobba, and Mohab Safey El Din. Computing the volume of compact semi-algebraic sets. In Proceedings of the 2019 on Inter- national Symposium on Symbolic and Algebraic Compu- tation, pages 259-266, 2019.
  27. [Meurer et al., 2017] Aaron Meurer, Christopher P Smith, Mateusz Paprocki, Ondrej Certik, Sergey B Kirpichev, Matthew Rocklin, AMiT Kumar, Sergiu Ivanov, Jason K Moore, Sartaj Singh, et al. Sympy: symbolic computing in python. PeerJ Computer Science, 2017.
  28. [Morettin et al., 2017] Paolo Morettin, Andrea Passerini, and Roberto Sebastiani. Efficient weighted model integra- tion via smt-based predicate abstraction. In Proceedings of the 26th International Joint Conference on Artificial In- telligence, pages 720-728. AAAI Press, 2017. IJCAI
  29. [Morettin et al., 2021] Paolo Morettin, Pedro Zuidberg Dos Martires, Samuel Kolb, and Andrea Passerini. Hybrid probabilistic inference with logical and algebraic con- straints: a survey. In Zhi-Hua Zhou, editor, Proceedings of the Thirtieth International Joint Conference on Artifi- cial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pages 4533-4542. ijcai.org, 2021. IJCAI
  30. [Riley et al., 2006] Kenneth Franklin Riley, Michael Paul Hobson, and Stephen John Bence. Mathematical meth- ods for physics and engineering: a comprehensive guide. Cambridge university press, 2006. [Rom and Brakhage, 2011] Michael Rom and Karl-Heinz Brakhage. Volume mesh generation for numerical flow simulations using Catmull-Clark and surface approxima- tion methods. Inst. für Geometrie und Praktische Mathe- matik Aachen, Germany, 2011.
  31. [Sankaranarayanan et al., 2013] Sriram Sankaranarayanan, Aleksandar Chakarov, and Sumit Gulwani. Static analysis for probabilistic programs: inferring whole program prop- erties from finitely many paths. In Proceedings of the 34th ACM SIGPLAN conference on Programming language de- sign and implementation, pages 447-458, 2013.
  32. [Sims et al., 2008] David W Sims, Emily J Southall, Nico- las E Humphries, Graeme C Hays, Corey JA Brad- shaw, Jonathan W Pitchford, Alex James, Mohammed Z Ahmed, Andrew S Brierley, Mark A Hindell, et al. Scal- ing laws of marine predator search behaviour. Nature, 451(7182):1098-1102, 2008.
  33. [Spallitta et al., 2024] Giuseppe Spallitta, Gabriele Masina, Paolo Morettin, Andrea Passerini, and Roberto Sebas- tiani. Enhancing smt-based weighted model integration by structure awareness. Artificial Intelligence, 328:104067, 2024.
  34. [Tankov, 2003] Peter Tankov. Financial modelling with jump processes. Chapman and Hall/CRC, 2003.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards