Proceedings

Verifying Quantized Graph Neural Networks is PSPACE-complete

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 4660-4668.

https://doi.org/10.24963/ijcai.2025/519

Abstract

In this paper, we investigate verification of quantized Graph Neural Networks (GNNs), where some fixed-width arithmetic is used to represent numbers.

We introduce the linear-constrained validity (LVP) problem for verifying GNNs properties, and provide an efficient translation from LVP instances into a logical language. We show that LVP is in PSPACE, for any reasonable activation functions. We provide a proof system. We also prove PSPACE-hardness, indicating that while reasoning about quantized GNNs is feasible, it remains generally computationally challenging.

  1. [Ahvonen et al., 2024] Veeti Ahvonen, Damian Heiman, Antti Kuusisto, and Carsten Lutz. Logical characteriza- tions of recurrent graph neural networks with reals and floats. In Amir Globersons, Lester Mackey, Danielle Bel- grave, Angela Fan, Ulrich Paquet, Jakub M. Tomczak, and Cheng Zhang, editors, Advances in Neural Information Processing Systems 38: Annual Conference on Neural In- formation Processing Systems 2024, NeurIPS 2024, Van- couver, BC, Canada, December 10 -15, 2024, 2024.
  2. [Baader, 2017] Franz Baader. A new description logic with set constraints and cardinality constraints on role succes- sors. In Clare Dixon and Marcelo Finger, editors, Frontiers of Combining Systems -11th International Symposium, FroCoS 2017, Brasília, Brazil, September 27-29, 2017, Proceedings, volume 10483 of Lecture Notes in Computer Science, pages 43-59. Springer, 2017.
  3. [Barceló et al., 2020] Pablo Barceló, Egor V. Kostylev, Mikaël Monet, Jorge Pérez, Juan L. Reutter, and Juan Pablo Silva. The logical expressiveness of graph neu- ral networks. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net, 2020.
  4. [Bednarczyk et al., 2021] Bartosz Bednarczyk, Maja Or- lowska, Anna Pacanowska, and Tony Tan. On classical decidable logics extended with percentage quantifiers and arithmetics. In Mikolaj Bojanczyk and Chandra Chekuri, editors, 41st IARCS Annual Conference on Foundations of Software Technology and Theoretical Computer Science, FSTTCS 2021, December 15-17, 2021, Virtual Confer- ence, volume 213 of LIPIcs, pages 36:1-36:15. Schloss Dagstuhl -Leibniz-Zentrum für Informatik, 2021.
  5. [Benedikt et al., 2024] Michael Benedikt, Chia-Hsuan Lu, Boris Motik, and Tony Tan. Decidability of graph neu- ral networks via logical characterizations. In Karl Bring- mann, Martin Grohe, Gabriele Puppis, and Ola Svensson, editors, 51st International Colloquium on Automata, Lan- guages, and Programming, ICALP 2024, July 8-12, 2024, Tallinn, Estonia, volume 297 of LIPIcs, pages 127:1- 127:20. Schloss Dagstuhl -Leibniz-Zentrum für Infor- matik, 2024.
  6. [Cucala and Grau, 2024] David J. Tena Cucala and Bernardo Cuenca Grau. Bridging max graph neural networks and Datalog with negation. In Pierre Mar- quis, Magdalena Ortiz, and Maurice Pagnucco, editors, Proceedings of the 21st International Conference on Principles of Knowledge Representation and Reasoning, KR 2024, Hanoi, Vietnam. November 2-8, 2024, 2024. [Demri and Lugiez, 2010] Stéphane Demri and Denis Lugiez. Complexity of modal logics with presburger constraints. J. Appl. Log., 8(3):233-252, 2010.
  7. [Ercegovac and Lang, 2004] Miloš D. Ercegovac and Tomás Lang. Digital Arithmetic. Morgan Kaufmann, San Fran- cisco, CA, 2004.
  8. [Fey and Lenssen, 2019] Matthias Fey and Jan E. Lenssen. Fast graph representation learning with PyTorch Geomet- ric. In ICLR Workshop on Representation Learning on Graphs and Manifolds, 2019.
  9. [Fine, 1972] Kit Fine. In so many possible worlds. Notre Dame J. Formal Log., 13(4):516-520, 1972.
  10. [Galliani et al., 2023] Pietro Galliani, Oliver Kutz, and Nico- las Troquard. Succinctness and complexity of ALC with counting perceptrons. In Pierre Marquis, Tran Cao Son, and Gabriele Kern-Isberner, editors, Proceedings of the 20th International Conference on Principles of Knowledge Representation and Reasoning, KR 2023, Rhodes, Greece, September 2-8, 2023, pages 291-300, 2023.
  11. [Gasquet et al., 2014] Olivier Gasquet, Andreas Herzig, Bi- lal Said, and Franc ¸ois Schwarzentruber. Kripke's Worlds - An Introduction to Modal Logics via Tableaux. Studies in Universal Logic. Birkhäuser, 2014.
  12. [Gholami et al., 2021] Amir Gholami, Sehoon Kim, Zhen Dong, Zhewei Yao, Michael W. Mahoney, and Kurt Keutzer. A survey of quantization methods for efficient neural network inference. CoRR, abs/2103.13630, 2021.
  13. [Goldberg, 1991] David Goldberg. What every computer scientist should know about floating-point arithmetic. ACM Comput. Surv., 23(1):5-48, March 1991.
  14. [Grohe, 2023] Martin Grohe. The descriptive complexity of graph neural networks. In 38th Annual ACM/IEEE Sym- posium on Logic in Computer Science, LICS 2023, Boston, MA, USA, June 26-29, 2023, pages 1-14. IEEE, 2023.
  15. [Günnemann, 2022] Stephan Günnemann. Graph neural net- works: Adversarial robustness. In Graph Neural Net- works: Foundations, Frontiers, and Applications, pages 149-176. Springer Nature Singapore, Singapore, 2022.
  16. [Hähnle, 2001] Reiner Hähnle. Tableaux and related meth- ods. In John Alan Robinson and Andrei Voronkov, editors, Handbook of Automated Reasoning (in 2 volumes), pages 100-178. Elsevier and MIT Press, 2001.
  17. [Halpern and Moses, 1992] Joseph Y. Halpern and Yoram Moses. A guide to completeness and complexity for modal logics of knowledge and belief. Artif. Intell., 54(2):319- 379, 1992.
  18. [Henzinger et al., 2021] Thomas A. Henzinger, Mathias Lechner, and Dorde Zikelic. Scalable verification of quan- tized neural networks. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Confer- ence on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Ad- vances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021, pages 3787-3795. AAAI Press, 2021.
  19. [Huang et al., 2024] Pei Huang, Haoze Wu, Yuting Yang, Ieva Daukantas, Min Wu, Yedi Zhang, and Clark W. Bar- rett. Towards efficient verification of quantized neural net- works. In Michael J. Wooldridge, Jennifer G. Dy, and Sri- raam Natarajan, editors, Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Confer- ence on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Ad- vances in Artificial Intelligence, EAAI 2014, February 20- 27, 2024, Vancouver, Canada, pages 21152-21160. AAAI Press, 2024.
  20. [Marques-Silva and Ignatiev, 2022] João Marques-Silva and Alexey Ignatiev. Delivering trustworthy AI through for- mal XAI. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on In- novative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Ar- tificial Intelligence, EAAI 2022 Virtual Event, February 22 -March 1, 2022, pages 12342-12350. AAAI Press, 2022.
  21. [Nunn et al., 2024] Pierre Nunn, Marco Sälzer, Franc ¸ois Schwarzentruber, and Nicolas Troquard. A logic for rea- soning about aggregate-combine graph neural networks. In Proceedings of the 33rd International Joint Conference on Artificial Intelligence, IJCAI 2024, Jeju, South Korea, 3-9 August 2024. ijcai.org, 2024. IJCAI
  22. [Sälzer and Lange, 2021] Marco Sälzer and Martin Lange. Reachability is NP-complete even for the simplest neu- ral networks. In Paul C. Bell, Patrick Totzke, and Igor Potapov, editors, Reachability Problems -15th Interna- tional Conference, RP 2021, Liverpool, UK, October 25- 27, 2021, Proceedings, volume 13035 of Lecture Notes in Computer Science, pages 149-164. Springer, 2021.
  23. [Sälzer and Lange, 2023] Marco Sälzer and Martin Lange. Fundamental limits in formal verification of message- passing neural networks. In The Eleventh International Conference on Learning Representations, ICLR 2023, Ki- gali, Rwanda, May 1-5, 2023. OpenReview.net, 2023.
  24. [Sälzer et al., 2025] Marco Sälzer, Franc ¸ois Schwarzentru- ber, and Nicolas Troquard. Verifying quantized graph neu- ral networks is pspace-complete. CoRR, abs/2502.16244, 2025.
  25. [Savitch, 1970] Walter J. Savitch. Relationships between nondeterministic and deterministic tape complexities. J. Comput. Syst. Sci., 4(2):177-192, 1970.
  26. [van Benthem and Icard, 2023] Johan van Benthem and Thomas Icard. Interleaving logic and counting. Bull. Symb. Log., 29(4):503-587, 2023.
  27. [Velickovic et al., 2018] Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. Graph attention networks. In 6th Inter- national Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 -May 3, 2018, Conference Track Proceedings. OpenReview.net, 2018.
  28. [Ye et al., 2022] Zi Ye, Yogan Jaya Kumar, Goh Ong Sing, Fengyan Song, and Junsong Wang. A comprehensive sur- vey of graph neural networks for knowledge graphs. IEEE Access, 10:75729-75741, 2022.
  29. [Zhang et al., 2023] Yedi Zhang, Zhe Zhao, Guangke Chen, Fu Song, Min Zhang, Taolue Chen, and Jun Sun. Qvip: An ILP-based formal verification approach for quantized neu- ral networks. In Proceedings of the 37th IEEE/ACM In- ternational Conference on Automated Software Engineer- ing, ASE '22, New York, NY, USA, 2023. Association for Computing Machinery.
  30. [Zhou et al., 2020] Jie Zhou, Ganqu Cui, Shengding Hu, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Lifeng Wang, Changcheng Li, and Maosong Sun. Graph neural networks: A review of methods and applications. AI Open, 1:57-81, 2020.
  31. [Zhu et al., 2023] Zeyu Zhu, Fanrong Li, Zitao Mo, Qinghao Hu, Gang Li, Zejian Liu, Xiaoyao Liang, and Jian Cheng. A 2 Q: Aggregation-aware quantization for graph neural networks. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards