Proceedings

Efficient Counterexample-Guided Fairness Verification and Repair of Neural Networks Using Satisfiability Modulo Convex Programming

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 367-375.

https://doi.org/10.24963/ijcai.2025/42

Abstract

Ensuring fairness is essential for ethical decision-making in various domains. Informally, a neural network is considered fair if and only if it treats similar individuals similarly in a given task.

We introduce FaVeR (Fairness Verification and Repair), a framework for efficiently verifying and repairing pre-trained neural networks with respect to individual fairness properties.

FaVeR ensures fairness via iterative search of high-sensitivity neurons and backward adjustment of their weights, guided by counterexamples generated from fairness verification using satisfiability modulo convex programming. By addressing fairness at the neuron level, FaVeR minimizes the impact of neural network repair on the overall performance. Experimental evaluations on common fairness datasets show that FaVeR achieves a 100% fairness repair rate across all models, with accuracy reduction of less than 2.27%. Moreover, its significantly lower average runtime makes it suitable for practical applications.

  1. [Albarghouthi et al., 2017] Aws Albarghouthi, Loris D'Antoni, Samuel Drews, and Aditya V Nori. Fairsquare: probabilistic verification of program fairness. Proc. ACM on Programming Languages (PACMPL), 1(OOPSLA):1- 30, 2017.
  2. [Barocas et al., 2023] Solon Barocas, Moritz Hardt, and Arvind Narayanan. Fairness and machine learning: Limi- tations and opportunities. MIT press, 2023.
  3. [Barrett and Tinelli, 2018] Clark Barrett and Cesare Tinelli. Satisfiability modulo theories. Handbook of model check- ing, pages 305-343, 2018.
  4. [Bastani et al., 2019] Osbert Bastani, Xin Zhang, and Ar- mando Solar-Lezama. Probabilistic verification of fairness properties via concentration. Proc. ACM on Programming Languages (PACMPL), 3(OOPSLA):1-27, 2019.
  5. [Bechavod and Ligett, 2017] Yahav Bechavod and Katrina Ligett. Penalizing unfairness in binary classification. arXiv preprint arXiv:1707.00044, 2017.
  6. [Bengio et al., 1994] Yoshua Bengio, Patrice Simard, and Paolo Frasconi. Learning long-term dependencies with gradient descent is difficult. IEEE TNN, 1994.
  7. [Benussi et al., 2022] Elias Benussi, Andrea Patane, Matthew Wicker, Luca Laurenti, and Marta Kwiatkowska. Individual fairness guarantees for neural networks. In Proc. International Joint Conference on Artificial Intelligence (IJCAI), 2022. IJCAI
  8. [Biswas and Rajan, 2023] Sumon Biswas and Hridesh Ra- jan. Fairify: Fairness verification of neural networks. In Proc. IEEE/ACM International Conference on Software Engineering (ICSE), pages 1546-1558, 2023.
  9. [Dasu et al., 2024] Vishnu Asutosh Dasu, Ashish Kumar, Saeid Tizpaz-Niari, and Gang Tan. NeuFair: Neural net- work fairness repair with dropout. In Proc. ACM Inter- national Symposium on Software Testing and Analysis (IS- STA), pages 1541-1553, 2024.
  10. [De Moura and Bjørner, 2008] Leonardo De Moura and Nikolaj Bjørner. Z3: An efficient SMT solver. In Inter- national Conference on Tools and Algorithms for the Con- struction and Analysis of Systems (TACAS), pages 337- 340. Springer, 2008.
  11. [Dwork et al., 2012] Cynthia Dwork, Moritz Hardt, Toni- ann Pitassi, Omer Reingold, and Richard Zemel. Fair- ness through awareness. In Proc. Innovations in Theoreti- cal Computer Science Conference (ITCS), pages 214-226, 2012.
  12. [Fayyazi et al., 2025] Arya Fayyazi, Mehdi Kamal, and Massoud Pedram. FACTER: Fairness-aware confor- mal thresholding and prompt engineering for enabling fair llm-based recommender systems. arXiv preprint arXiv:2502.02966, 2025.
  13. [Fu et al., 2024] Feisi Fu, Zhilu Wang, Weichao Zhou, Yix- uan Wang, Jiameng Fan, Chao Huang, Qi Zhu, Xin Chen, and Wenchao Li. REGLO: Provable neural network repair for global robustness properties. In Proc. AAAI Conference on Artificial Intelligence, volume 38, pages 12061-12071, 2024.
  14. [Gao et al., 2022] Xuanqi Gao, Juan Zhai, Shiqing Ma, Chao Shen, Yufei Chen, and Qian Wang. FairNeuron: Improv- ing deep neural network fairness with adversary games on selective neurons. In Proc. International Conference on Software Engineering (ICSE), pages 921-933, 2022.
  15. [Goodfellow et al., 2016] Ian Goodfellow, Yoshua Bengio, and Aaron Courville. Deep Learning. MIT Press, 2016. https://www.deeplearningbook.org/. Link
  16. Gurobi Optimization, LLC. Gurobi Optimizer Reference Manual, 2023.
  17. [Hardt and Barocas, 2017] Moritz Hardt and Solon Barocas. Fairness in machine learning. In Neural Information Pro- cessing Symposium, Tutorials Track, 2017.
  18. [Hardt et al., 2016] Moritz Hardt, Eric Price, and Nati Sre- bro. Equality of opportunity in supervised learning. Advances in neural information processing systems, 29, 2016.
  19. [Hochreiter, 1998] Sepp Hochreiter. The vanishing gradient problem during learning recurrent neural nets. ICANN, 1998.
  20. [Kim et al., 2024] Brian Hyeongseok Kim, Jingbo Wang, and Chao Wang. FairQuant: Certifying and quantify- ing fairness of deep neural networks. arXiv preprint arXiv:2409.03220, 2024.
  21. [Krishna et al., 2022] Satyapriya Krishna, Tessa Han, Alex Gu, Steven Wu, Shahin Jabbari, and Himabindu Lakkaraju. The disagreement problem in explainable ma- chine learning: A practitioner's perspective. arXiv preprint arXiv:2202.01602, 2022.
  22. [Li et al., 2023] Tianlin Li, Xiaofei Xie, Jian Wang, Qing Guo, Aishan Liu, Lei Ma, and Yang Liu. Faire: Repair- ing fairness of neural networks via neuron condition syn- thesis. ACM Transactions on Software Engineering and Methodology (TOSEM), 33(1):1-24, 2023.
  23. [Li et al., 2024] Tianlin Li, Yue Cao, Jian Zhang, Shiqian Zhao, Yihao Huang, Aishan Liu, Qing Guo, and Yang Liu. Runner: Responsible unfair neuron repair for enhancing deep neural network fairness. In Proc. IEEE/ACM Interna- tional Conference on Software Engineering (ICSE), pages 1-13, 2024.
  24. [Mohammadi et al., 2023] Kiarash Mohammadi, Aishwarya Sivaraman, and Golnoosh Farnadi. Feta: Fairness enforced verifying, training, and predicting algorithms for neural networks. In Proc. ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO), pages 1-11, 2023.
  25. [Montavon et al., 2018] Grégoire Montavon, Wojciech Samek, and Klaus-Robert Müller. Methods for inter- preting and understanding deep neural networks. Digital Signal Processing, 73:1-15, 2018.
  26. [Naik and Nuzzo, 2020] Nikhil Naik and Pierluigi Nuzzo. Robustness contracts for scalable verification of neu- ral network-enabled cyber-physical systems. In Proc. IEEE/ACM International Conference on Formal Methods and Models for System Design (MEMOCODE), pages 1- 12, 2020.
  27. [Nguyen et al., 2023] Giang Nguyen, Sumon Biswas, and Hridesh Rajan. Fix fairness, don't ruin accuracy: Per- formance aware fairness repair using automl. In Proc. ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineer- ing (ESEC/FSE), pages 502-514, 2023.
  28. [Shoukry et al., 2017] Yasser Shoukry, Pierluigi Nuzzo, Al- berto L Sangiovanni-Vincentelli, Sanjit A Seshia, George J Pappas, and Paulo Tabuada. SMC: Satisfiability modulo convex optimization. In Proc. International Conference on Hybrid Systems: Computation and Control (HSCC), pages 19-28, 2017.
  29. [Shoukry et al., 2018] Yasser Shoukry, Pierluigi Nuzzo, Al- berto L Sangiovanni-Vincentelli, Sanjit A Seshia, George J Pappas, and Paulo Tabuada. SMC: Satisfiability mod- ulo convex programming. Proc. IEEE, 106(9):1655-1679, 2018.
  30. [Urban et al., 2020] Caterina Urban, Maria Christakis, Valentin Wüstholz, and Fuyuan Zhang. Perfectly parallel fairness certification of neural networks. Proc. ACM on Programming Languages (PACMPL), 4(OOPSLA):1-30, 2020.
  31. [Zhang et al., 2020] Peixin Zhang, Jingyi Wang, Jun Sun, Guoliang Dong, Xinyu Wang, Xingen Wang, Jin Song Dong, and Ting Dai. White-box fairness testing through adversarial sampling. In Proc. IEEE/ACM International Conference on Software Engineering (ICSE), pages 949- 960, 2020.
  32. [Zheng et al., 2022] Haibin Zheng, Zhiqing Chen, Tianyu Du, Xuhong Zhang, Yao Cheng, Shouling Ji, Jingyi Wang, Yue Yu, and Jinyin Chen. Neuronfair: Interpretable white- box fairness testing through biased neuron identification. In Proc. International Conference on Software Engineer- ing (ICSE), pages 1519-1531, 2022.
  33. [Zhou et al., 2003] Dengyong Zhou, Olivier Bousquet, Thomas Lal, Jason Weston, and Bernhard Schölkopf. Learning with local and global consistency. Advances in Neural Information Processing Systems (NeurIPS), 16, 2003.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards