Proceedings

Inverse Game Theory: An Incenter-Based Approach

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 3805-3813.

https://doi.org/10.24963/ijcai.2025/423

Abstract

Estimating player utilities from observed equilibria is crucial for many applications. Existing approaches to tackle this problem are either limited to specific games or do not scale well with the number of players. Our work addresses these issues by proposing a novel utility estimation method for general multi-player non-cooperative games. Our main idea consists in reformulating the inverse game problem as an inverse variational inequality problem and in selecting among all utility parameters consistent with the data, the so-called incenter. We show that the choice of the incenter can produce parameters that are most robust to the observed equilibrium behaviors. However, its computation is challenging, as the number of constraints in the corresponding optimization problem increases with the number of players and the behavior space size. To tackle this challenge, we propose a loss function-based algorithm, making our method scalable to games with many players or a continuous action space. Furthermore, we show that our method can be extended to incorporate prior knowledge of player utilities, and that it can handle inconsistent data, i.e., data where players do not play exact equilibria. Numerical experiments on three game applications demonstrate that our methods outperform the state of the art. The code, datasets, and supplementary material are available at https://github.com/cuilvye/Incenter-Project.

  1. [Alizadeh et al., 1998] Farid Alizadeh, Jean-Pierre A Hae- berly, and Michael L Overton. Primal-dual interior- point methods for semidefinite programming: Conver- gence rates, stability and numerical results. SIAM Journal on Optimization, 8(3):746-768, 1998.
  2. [Aswani et al., 2018] Anil Aswani, Zuo-Jun Shen, and Auyon Siddiq. Inverse optimization with noisy data. Op- erations Research, 66(3):870-892, 2018.
  3. [Beck and Teboulle, 2003] Amir Beck and Marc Teboulle. Mirror descent and nonlinear projected subgradient meth- ods for convex optimization. Operations Research Letters, 31(3):167-175, 2003.
  4. [Berry et al., 1995] Steven Berry, James Levinsohn, and Ariel Pakes. Automobile prices in market equilibrium. Econometrica: Journal of the Econometric Society, pages 841-890, 1995.
  5. [Berry, 1994] Steven T Berry. Estimating discrete-choice models of product differentiation. The RAND Journal of Economics, pages 242-262, 1994.
  6. [Bertsekas, 2016] Dimitri Bertsekas. Nonlinear program- ming, volume 4. Athena Scientific, 2016.
  7. [Bertsimas et al., 2015] Dimitris Bertsimas, Vishal Gupta, and Ioannis Ch Paschalidis. Data-driven estimation in equilibrium using inverse optimization. Mathematical Programming, 153:595-633, 2015.
  8. [Besbes et al., 2023] Omar Besbes, Yuri Fonseca, and Ilan Lobel. Contextual inverse optimization: Offline and online learning. Operations Research, 2023.
  9. [Blum et al., 2014] Avrim Blum, Nika Haghtalab, and Ariel D Procaccia. Learning optimal commitment to over- come insecurity. Advances in Neural Information Process- ing Systems, 27, 2014.
  10. [Bnouhachem et al., 2015] Abdellah Bnouhachem, Qam- rul Hasan Ansari, and Ching-Feng Wen. A projection de- scent method for solving variational inequalities. Journal of Inequalities and Applications, 2015:1-14, 2015.
  11. [Boyd and Vandenberghe, 2004] Stephen Boyd and Lieven Vandenberghe. Convex optimization. Cambridge Univer- sity Press, 2004.
  12. [Bubeck and others, 2015] Sébastien Bubeck et al. Con- vex optimization: Algorithms and complexity. Founda- tions and Trends R in Machine Learning, 8(3-4):231-357, 2015.
  13. [Chan et al., 2023] Timothy CY Chan, Rafid Mahmood, and Ian Yihang Zhu. Inverse optimization: Theory and appli- cations. Operations Research, 2023.
  14. [Facchinei and Pang, 2003] Francisco Facchinei and Jong- Shi Pang. Finite-dimensional variational inequalities and complementarity problems. Springer, 2003.
  15. [Fukushima, 1992] Masao Fukushima. Equivalent differ- entiable optimization problems and descent methods for asymmetric variational inequality problems. Mathemati- cal programming, 53:99-110, 1992.
  16. [Haghtalab et al., 2016] Nika Haghtalab, Fei Fang, Thanh Hong Nguyen, Arunesh Sinha, Ariel D Pro- caccia, and Milind Tambe. Three strategies to success: Learning adversary models in security games. 2016. IJCAI
  17. [Harker and Pang, 1990] Patrick T Harker and Jong-Shi Pang. Finite-dimensional variational inequality and non- linear complementarity problems: A survey of theory, al- gorithms and applications. Mathematical programming, 48(1):161-220, 1990.
  18. [Heuberger, 2004] Clemens Heuberger. Inverse combinato- rial optimization: A survey on problems, methods, and re- sults. Journal of combinatorial optimization, 8:329-361, 2004.
  19. [Jensen, 2018] Martin Kaae Jensen. Aggregative games. In Handbook of Game Theory and Industrial Organization, Volume I, pages 66-92.
  20. [Korpelevich, 1976] Galina M Korpelevich. The extragradi- ent method for finding saddle points and other problems. Matecon, 12:747-756, 1976.
  21. [Kuleshov and Schrijvers, 2015] Volodymyr Kuleshov and Okke Schrijvers. Inverse game theory: Learning utili- ties in succinct games. In Web and Internet Economics: 11th International Conference, WINE 2015, Amsterdam, The Netherlands, December 9-12, 2015, Proceedings 11, pages 413-427. Springer, 2015.
  22. [LeBlanc et al., 1975] Larry J LeBlanc, Edward K Morlok, and William P Pierskalla. An efficient approach to solving the road network equilibrium traffic assignment problem. Transportation research, 9(5):309-318, 1975.
  23. [Ling et al., 2018] Chun Kai Ling, Fei Fang, and J Zico Kolter. What game are we playing? end-to-end learning in normal and extensive form games. In Proceedings of the 27th International Joint Conference on Artificial Intel- ligence, pages 396-402, 2018. IJCAI
  24. [Ling et al., 2019] Chun Kai Ling, Fei Fang, and J Zico Kolter. Large scale learning of agent rationality in two- player zero-sum games. In Proceedings of the AAAI Con- ference on Artificial Intelligence, volume 33, pages 6104- 6111, 2019.
  25. [Maddux et al., 2023] Anna M Maddux, Nicolò Pagan, Giuseppe Belgioioso, and Florian Dörfler. Data-driven behaviour estimation in parametric games. IFAC- PapersOnLine, 56(2):9330-9335, 2023.
  26. [Mohajerin Esfahani et al., 2018] Peyman Mohajerin Esfa- hani, Soroosh Shafieezadeh-Abadeh, Grani A Hanasu- santo, and Daniel Kuhn. Data-driven inverse optimization with imperfect information. Mathematical Programming, 167:191-234, 2018.
  27. [Narahari et al., 2009] Yadati Narahari, Dinesh Garg, Rama- suri Narayanam, and Hastagiri Prakash. Game theoretic problems in network economics and mechanism design so- lutions. Springer Science & Business Media, 2009.
  28. [Nash, 1950] John F Nash. Equilibrium points in n-person games. Proceedings of the National Academy of Sciences of the United States of America, 36(1):48-49, 1950.
  29. [Nesterov and Nemirovskii, 1994] Yurii Nesterov and Arkadii Nemirovskii. Interior-point polynomial algo- rithms in convex programming. SIAM, 1994.
  30. [Noti, 2021] Gali Noti. From behavioral theories to econo- metrics: Inferring preferences of human agents from data on repeated interactions. In Proceedings of the AAAI Con- ference on Artificial Intelligence, volume 35, pages 5637- 5646, 2021.
  31. [Patriksson, 2015] Michael Patriksson. The traffic assign- ment problem: models and methods. Courier Dover Pub- lications, 2015.
  32. [Peters et al., 2023] Lasse Peters, Vicenc ¸Rubies-Royo, Claire J Tomlin, Laura Ferranti, Javier Alonso-Mora, Cyrill Stachniss, and David Fridovich-Keil. Online and offline learning of player objectives from partial obser- vations in dynamic games. The International Journal of Robotics Research, 42(10):917-937, 2023.
  33. [Risanger et al., 2020] Simon Risanger, Stein-Erik Fleten, and Steven A Gabriel. Inverse equilibrium analysis of oligopolistic electricity markets. IEEE Transactions on Power Systems, 35(6):4159-4166, 2020.
  34. [Sheffi, 1985] Yosef Sheffi. Urban transportation networks, volume 6. Prentice-Hall, Englewood Cliffs, NJ, 1985.
  35. [Tsai et al., 2016] Dorian Tsai, Timothy L Molloy, and Tris- tan Perez. Inverse two-player zero-sum dynamic games. In 2016 Australian Control Conference (AuCC), pages 192- 196. IEEE, 2016.
  36. [Vandenberghe and Boyd, 1996] Lieven Vandenberghe and Stephen Boyd. Semidefinite programming. SIAM review, 38(1):49-95, 1996.
  37. [Waugh et al., 2011] Kevin Waugh, Brian D Ziebart, and J Andrew Bagnell. Computational rationalization: the in- verse equilibrium problem. In Proceedings of the 28th International Conference on International Conference on Machine Learning, pages 1169-1176, 2011.
  38. [Wu et al., 2022] Jibang Wu, Weiran Shen, Fei Fang, and Haifeng Xu. Inverse game theory for stackelberg games: the blessing of bounded rationality. Advances in Neural Information Processing Systems, 35:32186-32198, 2022.
  39. [Xiu and Zhang, 2003] Naihua Xiu and Jianzhong Zhang. Some recent advances in projection-type methods for vari- ational inequalities. Journal of Computational and Ap- plied Mathematics, 152(1-2):559-585, 2003.
  40. [Yu et al., 2022] Yue Yu, Jonathan Salfity, David Fridovich- Keil, and Ufuk Topcu. Inverse matrix games with unique quantal response equilibrium. IEEE Control Systems Let- ters, 7:643-648, 2022.
  41. [Zattoni Scroccaro et al., 2024] Pedro Zattoni Scroccaro, Bilge Atasoy, and Peyman Mohajerin Esfahani. Learning in inverse optimization: Incenter cost, augmented sub- optimality loss, and algorithms. Operations Research, 2024.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards