Proceedings

Online Contract Design

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 3470-3478.

https://doi.org/10.24963/ijcai.2026/386

Abstract

We initiate the study of online contracts, which integrate the game-theoretic considerations of economic contract theory, with the algorithmic and informational challenges of online algorithm design. Our starting point is the classic online setting with preemption, in which a hiring principal faces a sequence of adversarial agent arrivals. Upon arrival, the principal must decide whether to tentatively accept the agent to their team, and whether to dismiss previous tentative choices. Dismissal is irrevocable, giving the setting its online decision-making flavor. In our setting, the agents are rational players: once the team is finalized, a game is played where the principal offers contracts (performance-based payment schemes), and each agent decides whether or not to work. Working agents reward the principal, and the goal is to choose a team that maximizes the principal's utility. Our main positive result is a 1/2-competitive algorithm when agent rewards are additive, which matches the best-possible competitive ratio. Our algorithm is randomized and this is necessary, as we show that no deterministic algorithm can attain a bounded competitive ratio. Moreover, if agent rewards are allowed to exhibit combinatorial structure known as XOS, even randomized algorithms might fail. En route to our competitive algorithm, we develop the technique of balance points, which can be useful for further exploration of online contracts in the adversarial model.

  1. [Aharoni et al., 2025] Gil Aharoni, Martin Hoefer, and Inbal Talgam-Cohen. Welfare and beyond in multi-agent con- tracts. In Proc. EC 2025, page 895. ACM, 2025.
  2. [Alon et al., 2025] Tal Alon, Matteo Castiglioni, Junjie Chen, Tomer Ezra, Yingkai Li, and Inbal Talgam-Cohen. Multi-project contracts. In EC, page 580-598, 2025.
  3. [Babaioff et al., 2007] Moshe Babaioff, Nicole Immorlica, and Robert Kleinberg. Matroids, secretary problems, and online mechanisms. In SODA, pages 434-443. SIAM, 2007.
  4. [Babaioff et al., 2012] Moshe Babaioff, Michal Feldman, Noam Nisan, and Eyal Winter. Combinatorial agency. Journal of Economic Theory, 147(3):999-1034, 2012.
  5. [Bacchiocchi et al., 2024] Francesco Bacchiocchi, Matteo Castiglioni, Alberto Marchesi, and Nicola Gatti. Learn- ing optimal contracts: How to exploit small action spaces. In ICLR, 2024.
  6. [Bhattachary et al., 2024] Sayan Bhattachary, Martin Costa, Naveen Garg, Silvio Lattanzi, and Nikos Parotsidis. Fully dynamic k-clustering with fast update time and small re- course. In FOCS, pages 216-227, 2024.
  7. [Bollini et al., 2024] Matteo Bollini, Francesco Bacchiocchi, Matteo Castiglioni, Alberto Marchesi, and Nicola Gatti. Contracting with a reinforcement learning agent by play- ing trick or treat. Available at https://arxiv.org/abs/2410. 13520, 2024. Link
  8. [Borodin and El-Yaniv, 2005] Allan Borodin and Ran El- Yaniv. Online Computation and Competitive Analysis. Cambridge University Press, 2005.
  9. [Buchbinder et al., 2015] Niv Buchbinder, Moran Feldman, and Roy Schwartz. Online submodular maximization with preemption. In Proceedings of the Twenty-Sixth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA, pages 1202-1216, 2015.
  10. [Buchbinder et al., 2019] Niv Buchbinder, Moran Feldman, and Roy Schwartz. Online submodular maximization with preemption. ACM Trans. Algorithms, 15(3):30:1-30:31, 2019.
  11. [Cacciamani et al., 2024] Federico Cacciamani, Martino Bernasconi, Matteo Castiglioni, and Nicola Gatti. Multi- agent contract design beyond binary actions. In EC, page 1293, 2024.
  12. [Castiglioni et al., 2023] Matteo Castiglioni, Alberto March- esi, and Nicola Gatti. Multi-agent contract design: How to commission multiple agents with individual outcome. In EC, pages 412-448, 2023.
  13. [Chan et al., 2018] T.-H. Hubert Chan, Zhiyi Huang, Shaofeng H.-C. Jiang, Ning Kang, and Zhihao Gavin Tang. Online submodular maximization with free disposal. ACM Trans. Algorithms, 14(4):56:1-56:29, 2018.
  14. [Chen et al., 2024] Yurong Chen, Zhaohua Chen, Xiaotie Deng, and Zhiyi Huang. Are bounded contracts learnable and approximately optimal? In EC, 2024. [Collina et al., 2024] Natalie Collina, Varun Gupta, and Aaron Roth. Repeated contracting with multiple non- myopic agents: Policy regret and limited liability. In EC, pages 640-668, 2024.
  15. [Deo-Campo Vuong et al., 2024] Ramiro Deo- Campo Vuong, Shaddin Dughmi, Neel Patel, and Aditya Prasad. On supermodular contracts and dense subgraphs. In SODA, pages 109-132, 2024.
  16. [Dütting et al., 2019] Paul Dütting, Tim Roughgarden, and Inbal Talgam-Cohen. Simple versus optimal contracts. In EC, pages 369-387, 2019.
  17. [Dütting et al., 2023a] Paul Dütting, Tomer Ezra, Michal Feldman, and Thomas Kesselheim. Multi-agent contracts. In STOC, pages 1311-1324, 2023.
  18. [Dütting et al., 2023b] Paul Dütting, Guru Guruganesh, Jon Schneider, and Joshua Wang. Optimal no-regret learning of one-sided Lipschitz functions. In ICML, 2023.
  19. [Dütting et al., 2024] Paul Dütting, Michal Feldman, and In- bal Talgam-Cohen. Algorithmic contract theory: A survey. Foundations and Trends in Theoretical Computer Science, 16(3-4):211-412, 2024.
  20. [Dütting et al., 2025a] Paul Dütting, Tomer Ezra, Michal Feldman, and Thomas Kesselheim. Multi-agent combi- natorial contracts. In SODA, pages 1857-1891, 2025.
  21. [Dütting et al., 2025b] Paul Dütting, Federico Fusco, Sil- vio Lattanzi, Ashkan Norouzi-Fard, Ola Svensson, and Morteza Zadimoghaddam. The cost of consistency: Sub- modular maximization with constant recourse. In STOC, pages 1406-1417. ACM, 2025.
  22. [Ezra et al., 2024] Tomer Ezra, Michal Feldman, and Maya Schlesinger. Contract design for sequential actions. arXiv:2403.09545, 2024.
  23. [Feldman et al., 2009] Jon Feldman, Aranyak Mehta, Vahab Mirrokni, and S. Muthukrishnan. Online ad allocation with free disposal. In ESA, pages 374-385. Springer, 2009.
  24. [Fichtenberger et al., 2021] Hendrik Fichtenberger, Silvio Lattanzi, Ashkan Norouzi-Fard, and Ola Svensson. Con- sistent k-clustering for general metrics. In SODA, pages 2660-2678. SIAM, 2021.
  25. [Gupta and Levin, 2020] Anupam Gupta and Roie Levin. Fully-dynamic submodular cover with bounded recourse. In FOCS, pages 1147-1157. IEEE, 2020.
  26. [Gupta et al., 2022] Anupam Gupta, Vijaykrishna Gu- runathan, Ravishankar Krishnaswamy, Amit Kumar, and Sahil Singla. Online discrepancy with recourse for vectors and graphs. In SODA, pages 1356-1383. SIAM, 2022.
  27. [Guruganesh et al., 2023] Guru Guruganesh, Jon Schneider, Joshua Wang, and Junyao Zhao. The power of menus in contract design. In EC, pages 818-848, 2023.
  28. [Guruganesh et al., 2024] Guru Guruganesh, Yoav Kolum- bus, Jon Schneider, Inbal Talgam-Cohen, Emmanouil- Vasileios Vlatakis-Gkaragkounis, Joshua Wang, and S. Matthew Weinberg. Contracting with a learning agent. Advances in Neural Information Processing Sys- tems, 37:77366-77408, 2024.
  29. [Han et al., 2015] Xin Han, Yasushi Kawase, and Kazuhisa Makino. Randomized algorithms for removable on- line knapsack problems. Theoretical Computer Science, 562:395-405, 2015.
  30. [Ho et al., 2014] Chien-Ju Ho, Aleksandrs Slivkins, and Jen- nifer Wortman Vaughan. Adaptive contract design for crowdsourcing markets: Bandit algorithms for repeated principal-agent problems. In EC, pages 359-376, 2014.
  31. [Holmström and Milgrom, 1987] Bengt Holmström and Paul Milgrom. Aggregation and linearity in the provi- sion of intertemporal incentives. Econometrica, pages 303-328, 1987.
  32. [Holmström, 1979] Bengt Holmström. Moral hazard and ob- servability. The Bell Journal of Economics, pages 74-91, 1979.
  33. [Holmström, 1982] Bengt Holmström. Moral hazard in teams. The Bell Journal of Economics, 13(2):324-340, 1982.
  34. [Ivanov et al., 2024] Dima Ivanov, Paul Dütting, Inbal Talgam-Cohen, Tonghan Wang, and David C Parkes. Principal-agent reinforcement learning: Orchestrating AI agents with contracts. arXiv:2407.18074, 2024.
  35. [Kleinberg and Weinberg, 2012] Robert Kleinberg and S. Matthew Weinberg. Matroid prophet inequalities. In STOC, pages 123-136. ACM, 2012.
  36. [Kleinberg, 2005] Robert Kleinberg. A multiple-choice sec- retary problem with applications to online auctions. In SODA, pages 630-631. SIAM, 2005.
  37. [Łacki et al., 2021] Jakub Łacki, Bernhard Haeupler, Christoph Grunau, Rajesh Jayaram, and Václav Rozhoň. Fully dynamic consistent k-center clustering. In SODA, pages 3463-3484. SIAM, 2021.
  38. [Lattanzi and Vassilvitskii, 2017] Silvio Lattanzi and Sergei Vassilvitskii. Consistent k-clustering. In ICML, pages 1975-1984, 2017.
  39. [Lavi et al., 2026] Elad Lavi, Hadas Shachnai, and Inbal Talgam-Cohen. Online contract design. arXiv preprint arXiv:2602.07385, 2026.
  40. [Rawitz and Rosén, 2021] Dror Rawitz and Adi Rosén. Online budgeted maximum coverage. Algorithmica, 83(9):2989-3014, 2021.
  41. [Samuel-Cahn, 1984] Esther Samuel-Cahn. Comparison of threshold stop rules and maximum for independent non- negative random variables. The Annals of Probability, 12(4):1213-1216, 1984.
  42. [Sleator and Tarjan, 1985] Daniel Dominic Sleator and Robert Endre Tarjan. Amortized efficiency of list update and paging rules. Commun. ACM, 28(2):202-208, 1985.
  43. [Valentine and Bernstein, 2025] Melissa Valentine and Michael S Bernstein. Flash Teams: Leading the Future of AI-Enhanced, On-Demand Work. MIT Press, 2025.
  44. [Wu et al., 2023] Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Shaokun Zhang, Erkang Zhu, Beibin Li, Li Jiang, Xiaoyun Zhang, and Chi Wang. Autogen: En- abling next-gen LLM applications via multi-agent conver- sation framework. https://arxiv.org/abs/2308.08155, 2023. Link
  45. [Wu et al., 2024] Jibang Wu, Siyu Chen, Mengdi Wang, Huazheng Wang, and Haifeng Xu. Contractual reinforce- ment learning: Pulling arms with invisible hands, 2024. arXiv preprint.
  46. [Yang and Zheng, 2024] Zhengchen Yang and Jiping Zheng. Online submodular maximization via adaptive thresholds. In Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, IJCAI, pages 7065- 7073, 2024. IJCAI
  47. [Zhu et al., 2023] Banghua Zhu, Stephen Bates, Zhuoran Yang, Yixin Wang, Jiantao Jiao, and Michael I. Jordan. The sample complexity of online contract design. In EC, page 1188, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards