Proceedings

Fostering Collective Action in Complex Societies Using Community-Based Agents

Download BibTeX Cite

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence. Main Track. Pages 211-219.

https://doi.org/10.24963/ijcai.2024/24

Abstract

As AI integrates into human societies, its ability to engage in collective action is increasingly important. Human social systems have large and flexible strategy spaces, conflicting interests, power asymmetry, and interdependence among members, which together make it challenging for agents to learn collective action. In this paper, we explore the ability of community-based agents to learn collective action within a novel model of complex social systems. We first present this social model, called the Junior High Game (JHG). The JHG embodies key elements of human social systems that require players to act collectively. We then describe an agent, called CAB, which is based on community detection and formation algorithms. Via simulations and user studies, we evaluate the ability of CAB agents to interact in JHG societies consisting of humans and AI agents. These evaluations both identify requirements for successful collective behaviors in the JHG and identify important unsolved problems for developing AI agents capable of collective action in complex social systems.

  1. [Acemoglu and Robinson, 2013] Daron Acemoglu and James A. Robinson. Why Nations Fail: The Origins of Power, Prosperity, and Poverty. Profile Books, 2013.
  2. [Axelrod, 1984] Robert Axelrod. The Evolution of Coopera- tion. Basic Books, New York, 1984.
  3. [Baek et al., 2022] In-Chang Baek, Tae-Gwan Ha, Tae-Hwa Park, and Kyung-Joong Kim. Toward cooperative level generation in multiplayer games: A user study in over- cooked! In 2022 IEEE Conference on Games (CoG), pages 276-283. IEEE, 2022.
  4. [Barabási and Albert, 1999] Albert-László Barabási and Réka Albert. Emergence of scaling in random networks. science, 286(5439):509-512, 1999.
  5. [Bard et al., 2020] Nolan Bard, Jakob N. Foerster, Sarath Chandar, Neil Burch, Marc Lanctot, H. Francis Song, Emilio Parisotto, Vincent Dumoulin, Subhodeep Moitra, Edward Hughes, et al. The Hanabi challenge: A new fron- tier for AI research. Artificial Intelligence, 280:103216, 2020.
  6. [Biely et al., 2007] Christoly Biely, Klaus Dragosits, and Stefan Thurner. The prisoner's dilemma on co-evolving networks under perfect rationality. Physica D: Nonlinear Phenomena, 228(1):40-48, apr 2007.
  7. [Bishop et al., 2020] Justin Bishop, Jaylen Burgess, Cooper Ramos, Jade B Driggs, Tom Williams, Chad C Tossell, Elizabeth Phillips, Tyler H Shaw, and Ewart J de Visser. Chaopt: a testbed for evaluating human-autonomy team collaboration using the video game overcooked! 2. In 2020 Systems and Information Engineering Design Sym- posium (SIEDS), pages 1-6. IEEE, 2020.
  8. [Blondel et al., 2008] Vincent D. Blondel, Jean-Loup Guil- laume, Renaud Lambiotte, and Etienn Lefebvre. Fast un- folding of communities in large networks. Journal of Sta- tistical Mechanics: Theory and Experiment, 10, 2008.
  9. [Bonacich and Lloyd, 2001] Phillip Bonacich and Paulette Lloyd. Eigenvector-like measures of centrality for asym- metric relations. Social networks, 23(3):191-201, 2001.
  10. [Bowling et al., 2017] Michael Bowling, Neil Burch, Michael Johanson, and Oskari Tammelin. Heads-up limit hold'em poker is solved. Communications of the ACM, 60(11):81-88, 2017.
  11. [Brandes et al., 2007] Ulrik Brandes, Daniel Delling, Marco Gaertler, Robert Gorke, Martin Hoefer, Zoran Nikoloski, and Dorothea Wagner. On modularity clustering. IEEE transactions on knowledge and data engineering, 20(2):172-188, 2007.
  12. [Brown and Sandholm, 2019] Noam Brown and Tuomas Sandholm. Superhuman AI for multiplayer poker. Sci- ence, 365(6456):885-890, 2019.
  13. [Campbell et al., 2002] Murray Campbell, A. Joseph Hoane Jr, and Feng-hsiung Hsu. Deep blue. Artificial intelligence, 134(1-2):57-83, 2002.
  14. [Centola, 2018] Damon Centola. How behavior spreads: The science of complex contagions, volume 3. Princeton University Press Princeton, NJ, 2018.
  15. [Dafoe et al., 2021] Allan Dafoe, Yoram Bachrach, Gillian Hadfield, Eric Horvitz, Kate Larson, and Thore Grae- pel. Cooperative AI: machines must learn to find common ground. Nature, 593(7857):33-36, 2021.
  16. [De Jong et al., 2011] Steven De Jong, Daniel Hennes, Karl Tuyls, and Ya'akov Gal. Metastrategies in the colored trails game. In The 10th International Conference on Au- tonomous Agents and Multiagent Systems-Volume 2, pages 551-558.
  17. [De Jonge et al., 2019] Dave De Jonge, Tim Baarslag, Rey- han Aydogan, Catholijn Jonker, Katsuhide Fujita, and Takayuki Ito. The challenge of negotiation in the game of diplomacy. In Agreement Technologies: 6th International Conference, AT 2018, Bergen, Norway, December 6-7, 2018, Revised Selected Papers 6, pages 100-114. Springer, 2019.
  18. [Easley and Kleinberg, 2010] David Easley and Jon Klein- berg. Networks, Crowds, and Markets: Reasoning about a Highly Connected World. Cambridge University Press, 2010.
  19. [et al., 2022] Meta Fundamental AI Research Diplo- macy Team (FAIR), Anton Bakhtin, Noam Brown, Emily Dinan, Gabriele Farina, Colin Flaherty, Daniel Fried, Andrew Goff, Jonathan Gray, Hengyuan Hu, et al. Human-level play in the game of diplomacy by combin- ing language models with strategic reasoning. Science, 378(6624):1067-1074, 2022.
  20. [Fehr and Gächter, 2002] Ernst Fehr and Simon Gächter. Al- truistic punishment in humans. Nature, 415(6868):137- 140, 2002.
  21. [Fosong et al., 2023] Eliott Fosong, Arrasy Rahman, Igna- cio Carlucho, and Stefano V. Albrecht. Learning com- plex teamwork tasks using a sub-task curriculum. ArXiv preprint arXiv:2302.04944, 2023.
  22. [Freeman, 1977] Linton C Freeman. A set of measures of centrality based on betweenness. Sociometry, pages 35- 41, 1977.
  23. [Gini, 1921] Corrado Gini. Measurement of inequality of in- comes. The economic journal, 31(121):124-125, 1921.
  24. [Granovetter, 1973] Mark S. Granovetter. The strength of weak ties. American journal of sociology, 78(6):1360- 1380, 1973.
  25. [Heider, 1946] Fritz Heider. Attitudes and cognitive organi- zation. The Journal of psychology, 21(1):107-112, 1946.
  26. [Holland and Leinhardt, 1971] Paul W. Holland and Samuel Leinhardt. Transitivity in structural models of small groups. Comparative group studies, 2(2):107-124, 1971.
  27. [Katz, 1953] Leo Katz. A new status index derived from so- ciometric analysis. Psychometrika, 18(1):39-43, 1953.
  28. [Kraus and Lehmann, 1988] Sarit Kraus and Daniel Lehmann. Diplomat, an agent in a multi agent environ- ment: An overview. In IEEE International Performance Computing and Communications Conference, pages 434-435. IEEE Computer Society, 1988.
  29. [Lerer and Peysakhovich, 2017] Adam Lerer and Alexander Peysakhovich. Maintaining cooperation in complex so- cial dilemmas using deep reinforcement learning. ArXiv preprint arXiv:1707.01068, 2017.
  30. [Liaqat et al., 2020] Aisha Liaqat, Muddassar Azam Sindhu, and Ghazanfar Farooq Siddiqui. Metamorphic testing of an artificially intelligent chess game. IEEE Access, 8:174179-174190, 2020.
  31. [McCoy et al., 2013] Josh M. McCoy, Mike Treanor, Ben Samuel, Aaron A. Reed, Michael Mateas, and Noah Wardrip-Fruin. Prom week: Designing past the game/story dilemma. In Proceedings of the 8th International Confer- ence on the Foundations of Digital Games, 2013.
  32. [McPherson et al., 2001] Miller McPherson, Lynn Smith- Lovin, and James M. Cook. Birds of a feather: Homophily in social networks. Annual review of sociology, pages 415- 444, 2001.
  33. [Mukobi et al., 2023] Gabriel Mukobi, Hannah Erlebach, Niklas Lauffer, Lewis Hammond, Alan Chan, and Jesse Clifton. Welfare diplomacy: Benchmarking language model cooperation. arXiv preprint arXiv:2310.08901, 2023.
  34. [Newman et al., 2002] Mark Newman, Stephanie Forrest, and Justin Balthrop. Email networks and the spread of computer viruses. Physical Review E, 66(3):035101, 2002.
  35. [Newman, 2002] Mark Newman. Assortative mixing in net- works. Physical review letters, 89(20):208701, 2002.
  36. [Newman, 2006] Mark Newman. Modularity and commu- nity structure in networks. Proceedings of the national academy of sciences, 103(23):8577-8582, 2006.
  37. [Newman, 2010] Mark Newman. Networks: An introduc- tion, 2010.
  38. [Paquette et al., 2019] Philip Paquette, Yuchen Lu, Se- ton Steven Bocco, Max Smith, Satya O-G, Jonathan K Kummerfeld, Joelle Pineau, Satinder Singh, and Aaron C Courville. No-press diplomacy: Modeling multi-agent gameplay. Advances in Neural Information Processing Systems, 32, 2019.
  39. [Rosero et al., 2021] Andres Rosero, Faustina Dinh, Ewart J de Visser, Tyler Shaw, and Elizabeth Phillips. Two many cooks: Understanding dynamic human-agent team com- munication and perception using overcooked 2. arXiv preprint arXiv:2110.03071, 2021.
  40. [Rubin and Watson, 2011] Jonathan Rubin and Ian Watson. Computer poker: A review. Artificial intelligence, 175(5- 6):958-987, 2011.
  41. [Salancik, 1978] Gerald R Salancik. The external control of organizations: A resource dependence perspective. New York: Harper & Row, 1978.
  42. [Shi et al., 2022] Zhenyu Shi, Wei Wei, Matjaž Perc, Baifeng Li, and Zhiming Zheng. Coupling group selection and network reciprocity in social dilemmas through mul- tilayer networks. Applied Mathematics and Computation, 418:126835, 2022.
  43. [Silver et al., 2018] David Silver, Thomas Hubert, Julian Schrittwieser, Ioannis Antonoglou, Matthew Lai, Arthur Guez, Marc Lanctot, Laurent Sifre, Dharshan Kumaran, Thore Graepel, et al. A general reinforcement learning algorithm that masters chess, shogi, and Go through self- play. Science, 362(6419):1140-1144, 2018.
  44. [Skyrms, 2003] Brian Skyrms. The Stag Hunt and the Evo- lution of Social Structure. Cambridge University Press, 2003.
  45. [Walton-Rivers et al., 2019] Joseph Walton-Rivers, Piers R. Williams, and Richard Bartle. The 2018 Hanabi compe- tition. In 2019 IEEE Conference on Games (CoG), pages 1-8. IEEE, 2019.
  46. [Watts and Strogatz, 1998] Duncan J. Watts and Steven H. Strogatz. Collective dynamics of 'small-world' networks. Nature, 393(6684):440-442, 1998.
  47. [Wellman et al., 2003] Michael P. Wellman, Shih-Fen Cheng, Daniel M. Reeves, and Kevin M. Lochner. Trad- ing agents competing: Performance, progress, and market effectiveness. IEEE Intelligent Systems, 18(6):48-53, 2003.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards