The Minds of Many: Opponent Modeling in a Stochastic Game

The Minds of Many: Opponent Modeling in a Stochastic Game

Friedrich Burkhard von der Osten, Michael Kirley, Tim Miller

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence
Main track. Pages 3845-3851. https://doi.org/10.24963/ijcai.2017/537

The Theory of Mind provides a framework for an agent to predict the actions of adversaries by building an abstract model of their strategies using recursive nested beliefs. In this paper, we extend a recently introduced technique for opponent modeling based on Theory of Mind reasoning. Our extended multi-agent Theory of Mind model explicitly considers multiple opponents simultaneously. We introduce a stereotyping mechanism, which segments the agent population into sub-groups of agents with similar behavior. Here, sub-group profiles guide decision making in place of individual agent profiles. We evaluate our model using a multi-player stochastic game, which presents agents with the challenge of unknown adversaries in a partially-observable environment. Simulation results demonstrate that the model performs well under uncertainty and that stereotyping allows larger groups of agents to be modeled robustly. The findings strengthen results showing that Theory of Mind modeling is useful in many artificial intelligence applications.
Keywords:
Multidisciplinary Topics and Applications: AI and Social Sciences
Multidisciplinary Topics and Applications: Cognitive Modeling