Proactive and Reactive Coordination of Non-dedicated Agent Teams Operating in Uncertain Environments

Proactive and Reactive Coordination of Non-dedicated Agent Teams Operating in Uncertain Environments

Pritee Agrawal, Pradeep Varakantham

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence

Domains such as disaster rescue, security patrolling etc. often feature dynamic environments where allocations of tasks to agents become ineffective due to unforeseen conditions that may require agents to leave the team. Agents leave the team either due to arrival of high priority tasks (e.g., emergency, accident or violation) or due to some damage to the agent. Existing research in task allocation has only considered fixed number of agents and in some instances arrival of new agents on the team. However, there is little or no literature that considers situations where agents leave the team after task allocation. To that end, we first provide a general model to represent non-dedicated teams. Second, we provide a proactive approach based on sample average approximation to generate a strategy that works well across different feasible scenarios of agents leaving the team. Furthermore, we also provide a 2-stage approach that provides a 2-stage policy that changes allocation based on observed state of the team. Third, we provide a reactive approach that rearranges the allocated tasks to better adapt to leaving agents. Finally, we provide a detailed evaluation of our approaches on existing benchmark problems.
Keywords:
Agent-based and Multi-agent Systems: Multi-agent Planning
Planning and Scheduling: Markov Decisions Processes
Agent-based and Multi-agent Systems: Coordination and cooperation
Planning and Scheduling: Planning under Uncertainty