Proceedings

Goal Recognition Design with Stochastic Agent Action Outcomes

Download BibTeX Cite

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. Pages 3279-3284.

Abstract

Goal Recognition Design (GRD) problems involve identifying the best ways to modify the underlying environment that the agents operate in, typically by making a subset of feasible actions infeasible, in such a way that agents are forced to reveal their goals as early as possible. Thus far, existing work assumes that the outcomes of the actions of the agents are deterministic, which might be unrealistic in real-world problems. For example, wheel slippage in robots cause the outcomes of their movements to be stochastic. In this paper, we generalize the GRD problem to Stochastic GRD (S-GRD) problems, which handle stochastic action outcomes. We also generalize the worst-case distinctiveness (wcd) measure, which measures the goodness of a solution, to take stochasticity into account. Finally, we introduce Markov decision process (MDP) based algorithms to compute the wcd and minimize it by making up to k actions infeasible.

  1. [Bellman, 1957] Richard Bellman. Dynamic Programming. Princeton University Press, 1957.
  2. [Geffner and Bonet, 2013] Hector Geffner and Blai Bonet. A Concise Introduction to Models and Methods for Auto- mated Planning. Morgan & Claypool Publishers, 2013.
  3. [Geib and Steedman, 2007] Christopher Geib and Mark Steedman. On natural language processing and plan recognition. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pages 1612-1617, 2007. IJCAI
  4. [Jarvis et al., 2005] Peter Jarvis, Teresa Lunt, and Karen My- ers. Identifying terrorist activity with AI plan recognition technology. AI Magazine, 26(3):73-81, 2005.
  5. [Johnson, 2010] W. Lewis Johnson. Serious use of a serious game for language learning. International Journal of Arti- ficial Intelligence in Education, 20(2):175-195, 2010.
  6. [Kelley et al., 2012] Richard Kelley, Liesl Wigand, Brian Hamilton, Katie Browne, Monica Nicolescu, and Mircea Nicolescu. Deep networks for predicting human intent with respect to objects. In Proceedings of the International Con- ference on Human-Robot Interaction (HRI), pages 171- 172, 2012.
  7. [Keren et al., 2014] Sarah Keren, Avigdor Gal, and Erez Karpas. Goal recognition design. In Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS), pages 154-162, 2014.
  8. [Keren et al., 2015] Sarah Keren, Avigdor Gal, and Erez Karpas. Goal recognition design for non-optimal agents. In Proceedings of the AAAI Conference on Artificial Intel- ligence (AAAI), pages 3298-3304, 2015.
  9. [Keren et al., 2016a] Sarah Keren, Avigdor Gal, and Erez Karpas. Goal recognition design with non-observable ac- tions. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2016.
  10. [Keren et al., 2016b] Sarah Keren, Avigdor Gal, and Erez Karpas. Privacy preserving plans in partially observable environments. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2016. IJCAI
  11. [Kolobov, 2013] Andrey Kolobov. Scalable Methods and Ex- pressive Models for Planning Under Uncertainty. PhD the- sis, University of Washington, 2013.
  12. [Lee et al., 2012] Seung Lee, Bradford Mott, and James Lester. Real-time narrative-centered tutorial planning for story-based learning. In Proceedings of the International Conference on Intelligent Tutoring Systems (ITS), pages 476-481, 2012.
  13. [Mausam and Kolobov, 2012] Mausam and Andrey Kolobov. Planning with Markov Decision Processes: An AI Perspec- tive. Synthesis Lectures on Artificial Intelligence and Ma- chine Learning. Morgan & Claypool Publishers, 2012.
  14. [McQuiggan et al., 2008] Scott McQuiggan, Jonathan Rowe, Sunyoung Lee, and James Lester. Story-based learning: The impact of narrative on learning experiences and out- comes. In Proceedings of the International Conference on Intelligent Tutoring Systems (ITS), pages 530-539, 2008.
  15. [Min et al., 2014] Wookhee Min, Eunyoung Ha, Jonathan Rowe, Bradford Mott, and James Lester. Deep learning- based goal recognition in open-ended digital games. In Proceedings of the AAAI Conference on Artificial Intel- ligence and Interactive Digital Entertainment (AIIDE), 2014.
  16. [Oh et al., 2010] Jean Oh, Felipe Meneguzzi, Katia Sycara, and Timothy Norman. ANTIPA: An agent architecture for intelligent information assistance. In Proceedings of the European Conference on Artificial Intelligence (ECAI), pages 1055-1056, 2010.
  17. [Oh et al., 2011a] Jean Oh, Felipe Meneguzzi, Katia Sycara, and Timothy Norman. An agent architecture for prognostic reasoning assistance. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pages 2513-2518, 2011. IJCAI
  18. [Oh et al., 2011b] Jean Oh, Felipe Meneguzzi, Katia Sycara, and Timothy Norman. Probabilistic plan recognition for intelligent information agents: Towards proactive software assistant agents. In Proceedings of the International Con- ference on Agents and Artificial Intelligence (ICAART), pages 281-287, 2011.
  19. [Ramírez and Geffner, 2009] Miquel Ramírez and Hector Geffner. Plan recognition as planning. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pages 1778-1783, 2009. IJCAI
  20. [Ramírez and Geffner, 2010] Miquel Ramírez and Hector Geffner. Probabilistic plan recognition using off-the-shelf classical planners. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2010.
  21. [Ramírez and Geffner, 2011] Miquel Ramírez and Hector Geffner. Goal recognition over POMDPs: Inferring the in- tention of a POMDP agent. In Proceedings of the Interna- tional Joint Conference on Artificial Intelligence (IJCAI), pages 2009-2014, 2011. IJCAI
  22. [Son et al., 2016] Tran Cao Son, Orkunt Sabuncu, Christian Schulz-Hanke, Torsten Schaub, and William Yeoh. Solving goal recognition design using ASP. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2016.
  23. [Tavakkoli et al., 2007] Alireza Tavakkoli, Richard Kelley, Christopher King, Mircea Nicolescu, Monica Nicolescu, and George Bebis. A vision-based architecture for intent recognition. In Proceedings of the International Sympo- sium on Advances in Visual Computing, pages 173-182, 2007.
  24. [Vilain, 1990] Marc Vilain. Getting serious about parsing plans: A grammatical analysis of plan recognition. In Pro- ceedings of the National Conference on Artificial Intelli- gence (AAAI), pages 190-197, 1990.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards