Proceedings

Solving Probability Problems in Natural Language

Download BibTeX Cite

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence. Main track. Pages 3981-3987.

https://doi.org/10.24963/ijcai.2017/556

© 2017 International Joint Conferences on Artificial Intelligence

Abstract

The ability to solve probability word problems such as those found in introductory discrete mathematics textbooks, is an important cognitive and intellectual skill. In this paper, we develop a two-step end-to-end fully automated approach for solving such questions that is able to automatically provide answers to exercises about probability formulated in natural language.In the first step, a question formulated in natural language is analysed and transformed into a high-level model specified in a declarative language. In the second step, a solution to the high-level model is computed using a probabilistic programming system. On a dataset of 2160 probability problems, our solver is able to correctly answer 97.5% of the questions given a correct model. On the end-to-end evaluation, we are able to answer 12.5% of the questions (or 31.1% if we exclude examples not supported by design).

  1. [Alvin et al., 2014] Chris Alvin, Sumit Gulwani, Rupak Ma- jumdar, and Supratik Mukhopadhyay. Synthesis of geom- etry proof problems. In AAAI, pages 245-252, 2014.
  2. [De Raedt and Kimmig, 2015] Luc De Raedt and Angelika Kimmig. Probabilistic (logic) programming concepts. Ma- chine Learning, pages 1-43, 2015.
  3. [De Raedt et al., 2007] Luc De Raedt, Angelika Kimmig, and Hannu Toivonen. ProbLog: A probabilistic Prolog and its application in link discovery. In IJCAI, pages 2462- 2467, 2007. IJCAI
  4. [De Raedt et al., 2016] Luc De Raedt, Kristian Kersting, Sri- raam Natarajan, and David Poole. Statistical relational ar- tificial intelligence: Logic, probability, and computation. Synthesis Lectures on Artificial Intelligence and Machine Learning, 10(2):1-189, 2016.
  5. [Gelb, 1971] Jack P Gelb. Experiments with a natural lan- guage problem-solving system. In IJCAI, pages 455-462, 1971. IJCAI
  6. [Getoor and Taskar, 2007] Lise Getoor and Ben Taskar. In- troduction to statistical relational learning. MIT press, 2007.
  7. [Gordon et al., 2014] Andrew D Gordon, Thomas A Hen- zinger, Aditya V Nori, and Sriram K Rajamani. Proba- bilistic programming. In Proceedings of the on Future of Software Engineering, pages 167-181. ACM, 2014.
  8. [Hernández-Orallo et al., 2016] José Hernández-Orallo, Fer- nando Martínez-Plumed, Ute Schmid, Michael Siebers, and David L Dowe. Computer models solving intelligence test problems: Progress and implications. Artificial Intel- ligence, 230:74-107, 2016.
  9. [Hosseini et al., 2014] Mohammad Javad Hosseini, Han- naneh Hajishirzi, Oren Etzioni, and Nate Kushman. Learn- ing to solve arithmetic word problems with verb catego- rization. In EMNLP 2014, pages 523-533, 2014.
  10. [Kushman et al., 2014] Nate Kushman, Yoav Artzi, Luke Zettlemoyer, and Regina Barzilay. Learning to automat- ically solve algebra word problems. ACL (1), pages 271- 281, 2014.
  11. [Mukherjee and Garain, 2008] Anirban Mukherjee and Ut- pal Garain. A review of methods for automatic understand- ing of natural language mathematical problems. Artificial Intelligence Review, 29(2):93-122, 2008.
  12. [Niepert and Van den Broeck, 2014] Mathias Niepert and Guy Van den Broeck. Tractability through exchangeabil- ity: A new perspective on efficient probabilistic inference. In AAAI, 2014.
  13. [Poole, 2003] David Poole. First-order probabilistic infer- ence. IJCAI, 3:985-991, 2003. IJCAI
  14. [Seo et al., 2014] Min Joon Seo, Hannaneh Hajishirzi, Ali Farhadi, and Oren Etzioni. Diagram understanding in ge- ometry questions. In AAAI, 2014.
  15. [Seo et al., 2015] Minjoon Seo, Hannaneh Hajishirzi, Ali Farhadi, Oren Etzioni, and Clint Malcolm. Solving geom- etry problems: Combining text and diagram interpretation. EMNLP, 2015.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards