Neural Belief Reasoner

Neural Belief Reasoner

Haifeng Qian

Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence
Main track. Pages 4275-4282. https://doi.org/10.24963/ijcai.2020/590

This paper proposes a new generative model called neural belief reasoner (NBR). It differs from previous models in that it specifies a belief function rather than a probability distribution. Its implementation consists of neural networks, fuzzy-set operations and belief-function operations, and query-answering, sample-generation and training algorithms are presented. This paper studies NBR in two tasks. The first is a synthetic unsupervised-learning task, which demonstrates NBR's ability to perform multi-hop reasoning, reasoning with uncertainty and reasoning about conflicting information. The second is supervised learning: a robust MNIST classifier for 4 and 9, which is the most challenging pair of digits. This classifier needs no adversarial training, and it substantially exceeds the state of the art in adversarial robustness as measured by the L2 metric, while at the same time maintains 99.1% accuracy on natural images.
Keywords:
Uncertainty in AI: Uncertainty Representations
Machine Learning: Adversarial Machine Learning
Machine Learning: Unsupervised Learning
Machine Learning: Neuro-Symbolic Methods