Deep Forest: Towards An Alternative to Deep Neural Networks

Deep Forest: Towards An Alternative to Deep Neural Networks

Zhi-Hua Zhou, Ji Feng

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence
Main track. Pages 3553-3559. https://doi.org/10.24963/ijcai.2017/497

In this paper, we propose gcForest, a decision tree ensemble approach with performance highly competitive to deep neural networks in a broad range of tasks. In contrast to deep neural networks which require great effort in hyper-parameter tuning, gcForest is much easier to train; even when it is applied to different data across different domains in our experiments, excellent performance can be achieved by almost same settings of hyper-parameters. The training process of gcForest is efficient, and users can control training cost according to computational resource available. The efficiency may be further enhanced because gcForest is naturally apt to parallel implementation. Furthermore, in contrast to deep neural networks which require large-scale training data, gcForest can work well even when there are only small-scale training data.
Keywords:
Machine Learning: Ensemble Methods
Machine Learning: Deep Learning