Towards Utilitarian Online Learning -- A Review of Online Algorithms in Open Feature Space
Towards Utilitarian Online Learning -- A Review of Online Algorithms in Open Feature Space
Yi He, Christian Schreckenberger, Heiner Stuckenschmidt, Xindong Wu
Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence
Survey Track. Pages 6647-6655.
https://doi.org/10.24963/ijcai.2023/745
Human intelligence comes from the capability to describe and make sense of the world surrounding us, often in a lifelong manner. Online Learning (OL) allows a model to simulate this capability, which involves processing data in sequence, making predictions, and learning from predictive errors. However, traditional OL assumes a fixed set of features to describe data, which can be restrictive. In reality, new features may emerge and old features may vanish or become obsolete, leading to an open
feature space. This dynamism can be caused by more advanced or outdated technology for sensing the world, or it can be a natural process of evolution. This paper reviews recent breakthroughs that strived to enable OL in open feature spaces, referred to as Utilitarian Online Learning (UOL). We taxonomize existing UOL models into three categories, analyze their pros and cons, and discuss their application scenarios. We also benchmark the performance of representative UOL models, highlighting open problems, challenges, and potential future directions of this emerging topic.
Keywords:
Survey: Data Mining
Survey: Uncertainty in AI
Survey: Game Theory and Economic Paradigms