Sketch Recognition via Part-based Hierarchical Analogical Learning

Sketch Recognition via Part-based Hierarchical Analogical Learning

Kezhen Chen, Ken Forbus, Balaji Vasan Srinivasan, Niyati Chhaya, Madeline Usher

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence
Main Track. Pages 2967-2974. https://doi.org/10.24963/ijcai.2023/331

Sketch recognition has been studied for decades, but it is far from solved. Drawing styles are highly variable across people and adapting to idiosyncratic visual expressions requires data-efficient learning. Explainability also matters, so that users can see why a system got confused about something. This paper introduces a novel part-based approach for sketch recognition, based on hierarchical analogical learning, a new method to apply analogical learning to qualitative representations. Given a sketched object, our system automatically segments it into parts and constructs multi-level qualitative representations of them. Our approach performs analogical generalization at multiple levels of part descriptions and uses coarse-grained results to guide interpretation at finer levels. Experiments on the Berlin TU dataset and the Coloring Book Objects dataset show that the system can learn explainable models in a data-efficient manner.
Keywords:
Humans and AI: HAI: Cognitive modeling
Knowledge Representation and Reasoning: KRR: Case-based reasoning
Knowledge Representation and Reasoning: KRR: Qualitative, geometric, spatial, and temporal reasoning