Auxiliary Template-Enhanced Generative Compatibility Modeling

Auxiliary Template-Enhanced Generative Compatibility Modeling

Jinhuan Liu, Xuemeng Song, Zhaochun Ren, Liqiang Nie, Zhaopeng Tu, Jun Ma

Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence
Main track. Pages 3508-3514. https://doi.org/10.24963/ijcai.2020/485

In recent years, there has been a growing interest in the fashion analysis (e.g., clothing matching) due to the huge economic value of the fashion industry. The essential problem is to model the compatibility between the complementary fashion items, such as the top and bottom in clothing matching. The majority of existing work on fashion analysis has focused on measuring the item-item compatibility in a latent space with deep learning methods. In this work, we aim to improve the compatibility modeling by sketching a compatible template for a given item as an auxiliary link between fashion items. Specifically, we propose an end-to-end Auxiliary Template-enhanced Generative Compatibility Modeling (AT-GCM) scheme, which introduces an auxiliary complementary template generation network equipped with the pixel-wise consistency and compatible template regularization. Extensive experiments on two real-world datasets demonstrate the superiority of the proposed approach.
Keywords:
Multidisciplinary Topics and Applications: Information Retrieval
Multidisciplinary Topics and Applications: Recommender Systems