End-to-End Adversarial Memory Network for Cross-domain Sentiment Classification

End-to-End Adversarial Memory Network for Cross-domain Sentiment Classification

Zheng Li, Yu Zhang, Ying Wei, Yuxiang Wu, Qiang Yang

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence
Main track. Pages 2237-2243. https://doi.org/10.24963/ijcai.2017/311

Domain adaptation tasks such as cross-domain sentiment classification have raised much attention in recent years. Due to the domain discrepancy, a sentiment classifier trained in a source domain may not work well when directly applied to a target domain. Traditional methods need to manually select pivots, which behave in the same way for discriminative learning in both domains. Recently, deep learning methods have been proposed to learn a representation shared by domains. However, they lack the interpretability to directly identify the pivots. To address the problem, we introduce an end-to-end Adversarial Memory Network (AMN) for cross-domain sentiment classification. Unlike existing methods, our approach can automatically capture the pivots using an attention mechanism. Our framework consists of two parameter-shared memory networks: one is for sentiment classification and the other is for domain classification. The two networks are jointly trained so that the selected features minimize the sentiment classification error and at the same time make the domain classifier indiscriminative between the representations from the source or target domains. Moreover, unlike deep learning methods that cannot tell us which words are the pivots, our approach can offer a direct visualization of them. Experiments on the Amazon review dataset demonstrate that our approach can significantly outperform state-of-the-art methods.
Keywords:
Machine Learning: Transfer, Adaptation, Multi-task Learning
Natural Language Processing: Sentiment Analysis and Text Mining
Machine Learning: Deep Learning