High-dimensional Similarity Learning via Dual-sparse Random Projection

High-dimensional Similarity Learning via Dual-sparse Random Projection

Dezhong Yao, Peilin Zhao, Tuan-Anh Nguyen Pham, Gao Cong

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence
Main track. Pages 3005-3011. https://doi.org/10.24963/ijcai.2018/417

We investigate how to adopt dual random projection for high-dimensional similarity learning. For a high-dimensional similarity learning problem, projection is usually adopted to map high-dimensional features into low-dimensional space, in order to reduce the computational cost. However, dimensionality reduction method sometimes results in unstable performance due to the suboptimal solution in original space. In this paper, we propose a dual random projection framework for similarity learning to recover the original optimal solution from subspace optimal solution. Previous dual random projection methods usually make strong assumptions about the data, which need to be low rank or have a large margin. Those assumptions limit dual random projection applications in similarity learning. Thus, we adopt a dual-sparse regularized random projection method that introduces a sparse regularizer into the reduced dual problem. As the original dual solution is a sparse one, applying a sparse regularizer in the reduced space relaxes the low-rank assumption. Experimental results show that our method enjoys higher effectiveness and efficiency than state-of-the-art solutions.
Keywords:
Machine Learning: Learning Preferences or Rankings
Machine Learning Applications: Applications of Supervised Learning
Multidisciplinary Topics and Applications: Information Retrieval
Machine Learning Applications: Big data ; Scalability