Preference-Adaptive Meta-Learning for Cold-Start Recommendation
Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence. Main Track. Pages 1607-1614.
https://doi.org/10.24963/ijcai.2021/222
Keywords
- Data Mining: Recommender Systems
- Machine Learning: Recommender Systems
- Machine Learning: Learning Preferences or Rankings
Abstract
In recommender systems, the cold-start problem is a critical issue. To alleviate this problem, an emerging direction adopts meta-learning frameworks and achieves success. Most existing works aim to learn globally shared prior knowledge across all users so that it can be quickly adapted to a new user with sparse interactions. However, globally shared prior knowledge may be inadequate to discern users’ complicated behaviors and causes poor generalization. Therefore, we argue that prior knowledge should be locally shared by users with similar preferences who can be recognized by social relations. To this end, in this paper, we propose a Preference-Adaptive Meta-Learning approach (PAML) to improve existing meta-learning frameworks with better generalization capacity. Specifically, to address two challenges imposed by social relations, we first identify reliable implicit friends to strengthen a user’s social relations based on our defined palindrome paths. Then, a coarse-fine preference modeling method is proposed to leverage social relations and capture the preference. Afterwards, a novel preference-specific adapter is designed to adapt the globally shared prior knowledge to the preference-specific knowledge so that users who have similar tastes share similar knowledge. We conduct extensive experiments on two publicly available datasets. Experimental results validate the power of social relations and the effectiveness of PAML.
- [Aral et al., 2009] Sinan Aral, Lev Muchnik, and Arun Sundararajan. Distinguishing influence-based conta- gion from homophily-driven diffusion in dynamic net- works. Proceedings of the National Academy of Sciences, 106(51):21544-21549, 2009.
- [Cheng et al., 2016] Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et al. Wide & deep learning for recom- mender systems. In Proceedings of the 1st workshop on deep learning for recommender systems, pages 7-10, 2016.
- [Dong et al., 2020] Manqing Dong, Feng Yuan, Lina Yao, Xiwei Xu, and Liming Zhu. Mamo: Memory-augmented meta-optimization for cold-start recommendation. In Pro- ceedings of the 26th ACM SIGKDD International Confer- ence on Knowledge Discovery & Data Mining, pages 688- 697, 2020.
- [Fan et al., 2019] Wenqi Fan, Yao Ma, Qing Li, Yuan He, Eric Zhao, Jiliang Tang, and Dawei Yin. Graph neural networks for social recommendation. In The World Wide Web Conference, pages 417-426, 2019.
- [Finn et al., 2017] Chelsea Finn, Pieter Abbeel, and Sergey Levine. Model-agnostic meta-learning for fast adaptation of deep networks. In Proceedings of the 34th Interna- tional Conference on Machine Learning, volume 70, pages 1126-1135, 2017.
- [Glorot and Bengio, 2010] Xavier Glorot and Yoshua Ben- gio. Understanding the difficulty of training deep feedfor- ward neural networks. In Proceedings of the thirteenth in- ternational conference on artificial intelligence and statis- tics, pages 249-256, 2010.
- [Goodfellow et al., 2014] Ian Goodfellow, Jean Pouget- Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Gen- erative adversarial nets. In Proceedings of NeurIPS'14, volume 27, pages 2672-2680, 2014.
- [He et al., 2017] Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. Neural collab- orative filtering. In Proceedings of the 26th international conference on world wide web, pages 173-182, 2017.
- [Huang et al., 2019] Zhenya Huang, Qi Liu, Chengxiang Zhai, Yu Yin, Enhong Chen, Weibo Gao, and Guoping Hu. Exploring multi-objective exercise recommendations in online education systems. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pages 1261-1270, 2019.
- [Jin et al., 2020] Binbin Jin, Defu Lian, Zheng Liu, Qi Liu, Jianhui Ma, Xing Xie, and Enhong Chen. Sampling- decomposable generative adversarial recommender. In Advances in Neural Information Processing Systems, vol- ume 33, pages 22629-22639, 2020.
- [Lee et al., 2019] Hoyeop Lee, Jinbae Im, Seongwon Jang, Hyunsouk Cho, and Sehee Chung. Melu: Meta-learned user preference estimator for cold-start recommendation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 1073-1082, 2019.
- [Li et al., 2018] Zhi Li, Hongke Zhao, Qi Liu, Zhenya Huang, Tao Mei, and Enhong Chen. Learning from his- tory and present: Next-item recommendation via discrim- inatively exploiting user behaviors. In Proceedings of the 24th ACM SIGKDD International Conference on Knowl- edge Discovery & Data Mining, pages 1734-1743, 2018.
- [Liu et al., 2019] Qi Liu, Zhenya Huang, Yu Yin, Enhong Chen, Hui Xiong, Yu Su, and Guoping Hu. Ekt: Exercise- aware knowledge tracing for student performance predic- tion. IEEE Transactions on Knowledge and Data Engi- neering, 33(1):100-115, 2019.
- [Lu et al., 2020] Yuanfu Lu, Yuan Fang, and Chuan Shi. Meta-learning on heterogeneous information networks for cold-start recommendation. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 1563-1573, 2020.
- [Ma et al., 2011] Hao Ma, Dengyong Zhou, Chao Liu, Michael R Lyu, and Irwin King. Recommender systems with social regularization. In Proceedings of the fourth ACM international conference on Web search and data mining, pages 287-296, 2011.
- [Mi et al., 2019] Fei Mi, Minlie Huang, Jiyong Zhang, and Boi Faltings. Meta-learning for low-resource natural lan- guage generation in task-oriented dialogue systems. In Proceedings of the Twenty-Eighth International Joint Con- ference on Artificial Intelligence, IJCAI-19, pages 3151- 3157, 2019. IJCAI
- [Nair and Hinton, 2010] Vinod Nair and Geoffrey E Hinton. Rectified linear units improve restricted boltzmann ma- chines. In Proceedings of the 27th International Confer- ence on Machine Learning, 2010.
- [Pan et al., 2019] Feiyang Pan, Shuokai Li, Xiang Ao, Pingzhong Tang, and Qing He. Warm up cold-start adver- tisements: Improving ctr predictions via learning to learn id embeddings. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 695-704, 2019.
- [Pei et al., 2020] Hongbin Pei, Bingzhe Wei, Kevin Chang, Chunxu Zhang, and Bo Yang. Curvature regularization to prevent distortion in graph embedding. In Advances in Neural Information Processing Systems, volume 33, pages 20779-20790.
- Curran Associates, Inc., 2020.
- [Rendle, 2010] Steffen Rendle. Factorization machines. In 2010 IEEE International Conference on Data Mining, pages 995-1000. IEEE, 2010.
- [Vartak et al., 2017] Manasi Vartak, Arvind Thiagarajan, Conrado Miranda, Jeshua Bratman, and Hugo Larochelle. A meta-learning perspective on cold-start recommenda- tions for items. In Proceedings of NeurIPS'17, pages 6904-6914, 2017.
- [Wang et al., 2013] Hao Wang, Binyi Chen, and Wu-Jun Li. Collaborative topic regression with social regularization for tag recommendation. In Twenty-Third International Joint Conference on Artificial Intelligence, 2013. IJCAI
- [Wang et al., 2019] Hao Wang, Tong Xu, Qi Liu, Defu Lian, Enhong Chen, Dongfang Du, Han Wu, and Wen Su. Mcne: An end-to-end framework for learning multiple condi- tional network representations of social network. In Pro- ceedings of the 25th ACM SIGKDD International Con- ference on Knowledge Discovery & Data Mining, pages 1064-1072, 2019.
- [Wu et al., 2019] Le Wu, Peijie Sun, Yanjie Fu, Richang Hong, Xiting Wang, and Meng Wang. A neural influence diffusion model for social recommendation. In Proceed- ings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pages 235-244, 2019.
- [Yao et al., 2019] Huaxiu Yao, Ying Wei, Junzhou Huang, and Zhenhui Li. Hierarchically structured meta-learning. In Proceedings of the 36th International Conference on Machine Learning, volume 97, pages 7045-7054, 2019.
- [Yu et al., 2018] Junliang Yu, Min Gao, Jundong Li, Hongzhi Yin, and Huan Liu. Adaptive implicit friends identification over heterogeneous network for social rec- ommendation. In Proceedings of the 27th ACM Interna- tional Conference on Information and Knowledge Man- agement, pages 357-366, 2018.
- [Yu et al., 2019] Junliang Yu, Min Gao, Hongzhi Yin, Jun- dong Li, Chongming Gao, and Qinyong Wang. Generating reliable friends via adversarial training to improve social recommendation. In 2019 IEEE International Conference on Data Mining (ICDM), pages 768-777. IEEE, 2019.
- [Zhao et al., 2014] Tong Zhao, Julian McAuley, and Irwin King. Leveraging social connections to improve person- alized ranking for collaborative filtering. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, pages 261- 270, 2014.
- [Zhu et al., 2020] Yaohui Zhu, Chenlong Liu, and Shuqiang Jiang. Multi-attention meta learning for few-shot fine- grained image recognition. In Twenty-Ninth International Joint Conference on Artificial Intelligence and Seventeenth Pacific Rim International Conference on Artificial Intelli- gence, pages 1090-1096, 2020.
References were extracted automatically from the PDF and may contain errors.
Full text extracted automatically from the PDF; figures, tables and equations may differ. The PDF is the version of record.
Preference-Adaptive Meta-Learning for Cold-Start Recommendation
Li Wang1 , Binbin Jin1 , Zhenya Huang1 , Hongke Zhao2 , Defu Lian1 ,
Qi Liu1 and Enhong Chen1∗
1 Anhui Province Key Lab. of Big Data Analysis and Application, School of Data Science &
School of Computer Science and Technology, University of Science and Technology of China
2 College of Management and Economics, Tianjin University
{wl063, bb0725}@mail.ustc.edu.cn, {huangzhy, liandefu, qiliuql, cheneh}@ustc.edu.cn,
{hongke}@tju.edu.cn
Abstract
In recommender systems, the cold-start problem is
a critical issue. To alleviate this problem, an emerg-
ing direction adopts meta-learning frameworks and
achieves success. Most existing works aim to learn
globally shared prior knowledge across all users so
that it can be quickly adapted to a new user with
sparse interactions. However, globally shared prior

knowledge may be inadequate to discern users'
complicated behaviors and causes poor generaliza-
tion. Therefore, we argue that prior knowledge
should be locally shared by users with similar pref-
erences who can be recognized by social relations.
To this end, in this paper, we propose a Preference-
Adaptive Meta-Learning approach (PAML) to im-
prove existing meta-learning frameworks with bet-
ter generalization capacity. Specifically, to address
two challenges imposed by social relations, we first
identify reliable implicit friends to strengthen a
user's social relations based on our defined palin-
drome paths. Then, a coarse-fine preference model-
ing method is proposed to leverage social relations
and capture the preference. Afterwards, a novel
preference-specific adapter is designed to adapt the
globally shared prior knowledge to the preference-
specific knowledge so that users who have similar
tastes share similar knowledge. We conduct exten-
sive experiments on two publicly available datasets.
Experimental results validate the power of social
relations and the effectiveness of PAML.
1 Introduction
Benefiting from filtering out personalized irrelevant informa-
tion for users, recommender systems can effectively remedy
the information overload problem and are widely used in vari-
ous kinds of web services [Li et al., 2018; Huang et al., 2019].
In most recommender systems, collaborative filtering (CF) is
the mainstream method which makes predictions based on
user-item interactions (e.g. ratings). However, when encountering new users, CF based approaches fail due to scarce interactions, leading to a decline in the new users' experience.
∗Corresponding Author
Figure 1: Comparison between MeLU and our proposed model.
To address the cold-start problem, an emerging direction adopts the meta-learning frameworks and some pioneering works prove its effectiveness [Vartak et al., 2017]. Most existing works (e.g. MeLU [Lee et al., 2019]) formulate each user as a task and aim to learn globally shared prior knowledge across all users. As shown in Fig. 1 (a), for a cold-start user, the learned prior knowledge can be quickly adapted to the personalized knowledge (i.e. initialization of parameters) based on her sparse interactions. However, globally shared prior knowledge may be inadequate to discern users' complicated behaviors and causes poor generalization [Dong et al., 2020]. In this paper, instead of global sharing knowledge, we argue that users with similar preferences should locally share similar prior knowledge (named preference-specific knowledge) so that it can be easily generalized to these users. Thus, the key issue is how to recognize users with similar preferences and then generate the prior knowledge for them.
In recent years, with the prevalence of social platforms, users prefer to bond with each other and form the social network. Based on the homophily effect theory [Aral et al., 2009], which states people tend to associate and bond with others that have similar preferences, it is natural to realize that the connected users in the social network are highly similar. Therefore, social relations can provide a guidance to recognize a bundle of users who have similar preferences and share similar knowledge as shown Fig. 1 (b).
Unfortunately, leveraging social relations imposes two challenges. (1) How to explore and strengthen social relations between users? In cold-start scenarios, social relations are almost as sparse as the user feedback. According to our statistics, most users only have less than 6 connected friends, who are referred to as explicit friends. In reality, except for these explicit friends, users also share similar tastes with other unknown ones and we refer to such users as implicit friends. However, it is difficult to identify credible implicit friends for a user from a large number of noisy ones. (2) How to recognize closely correlated users from a user's social relations? Although two connected users have similar preferences, the strength of the link between them varies at different rating levels. For example, two users both dislike action movies, leading to a strong tie at a low rating level. On the contrary, they favor different types of movies so that the strength is weak at a high rating level. Ignoring this may result in bad similarity discovery between a user and her friends, which arouses inaccurate user preferences. Therefore, how to wisely utilize social relations is another challenge.
Motivated by the above problems, in this paper, we propose a Preference-Adaptive Meta-Learning approach (PAML) for improving existing meta-learning frameworks with better generalization capacity. Particularly, we focus on recognizing users who have similar preferences and share similar knowledge (i.e. preference-specific knowledge in Fig. 1 (b)) by utilizing social relations. Specifically, to address the challenges imposed by social relations, we first define palindrome paths over the user-item-attribute graph and propose a measurement to identify reliable implicit friends, who have expressed same tastes on items or item attributes. Then, we propose a coarse-fine preference modeling method to accurately capture a user's preference which can also reflect relations with others. After that, a novel preference-specific adapter is designed to adapt the globally shared prior knowledge to the preference-specific knowledge so that users who have similar preferences can share similar knowledge. Under the preference-specific knowledge, optimal personalized knowledge can be learned and utilized to make predictions. We conduct extensive experiments on two publicly available datasets. Experimental results clearly demonstrate the power of social relations and validate the effectiveness of PAML.
2 RelatedWork
In our study, the related work involves two categories: metalearning for recommendation and social recommendation.
2.1 Meta-learning for Recommendation
Meta-learning, enabling models to quickly learn a new task with scarce labeled data by utilizing prior knowledge learned from previous tasks, has been applied to solve the data sparsity problem in various fields, such as computer vision [Zhu et al., 2020] and natural language processing [Mi et al., 2019].
Since the cold-start problem is a typical data sparsity problem, meta-learning has been adopted to deal with it and achieved desired results [Vartak et al., 2017]. For example, MeLU [Lee et al., 2019] aimed to learn the initial weights of the neural networks for cold-start users based on MAML [Finn et al., 2017]. Pan et al. [2019] proposed MetaEmbedding which was a content-based embedding generator for learning embeddings for new IDs. The above works learn globally shared parameters which are the same for all tasks. This setting may suffer from handling a sequence of tasks originated from different distributions [Yao et al., 2019]. MAMO [Dong et al., 2020] was the first attempt to get specific parameters by user profiles. MetaHIN [Lu et al., 2020] took the advantage of HIN and proposed semantic-specific parameters. In contrast to existingworks, we claimusers with similar preferences should share similar prior knowledge and leverage social relations to achieve this goal. To the best of our knowledge, this is the first attempt.
2.2 Social Recommendation
Social relations are effective in advancing recommendation performance [Wang et al., 2019]. Based on the homophily effect recognized by social scientists which declares that users' preferences are similar to their social neighbors [Aral et al., 2009], previous studies for social recommendation attempt to model social effects in various ways. Ma et al. [2011] and Wang et al. [2013] formulated the social relations as a regularization term. Zhao et al. [2014] proposed a bayesian personalized framework together with social information. With the development of graph neural networks and graph embedding methods [Pei et al., 2020], more complicated information hidden in the social networks can be captured. Along this line, GraphRec [Fan et al., 2019] and DiffNet [Wu et al., 2019] were two representative works.
In contrast to most existing works extracting explicit social relations, some researchers pay attention to identify reliable friends from unobserved social networks. Yu et al. [2018; 2019] proposed two approaches to recognize implicit friends. One was implemented on the HIN where users in the same meta path might have a strong connection. The other turned to the GAN [Goodfellow et al., 2014; Jin et al., 2020]. In cold-start scenarios, explicit friends are limited. Therefore, it is necessary to strengthen social relations by identifying implicit friends. Different from [Yu et al., 2018] which mainly identifies implicit friends with the help of social networks, we adopt the user-item-attribute graph since the social network is sparse and propose a measurement to evaluate the similarity between users based on our defined palindrome paths.
3 Preliminaries
In this section, we first give an overview of our problem and then illustrate the HIN and palindrome paths.
3.1 ProblemOverview
In this paper, we suppose U is the user set, I is the item set, R is the rating set. For a user u ∈ U with profiles and a set of explicit friends {fu|fu ∈ U}, given a set of ratings on the items {ru,i|u ∈ U, i ∈ I, ru,i ∈ R} where each item has several attributes, we aim to predict the unknown rating ˆ ru,i between the user u and the item i.
In this paper, we formalize each user with historical interactions as a learning task which is similar to [Lee et al., 2019], however with one important difference: we introduce users' social relations. More formally, a user u can be defined with Tu = (Fu, Su,Qu), where Fu is the friend set of u, Su is the support set containing the interacted items, and Qu is the query set containing the items to be predicted. All tasks are split into meta-training tasks T tr and meta-testing tasks T te . Generally, T tr are used to train the model while T te are used to validate its performance. For each task in T tr and T te , its friend set and support set are used to adapt the prior knowledge to preference-specific knowledge and personalized knowledge. Under the personalized knowledge, each item in the query set can be predicted. In addition, the query set in T tr also plays a role in updating the prior knowledge.

3.2 User-Item-Attribute Graph
Since we identify implicit friends over the user-item-attribute graph which is a kind of heterogeneous information networks (HINs), we give definitions of the HIN and palindrome paths. Note that implicit friends are identified from a group of known users so that the HIN is constructed from all support sets in the meta-training tasks.
Definition 1 (Heterogeneous information network). A HIN is denoted as G = (V, E, T ), where each node v ∈ V and each link e ∈ E is associated with a mapping function φ(v) : V → TV and φ(e) : E → TE, respectively. TV and TE denote the sets of node and relation types where T = TV ∪ TE and |TV | + |TE| > 2.
Definition 2 (Palindrome path). Given the HIN G, a palindrome path of length l is defined as pl = v0 e0→ · · · el-1 → vl el-1 → · · · e0→ v2l, where vi ∈ V, φ(vi) = φ(v2l-i) and ei ∈ E.
Fig. 2 shows a toy example of the HIN. There are three types of nodes (i.e., users, movies and attributes) as well as three types of relations (i.e., ratings, genres, years). "u2 1→ m1 1→ u1" is a palindrome path of length 1 where u1 and u2 are both users who rate 1 score on the movie m1.
4 Preference-adaptive Meta-learning
In this section, we will introduce the technical details of our proposed PAML, i.e., the approach to identifying implicit friends, social enhanced recommender with the coarsefine preference modeling method and the entire meta-learning framework.
4.1 Identifying Implicit Friends over the HIN
In cold-start scenarios, most users have few explicit friends which restricts the power of social relations. Identifying implicit friends can strengthen the social relations. To achieve this goal, we design two palindrome paths over the heterogeneous information network G we defined and assume users appeared in the same path share similar tastes since they express the same opinion on the item or the item attribute: (1) p1 = u ru,i → i ru,i → u where u ∈ U, i ∈ I, ru,i ∈ R (e.g. the blue path in Fig. 2 shows u1 and u2 both dislike the movie m1 and give 1 score); (2) p2 = u ru,i → i ri,a → a ri,a → i ru,i → u where ri,a is a certain value of the attribute a (e.g. the red path in Fig. 2 shows u2 and u3 might have similar tastes since their favorite movies m2 and m3 both belong to action movies). Here, we only consider palindrome paths with a maximum length of 2 because a larger one entails more complicated semantics and does not contribute to finding implicit friends.
Then, we propose a measurement to evaluate the similarity between users based on palindrome paths. Suppose u1 is connected to u2 through pl = v0(u1) e0→ · · · e2l-1 → v2l(u2), their similarity over pl is formulated as follows:
where N(vi, ei, vi+1) denotes the number of neighborhoods of the node vi with the same relation value ei and node type of vi+1. Given a user u and her support set Su, we collect all paths denoted as P starting from u ru,i -→ i, i ∈ Su over G and calculate how similar she is to the others as Sim(u, u′ ) = ∑p∈P I(u′ , p)Sim(u, u′ , p), where I(u′ , p) is an indicator function which equals 1 when u′ locates at the end of p and equals 0 otherwise. Finally, we choose the top similar users as u's implicit friends to strengthen the social relations which can help to recognize the relations between users. Now, the friend set Fu of the user u consists of implicit and explicit friends which are denoted as F iu and F e u , respectively.
4.2 Social Enhanced Recommender
Here, we will illustrate the social enhanced recommender including the coarse-fine preference modeling method.
Coarse-fine Preference Modeling
We aim to integrate a user's interactions and her friends to capture her preference which can also reflect the relations with others. Considering the strength of links between users varies at different rating levels, we propose the coarse-fine preference modeling method. Specifically, for the fine level, we distinguish the strength of social relations and combine them together at each rating score. For the coarse level, we learn an overall preference by integrating preferences obtained by the fine level.
First, we initialize user and item embeddings based on their features. Suppose there are N kinds of features for a user u, we define her embedding as follows:
where ⊕ is the concatenation operation, and en is the n-th feature embedding extracted from the embedding matrix. For an item i, its embedding iini can be defined in the same way.
Coarse-fine preference modeling with parameters 𝜽 = 𝝎 ∪ 𝚽
Fine level preference modeling Coarse level preference modeling
𝑟 = 5
𝑟 = ʹ
𝑟 = ͳ𝝎, 𝚽
user 𝑢
Implicit friends: ℱ𝑢𝑖
𝑭ଵ𝑖
attention
…
Explicit friends: ℱ𝑢𝑒
attention
𝝎,𝚽 𝑭ଵ𝑒
…
𝒖ଵ 𝒖ଶ …𝒖5
𝒖
Learned from
interactions
𝒖𝑜
𝚽
𝚽
Learned from
social relations

Then, we introduce the fine level preference modeling as shown in the left part of Fig. 3. Given a user u with her friend set F iu ∪ F e u and support set Su, we split items of Su into several groups by rating scores and learn an item based user preference for u as follows:
ur = τ(W[mean{i|i∈Su∧ru,i=r}(iini ) ⊕uini ] +b), (4)
u . We stack them by col-
r and
where r ∈ R denotes a specific rating, mean(·) is mean pooling, W and b are the weight matrix and bias vector, and τ(·) is the activation function which is stated as ReLU [Nair and Hinton, 2010]. Similarly, we can also get the item based preference for each friend in F iu and F e umn and get the corresponding matrices denoted as F i F e r , respectively. Note that although implicit and explicit friends are modeled independently, they share the same pa-
rameters in (4). For a specific rating r, different friends contribute differently to capturing u's preference. Therefore, we adopt the attention mechanism as follows:
Now, for a user, we obtain the item based preference ur, the implicit friends based preference f i r , and the explicit friends based preference f e r for each rating r at a fine level.
Afterwards, we describe the coarse level preference modeling as shown in the right part of Fig. 3. Formally, we stack all ur obtained from the fine level by column and get the matrix denoted as U. An attention mechanism is applied to get the coarse level preference u which is learned from u's interactions as follows:
where W1 is the weight matrix, b1 is the bias vector, and W2 is the weight vector. Similarly, we can acquire the coarse level preferences f i and f e learned from implicit and explicit friends, respectively. Finally, we implement the following formula and obtain the overall preference uo:
where λ1 and λ2 are learnable parameters that control the contributions of the implicit and explicit friends to modeling the user's preference.
𝒖ଵ
𝚽
attention
𝚽
attention
𝚽
attention

Prediction & Objective Function
Given the user's overall preference uo and an unobserved item i, we can predict the rating as follows:
where MLP is a two-layer multilayer perceptron with ReLU activation functions. We minimize the following loss for the user u to optimize the parameters:
where θ includes all parameters, Du is a set of items to be predicted, and ru,i is the actual rating of user u on item i.
4.3 Meta-learning Framework
Here, we describe the training procedure of our framework as well as our designed preference-specific adapter.
Preference-specific Adapter
Existing methods such as MeLU learn globally shared prior knowledge across all users, which may cause poor generalization. In contrast, we argue that closely correlated users may have similar preferences so they should locally share similar prior knowledge. Depend on that, we design a preferencespecific adapter to customize the globally shared prior knowledge to preference-specific knowledge. Since the overall preference uo can reflect the relations between users, it can help achieve this goal.
As shown in Fig. 4, we denote the parameters of feature embeddings as ω and the rest as Φ, so that θ = ω ∪Φ. Note that Φ is the prior knowledge. To generate similar knowledge for users with similar preferences, we design a series of preference-specific gates:
where {Wg, bg} ∈ Φ are the weight matrix and bias vector, σ(·) is the sigmoid function, and gu has the same shape with Φ. Then, the prior knowledge Φ is adapted to the preferencespecific knowledge Φu of task Tu via the following equation:
where ◦ is the element-wise product operation.
Therefore, correlated users who share similar preferences will trigger similar parameter gates, resulting in similar model parameters and allowing more knowledge to be shared, while unrelated users are controlled to share less knowledge.
Algorithm 1: Training Procedure of PAML
Input: T tr : meta-training tasks; α, β: learning rate Output: Parameters θ 1 Randomly initialize θ = ω ∪ Φ 2 while not converge do 3 Sample a batch of tasks B = {Tu|Tu ∈ T tr } 4 foreach task Tu = (F e u, Su, Qu) ∈ B do 5 Identify implicit friends F iu 6 Tu = (F e u ∪ F iu, Su, Qu) 7 Compute the overall preference uo in (8) 8 Compute preference-specific knowledge Φu in (12) 9 Local update: Φ∗u = Φu - α∇Φu L (ω ∪ Φu, Su) 10 Global update: θ = θ -β∇θ ∑Tu∈B L(ω ∪Φ∗u,Qu) 11 return θ
Meta Optimization
Under the preference-specific knowledge, we aim to generate the personalized knowledge Φ∗u (i.e. initialization of parameters for u). Given the preference-specific knowledge Φu and support set Su, Φ∗u is obtained by locally updating Φu through several gradient descent steps:
where α is the learning rate.
During the inference stage, Φ∗u is adopted to make predictions for items in the query set Qu ∈ T te . During the training stage, we sample a batch of tasks B from meta-training tasks T tr . For each task, the learned personalized knowledge is utilized to calculate the loss on the query set Qu and optimize all parameters. Overall, all parameters are globally updated as follows:
where β is another learning rate. The training procedure is shown in Algorithm 1.
5 Experiments
In this section, we first introduce the experimental setup in details and then report the experimental results from three perspectives.
5.1 Experimental Setup
Datasets Description
We conduct experiments on two real-world datasets: Bouban Book 1 and Yelp 2 , which are from publicly accessible repositories. Both datasets provide a large quantity of ratings, social relations and information of users and items. The rating scale is from 1 to 5, where higher score means stronger preference.
Considering cold-start scenarios, we first separate the users and items into two groups (existing/new) with a ratio of 8:2 for each dataset according to user joining time (or first user action time) and item releasing time. Then, for each dataset, we divide it into meta-training tasks and meta-testing tasks. The former only contain existing users and existing items. The latter include three kinds of cold-start scenarios, i.e., UC denotes the scenario where only the users are new, IC denotes the scenario where only the items are new, and UIC denotes the scenario where both users and items are new. Moreover, we randomly extract 10% of meta-training tasks as the traditional recommendation scenario which is denoted as NC.
2 https://www.yelp.com/dataset
| Dataset | Douban Book | Yelp |
|---|---|---|
| # Users | 6,576 | 25,783 |
| # Items | 20,547 | 33,105 |
| # Ratings | 326,419 | 727,259 |
| Rating Sparsity | 99.76% | 99.91% |
| Avg. friends of each user | 6.0 | 3.8 |
| # Users without friends | 1,314 | 10,867 |
To construct the support and query sets, we first keep users whose interaction history length is between 13 and 100 for Bouban Book, and keep users whose interaction history length is between 20 and 50 for Yelp. Then, for each user, 10 interacted items in history are randomly chosen to be the query set (i.e. Qu), the rest make up the support set (i.e. Su) , and social connected friends who belong to meta-training tasks are used as explicit friends (i.e. F e u ). We use the information of all support sets in the meta-training tasks to construct the HIN and identify implicit friends (i.e. F iu ). Especially, we use the attribute set {Publisher} of items to construct the HIN for Douban Book and the attribute set {Stars, PostalCode} of items to construct the HIN for Yelp. Table 1 lists the detailed statistics of two datasets.
Baselines
To validate the effectiveness of PAML, we choose three kinds of baselines. (1) Traditional methods, including FM [Rendle, 2010], NeuMF [He et al., 2017] and Wide & Deep [Cheng et al., 2016]. They are classic and widely used for recommendation. (2) Social based methods, including SoReg [Ma et al., 2011] which used social regularization with the assumption that connected users would share similar latent embeddings and DiffNet [Wu et al., 2019] which used the GCN method to propogate social relations. (3) Meta-learning based methods, including MetaEmb [Pan et al., 2019], MeLU [Lee et al., 2019] and MAMO [Dong et al., 2020]. They are designed for solving the cold-start problem by meta-learning algorithms.
Evaluation Metrics
We adopt two popular metrics. One is the root mean square error (RMSE) which is used to evaluate the predictive accuracy [Liu et al., 2019]. Smaller value of RMSE indicates better predictive accuracy. The other is the normalized discounted cumulative gain at rank K (nDCG@K) which is used to evaluate top-K ranking performance. In this paper, we set K = 5 and the larger the value, the better the performance.
Parameters Setting
For parameters in PAML, they are randomly initialized following the xavier normal distribution [Glorot and Bengio, 2010]. We set the dimension of the feature embeddings to
| Scenario | Model | Douban Book | Yelp | Scenario | Model | Bouban Book | Yelp | ||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| RMSE | nDCG@5 | RMSE | nDCG@5 | RMSE | nDCG@5 | RMSE | nDCG@5 | ||||
| UC | FM | 0.8884 | 0.8287 | 1.1856 | 0.7581 | NC | FM | 0.8853 | 0.8314 0.8288 | 1.0936 | 0.7573 0.7751 |
| NeuMF | 0.8311 | 0.8364 | 1.1761 | 0.7644 | NeuMF | 0.8003 | 0.8344 | 1.0471 | |||
| Wide &Deep SoReg | 0.7988 0.8741 | 0.8483 | 1.1635 1.1654 | 0.7765 | Wide &Deep | 0.7923 0.8705 | 0.8497 | 1.0449 1.0593 | 0.7802 0.7655 0.7910 | ||
| DiffNet MetaEmb | 0.7758 0.7662 | 0.8114 0.8653 0.8833 | 1.1094 1.1087 | IC 0.7614 0.8032 0.8262 | SoReg DiffNet | 0.7810 0.7624 | 0.8536 0.8836 | 1.0528 1.0178 | 0.8266 | ||
| MeLU | 0.7650 | 0.8920 | 1.0972 | 0.8320 | MetaEmb MeLU | 0.7666 | 0.8890 | 1.0107 | 0.8356 | ||
| MAMO | 0.8213 | MAMO | 0.8766 | 1.0243 | 0.8330 | ||||||
| PAML | 0.7246 | 0.9117 | 1.0506 | 0.8412 | PAML | 0.7355 | 0.9108 | 0.9404 | |||
| 0.7849 | 0.8583 | 1.1431 | 0.7592 | 0.8505 | |||||||
| 0.7649 | 0.7953 | ||||||||||
| FM | 0.9094 | 0.8296 | 1.0774 | FM | 0.8888 | 0.8470 | 1.0328 | ||||
| NeuMF | 0.8735 | 0.8304 | 1.0660 | 0.7718 | NeuMF | 0.8380 | 0.8521 | 1.0059 | 0.8016 | ||
| Wide &Deep | 0.8027 | 0.8510 | 1.0391 | 0.7838 | Wide &Deep | 0.8097 | 0.8677 | 0.9993 | 0.8133 | ||
| SoReg | 0.8930 | 0.8084 | 1.0469 | 0.7713 | SoReg | 0.8757 | 0.8495 | 1.0009 | 0.7986 | ||
| UIC DiffNet | 0.7888 | 0.8541 | 1.0037 | 0.8033 | DiffNet | 0.7750 | 0.8812 | 0.9471 | 0.8455 | ||
| MetaEmb | 0.7651 | 0.8805 | 1.0008 | 0.8270 | MetaEmb | 0.7819 | 0.8880 | 0.9582 | 0.8475 | ||
| MeLU | 0.7795 | 0.8903 | 0.9942 | 0.8323 | MeLU | 0.7793 | 0.9144 | 0.9621 | 0.8559 | ||
| MAMO | 0.7679 | 0.8702 | 0.9945 | 0.8421 | MAMO | 0.8072 | 0.8893 | 0.9929 | 0.8479 | ||
| PAML | 0.7496 | 0.9146 | 0.9536 | 0.8489 | PAML | 0.7604 | 0.9284 | 0.8997 | 0.8662 | ||
| Model | Bouban Book | Yelp | ||
|---|---|---|---|---|
| RMSE | nDCG@5 | RMSE | nDCG@5 | |
| PAML | 0.7496 | 0.9146 | 0.9536 | 0.8489 |
| PAML-I-E-A∗ | 0.7795 | 0.8903 | 0.9942 | 0.8323 |
| PAML-I | 0.7732 | 0.9056 | 0.9743 | 0.8406 |
| PAML-E | 0.7512 | 0.9097 | 0.9866 | 0.8392 |
| PAML-I-E | 0.7743 | 0.9045 | 0.9858 | 0.8343 |
| PAML-A | 0.7538 | 0.9036 | 0.9659 | 0.8364 |
Table 3: Ablation study in UIC.
32 and batch size to 64. Two layers used for the prediction are with 64 nodes each. We set the local and global learning rate (i.e., α, β) to 0.001 and 0.001 for Bouban Book, 0.001 and 0.0005 for Yelp, respectively. For two datasets, the number of implicit friends is empirically fixed to 5 by default , and the number of local updates is fixed to 1 by default. The sensitivity of some important hyper-parameters is discussed in Section 5.2. In addition, the hyper-parameters for baselines are set as stated in the corresponding papers and tuned carefully to achieve the best performance for fair comparisons.
In this paper, our proposed PAML is implemented by Pytorch and trained on a Linux system (2.10GHz Intel Xeon Gold 6230 CPUs and a Tesla V100 GPU).
5.2 Experimental Results
Overall Performance
In this experiment, we compare the overall performance of all methods on two datasets. Specifically, Table 2 shows the comparison results on both datasets in three cold-start scenarios and the non-cold-start scenario.
From the results, we observe our PAML consistently yields the best performance among all methods on two datasets. For instance, PAML relatively improves over the best baseline w.r.t. RMSE by 1.9-5.3% on Bouban Book and 4.1-6.9% on Yelp. By comparing the results in different scenarios, we can also find it is more difficult to make predictions in cold-start scenarios than that in the non-cold-start one. Among baselines, meta-learning based methods (i.e., MAMO, MeLU and MetaEmb) perform better than the other two kinds of methods, especially in cold-start scenarios, which validates the advantage of the meta-learning frameworks in alleviating the cold-start issue. In addition, DiffNet is a competitive model since it adopts GCN to diffuse the social influence, enriching social relations to a certain extent, and achieves the best performance among the social based methods and traditional methods, especially in the non-cold-start scenario. The rest of baselines are least competitive because they suffer from limited capacity to express user preferences by features and scarce labeled data.
Ablation Study
We conduct an ablation study to investigate the impact of different components in PAML. Here, we only report the performance in the typical scenario UIC. As for the others, the trends are similar. As shown in Table 3, "I" denotes the component of implicit friends while "E" denotes that of explicit friends. "A" denotes the preference-specific adapter. "-" denotes removing the following component. Note that MeLU is a special case of PAML which is equivalent to PAML-I-E-A.
We first study the effect of social relations. Since we use both implicit friends and explicit friends, we consider three variants of PAML including PAML-I, PAML-E and PAMLI-E. The results clearly demonstrate that the social relations could contribute to modeling the user's preference so that facilitating the performance. In addition, we realize the implicit friends contribute more than explicit ones on Bouban Book, but it becomes opposite on Yelp.
We then explore the effect of preference-specific adapter. As the preference-specific adapter plays a pivotal role in our model, we give the results of the variant PAML-A which directly adapts the prior knowledge to personalized knowledge.

The results not only prove our claim that users with similar preferences should locally share prior knowledge is reasonable but also demonstrate our proposed preference-specific adapter is effective.
Parameter Sensitivity
Finally, we conduct parameter sensitivity experiments on two datasets. As mentioned in Section 4.1, the top similar users are chosen as implicit friends of the user u. Therefore, we explore how the number of implicit friends would impact on the performance. As shown in the top half of Fig. 5, for the Bouban Book dataset, nDCG@5 increases quickly from 0 to 5 and then reaches to a stable level. For the Yelp dataset, increasing the number of implicit friends does not lead to continuous improvements but a slight drop. We guess the reason is that more implicit friends may introduce noise.
In addition, we analyze the effect of the number of local updates in the meta-learning process. The bottom half of Fig. 5 shows nDCG@5 of PAML for varying the number of local updates from 0 to 5. The results reach the optimal performance at one local update, and then as the number of local updates increases, nDCG@5 gradually decreases, which may be due to overfitting on the support set.
6 Conclusion
In this paper, we proposed a Preference-Adaptive MetaLearning approach (PAML) for improving existing metalearning frameworks with better generalization capacity. By leveraging users' social relations and our proposed preference-specific adapter, correlated users who share similar preferences could trigger similar knowledge. Benefits from that, the meta-learning algorithm could have better generalization capacity, so the prior knowledge could be quickly adapted to new users with sparse interactions. The proposed method was evaluated on two real-world datasets, showing that PAML outperforms the competing baselines. The ablation study demonstrated the power of social relations and the effectiveness of the preference-specific adapter.
Acknowledgments
This research was partially supported by grants from the National Natural Science Foundation of China (Grants No. U20A20229, 61922073, 61976198 and 62022077), the National Key R&D Program of China under Grant No. 2020AAA0103800, and the Fundamental Research Funds for the Central Universities (Grant No.WK2150110021 and WK2150110017).
@inproceedings{ijcai2021p222,
title = {Preference-Adaptive Meta-Learning for Cold-Start Recommendation},
author = {Wang, Li and Jin, Binbin and Huang, Zhenya and Zhao, Hongke and Lian, Defu and Liu, Qi and Chen, Enhong},
booktitle = {Proceedings of the Thirtieth International Joint Conference on
Artificial Intelligence, {IJCAI-21}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Zhi-Hua Zhou},
pages = {1607--1614},
year = {2021},
month = {8},
note = {Main Track},
doi = {10.24963/ijcai.2021/222},
url = {https://doi.org/10.24963/ijcai.2021/222},
}
TY - CPAPER TI - Preference-Adaptive Meta-Learning for Cold-Start Recommendation AU - Wang, Li AU - Jin, Binbin AU - Huang, Zhenya AU - Zhao, Hongke AU - Lian, Defu AU - Liu, Qi AU - Chen, Enhong T2 - Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI-21 PB - International Joint Conferences on Artificial Intelligence Organization PY - 2021 SP - 1607 EP - 1614 DO - 10.24963/ijcai.2021/222 UR - https://doi.org/10.24963/ijcai.2021/222 ER -Copied
Machine-readable versions of this paper, for tools and AI agents:
Welcome
Future Conferences
AI Journal Division
IJCAI Proceedings
About IJCAI
IJCAI Awards