Proceedings

On the Opportunity of Causal Learning in Recommendation Systems: Foundation, Estimation, Prediction and Challenges

Video #1 Video #2 Download BibTeX Cite

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence. Survey Track. Pages 5646-5653.

https://doi.org/10.24963/ijcai.2022/787

Abstract

Recently, recommender system (RS) based on causal inference has gained much attention in the industrial community, as well as the states of the art performance in many prediction and debiasing tasks. Nevertheless, a unified causal analysis framework has not been established yet. Many causal-based prediction and debiasing studies rarely discuss the causal interpretation of various biases and the rationality of the corresponding causal assumptions. In this paper, we first provide a formal causal analysis framework to survey and unify the existing causal-inspired recommendation methods, which can accommodate different scenarios in RS. Then we propose a new taxonomy and give formal causal definitions of various biases in RS from the perspective of violating the assumptions adopted in causal analysis. Finally, we formalize many debiasing and prediction tasks in RS, and summarize the statistical and machine learning-based causal estimation methods, expecting to provide new research opportunities and perspectives to the causal RS community.

  1. [Afsar et al., 2021] M Mehdi Afsar, Trafford Crump, and Behrouz Far. Reinforcement learning based recommender systems: A survey. arXiv:2101.06286, 2021.
  2. [Athey and Imbens, 2015a] Susan Athey and Guido W Im- bens. Machine learning methods for estimating heteroge- neous causal effects. stat, 1050:1-26, 2015.
  3. [Athey and Imbens, 2015b] Susan Athey and Guido W Im- bens. Recursive partitioning for heterogeneous causal ef- fects. PNAS, 113:7353-7360, 2015.
  4. [Athey et al., 2019] Susan Athey, Julia Tibshirani, and Ste- fan Wager. Generalized random forests. The Annals of Statistics, 47:1148-1178, 2019.
  5. [Bareinboim et al., 2014] Elias Bareinboim, Jin Tian, and Judea Pearl. Recovering from selection bias in causal and statistical inference. In AAAI, 2014.
  6. [Carvalho, 2020] P. Richard Hahn. Jared S. Murray. Car- los M. Carvalho. Bayesian regression tree models for causal inference: Regularization, confounding, and het- erogeneous effects (with discussion). Journal of the Amer- ican Statistical Association, 15:965-1056, 2020.
  7. [Chen et al., 2020] Jiawei Chen, Hande Dong, Xiang Wang, Fuli Feng, Meng Wang, and Xiangnan He. Bias and debias in recommender system: A survey and future directions. arXiv:2010.03240, 2020.
  8. [Chen et al., 2021] Jiawei Chen, Hande Dong, Yang Qiu, Xi- angnan He, Xin Xin, Liang Chen, Guli Lin, and Keping Yang. Autodebias: Learning to debias for recommenda- tion. In SIGIR, 2021.
  9. [Chiappa, 2019] Silvia Chiappa. Path-specific counterfactual fairness. In AAAI, 2019.
  10. [Correa et al., 2019] Juan D. Correa, Jin Tian, and Elias Bareinboim. Identification of causal effect in the presence of selection bias. In AAAI, 2019.
  11. [Daniel et al., 2016] Rhian M Daniel, Bianca L de Stavola, and Stijn Vansteelandt. Commentary: The formal ap- proach to quantitative causal inference in epidemiology: misguided or misrepresented? International Journal of Epidemiology, 45:1817-1829, 2016.
  12. [Deldjoo et al., 2021] Yashar Deldjoo, Vito Walter Anelli, Hamed Zamani, and et al. A flexible framework for eval- uating user and item fairness in recommender systems. User Modeling and User-Adapted Interaction, 31:457- 511, 2021.
  13. [Goetghebeur et al., 2020] Els Goetghebeur, Saskia le Cessie, Bianca De Stavola, and et al. Formulating causal questions and principled statistical answers. Statistics In Medicine, 39:4922-4948, 2020.
  14. [Gopalan et al., 2015] Prem Gopalan, Jake M. Hofman, and David M. Blei. Scalable recommendation with hierarchi- cal poisson factorization. In UAI, 2015.
  15. [Gu et al., 2021] Tiankai Gu, Kun Kuang, Hong Zhu, and et al. Estimating true post-click conversion via group- stratified counterfactual inference. In ADKDD, 2021.
  16. [Guo et al., 2021] Siyuan Guo, Lixin Zou, Yiding Liu, et al. Wang, Hechang Chen, Dawei Yin, and Yi Chang. En- hanced doubly robust learning for debiasing post-click conversion rate estimation. In SIGIR, 2021.
  17. [Gutierrez and Gérardy, 2017] Pierre Gutierrez and Jean- Yves Gérardy. Causal inference and uplift modelling: A review of the literature. In International Conference on Predictive Applications and APIs, pages 1-13, 2017.
  18. [Hansotia and Rukstales, 2002] Behram Hansotia and Brad Rukstales. Incremental value modeling. Journal of In- teractive Marketing, 16:35-46, 2002.
  19. [Hernán and Robins, 2020] Miguel A. Hernán and James M. Robins. Causal Inference: What If. Boca Raton: Chapman and Hall/CRC, 2020.
  20. [Hill, 2011] Jennifer L Hill. Bayesian nonparametric mod- eling for causal inference. Journal of Computational and Graphical Statistics, 20:217-240, 2011.
  21. [Hitsch and Misra, 2018] Günter J Hitsch and Sanjog Misra. Heterogeneous treatment effects and optimal targeting pol- icy evaluation. Available at SSRN 3111957, 2018.
  22. [Horvitz and Thompson, 1952] Daniel G Horvitz and Dono- van J Thompson. A generalization of sampling without replacement from a finite universe. Journal of the Ameri- can Statistical Association, 47:663-685, 1952.
  23. [Hünermund and Bareinboim, 2019] Paul Hünermund and Elias Bareinboim. Causal inference and data-fusion in econometrics. arXiv:1912.09104, 2019.
  24. [Imbens and Rubin, 2015] Guido W. Imbens and Donald B. Rubin. Causal Inference For Statistics Social and Biomed- ical Science. Cambridge University Press, 2015.
  25. [Johansson et al., 2016] Fredrik Johansson, Uri Shalit, and David Sontag. Learning representations for counterfactual inference. In ICML, 2016.
  26. [Kallus et al., 2018] Nathan Kallus, Aahlad Manas Puli, and Uri Shalit. Removing hidden confounding by experimen- tal grounding. In NIPS, 2018.
  27. [Kennedy, 2020] Edward H. Kennedy. Optimal dou- bly robust estimation of heterogeneous causal effects. arXiv:2004.14497v1, 2020.
  28. [Kunzel et al., 2019] Soren R Kunzel, Jasjeet S Sekhon, Pe- ter J Bickel, and Bin Y. Metalearners for estimating hetero- geneous treatment effects using machine learning. PNAS, 116:4156-4165, 2019.
  29. [Kusner et al., 2017] Matt J Kusner, Joshua R Loftus, Chris Russell, and Ricardo Silva. Counterfactual fairness. arXiv preprint arXiv:1703.06856, 2017.
  30. [Lechner, 2019] Michael Lechner. Modified causal forests for estimating heterogeneous causal effects. arXiv:1812.09487, 2019.
  31. [Li et al., 2010] Lihong Li, Wei Chu, John Langford, and Robert E Schapire. A contextual-bandit approach to per- sonalized news article recommendation. In WWW, 2010.
  32. [Liang et al., 2020] Dawen Liang, Laurent Charlin, and David M. Blei. Causal inference for recommender sys- tems. In RecSys, 2020.
  33. [Liu et al., 2021] Dugang Liu, Pengxiang Cheng, Hong Zhu, and et al. Mitigating confounding bias in recommendation via information bottleneck. In RecSys, 2021.
  34. [Louizos et al., 2017] Christos Louizos, Uri Shalit, Joris Mooij, and et al. Causal effect inference with deep latent- variable models. arXiv:1705.08821, 2017.
  35. [Mohan and Pearl, 2021] Karthika Mohan and Judea Pearl. Graphical models for processing missing data. Journal of the American Statistical Association, 2021.
  36. [Munemasa et al., 2018] Isshu Munemasa, Yuta Tomo- matsu, Kunioki Hayashi, and et al. Deep reinforcement learning for recommender systems. In ICOIACT, 2018.
  37. [Nabi and Shpitser, 2018] Razieh Nabi and Ilya Shpitser. Fair inference on outcomes. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32, 2018.
  38. [Nie and Wager, 2021] Xinkun Nie and Stefan Wager. Quasi-oracle estimation of heterogeneous treatment ef- fects. Biometrika, 108:4156-4165, 2021.
  39. [Oprescu et al., 2020] Miruna Oprescu, Vasilis Syrgkanis, and Zhiwei Steven Wu. Orthogonal random forest for causal inference. arXiv:1806.03467, 2020.
  40. [Pearl and Mackenzie, 2018] Judea Pearl and Dana Macken- zie. The book of why: the new science of cause and effect. New York: Basic Books, 2018.
  41. [Pearl, 2009] Judea Pearl. Causality: Models, Reasoning, and Inference. Cambridge University Press, second edi- tion, 2009.
  42. [Pearl, 2019] Judea Pearl. The seven tools of causal infer- ence, with reflections on machine learning. Communica- tions of the ACM, 62:54-60, 2019.
  43. [Powers et al., 2018] Scott Powers, Junyang Qian, Kenneth Jung, and et al. Some methods for heterogeneous treat- ment effect estimation in high dimensions. Statistics in medicine, 37:1767-1787, 2018.
  44. [Rosenbaum and Rubin, 1983] Paul R. Rosenbaum and Donald B. Rubin. The central role of the propensity score in observational studies for causal effects. Biometrika, 70:41-55, 1983.
  45. [Rubin, 1974] Donald B. Rubin. Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of educational psychology, 66:688-701, 1974.
  46. [Rubin, 1980] Donald B. Rubin. Discussion of randomiza- tion analysis of experimental data in the fisher random- ization test by basu. Journal of the American Statistical Association, 75:591-593, 1980.
  47. [Saito, 2020] Yuta Saito. Asymmetric tri-training for debi- asing missing-not-at-random explicit feedback. In SIGIR, pages 309-318, 2020.
  48. [Sato et al., 2019] Masahiro Sato, Janmajay Singh, Sho Takemori, and et al. Uplift-based evaluation and optimiza- tion of recommenders. In RecSys, 2019.
  49. [Sato et al., 2020] Masahiro Sato, Sho Takemori, Janmajay Singh, and Tomoko Ohkuma. Unbiased learning for the causal effect of recommendation. In RecSys, 2020.
  50. [Schnabel et al., 2016] Tobias Schnabel, Adith Swami- nathan, Ashudeep Singh, Navin Chandak, and Thorsten Joachims. Recommendations as treatments: Debiasing learning and evaluation. In ICML, 2016.
  51. [Vansteelandt and Dukes, 2021] Stijn Vansteelandt and Oliver Dukes. Discussion of kallus and mo, qi, and liu: New objectives for policy learning. Journal of the American Statistical Association, 116:675-679, 2021.
  52. [Wager and Athey, 2018] Stefan Wager and Susan Athey. Estimation and inference of heterogeneous treatment ef- fects using random forests. Journal of the American Sta- tistical Association, 113:1228-1242, 2018.
  53. [Wang et al., 2019a] Xiaojie Wang, Rui Zhang, Yu Sun, and Jianzhong Qi. Doubly robust joint learning for recommen- dation on data missing not at random. In ICML, 2019.
  54. [Wang et al., 2019b] Yixin Wang, Dawen Liang, Laurent Charlin, and David M. Blei. The deconfounded recom- mender: A causal inference approach to recommendation. arXiv:1808.06581, 2019.
  55. [Wang et al., 2020a] Yixin Wang, Dawen Liang, Laurent Charlin, and David M. Blei. Causal inference for recom- mender systems. In RecSys, 2020.
  56. [Wang et al., 2020b] Zifeng Wang, Xi Chen, Rui Wen, and et al. Information theoretic counterfactual learning from missing-not-at-random feedback. NeurIPS, 2020.
  57. [Wu et al., 2022] Peng Wu, Haoxuan Li, Yan Lyu, and Xiao- Hua Zhou. Doubly robust collaborative targeted learn- ing for recommendation on data missing not at random. arXiv:2203.10258, 2022.
  58. [Yao et al., 2018] Liuyi Yao, Sheng Li, Yaliang Li, and et al. Representation learning for treatment effect estimation from observational data. NeurIPS, 31, 2018.
  59. [Yoon et al., 2018] Jinsung Yoon, James Jordon, and Mi- haela Van Der Schaar. Ganite: Estimation of individu- alized treatment effects using generative adversarial nets. In ICLR, 2018.
  60. [Yuan et al., 2019] Bowen Yuan, Juiyang Hsia, Mengyuan Yang, and et al. Improving ad click prediction by con- sidering non-displayed events. In CIKM, 2019.
  61. [Yuan et al., 2020] Bowen Yuan, Yaxu Liu, Jui-Yang Hsia, and et al. Unbiased ad click prediction for position-aware advertising systems. In RecSys, 2020.
  62. [Zhang et al., 2020] Wenhao Zhang, Wentian Bao, Xiao- Yang Liu, and et al. Large-scale causal approaches to debi- asing post-click conversion rate estimation with multi-task learning. In WWW, 2020.
  63. [Zhang et al., 2021] Xiao Zhang, Haonan Jia, Hanjing Su, Wenhan Wang, Jun Xu, and Ji-Rong Wen. Counterfactual reward modification for streaming recommendation with delayed feedback. In SIGIR, pages 41-50, 2021.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards