Proceedings

Towards Counterfactual Fairness-aware Domain Generalization in Changing Environments

Download BibTeX Cite

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence. Main Track. Pages 4560-4568.

https://doi.org/10.24963/ijcai.2024/504

Abstract

Recognizing domain generalization as a commonplace challenge in machine learning, data distribution might progressively evolve across a continuum of sequential domains in practical scenarios. While current methodologies primarily concentrate on bolstering model effectiveness within these new domains, they tend to neglect issues of fairness throughout the learning process. In response, we propose an innovative framework known as Disentanglement for Counterfactual Fairness-aware Domain Generalization (DCFDG). This approach adeptly removes domain-specific information and sensitive information from the embedded representation of classification features. To scrutinize the intricate interplay between semantic information, domain-specific information, and sensitive attributes, we systematically partition the exogenous factors into four latent variables. By incorporating fairness regularization, we utilize semantic information exclusively for classification purposes. Empirical validation on synthetic and authentic datasets substantiates the efficacy of our approach, demonstrating elevated accuracy levels while ensuring the preservation of fairness amidst the evolving landscape of continuous domains.

  1. [Bai et al., 2022] Guangji Bai, Chen Ling, and Liang Zhao. Temporal domain generalization with drift-aware dynamic neural networks. arXiv preprint arXiv:2205.10664, 2022.
  2. [Finn et al., 2017] Chelsea Finn, Pieter Abbeel, and Sergey Levine. Model-agnostic meta-learning for fast adaptation of deep networks. In International conference on machine learning, pages 1126-1135. PMLR, 2017.
  3. [Goodfellow et al., 2014] Ian Goodfellow, Jean Pouget- Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Gen- erative adversarial nets. Advances in neural information processing systems, 27, 2014.
  4. [Grari et al., 2021] Vincent Grari, Sylvain Lamprier, and Marcin Detyniecki. Fairness without the sensitive at- tribute via causal variational autoencoder. arXiv preprint arXiv:2109.04999, 2021. IJCAI
  5. [Hernán and Robins, 2018] Miguel A Hernán and James M Robins. Causal inference. International encyclopedia of statistical science, pages 1-10, 2018.
  6. [Hitchcock and Pearl, 2001] C. Hitchcock and J. Pearl. Causality: Models, reasoning and inference. Philosoph- ical Review, 110(4):639, 2001.
  7. [Hochreiter and Schmidhuber, 1997] Sepp Hochreiter and Jürgen Schmidhuber. Long short-term memory. Neural computation, 9(8):1735-1780, 1997.
  8. [Ilse et al., 2020] Maximilian Ilse, Jakub M Tomczak, Chris- tos Louizos, and Max Welling. Diva: Domain invariant variational autoencoders. In Medical Imaging with Deep Learning, pages 322-348. PMLR, 2020.
  9. [Kim and Mnih, 2018] Hyunjik Kim and Andriy Mnih. Dis- entangling by factorising. In International Conference on Machine Learning, pages 2649-2658. PMLR, 2018.
  10. [Kim et al., 2021] Hyemi Kim, Seungjae Shin, JoonHo Jang, Kyungwoo Song, Weonyoung Joo, Wanmo Kang, and Il- Chul Moon. Counterfactual fairness with disentangled causal effect variational autoencoder. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 8128-8136, 2021.
  11. [Kingma and Welling, 2013] Diederik P Kingma and Max Welling. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013.
  12. [Kohavi and others, 1996] Ron Kohavi et al. Scaling up the accuracy of naive-bayes classifiers: A decision-tree hy- brid. In Kdd, volume 96, pages 202-207, 1996.
  13. [Kusner et al., 2017] Matt J Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. Counterfactual fairness. Ad- vances in neural information processing systems, 30, 2017.
  14. [Louizos et al., 2017] Christos Louizos, Uri Shalit, Joris M Mooij, David Sontag, Richard Zemel, and Max Welling. Causal effect inference with deep latent-variable models. Advances in neural information processing systems, 30, 2017.
  15. [Miller, 2020] Jennifer Miller. Is an algorithm less racist than a loan officer? The New York Times, 2020.
  16. [Pearl and Mackenzie, 2018] Judea Pearl and Dana Macken- zie. The book of why: the new science of cause and effect. Basic books, 2018. [Pearl, 2009] Judea Pearl. Causality. Cambridge University Press, 2009.
  17. [Pfohl et al., 2019] Stephen R Pfohl, Tony Duan, Daisy Yi Ding, and Nigam H Shah. Counterfactual reasoning for fair clinical risk prediction. In Machine Learning for Healthcare Conference, pages 325-358. PMLR, 2019.
  18. [Qin et al., 2022] Tiexin Qin, Shiqi Wang, and Haoliang Li. Generalizing to evolving domains with latent structure- aware sequential autoencoder. In International Conference on Machine Learning, pages 18062-18082. PMLR, 2022.
  19. [Qin et al., 2023] Tiexin Qin, Shiqi Wang, and Haoliang Li. Evolving domain generalization via latent structure-aware sequential autoencoder. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023.
  20. [Shpitser and Pearl, 2008] Ilya Shpitser and Judea Pearl. Complete identification methods for the causal hierar- chy. Journal of Machine Learning Research, 9:1941- 1979, 2008.
  21. [Sohn et al., 2015] Kihyuk Sohn, Honglak Lee, and Xinchen Yan. Learning structured output representation using deep conditional generative models. Advances in neural infor- mation processing systems, 28, 2015.
  22. [Spirtes et al., 2000] Peter Spirtes, Clark N Glymour, Richard Scheines, and David Heckerman. Causation, prediction, and search. MIT press, 2000.
  23. [Wang et al., 2021] Yufei Wang, Haoliang Li, Lap-Pui Chau, and Alex C Kot. Variational disentanglement for domain generalization. arXiv preprint arXiv:2109.05826, 2021.
  24. [Wang et al., 2022] William Wei Wang, Gezheng Xu, Ruizhi Pu, Jiaqi Li, Fan Zhou, Changjian Shui, Charles Ling, Christian Gagné, and Boyu Wang. Evolving domain gen- eralization. arXiv preprint arXiv:2206.00047, 2022.
  25. [Wu et al., 2019] Yongkai Wu, Lu Zhang, Xintao Wu, and Hanghang Tong. Pc-fairness: A unified framework for measuring causality-based fairness. Advances in neural information processing systems, 32, 2019.
  26. [Zafar et al., 2017] Muhammad Bilal Zafar, Isabel Valera, Manuel Gomez Rogriguez, and Krishna P Gummadi. Fair- ness constraints: Mechanisms for fair classification. In Ar- tificial intelligence and statistics, pages 962-970. PMLR, 2017.
  27. [Zeng et al., 2023] Qiuhao Zeng, Wei Wang, Fan Zhou, Charles Ling, and Boyu Wang. Foresee what you will learn: Data augmentation for domain generaliza- tion in non-stationary environments. arXiv preprint arXiv:2301.07845, 2023.
  28. [Zhao and Chen, 2020] Chen Zhao and Feng Chen. Un- fairness discovery and prevention for few-shot regression. In 2020 IEEE International Conference on Knowledge Graph (ICKG), pages 137-144. IEEE, 2020.
  29. [Zhao et al., 2021a] Chen Zhao, Feng Chen, and Bhavani Thuraisingham. Fairness-aware online meta-learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pages 2294-2304, 2021.
  30. [Zhao et al., 2021b] Tianxiang Zhao, Enyan Dai, Kai Shu, and Suhang Wang. You can still achieve fairness with- out sensitive attributes: Exploring biases in non-sensitive features. arXiv preprint arXiv:2104.14537, 2021.
  31. [Zhao et al., 2022] Chen Zhao, Feng Mi, Xintao Wu, Kai Jiang, Latifur Khan, and Feng Chen. Adaptive fairness- aware online meta-learning for changing environments. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 2565- 2575, 2022.
  32. [Zhao et al., 2023] Chen Zhao, Feng Mi, Xintao Wu, Kai Jiang, Latifur Khan, Christan Grant, and Feng Chen. To- wards fair disentangled online learning for changing envi- ronments. In Proceedings of the 29th ACM SIGKDD Con- ference on Knowledge Discovery and Data Mining, pages 3480-3491, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards