Proceedings

Identifying Causal Mechanism Shifts Under Additive Models with Arbitrary Noise

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 4706-4714.

https://doi.org/10.24963/ijcai.2025/524

Abstract

In many real-world scenarios, the goal is to identify variables whose causal mechanisms change across related datasets. For example, detecting abnormal root nodes in manufacturing, and identifying key genes that influence cancer by analyzing differences in gene regulatory mechanisms between healthy individuals and cancer patients. This can be done by recovering the causal structure for each dataset independently and then comparing them to identify differences, but the performance is often suboptimal. Typically, existing methods directly identify causal mechanism shifts based on linear additive noise models (ANMs) or by imposing restrictive assumptions on the noise distribution. In this paper, we introduce CMSI, a novel and more general algorithm based on nonlinear ANMs that identifies variables with shifting causal mechanisms under arbitrary noise distributions. Evaluated on various synthetic datasets, CMSI consistently outperforms existing baselines in terms of F1 score. Additionally, we demonstrate CMSI's applicability on gene expression datasets of ovarian cancer patients at different disease stages.

  1. [Bogatinovski et al., 2021] Jasmin Bogatinovski, Sasho Nedelkoski, Alexander Acker, Florian Schmidt, Thorsten Wittkopp, Soeren Becker, Jorge Cardoso, and Odej Kao. Artificial intelligence for it operations (aiops) workshop white paper. arXiv preprint arXiv:2101.06054, 2021.
  2. [Budhathoki et al., 2021] Kailash Budhathoki, Dominik Janzing, Patrick Bloebaum, and Hoiyi Ng. Why did the distribution change? In International Conference on Artificial Intelligence and Statistics, pages 1666-1674.
  3. PMLR, 2021.
  4. [Ceppi et al., 2014] Paolo Ceppi, Abbas Hadji, Frederick J Kohlhapp, Abhinandan Pattanayak, Annika Hau, Xia Liu, Huiping Liu, Andrea E Murmann, and Marcus E Peter. Cd95 and cd95l promote and protect cancer stem cells. Nature communications, 5(1):5238, 2014.
  5. [Chen et al., 2024a] Mingjie Chen, Hongcheng Wang, Ruxin Wang, Yuzhong Peng, and Hao Zhang. Cdrm: Causal disentangled representation learning for missing data. Knowledge-Based Systems, 299:112079, 2024.
  6. [Chen et al., 2024b] Tianyu Chen, Kevin Bello, Bryon Aragam, and Pradeep Ravikumar. iscan: identifying causal mechanism shifts among nonlinear additive noise models. Advances in Neural Information Processing Sys- tems, 36, 2024.
  7. [Hoyer et al., 2008] Patrik Hoyer, Dominik Janzing, Joris M Mooij, Jonas Peters, and Bernhard Schölkopf. Nonlinear causal discovery with additive noise models. Advances in neural information processing systems, 21, 2008.
  8. [Hu et al., 2019] Xiaoyan Hu, Yang Meng, Lian Xu, Lei Qiu, Mingtian Wei, Dan Su, Xu Qi, Ziqiang Wang, Shengyong Yang, Cong Liu, et al. Cul4 e3 ubiquitin ligase regulates ovarian cancer drug resistance by targeting the antiapop- totic protein birc3. Cell death & disease, 10(2):104, 2019.
  9. [Hudson et al., 2009] Nicholas J Hudson, Antonio Reverter, and Brian P Dalrymple. A differential wiring analysis of expression data correctly identifies the gene contain- ing the causal mutation. PLoS computational biology, 5(5):e1000382, 2009.
  10. [Li and Turner, 2017] Yingzhen Li and Richard E Turner. Gradient estimators for implicit models. arXiv preprint arXiv:1705.07107, 2017.
  11. [Li et al., 2023] Xinran Li, Bo Jiang, and Jun S Liu. Kernel- based partial permutation test for detecting heterogeneous functional relationship. Journal of the American Statistical Association, 118(542):1429-1447, 2023.
  12. [Liu et al., 2017] Song Liu, Kenji Fukumizu, and Taiji Suzuki. Learning sparse structural changes in high- dimensional markov networks: A review on methodolo- gies and theories. Behaviormetrika, 44:265-286, 2017.
  13. [Lyu, 2012] Siwei Lyu. Interpretation and generalization of score matching. arXiv preprint arXiv:1205.2629, 2012.
  14. [Meek, 1997] Christopher Meek. Graphical Models: Select- ing causal and statistical models. PhD thesis, Carnegie Mellon University, 1997.
  15. [Mondal et al., 2023] Tanmoy Mondal, Himanshu Gaur, Brice EN Wamba, Abby Grace Michalak, Camryn Stout, Matthew R Watson, Sophia L Aleixo, Arjun Singh, Salva- tore Condello, Roland Faller, et al. Characterizing the reg- ulatory fas (cd95) epitope critical for agonist antibody tar- geting and car-t bystander function in ovarian cancer. Cell Death & Differentiation, 30(11):2408-2431, 2023.
  16. [Montagna et al., 2023] Francesco Montagna, Nicoletta No- ceti, Lorenzo Rosasco, Kun Zhang, and Francesco Lo- catello. Causal discovery with score matching on addi- tive models with arbitrary noise. In Conference on Causal Learning and Reasoning, pages 726-751. PMLR, 2023.
  17. [Peters et al., 2014] Jonas Peters, Joris M Mooij, Dominik Janzing, and Bernhard Schölkopf. Causal discovery with continuous additive noise models. 2014. [Pimanda et al., 2007]
  18. John E Pimanda, Katrin Ottersbach, Kathy Knezevic, Sarah Kinston, Wan YI Chan, Nicola K Wilson, Josette-Renée Landry, Andrew D Wood, Anja Kolb-Kokocinski, Anthony R Green, et al. Gata2, fli1, and scl form a recursively wired gene-regulatory circuit during early hematopoietic development. Proceedings of the Na- tional Academy of Sciences, 104(45):17692-17697, 2007.
  19. [Plis et al., 2010] Sergey M Plis, Vince D Calhoun, Michael P Weisend, Tom Eichele, and Terran Lane. Meg and fmri fusion for non-linear estimation of neural and bold signal changes. Frontiers in neuroinformatics, 4:114, 2010.
  20. [Ren et al., 2025] Yixin Ren, Haocheng Zhang, Yewei Xia, Hao Zhang, Jihong Guan, and Shuigeng Zhou. Fast causal discovery by approximate kernel-based generalized score functions with linear computational complexity. In Pro- ceedings of the 31st ACM SIGKDD Conference on Knowl- edge Discovery and Data Mining V.1, page 1197-1208, 2025.
  21. [Robins et al., 2000] James M Robins, Miguel Angel Her- nan, and Babette Brumback. Marginal structural models and causal inference in epidemiology, 2000.
  22. [Rolland et al., 2022] Paul Rolland, Volkan Cevher, Matthäus Kleindessner, Chris Russell, Dominik Janzing, Bernhard Schölkopf, and Francesco Locatello. Score matching enables causal discovery of nonlinear additive noise models. In International Conference on Machine Learning, pages 18741-18753.
  23. PMLR, 2022.
  24. [Sanei and Chambers, 2013] Saeid Sanei and Jonathon A Chambers. EEG signal processing. John Wiley & Sons, 2013.
  25. [Shi et al., 2020] Shuping Shi, Stan Hurn, and Peter CB Phillips. Causal change detection in possibly integrated systems: Revisiting the money-income relationship. Jour- nal of Financial Econometrics, 18(1):158-180, 2020.
  26. [Song and Ermon, 2019] Yang Song and Stefano Ermon. Generative modeling by estimating gradients of the data distribution. Advances in neural information processing systems, 32, 2019.
  27. [Song et al., 2020] Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456, 2020.
  28. [Spirtes et al., 2000] Peter Spirtes, Clark N Glymour, and Richard Scheines. Causation, Prediction, and Search. MIT Press, 2000.
  29. [Squires et al., 2020] Chandler Squires, Yuhao Wang, and Caroline Uhler. Permutation-based causal structure learn- ing with unknown intervention targets. In Conference on Uncertainty in Artificial Intelligence, pages 1039-1048.
  30. PMLR, 2020.
  31. [Stein, 1972] Charles Stein. A bound for the error in the nor- mal approximation to the distribution of a sum of depen- dent random variables. In Proceedings of the sixth Berke- ley symposium on mathematical statistics and probability, volume 2: Probability theory, volume 6, pages 583-603. University of California Press, 1972.
  32. [Tothill et al., 2008] Richard W Tothill, Anna V Tinker, Joshy George, Robert Brown, Stephen B Fox, Stephen Lade, Daryl S Johnson, Melanie K Trivett, Dariush Etemadmoghadam, Bianca Locandro, et al. Novel molec- ular subtypes of serous and endometrioid ovarian can- cer linked to clinical outcome. Clinical cancer research, 14(16):5198-5208, 2008.
  33. [Varici et al., 2021] Burak Varici, Karthikeyan Shanmugam, Prasanna Sattigeri, and Ali Tajer. Scalable intervention target estimation in linear models. Advances in Neural Information Processing Systems, 34:1494-1505, 2021.
  34. [Wang et al., 2018] Yuhao Wang, Chandler Squires, Anas- tasiya Belyaeva, and Caroline Uhler. Direct estimation of differences in causal graphs. Advances in neural informa- tion processing systems, 31, 2018.
  35. [Xu et al., 2024] Wenwei Xu, Hao Zhang, Yewei Xia, Yixin Ren, Jihong Guan, and Shuigeng Zhou. Hybrid causal feature selection for cancer biomarker identification from rna-seq data. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2024.
  36. [Yuan et al., 2017] Huili Yuan, Ruibin Xi, Chong Chen, and Minghua Deng. Differential network analysis via lasso pe- nalized d-trace loss. Biometrika, 104(4):755-770, 2017.
  37. [Zhang et al., 2021] Hao Zhang, Kun Zhang, Shuigeng Zhou, Jihong Guan, and Ji Zhang. Testing independence between linear combinations for causal discovery. In Pro- ceedings of the AAAI conference on artificial intelligence, volume 35, pages 6538-6546, 2021.
  38. [Zhang et al., 2022] Hao Zhang, Shuigeng Zhou, Kun Zhang, and Jihong Guan. Residual similarity based condi- tional independence test and its application in causal dis- covery. In Proceedings of the AAAI conference on artificial intelligence, volume 36, pages 5942-5949, 2022.
  39. [Zhang et al., 2024] Hao Zhang, Yixin Ren, Yewei Xia, Shuigeng Zhou, and Jihong Guan. Towards effective causal partitioning by edge cutting of adjoint graph. IEEE Transactions on Pattern Analysis and Machine Intelli- gence, 46(12):10259-10271, 2024.
  40. [Zhao et al., 2014] Sihai Dave Zhao, T Tony Cai, and Hongzhe Li. Direct estimation of differential networks. Biometrika, 101(2):253-268, 2014.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards