Proceedings

Counterfactual Estimation via Temporal-Aware Intervention Networks

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 4079-4087.

https://doi.org/10.24963/ijcai.2026/454

Abstract

Accurate estimation of time-varying treatment effects is crucial for optimizing interventions in personalized medicine. However, observational data often contains complex confounding bias and temporal complexities, making counterfactual estimation challenging. We propose Counterfactual Estimation via Temporal-Aware Intervention Networks (TAIN), a novel model that introduces an Intervention-aware Functional Convolution kernel to emphasize the role of treatments and capture complex temporal treatment interactions. TAIN addresses confounding bias from a domain generalization perspective, approximating the unknown target domain using adversarial examples and incorporating Sharpness-Aware Minimization to derive a generalization bound. This approach is more suitable for longitudinal settings compared to existing methods inspired by domain adaptation techniques due to inherent differences between static and longitudinal contexts. Experiments on simulated datasets demonstrate TAIN's superior performance compared to state-of-the-art models for counterfactual estimation over time.

  1. [Bai et al., 2018] Shaojie Bai, J Zico Kolter, and Vladlen Koltun. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271, 2018.
  2. [Ban et al., 2025a] Taiyu Ban, Lyuzhou Chen, Derui Lyu, Xiangyu Wang, Qinrui Zhu, and Huanhuan Chen. Llm- driven causal discovery via harmonized prior. IEEE Trans- actions on Knowledge and Data Engineering, 2025.
  3. [Ban et al., 2025b] Taiyu Ban, Changxin Rong, Xiangyu Wang, Lyuzhou Chen, Xin Wang, Derui Lyu, Qinrui Zhu, and Huanhuan Chen. Differentiable structure learning with ancestral constraints. In Forty-second International Conference on Machine Learning, 2025.
  4. [Bica et al., 2020a] Ioana Bica, Ahmed Alaa, and Mihaela Van Der Schaar. Time series deconfounder: Estimating treatment effects over time in the presence of hidden con- founders. In International conference on machine learn- ing, pages 884-895. PMLR, 2020.
  5. [Bica et al., 2020b] Ioana Bica, Ahmed M Alaa, James Jor- don, and Mihaela van der Schaar. Estimating counterfac- tual treatment outcomes over time through adversarially balanced representations. In International Conference on Learning Representations, 2020.
  6. [Chen et al., 2023] Yehu Chen, Annamaria Prati, Jacob Montgomery, and Roman Garnett. A multi-task gaussian process model for inferring time-varying treatment effects in panel data. In International Conference on Artificial In- telligence and Statistics, pages 4068-4088. PMLR, 2023.
  7. [Chen et al., 2025] Lyuzhou Chen, Taiyu Ban, Derui Lyu, Yijia Sun, Kangtao Hu, Xiangyu Wang, and Huanhuan Chen. Continuous structure constraint integration for ro- bust causal discovery. In The 28th International Confer- ence on Artificial Intelligence and Statistics, 2025.
  8. [Chevillon, 2007] Guillaume Chevillon. Direct multi-step estimation and forecasting. Journal of Economic Surveys, 21(4):746-785, 2007.
  9. [Cho et al., 2014] Kyunghyun Cho, Bart van Merrienboer, Dzmitry Bahdanau, and Yoshua Bengio. On the proper- ties of neural machine translation: Encoder-decoder ap- proaches. In Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Transla- tion, page 103. Association for Computational Linguistics, 2014.
  10. [Foret et al., 2021] Pierre Foret, Ariel Kleiner, Hossein Mobahi, and Behnam Neyshabur. Sharpness-aware mini- mization for efficiently improving generalization. In Inter- national Conference on Learning Representations, 2021.
  11. [Frauen et al., 2023] Dennis Frauen, Tobias Hatt, Valentyn Melnychuk, and Stefan Feuerriegel. Estimating average causal effects from patient trajectories. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 7586-7594, 2023.
  12. [Ganin et al., 2016] Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, Franc ¸ois Laviolette, Mario March, and Victor Lempitsky. Domain- adversarial training of neural networks. Journal of ma- chine learning research, 17(59):1-35, 2016.
  13. [Geng et al., 2017] Changran Geng, Harald Paganetti, and Clemens Grassberger. Prediction of treatment response for combined chemo-and radiation therapy for non-small cell lung cancer patients using a bio-mathematical model. Scientific reports, 7(1):13542, 2017.
  14. [Goodfellow et al., 2015] Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy. Explaining and harnessing adversarial examples. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, 2015.
  15. [Hariton and Locascio, 2018] Eduardo Hariton and Joseph J Locascio. Randomised controlled trials-the gold stan- dard for effectiveness research. BJOG: an international journal of obstetrics and gynaecology, 125(13):1716, 2018.
  16. [Hassanpour and Greiner, 2019] Negar Hassanpour and Russell Greiner. Counterfactual regression with impor- tance sampling weights. In IJCAI, pages 5880-5887, 2019. IJCAI
  17. [He et al., 2016] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770-778, 2016.
  18. [Hess et al., 2024] Konstantin Hess, Valentyn Melnychuk, Dennis Frauen, and Stefan Feuerriegel. Bayesian neu- ral controlled differential equations for treatment effect estimation. In The Twelfth International Conference on Learning Representations, 2024.
  19. [Huang and Ning, 2012] Xuelin Huang and Jing Ning. Anal- ysis of multi-stage treatments for recurrent diseases. Statistics in medicine, 31(24):2805-2821, 2012.
  20. [Huang et al., 2024] Qiang Huang, Chuizheng Meng, Defu Cao, Biwei Huang, Yi Chang, and Yan Liu. An empir- ical examination of balancing strategy for counterfactual estimation on time series. In Forty-first International Con- ference on Machine Learning, 2024.
  21. [Johansson et al., 2016] Fredrik Johansson, Uri Shalit, and David Sontag. Learning representations for counterfactual inference. In International conference on machine learn- ing, pages 3020-3029. PMLR, 2016.
  22. [Johansson et al., 2022] Fredrik D Johansson, Uri Shalit, Nathan Kallus, and David Sontag. Generalization bounds and representation learning for estimation of potential out- comes and causal effects. The Journal of Machine Learn- ing Research, 23(1):7489-7538, 2022.
  23. [Li et al., 2021] Rui Li, Stephanie Hu, Mingyu Lu, Yuria Utsumi, Prithwish Chakraborty, Daby M. Sow, Piyush Madan, Jun Li, Mohamed Ghalwash, Zach Shahn, and Li-wei Lehman. G-net: a recurrent network approach to g-computation for counterfactual prediction under a dynamic treatment regime. In Proceedings of Machine Learning for Health, volume 158 of Proceedings of Ma- chine Learning Research, pages 282-299. PMLR, 04 Dec 2021.
  24. [Lim et al., 2018] Bryan Lim, Ahmed Alaa, and Mihaela van der Schaar. Forecasting treatment responses over time using recurrent marginal structural networks. Advances in neural information processing systems, 31, 2018.
  25. [Matsuura and Harada, 2020] Toshihiko Matsuura and Tat- suya Harada. Domain generalization using a mixture of multiple latent domains. In Proceedings of the AAAI conference on artificial intelligence, pages 11749-11756, 2020.
  26. [Melnychuk et al., 2022] Valentyn Melnychuk, Dennis Frauen, and Stefan Feuerriegel. Causal transformer for estimating counterfactual outcomes. In International Conference on Machine Learning, pages 15293-15329.
  27. PMLR, 2022.
  28. [Meng et al., 2023] Chuizheng Meng, Yihe Dong, Sercan Ö Arık, Yan Liu, and Tomas Pfister. Costar: Improved tem- poral counterfactual estimation with self-supervised learn- ing. arXiv preprint arXiv:2311.00886, 2023.
  29. [Motiian et al., 2017] Saeid Motiian, Marco Piccirilli, Don- ald A Adjeroh, and Gianfranco Doretto. Unified deep su- pervised domain adaptation and generalization. In Pro- ceedings of the IEEE international conference on com- puter vision, pages 5715-5725, 2017.
  30. [Muandet et al., 2013] Krikamol Muandet, David Balduzzi, and Bernhard Schölkopf. Domain generalization via in- variant feature representation. In International conference on machine learning, pages 10-18. PMLR, 2013.
  31. [Nie et al., 2020] Lizhen Nie, Mao Ye, Dan Nicolae, et al. VCNet and functional targeted regularization for learning causal effects of continuous treatments. In Proceedings of the 9th International Conference on Learning Representa- tions, 2020.
  32. [Oord et al., 2016] Aaron van den Oord, Sander Diele- man, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. Wavenet: A generative model for raw au- dio. arXiv preprint arXiv:1609.03499, 2016.
  33. [Robins and Hernan, 2008] James Robins and Miguel Her- nan. Estimation of the causal effects of time-varying ex- posures. Chapman & Hall/CRC Handbooks of Modern Statistical Methods, pages 553-599, 2008.
  34. [Robins, 1986] James Robins. A new approach to causal inference in mortality studies with a sustained exposure period-application to control of the healthy worker sur- vivor effect. Mathematical modelling, 7(9-12):1393-1512, 1986.
  35. [Roemhild et al., 2022] Roderich Roemhild, Tobias Bollen- bach, and Dan I Andersson. The physiology and genetics of bacterial responses to antibiotic combinations. Nature Reviews Microbiology, 20(8):478-490, 2022.
  36. [Rubin, 1978] Donald B Rubin. Bayesian inference for causal effects: The role of randomization. The Annals of statistics, pages 34-58, 1978.
  37. [Seedat et al., 2022] Nabeel Seedat, Fergus Imrie, Alexis Bellot, Zhaozhi Qian, and Mihaela van der Schaar. Continuous-time modeling of counterfactual outcomes us- ing neural controlled differential equations. In Interna- tional Conference on Machine Learning, pages 19497- 19521. PMLR, 2022.
  38. [Shalit et al., 2017] Uri Shalit, Fredrik D Johansson, and David Sontag. Estimating individual treatment effect: gen- eralization bounds and algorithms. In International con- ference on machine learning, pages 3076-3085. PMLR, 2017.
  39. [Shi et al., 2021] Yuge Shi, Jeffrey Seely, Philip HS Torr, N Siddharth, Awni Hannun, Nicolas Usunier, and Gabriel Synnaeve. Gradient matching for domain generalization. arXiv preprint arXiv:2104.09937, 2021.
  40. [Taieb and Atiya, 2015] Souhaib Ben Taieb and Amir F Atiya. A bias and variance analysis for multistep-ahead time series forecasting. IEEE transactions on neural net- works and learning systems, 27(1):62-76, 2015.
  41. [Wang et al., 2024] Xin Wang, Shengfei Lyu, Lishan Yang, Yibing Zhan, and Huanhuan Chen. A dual-module frame- work for counterfactual estimation over time. In Forty-first International Conference on Machine Learning, 2024.
  42. [Wang et al., 2025] Xin Wang, Shengfei Lyu, Kangyang Luo, Lishan Yang, Huanhuan Chen, and Chunyan Miao. Enhancing counterfactual estimation: a focus on tempo- ral treatments. In Proceedings of the Thirty-Fourth Inter- national Joint Conference on Artificial Intelligence, pages 6442-6450, 2025. IJCAI
  43. [Xu et al., 2020] Minghao Xu, Jian Zhang, Bingbing Ni, Teng Li, Chengjie Wang, Qi Tian, and Wenjun Zhang. Ad- versarial domain adaptation with domain mixup. In Pro- ceedings of the AAAI conference on artificial intelligence, pages 6502-6509, 2020.
  44. [Zhang et al., 2024] Ruipeng Zhang, Ziqing Fan, Jiangchao Yao, Ya Zhang, and Yanfeng Wang. Domain-inspired sharpness-aware minimization under domain shifts. In The Twelfth International Conference on Learning Representa- tions, 2024.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards