Proceedings

CRAFT: Time Series Forecasting with Cross-Future Behavior Awareness

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 7056-7064.

https://doi.org/10.24963/ijcai.2025/785

Abstract

The past decades witness the significant advancements in time series forecasting (TSF) across various real-world domains, including e-commerce and disease spread prediction. However, TSF is usually constrained by the uncertainty dilemma of predicting future data with limited past observations. To settle this question, we explore the use of Cross-Future Behavior (CFB) in TSF, which occurs before the current time but takes effect in the future. We leverage CFB features and propose the CRoss-Future Behavior Awareness based Time Series Forecasting method (CRAFT). The core idea of CRAFT is to utilize the trend of cross-future behavior to mine the trend of time series data to be predicted. Specifically, to settle the sparse and partial flaws of cross-future behavior, CRAFT employs the Koopman Predictor Module to extract the key trend and the Internal Trend Mining Module to supplement the unknown area of the cross-future behavior matrix. Then, we introduce the External Trend Guide Module with a hierarchical structure to acquire more representative trends from higher levels. Finally, we apply the demand-constrained loss to calibrate the distribution deviation of prediction results. We conduct experiments on real-world dataset. Experiments on both offline large-scale dataset and online A/B test demonstrate the effectiveness of CRAFT. Our dataset and code are available at https://github.com/CRAFTinTSF/CRAFT.

  1. [Avati et al., 2020] Anand Avati, Tony Duan, Sharon Zhou, Kenneth Jung, Nigam H Shah, and Andrew Y Ng. Count- down regression: sharp and calibrated survival predictions. In Uncertainty in Artificial Intelligence, pages 145-155.
  2. PMLR, 2020.
  3. [Bai et al., 1803] Shaojie Bai, J Zico Kolter, and Vladlen Koltun. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arxiv 2018. arXiv preprint arXiv:1803.01271, 2(1803):8, 1803.
  4. [Chen et al., 2020] Yitian Chen, Yanfei Kang, Yixiong Chen, and Zizhuo Wang. Probabilistic forecasting with temporal convolutional neural network. Neurocomputing, 399:491-501, 2020.
  5. [Gao et al., 2022] Chengliang Gao, Fan Zhang, Yue Zhou, Ronggen Feng, Qiang Ru, Kaigui Bian, Renqing He, and Zhizhao Sun. Applying deep learning based probabilistic forecasting to food preparation time for on-demand deliv- ery service. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 2924-2934, 2022.
  6. [Glorot and Bengio, 2010] Xavier Glorot and Yoshua Ben- gio. Understanding the difficulty of training deep feedfor- ward neural networks. In Proceedings of the thirteenth in- ternational conference on artificial intelligence and statis- tics, pages 249-256. JMLR Workshop and Conference Proceedings, 2010.
  7. [Hu et al., 2024] Xuanming Hu, Wei Fan, Haifeng Chen, Pengyang Wang, and Yanjie Fu. Reconstructing missing variables for multivariate time series forecasting via con- ditional generative flows. In Proceedings of the 33rd In- ternational Joint Conference on Artificial Intelligence (IJ- CAI), Jeju, Korea, 2024. IJCAI
  8. [Koopman, 1931] Bernard O Koopman. Hamiltonian sys- tems and transformation in hilbert space. Proceedings of the National Academy of Sciences, 17(5):315-318, 1931.
  9. [Li et al., 2024] Yuxin Li, Wenchao Chen, Xinyue Hu, Bo Chen, Mingyuan Zhou, et al. Transformer-modulated diffusion models for probabilistic multivariate time series forecasting. In The Twelfth International Conference on Learning Representations, 2024.
  10. [Lim et al., 2021] Bryan Lim, Sercan Ö Arık, Nicolas Lo- eff, and Tomas Pfister. Temporal fusion transformers for interpretable multi-horizon time series forecasting. Inter- national Journal of Forecasting, 37(4):1748-1764, 2021.
  11. [Liu et al., 2020] Fan Liu, Xingshe Zhou, Jinli Cao, Zhu Wang, Tianben Wang, Hua Wang, and Yanchun Zhang. Anomaly detection in quasi-periodic time series based on automatic data segmentation and attentional lstm-cnn. IEEE Transactions on Knowledge and Data Engineering, 34(6):2626-2640, 2020.
  12. [Liu et al., 2021] Shizhan Liu, Hang Yu, Cong Liao, Jian- guo Li, Weiyao Lin, Alex X Liu, and Schahram Dust- dar. Pyraformer: Low-complexity pyramidal attention for long-range time series modeling and forecasting. In Inter- national conference on learning representations, 2021.
  13. [Liu et al., 2024a] Yong Liu, Tengge Hu, Haoran Zhang, Haixu Wu, Shiyu Wang, Lintao Ma, and Mingsheng Long. itransformer: Inverted transformers are effective for time series forecasting. In The Twelfth International Confer- ence on Learning Representations, 2024.
  14. [Liu et al., 2024b] Yong Liu, Chenyu Li, Jianmin Wang, and Mingsheng Long. Koopa: Learning non-stationary time series dynamics with koopman predictors. Advances in Neural Information Processing Systems, 36, 2024.
  15. [Lu et al., 2022] Yucheng Lu, Qiang Ji, Liang Wang, Tian- shu Wu, Hongbo Deng, Jian Xu, and Bo Zheng. Star- dom: semantic aware deep hierarchical forecasting model for search traffic prediction. In Proceedings of the 31st ACM International Conference On Information & Knowl- edge Management, pages 3352-3360, 2022.
  16. [Mendis et al., 2024] Kasun Mendis, Manjusri Wickramas- inghe, and Pasindu Marasinghe. Multivariate time series forecasting: A review. In Proceedings of the 2024 2nd Asia Conference on Computer Vision, Image Processing and Pattern Recognition, pages 1-9, 2024.
  17. [Mossop and Rahman, 2023] Brandon Mossop and Quazi Abidur Rahman. Infectious disease forecast- ing using multivariate incomplete time-series: A hybrid architecture with stacked dilated causal convolutions. In 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pages 4220-4227. IEEE, 2023.
  18. [Nie et al., 2024] Yuqi Nie, Nam H Nguyen, Phanwadee Sinthong, and Jayant Kalagnanam. A time series is worth 64 words: Long-term forecasting with transformers. In The Eleventh International Conference on Learning Rep- resentations, 2024.
  19. [Oord et al., 2016] Aaron van den Oord, Sander Diele- man, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. Wavenet: A generative model for raw au- dio. arXiv preprint arXiv:1609.03499, 2016.
  20. [Rasul et al., 2024] Kashif Rasul, Andrew Bennett, Pablo Vicente, Umang Gupta, Hena Ghonia, Anderson Schnei- der, and Yuriy Nevmyvaka. Vq-tr: Vector quantized at- tention for time series forecasting. In The Twelfth Interna- tional Conference on Learning Representations, 2024.
  21. [Salinas et al., 2020] David Salinas, Valentin Flunkert, Jan Gasthaus, and Tim Januschowski. Deepar: Probabilistic forecasting with autoregressive recurrent networks. Inter- national Journal of Forecasting, 36(3):1181-1191, 2020.
  22. [Shetty and Ismail, 2023] Dileep Kumar Shetty and B Is- mail. Forecasting stock prices using hybrid non-stationary time series model with ernn. Communications in Statistics-Simulation and Computation, 52(3):1026-1040, 2023.
  23. [Wang et al., 2019] Yuyang Wang, Alex Smola, Danielle Maddix, Jan Gasthaus, Dean Foster, and Tim Januschowski. Deep factors for forecasting. In In- ternational conference on machine learning, pages 6607-6617. PMLR, 2019.
  24. [Wang et al., 2024] Xue Wang, Tian Zhou, Qingsong Wen, Jinyang Gao, Bolin Ding, and Rong Jin. Card: Channel aligned robust blend transformer for time series forecast- ing. In The Twelfth International Conference on Learning Representations, 2024.
  25. [Wen et al., 2017] Ruofeng Wen, Kari Torkkola, Balakrish- nan Narayanaswamy, and Dhruv Madeka. A multi- horizon quantile recurrent forecaster. arXiv preprint arXiv:1711.11053, 2017.
  26. [Wen et al., 2023] Qingsong Wen, Tian Zhou, Chaoli Zhang, Weiqi Chen, Ziqing Ma, Junchi Yan, and Liang Sun. Transformers in time series: a survey. In Proceedings of the Thirty-Second International Joint Conference on Arti- ficial Intelligence, pages 6778-6786, 2023. IJCAI
  27. [Wu et al., 2021] Haixu Wu, Jiehui Xu, Jianmin Wang, and Mingsheng Long. Autoformer: Decomposition transform- ers with auto-correlation for long-term series forecast- ing. Advances in neural information processing systems, 34:22419-22430, 2021.
  28. [Yang et al., 2024] Yingnan Yang, Qingling Zhu, and Jiany- ong Chen. Vcformer: Variable correlation transformer with inherent lagged correlation for multivariate time se- ries forecasting. Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI), Jeju, Korea, 2024. IJCAI
  29. [Yin et al., 2022] Changchang Yin, Sayoko E Moroi, and Ping Zhang. Predicting age-related macular degenera- tion progression with contrastive attention and time-aware lstm. In Proceedings of the 28th ACM SIGKDD Confer- ence on Knowledge Discovery and Data Mining, pages 4402-4412, 2022.
  30. [Zeng et al., 2023] Ailing Zeng, Muxi Chen, Lei Zhang, and Qiang Xu. Are transformers effective for time series fore- casting? In Proceedings of the AAAI conference on artifi- cial intelligence, volume 37, pages 11121-11128, 2023.
  31. [Zhang et al., 2025] Yingwei Zhang, Ke Bu, Zhuoran Zhuang, Tao Xie, Yao Yu, Dong Li, Yang Guo, and De- tao Lv. Craft: Time series forecasting with cross-future behavior awareness, 2025.
  32. [Zhao and Shen, 2024] Lifan Zhao and Yanyan Shen. Re- thinking channel dependence for multivariate time series forecasting: Learning from leading indicators. In The Twelfth International Conference on Learning Represen- tations, 2024.
  33. [Zhou et al., 2021] Haoyi Zhou, Shanghang Zhang, Jieqi Peng, Shuai Zhang, Jianxin Li, Hui Xiong, and Wan- cai Zhang. Informer: Beyond efficient transformer for long sequence time-series forecasting. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pages 11106-11115, 2021.
  34. [Zhou et al., 2022] Tian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang, Liang Sun, and Rong Jin. Fedformer: Fre- quency enhanced decomposed transformer for long-term series forecasting. In International conference on machine learning, pages 27268-27286. PMLR, 2022.
  35. [Zhu et al., 2023] Ruitao Zhu, Detao Lv, Yao Yu, Ruihao Zhu, Zhenzhe Zheng, Ke Bu, Quan Lu, and Fan Wu. Linet: A location and intention-aware neural network for hotel group recommendation. In Proceedings of the ACM Web Conference 2023, pages 779-789, 2023.
  36. [Zonghan et al., 2019] Wu Zonghan, Pan Shirui, Long Guodong, Jiang Jing, and Zhang Chengqi. Graph wavenet for deep spatial-temporal graph modeling. In Proceed- ings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI 2019, Macao, China, Au- gust 10-16, 2019, pages 1907-1913, 2019. IJCAI

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards