Proceedings

WeatherGNN: Exploiting Meteo- and Spatial-Dependencies for Local Numerical Weather Prediction Bias-Correction

Download BibTeX Cite

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence. Main Track. Pages 2433-2441.

https://doi.org/10.24963/ijcai.2024/269

Abstract

Due to insufficient local area information, numerical weather prediction (NWP) may yield biases for specific areas. Previous studies correct biases mainly by employing handcrafted features or applying data-driven methods intuitively, overlooking the complicated dependencies between weather factors and between areas. To address this issue, we propose WeatherGNN, a local NWP bias-correction method that utilizes Graph Neural Networks (GNNs) to exploit meteorological dependencies and spatial dependencies under the guidance of domain knowledge. Specifically, we introduce a factor GNN to capture area-specific meteorological dependencies adaptively based on spatial heterogeneity and a fast hierarchical GNN to capture dynamic spatial dependencies efficiently guided by Tobler's first and second laws of geography. Our experimental results on two real-world datasets demonstrate that WeatherGNN achieves the state-of-the-art performance, outperforming the best baseline with an average of 4.75 % on RMSE.

  1. [Anselin, 2013] Luc Anselin. Spatial econometrics: meth- ods and models, volume 4. Springer Science & Business Media, 2013.
  2. [Bauer et al., 2015] Peter Bauer, Alan Thorpe, and Gilbert Brunet. The quiet revolution of numerical weather pre- diction. Nature, 525(7567):47-55, September 2015.
  3. [Bi et al., 2023] Kaifeng Bi, Lingxi Xie, Hengheng Zhang, Xin Chen, Xiaotao Gu, and Qi Tian. Accurate medium- range global weather forecasting with 3d neural networks. Nature, pages 1-6, 2023.
  4. [Chen et al., 2023a] Kang Chen, Tao Han, Junchao Gong, Lei Bai, Fenghua Ling, Jing-Jia Luo, Xi Chen, Leiming Ma, Tianning Zhang, Rui Su, et al. Fengwu: Pushing the skillful global medium-range weather forecast beyond 10 days lead. arXiv preprint arXiv:2304.02948, 2023.
  5. [Chen et al., 2023b] Lei Chen, Xiaohui Zhong, Feng Zhang, Yuan Cheng, Yinghui Xu, Yuan Qi, and Hao Li. Fuxi: A cascade machine learning forecasting system for 15-day global weather forecast. arXiv preprint arXiv:2306.12873, 2023.
  6. [Chen et al., 2023c] Ling Chen, Jiahui Xu, Binqing Wu, and Jianlong Huang. Group-aware graph neural network for nationwide city air quality forecasting. ACM Transactions on Knowledge Discovery from Data, 18(3):1-20, 2023.
  7. [Cui et al., 2012] Bo Cui, Zoltan Toth, Yuejian Zhu, and Dingchen Hou. Bias correction for global ensemble fore- cast. Weather and Forecasting, 27(2):396-410, 2012.
  8. [Delle Monache et al., 2006] Luca Delle Monache, Thomas Nipen, Xingxiu Deng, Yongmei Zhou, and Roland Stull. Ozone ensemble forecasts: 2. a kalman filter predictor bias correction. Journal of Geophysical Research: Atmo- spheres, 111(D5), 2006.
  9. [Durai and Bhradwaj, 2014] VR Durai and Rashmi Bhrad- waj. Evaluation of statistical bias correction methods for numerical weather prediction model forecasts of max- imum and minimum temperatures. Natural Hazards, 73:1229-1254, 2014.
  10. [Esmaeilzadeh et al., 2020] Soheil Esmaeilzadeh, Kamyar Azizzadenesheli, Karthik Kashinath, Mustafa Mustafa, Hamdi A Tchelepi, Philip Marcus, Mr Prabhat, An- ima Anandkumar, et al. Meshfreeflownet: A physics- constrained deep continuous space-time super-resolution framework. In SC20: International Conference for High Performance Computing, Networking, Storage and Analy- sis, pages 1-15. IEEE, 2020.
  11. [Gao et al., 2022] Zhihan Gao, Xingjian Shi, Hao Wang, Yi Zhu, Yuyang Bernie Wang, Mu Li, and Dit-Yan Ye- ung. Earthformer: Exploring space-time transformers for earth system forecasting. Advances in Neural Information Processing Systems, 35:25390-25403, 2022.
  12. [Ge et al., 2022] Tao Ge, Jaideep Pathak, Akshay Subra- maniam, and Karthik Kashinath. Dl-corrector-remapper: A grid-free bias-correction deep learning methodology for data-driven high-resolution global weather forecasting. arXiv preprint arXiv:2210.12293, 2022.
  13. [Gneiting and Raftery, 2005] Tilmann Gneiting and Adrian E Raftery. Weather forecasting with ensem- ble methods. Science, 310(5746):248-249, 2005.
  14. [Guibas et al., 2021] John Guibas, Morteza Mardani, Zongyi Li, Andrew Tao, Anima Anandkumar, and Bryan Catan- zaro. Efficient token mixing for transformers via adaptive fourier neural operators. In International Conference on Learning Representations, 2021.
  15. [Guo et al., 2021] Kan Guo, Yongli Hu, Yanfeng Sun, Sean Qian, Junbin Gao, and Baocai Yin. Hierarchical graph convolution network for traffic forecasting. Proceedings of the AAAI Conference on Artificial Intelligence, 35(1):151- 159, 2021.
  16. [Han et al., 2021] Lei Han, Mingxuan Chen, Kangkai Chen, Haonan Chen, Yanbiao Zhang, Bing Lu, Linye Song, and Rui Qin. A deep learning method for bias correction of ecmwf 24-240 h forecasts. Advances in Atmospheric Sci- ences, 38(9):1444-1459, 2021.
  17. [Han et al., 2022] Yan Han, Lihua Mi, Lian Shen, CS Cai, Yuchen Liu, Kai Li, and Guoji Xu. A short-term wind speed prediction method utilizing novel hybrid deep learn- ing algorithms to correct numerical weather forecasting. Applied Energy, 312:118777, 2022.
  18. [Hess et al., 2022] Philipp Hess, Markus Drüke, Stefan Petri, Felix M Strnad, and Niklas Boers. Physically constrained generative adversarial networks for improving precipitation fields from earth system models. Nature Ma- chine Intelligence, 4(10):828-839, 2022.
  19. [Hu et al., 2019] Xiaodan Hu, Mohamed A Naiel, Alexander Wong, Mark Lamm, and Paul Fieguth. Runet: A robust unet architecture for image super-resolution. In Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2019.
  20. [Hu et al., 2021] Shuai Hu, Yue Xiang, Da Huo, Shafqat Jawad, and Junyong Liu. An improved deep belief network based hybrid forecasting method for wind power. Energy, 224:120185, 2021.
  21. [Jiang et al., 2023] Renhe Jiang, Zhaonan Wang, Jiawei Yong, Puneet Jeph, Quanjun Chen, Yasumasa Kobayashi, Xuan Song, Toyotaro Suzumura, and Shintaro Fukushima. Megacrn: Meta-graph convolutional recurrent network for spatio-temporal modeling, 2023.
  22. [Lam et al., 2023] Remi Lam, Alvaro Sanchez-Gonzalez, Matthew Willson, Peter Wirnsberger, Meire Fortunato, Ferran Alet, Suman Ravuri, Timo Ewalds, Zach Eaton- Rosen, Weihua Hu, et al. Learning skillful medium-range global weather forecasting. Science, page eadi2336, 2023.
  23. [Li et al., 2022] Yu Li, Fei Tang, Xin Gao, Tongyan Zhang, Junfeng Qi, Jiarui Xie, Xinang Li, and Yuhan Guo. Nu- merical weather prediction correction strategy for short- term wind power forecasting based on bidirectional gated recurrent unit and xgboost. Frontiers in Energy Research, 9:1014, 2022.
  24. [Liu et al., 2021] Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF in- ternational conference on computer vision, pages 10012- 10022, 2021.
  25. [Ma et al., 2023] Guanghui Ma, Chunming Hu, Ling Ge, and Hong Zhang. Multi-view robust graph representation learning for graph classification. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, pages 4037-4045, 2023. IJCAI
  26. [Miller, 2004] Harvey J Miller. Tobler's first law and spatial analysis. Annals of the association of American geogra- phers, 94(2):284-289, 2004.
  27. [Moran and Moran, 2009] Joseph M. Moran and Joseph M. Moran. Weather Studies : Introduction to Atmospheric Science. American Meteorological Association, Boston, MA, 4th edition, 2009.
  28. [Müller, 2007] Meinard Müller. Dynamic time warping. In- formation retrieval for music and motion, pages 69-84, 2007.
  29. [Nguyen et al., 2023] Tung Nguyen, Johannes Brandstetter, Ashish Kapoor, Jayesh K Gupta, and Aditya Grover. Cli- max: A foundation model for weather and climate. arXiv preprint arXiv:2301.10343, 2023.
  30. [Pathak et al., 2022] Jaideep Pathak, Shashank Subrama- nian, Peter Harrington, Sanjeev Raja, Ashesh Chattopad- hyay, Morteza Mardani, Thorsten Kurth, David Hall, Zongyi Li, Kamyar Azizzadenesheli, et al. Fourcast- net: A global data-driven high-resolution weather model using adaptive fourier neural operators. arXiv preprint arXiv:2202.11214, 2022.
  31. [Rasp et al., 2023] Stephan Rasp, Stephan Hoyer, Alexander Merose, Ian Langmore, Peter Battaglia, Tyler Russel, Al- varo Sanchez-Gonzalez, Vivian Yang, Rob Carver, Shreya Agrawal, et al. Weatherbench 2: A benchmark for the next generation of data-driven global weather models. arXiv preprint arXiv:2308.15560, 2023.
  32. [Ravuri et al., 2021] Suman Ravuri, Karel Lenc, Matthew Willson, Dmitry Kangin, Remi Lam, Piotr Mirowski, Megan Fitzsimons, Maria Athanassiadou, Sheleem Kashem, Sam Madge, et al. Skilful precipitation now- casting using deep generative models of radar. Nature, 597(7878):672-677, 2021.
  33. [Shi et al., 2015] Xingjian Shi, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-kin Wong, and Wang-chun Woo. Convolutional lstm network: A machine learning approach for precipitation nowcasting. In Proceedings of the 28th International Conference on Neural Information Process- ing Systems, page 802-810. MIT Press, 2015.
  34. [Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  35. [Wu et al., 2020] Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and S Yu Philip. A com- prehensive survey on graph neural networks. IEEE trans- actions on neural networks and learning systems, 32(1):4- 24, 2020.
  36. [Wu et al., 2022] Lingfei Wu, Peng Cui, Jian Pei, Liang Zhao, and Xiaojie Guo. Graph neural networks: founda- tion, frontiers and applications. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 4840-4841, 2022.
  37. [Yang et al., 2022] Xiaoying Yang, Shuai Yang, Mou Leong Tan, Hengyang Pan, Hongliang Zhang, Guoqing Wang, Ruimin He, and Zimeng Wang. Correcting the bias of daily satellite precipitation estimates in tropical re- gions using deep neural network. Journal of Hydrology, 608:127656, 2022.
  38. [Yoshikane and Yoshimura, 2022] Takao Yoshikane and Kei Yoshimura. A bias correction method for precipita- tion through recognizing mesoscale precipitation sys- tems corresponding to weather conditions. PLoS Water, 1(5):e0000016, 2022.
  39. [Yu et al., 2018] Bing Yu, Haoteng Yin, and Zhanxing Zhu. Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting. In Proceedings of the International Joint Conference on Artificial Intelli- gence, pages 3634-3640, 2018. IJCAI
  40. [Zhang et al., 2019] Tiejun Zhang, Pengcheng Yan, Zhaorong Li, Yousheng Wang, and Yaohui Li. Bias- correction method for wind-speed forecasting. Meteorol- ogische Zeitschrift, 28(4):293-304, 11 2019.
  41. [Zhang et al., 2023a] Wei Zhang, Yueyue Jiang, Junyu Dong, Xiaojiang Song, Renbo Pang, Boyu Guoan, and Hui Yu. A deep learning method for real-time bias correction of wind field forecasts in the western north pacific. Atmo- spheric Research, 284:106586, 2023.
  42. [Zhang et al., 2023b] Yuchen Zhang, Mingsheng Long, Kaiyuan Chen, Lanxiang Xing, Ronghua Jin, Michael I Jordan, and Jianmin Wang. Skilful nowcasting of extreme precipitation with nowcastnet. Nature, 619(7970):526- 532, 2023.
  43. [Zhou et al., 2020] Jie Zhou, Ganqu Cui, Shengding Hu, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Lifeng Wang, Changcheng Li, and Maosong Sun. Graph neural networks: A review of methods and applications. AI open, 1:57-81, 2020.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards