Proceedings

Attention-based Conditional Random Field for Financial Fraud Detection

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 7822-7830.

https://doi.org/10.24963/ijcai.2025/870

Abstract

Financial fraud detection is critical for market transparency and regulatory compliance. Existing methods often ignore the temporal patterns in financial data, which are essential for understanding dynamic financial behaviors and detecting fraud. Moreover, they also treat companies as independent entities, overlooking the valuable interrelationships. To address these issues, we propose ACRF-RNN, a Recurrent Neural Network (RNN) with Attention-based Conditional Random Field (CRF) for fraud detection. Specifically, we use an RNN with a sliding window to capture temporal dependencies from historical data, and an attention-based CRF feature transformer to model inter-company relationships. This transforms raw financial data into optimized features, fed into a multi-layer perceptron for classification. Besides, we also use the focal loss to alleviate the class imbalance problem caused by rare fraudulent cases. This work presents a novel real-world dataset to evaluate the performance of ACRF-RNN. Extensive experiments show that ACRF-RNN outperforms the state-of-the-art methods by 15.28% in KS and 4.04% in Recall.

Data and code are available at: https://github.com/XNetLab/ACRF-RNN.git.

  1. [Aftabi et al., 2023] Seyyede Zahra Aftabi, Ali Ahmadi, and Saeed Farzi. Fraud detection in financial statements using data mining and gan models. Expert Systems with Appli- cations, 227:120144, 2023.
  2. [Bao et al., 2020] Yang Bao, Bin Ke, Bin Li, Y Julia Yu, and Jie Zhang. Detecting accounting fraud in publicly traded us firms using a machine learning approach. Journal of Accounting Research, 58(1):199-235, 2020.
  3. [Chen and Guestrin, 2016] Tianqi Chen and Carlos Guestrin. XGBoost: A Scalable Tree Boosting System. In Proceed- ings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 785- 794, San Francisco California USA, August 2016. ACM.
  4. [Chen et al., 2018a] Dapeng Chen, Dan Xu, Hongsheng Li, Nicu Sebe, and Xiaogang Wang. Group Consistent Simi- larity Learning via Deep CRF for Person Re-identification. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8649-8658, June 2018.
  5. [Chen et al., 2018b] Liang-Chieh Chen, George Papan- dreou, Iasonas Kokkinos, Kevin Murphy, and Alan L. Yuille. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(4):834-848, April 2018.
  6. [Cheng and Li, 2021] Rui Cheng and Qing Li. Modeling the Momentum Spillover Effect for Stock Prediction via Attribute-Driven Graph Attention Networks. Proceed- ings of the AAAI Conference on Artificial Intelligence, 35(1):55-62, May 2021.
  7. [Cheng et al., 2020] Dawei Cheng, Xiaoyang Wang, Ying Zhang, and Liqing Zhang. Risk Guarantee Prediction in Networked-Loans. In IJCAI International Joint Confer- ence on Artificial Intelligence, page 7, 2020. IJCAI
  8. [Cho et al., 2014] Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. Learning Phrase Representations using RNN Encoder-Decoder for Statisti- cal Machine Translation, September 2014.
  9. [Craja et al., 2020] Patricia Craja, Alisa Kim, and Stefan Lessmann. Deep learning for detecting financial statement fraud. Decision Support Systems, 139:113421, 2020.
  10. [Cucchiara, 2012] Andrew Cucchiara. Applied Logistic Re- gression. Technometrics, 34:358-359, March 2012.
  11. [Gao et al., 2019] Hongchang Gao, Jian Pei, and Heng Huang. Conditional Random Field Enhanced Graph Con- volutional Neural Networks. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pages 276-284, Anchorage AK USA, July 2019. ACM.
  12. [Grandini et al., 2020] Margherita Grandini, Enrico Bagli, and Giorgio Visani. Metrics for Multi-Class Classifica- tion: An Overview, August 2020.
  13. [Hajek and Henriques, 2017] Petr Hajek and Roberto Hen- riques. Mining corporate annual reports for intelligent de- tection of financial statement fraud-a comparative study of machine learning methods. Knowledge-Based Systems, 128:139-152, 2017.
  14. [Hamilton et al., 2017] Will Hamilton, Zhitao Ying, and Jure Leskovec. Inductive Representation Learning on Large Graphs. In Advances in Neural Information Processing Systems, volume 30.
  15. Curran Associates, Inc., 2017.
  16. [Ke et al., 2017] Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In Advances in Neural Informa- tion Processing Systems, volume 30.
  17. Curran Associates, Inc., 2017.
  18. [Kipf and Welling, 2017] Thomas N. Kipf and Max Welling. Semi-Supervised Classification with Graph Convolutional Networks, February 2017.
  19. [Krähenbühl and Koltun, 2011] Philipp Krähenbühl and Vladlen Koltun. Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials. In Advances in Neural Information Processing Systems, volume 24.
  20. Curran Associates, Inc., 2011.
  21. [Lin et al., 2015] Chi-Chen Lin, An-An Chiu, Shaio Yan Huang, and David C Yen. Detecting the financial state- ment fraud: The analysis of the differences between data mining techniques and experts' judgments. Knowledge- Based Systems, 89:459-470, 2015.
  22. [Lin et al., 2017] Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollar. Focal Loss for Dense Ob- ject Detection. In Proceedings of the IEEE international conference on computer vision, pages 2980-2988, 2017.
  23. [Liu et al., 2023] Yajing Liu, Zhengya Sun, and Wensheng Zhang. Improving fraud detection via hierarchical attention-based graph neural network. Journal of Infor- mation Security and Applications, 72:103399, 2023.
  24. [Lv et al., 2025] Xiangwei Lv, Jingyuan Chen, Mengze Li, Yongduo Sui, Zemin Liu, and Beishui Liao. Grasp the key takeaways from source domain for few shot graph domain adaptation. In Proceedings of the ACM on Web Conference 2025, pages 2330-2340, 2025.
  25. [Maas et al., 2013] Andrew L Maas, Awni Y Hannun, and Andrew Y Ng. Rectiper Nonlinearities Improve Neural Network Acoustic Models. In Proceedings of the 30 Th International Conference on Machine Learning, Atlanta, Georgia, USA, 2013.
  26. [Mao et al., 2022a] Xuting Mao, Mingxi Liu, and Yinghui Wang. Using gnn to detect financial fraud based on the re- lated party transactions network. Procedia Computer Sci- ence, 214:351-358, 2022.
  27. [Mao et al., 2022b] Xuting Mao, Hao Sun, Xiaoqian Zhu, and Jianping Li. Financial fraud detection using the related-party transaction knowledge graph. Procedia Com- puter Science, 199:733-740, 2022.
  28. [Mao et al., 2022c] Xuting Mao, Hao Sun, Xiaoqian Zhu, and Jianping Li. Financial fraud detection using the related-party transaction knowledge graph. Procedia Com- puter Science, 199:733-740, 2022.
  29. [Massey and Frank, 1951] J Massey and J Frank. The Kolmogorov-Smirnov test for goodness of fit. Journal of the American statistical Association, 46(253):68-78, 1951.
  30. [Papík and Papíková, 2022] Mário Papík and Lenka Papíková. Detecting accounting fraud in companies re- porting under us gaap through data mining. International Journal of Accounting Information Systems, 45:100559, 2022.
  31. [Rauber et al., 2016] Paulo E Rauber, Alexandre X Falcão, and Alexandru C Telea. Visualizing time-dependent data using dynamic t-sne. In Proceedings of the Eurograph- ics/IEEE VGTC Conference on Visualization: Short Pa- pers, pages 73-77, 2016.
  32. [Ribeiro et al., 2016] Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. "Why Should I Trust You?": Ex- plaining the Predictions of Any Classifier. In Proceed- ings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 1135- 1144, 2016.
  33. [Skousen et al., 2009] Christopher J. Skousen, Kevin R. Smith, and Charlotte J. Wright. Detecting and predicting financial statement fraud: The effectiveness of the fraud triangle and SAS No. 99. In Mark Hirschey, Kose John, and Anil K. Makhija, editors, Advances in Financial Eco- nomics, volume 13, pages 53-81. Emerald Group Publish- ing Limited, January 2009.
  34. [SONG and LU, 2015] Yan-yan SONG and Ying LU. Deci- sion tree methods: Applications for classification and pre- diction. Shanghai Archives of Psychiatry, 27(2):130-135, April 2015.
  35. [Sun et al., 2006] Yanmin Sun, Mohamed S. Kamel, and Yang Wang. Boosting for Learning Multiple Classes with Imbalanced Class Distribution. In Sixth international con- ference on data mining (ICDM'06), pages 592-602. IEEE, 2006.
  36. [Veličković et al., 2018] Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. Graph Attention Networks, February 2018.
  37. [Wang et al., 2021] Yurou Wang, Ruixue Li, and Yanfang Niu. A deep neural network based financial statement fraud detection model: Evidence from china. In Proceed- ings of the 2021 4th Artificial Intelligence and Cloud Com- puting Conference, pages 145-149, 2021.
  38. [Wang et al., 2024] Chenxu Wang, Mengqin Wang, Xi- aoguang Wang, Luyue Zhang, and Yi Long. Multi- relational graph representation learning for financial state- ment fraud detection. Big Data Mining and Analytics, 7(3):920-941, 2024.
  39. [Wang et al., 2025] Xiaoguang Wang, Chenxu Wang, Huan- long Liu, Mengqin Wang, Tao Qin, and Pinghui Wang. Figraph: A dynamic heterogeneous graph dataset for fi- nancial anomaly detection. In Companion Proceedings of the ACM on Web Conference 2025, pages 813-816, 2025.
  40. [Xu et al., 2021] Bingbing Xu, Huawei Shen, Bingjie Sun, Rong An, Qi Cao, and Xueqi Cheng. Towards consumer loan fraud detection: Graph neural networks with role- constrained conditional random field. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 4537-4545, 2021.
  41. [Yao et al., 2018] Jianrong Yao, Jie Zhang, and Lu Wang. A financial statement fraud detection model based on hybrid data mining methods. In 2018 international conference on artificial intelligence and big data (ICAIBD), pages 57-61. IEEE, 2018.
  42. [Zhang et al., 2021] Yanci Zhang, Tianming Du, Yujie Sun, Lawrence Donohue, and Rui Dai. Form 10-Q Itemization. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pages 4817- 4822, Virtual Event Queensland Australia, October 2021. ACM.
  43. [Zhu et al., 2021] Xiaoqian Zhu, Xiang Ao, Zidi Qin, Yan- peng Chang, Yang Liu, Qing He, and Jianping Li. Intel- ligent financial fraud detection practices in post-pandemic era. The Innovation, 2(4):100176, November 2021.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards