Proceedings

Endowing Interpretability for Neural Cognitive Diagnosis by Efficient Kolmogorov-Arnold Networks

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 7894-7903.

https://doi.org/10.24963/ijcai.2025/878

Abstract

Cognitive diagnosis is crucial for intelligent education because of its ability to reveal students' proficiency in knowledge concepts. Although neural network-based neural cognitive diagnosis models (CDMs) have exhibited significantly better performance than traditional models, neural cognitive diagnosis is criticized for the poor model interpretability due to the multi-layer perceptron(MLP) employed, even with the monotonicity assumption. Therefore, this paper proposes to empower the interpretability of neural cognitive diagnosis models through efficient Kolmogorov-Arnold networks (KANs), named KAN2CD, where KANs are used to enhance interpretability in two manners. Specifically, in the first manner, KANs are directly used to replace the used MLPs in existing neural CDMs; while in the second manner, the student embedding, exercise embedding, and concept embedding are directly processed by several KANs, and then their outputs are further combined and learned in a unified KAN to get final predictions. Besides, the implementation of original KANs is modified without affecting the interpretability to overcome the problem of training KANs slowly. Extensive experiments show KAN2CD outperforms traditional CDMs and slightly surpasses existing neural CDMs, and its learned structures ensure interpretability on par with traditional CDMs and better than neural CDMs. The datasets, associated code, and more experimental results are available at https://github.com/null233QAQ/KAN2CD.

  1. [AICFE, 2018] AICFE. Frcsub dataset. http://staff.ustc.edu. cn/%7Eqiliuql/data/math2015.rar, 2018. Link
  2. [Anderson et al., 2014] Ashton Anderson, Daniel Hutten- locher, Jon Kleinberg, and Jure Leskovec. Engaging with massive online courses. In Proceedings of the 23rd Inter- national Conference on World Wide Web, pages 687-698, 2014.
  3. [Beck, 2007] Joseph Beck. Difficulties in inferring student knowledge from observations (and why you should care). In Proceedings of the 13rd International Conference of Artificial Intelligence in Education, pages 21-30, 2007.
  4. [Braun and Griebel, 2009] Jürgen Braun and Michael Griebel. On a constructive proof of kolmogorov's superposition theorem. Constructive approximation, 30:653-675, 2009.
  5. [Chang et al., 2015] Haw-Shiuan Chang, Hwai-Jung Hsu, Kuan-Ta Chen, et al. Modeling exercise relationships in e- learning: A unified approach. In Proceedings of the 2015 In- ternational Educational Data Mining Society (EDM, pages 532-535, 2015.
  6. [De Boer et al., 2005] Pieter-Tjerk De Boer, Dirk P Kroese, Shie Mannor, and Reuven Y Rubinstein. A tutorial on the cross-entropy method. Annals of operations research, 134:19-67, 2005.
  7. [Embretson and Reise, 2013] Susan E Embretson and Steven P Reise. Item Response Theory. Psychology Press, 2013.
  8. [Fan et al., 2021] Feng-Lei Fan, Jinjun Xiong, Mengzhou Li, and Ge Wang. On interpretability of artificial neural net- works: A survey. IEEE Transactions on Radiation and Plasma Medical Sciences, 5(6):741-760, 2021.
  9. [Feng et al., 2009] Mingyu Feng, Neil Heffernan, and Ken- neth Koedinger. Addressing the assessment challenge with an online system that tutors as it assesses. User Modeling and User-adapted Interaction, 19(3):243-266, 2009.
  10. [Gao et al., 2021] Weibo Gao, Qi Liu, Zhenya Huang, Yu Yin, Haoyang Bi, Mu-Chun Wang, Jianhui Ma, Shijin Wang, and Yu Su. Rcd: Relation map driven cognitive diagnosis for intelligent education systems. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 501-510, 2021.
  11. [Hu et al., 2023] Liya Hu, Zhiang Dong, Jingyuan Chen, Guifeng Wang, Zhihua Wang, Zhou Zhao, and Fei Wu. Ptadisc: A cross-course dataset supporting personalized learning in cold-start scenarios. In Proceedings of the 37th Conference on Neural Information Processing Sys- tems Datasets and Benchmarks Track, 2023.
  12. [Jang et al., 2016] Eric Jang, Shixiang Gu, and Ben Poole. Categorical reparameterization with gumbel-softmax. arXiv preprint arXiv:1611.01144, 2016.
  13. [Kingma and Ba, 2014] Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
  14. [Koren et al., 2009] Yehuda Koren, Robert Bell, and Chris Volinsky. Matrix factorization techniques for recommender systems. Computer, 42(8):30-37, 2009.
  15. [Li, 2024] Ziyao Li. Kolmogorov-arnold networks are radial basis function networks. 2024.
  16. [Liu et al., 2024a] Ziming Liu, Pingchuan Ma, Yixuan Wang, Wojciech Matusik, and Max Tegmark. Kan 2.0: Kolmogorov-arnold networks meet science. arXiv preprint arXiv:2408.10205, 2024.
  17. [Liu et al., 2024b] Ziming Liu, Yixuan Wang, Sachin Vaidya, Fabian Ruehle, James Halverson, Marin Soljačić, Thomas Y Hou, and Max Tegmark. Kan: Kolmogorov- arnold networks. arXiv preprint arXiv:2404.19756, 2024.
  18. [Lu et al., 2021] Yu Lu, Yang Pian, Ziding Shen, Penghe Chen, and Xiaoqing Li. SLP: A multi-dimensional and consecutive dataset from K-12 education. In Proceedings of the 29th International Conference on Computers in Edu- cation Conference, volume 1, pages 261-266, 2021.
  19. [Ma et al., 2022] Haiping Ma, Manwei Li, Le Wu, Haifeng Zhang, Yunbo Cao, Xingyi Zhang, and Xuemin Zhao. Knowledge-sensed cognitive diagnosis for intelligent edu- cation platforms. In Proceedings of the 31st ACM Interna- tional Conference on Information & Knowledge Manage- ment, pages 1451-1460, 2022.
  20. [Nabizadeh et al., 2020] Amir Hossein Nabizadeh, José Paulo Leal, Hamed N Rafsanjani, and Rajiv Ratn Shah. Learning path personalization and recommendation methods: A survey of the state-of-the-art. Expert Systems with Applications, 159:113596, 2020.
  21. [Patikorn et al., 2018] Thanaporn Patikorn, Neil T Heffernan, and Ryan S Baker. Assistments longitudinal data mining competition 2017: A preface. In Proceedings of the 2018 In- ternational Conference on Educational Data Mining, 2018.
  22. [Peng et al., 2024] Yanhong Peng, Miao He, Fangchao Hu, Zebing Mao, Xia Huang, and Jun Ding. Predictive mod- eling of flexible ehd pumps using kolmogorov-arnold net- works. arXiv preprint arXiv:2405.07488, 2024.
  23. [Qian et al., 2024] Hong Qian, Shuo Liu, Mingjia Li, Bing- dong Li, Zhi Liu, and Aimin Zhou. Orcdf: An oversmoothing-resistant cognitive diagnosis framework for student learning in online education systems. In Proceed- ings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 2455-2466, 2024.
  24. [Reckase, 2009] Mark D Reckase. Multidimensional Item Response Theory Models. Springer, 2009.
  25. [Samek et al., 2016] Wojciech Samek, Alexander Binder, Grégoire Montavon, Sebastian Lapuschkin, and Klaus- Robert Müller. Evaluating the visualization of what a deep neural network has learned. IEEE Transactions on Neural Networks and Learning Systems, 28(11):2660-2673, 2016.
  26. [Shen et al., 2024] Junhao Shen, Hong Qian, Shuo Liu, Wei Zhang, Bo Jiang, and Aimin Zhou. Capturing homogeneous influence among students: Hypergraph cognitive diagnosis for intelligent education systems. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 2628-2639, 2024.
  27. [Somvanshi et al., 2024] Shriyank Somvanshi, Syed Aaqib Javed, Md Monzurul Islam, Diwas Pandit, and Subasish Das. A survey on kolmogorov-arnold network. arXiv preprint arXiv:2411.06078, 2024.
  28. [Stojanoski et al., 2018] Bobby Stojanoski, Kathleen M Lyons, Alexandra AA Pearce, and Adrian M Owen. Tar- geted training: Converging evidence against the transfer- able benefits of online brain training on cognitive function. Neuropsychologia, 117:541-550, 2018.
  29. [Torre and J., 2009] D. L. Torre and J. Dina model and pa- rameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34(1):115-130, 2009.
  30. [Urdaneta-Ponte et al., 2021] María Cora Urdaneta-Ponte, Amaia Mendez-Zorrilla, and Ibon Oleagordia-Ruiz. Rec- ommendation systems for education: Systematic review. Electronics, 10(14):1611, 2021.
  31. [Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017.
  32. [Wang et al., 2020] Fei Wang, Qi Liu, Enhong Chen, Zhenya Huang, Yuying Chen, Yu Yin, Zai Huang, and Shijin Wang. Neural cognitive diagnosis for intelligent education systems. In Proceedings of the 2020 AAAI Conference on Artificial Intelligence, volume 34, pages 6153-6161, 2020.
  33. [Wang et al., 2022] Fei Wang, Qi Liu, Enhong Chen, Zhenya Huang, Yu Yin, Shijin Wang, and Yu Su. Neuralcd: a gen- eral framework for cognitive diagnosis. IEEE Transactions on Knowledge and Data Engineering, 2022.
  34. [Wang et al., 2024] Fei Wang, Weibo Gao, Qi Liu, Jiatong Li, Guanhao Zhao, Zheng Zhang, Zhenya Huang, Mengxiao Zhu, Shijin Wang, Wei Tong, et al. A survey of models for cognitive diagnosis: New developments and future direc- tions. arXiv preprint arXiv:2407.05458, 2024.
  35. [Wu et al., 2024] Siyu Wu, Yang Cao, Jiajun Cui, Runze Li, Hong Qian, Bo Jiang, and Wei Zhang. A comprehensive exploration of personalized learning in smart education: From student modeling to personalized recommendations. arXiv preprint arXiv:2402.01666, 2024.
  36. [Yang et al., 2023] Shangshang Yang, Haoyu Wei, Haiping Ma, Ye Tian, Xingyi Zhang, Yunbo Cao, and Yaochu Jin. Cognitive diagnosis-based personalized exercise group as- sembly via a multi-objective evolutionary algorithm. IEEE Transactions on Emerging Topics in Computational Intelli- gence, 7(3):829-844, 2023.
  37. [Yu et al., 2024a] Xiaoshan Yu, Chuan Qin, Dazhong Shen, Haiping Ma, Le Zhang, Xingyi Zhang, Hengshu Zhu, and Hui Xiong. Rdgt: enhancing group cognitive diagnosis with relation-guided dual-side graph transformer. IEEE Transactions on Knowledge and Data Engineering, 2024.
  38. [Yu et al., 2024b] Xiaoshan Yu, Chuan Qin, Dazhong Shen, Shangshang Yang, Haiping Ma, Hengshu Zhu, and Xingyi Zhang. Rigl: A unified reciprocal approach for tracing the independent and group learning processes. In Proceed- ings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 4047-4058, 2024.
  39. [Yu et al., 2024c] Xiaoshan Yu, Chuan Qin, Qi Zhang, Chen Zhu, Haiping Ma, Xingyi Zhang, and Hengshu Zhu. Disco: A hierarchical disentangled cognitive diagnosis framework for interpretable job recommendation. In IEEE Interna- tional Conference on Data Mining (ICDM) 2024, 2024.
  40. Zhang et al., ] Zheng Zhang, Wei Song, Qi Liu, Qingyang Mao, Yiyan Wang, Weibo Gao, Zhenya Huang, Shijin Wang, and Enhong Chen. Towards accurate and fair cog- nitive diagnosis via monotonic data augmentation. In The Thirty-eighth Annual Conference on Neural Information Processing Systems.
  41. [Zhang et al., 2021] Yu Zhang, Peter Tiňo, Aleš Leonardis, and Ke Tang. A survey on neural network interpretability. IEEE Transactions on Emerging Topics in Computational Intelligence, 5(5):726-742, 2021.
  42. [Zhang et al., 2023] Zheng Zhang, Qi Liu, Hao Jiang, Fei Wang, Yan Zhuang, Le Wu, Weibo Gao, and Enhong Chen. Fairlisa: fair user modeling with limited sensitive attributes information. In Proceedings of the 37th International Con- ference on Neural Information Processing Systems, pages 41432-41450, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards