Proceedings

CoderAgent: Simulating Student Behavior for Personalized Programming Learning with Large Language Models

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 293-301.

https://doi.org/10.24963/ijcai.2025/34

Abstract

Personalized programming tutoring, such as exercise recommendation, can enhance learners' efficiency, motivation, and outcomes, which is increasingly important in modern digital education. However, the lack of sufficient and high-quality programming data, combined with the mismatch between offline evaluation and real-world learning, hinders the practical deployment of such systems. To address this challenge, many approaches attempt to simulate learner practice data, yet they often overlook the fine-grained, iterative nature of programming learning, resulting in a lack of interpretability and granularity. To fill this gap, we propose a LLM-based agent, CoderAgent, to simulate students' programming processes in a fine-grained manner without relying on real data. Specifically, we equip each human learner with an intelligent agent, the core of which lies in capturing the cognitive states of the human programming practice process. Inspired by ACT-R, a cognitive architecture framework, we design the structure of CoderAgent to align with human cognitive architecture by focusing on the mastery of programming knowledge and the application of coding ability. Recognizing the inherent patterns in multi-layered cognitive reasoning, we introduce the Programming Tree of Thought (PTOT), which breaks down the process into four steps: why, how, where, and what. This approach enables a detailed analysis of iterative problem-solving strategies. Finally, experimental evaluations on real-world datasets demonstrate that CoderAgent provides interpretable insights into learning trajectories and achieves accurate simulations, paving the way for personalized programming education.

  1. [Aher et al., 2023] Gati V Aher, Rosa I Arriaga, and Adam Tauman Kalai. Using large language models to sim- ulate multiple humans and replicate human subject studies. In International Conference on Machine Learning, pages 337-371. PMLR, 2023.
  2. [Anderson and Lebiere, 2014] John R Anderson and Chris- tian J Lebiere. The atomic components of thought. Psy- chology Press, 2014.
  3. [Berges et al., 2012] Marc Berges, Andreas Mühling, and Peter Hubwieser. The gap between knowledge and abil- ity. In Proceedings of the 12th Koli Calling international conference on computing education research, pages 126- 134, 2012.
  4. [Chen and Yen, 2024] Mao-Siang Chen and An-Zi Yen. E- qgen: Educational lecture abstract-based question genera- tion system. In Proceedings of the Thirty-Third Interna- tional Joint Conference on Artificial Intelligence, IJCAI- 24, pages 8631-8634. International Joint Conferences on Artificial Intelligence Organization, 8 2024. Demo Track.
  5. [Choi and Lee, 2009] Insu Choi and Kyounghee Lee. De- signing and implementing a case -based learning envi- ronment for enhancing ill -structured problem solving: classroom management problems for prospective teach- ers. Educational Technology Research and Development, 57(1):99-129, 2009.
  6. [Corbett and Anderson, 1994] Albert T Corbett and John R Anderson. Knowledge tracing: Modeling the acquisi- tion of procedural knowledge. User modeling and user- adapted interaction, 4:253-278, 1994.
  7. [Feng et al., 2020] Zhangyin Feng, Daya Guo, Duyu Tang, Nan Duan, Xiaocheng Feng, Ming Gong, Linjun Shou, Bing Qin, Ting Liu, Daxin Jiang, et al. Codebert: A pre-trained model for programming and natural languages. arXiv preprint arXiv:2002.08155, 2020.
  8. [Gao and Zhu, 2023] Yazhuo Gao and Xuehua Zhu. Re- search on the learning experience of virtual simulation class experimental teaching and learning based on the per- spective of nursing students. BMC nursing, 22(1):367, 2023.
  9. [Gao et al., 2021] Weibo Gao, Qi Liu, Zhenya Huang, Yu Yin, Haoyang Bi, Mu-Chun Wang, Jianhui Ma, Shi- jin Wang, and Yu Su. Rcd: Relation map driven cognitive diagnosis for intelligent education systems. In Proceed- ings of the 44th international ACM SIGIR conference on research and development in information retrieval, pages 501-510, 2021.
  10. [Gao et al., 2025a] Weibo Gao, Qi Liu, Rui Li, Yuze Zhao, Hao Wang, Linan Yue, Fangzhou Yao, and Zheng Zhang. Denoising programming knowledge tracing with a code graph-based tuning adaptor. In Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V. 1, pages 354-365, 2025.
  11. [Gao et al., 2025b] Weibo Gao, Qi Liu, Linan Yue, Fangzhou Yao, Rui Lv, Zheng Zhang, Hao Wang, and Zhenya Huang. Agent4edu: Generating learner re- sponse data by generative agents for intelligent education systems. arXiv preprint arXiv:2501.10332, 2025.
  12. [Hillier et al., 2024] Dylan Hillier, Cheston Tan, and Jing Jiang. Social learning through interactions with other agents: A survey. In Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, IJCAI-24, pages 8067-8076. International Joint Confer- ences on Artificial Intelligence Organization, 8 2024. Sur- vey Track. IJCAI
  13. [Hochreiter, 1997] S Hochreiter. Long short-term memory. Neural Computation MIT-Press, 1997.
  14. [Hu et al., 2024] Yuxuan Hu, Gemju Sherpa, Lan Zhang, Weihua Li, Quan Bai, Yijun Wang, and Xiaodan Wang. An llm-enhanced agent-based simulation tool for information propagation. In Proceedings of the Thirty-Third Interna- tional Joint Conference on Artificial Intelligence, IJCAI- 24, pages 8679-8682. International Joint Conferences on Artificial Intelligence Organization, 8 2024. Demo Track. IJCAI
  15. [Huang et al., 2023] Xu Huang, Jianxun Lian, Yuxuan Lei, Jing Yao, Defu Lian, and Xing Xie. Recommender ai agent: Integrating large language models for interac- tive recommendations. arXiv preprint arXiv:2308.16505, 2023.
  16. [Li et al., 2022] Ruixin Li, Yu Yin, Le Dai, Shuanghong Shen, Xin Lin, Yu Su, and Enhong Chen. Pst: measuring skill proficiency in programming exercise process via pro- gramming skill tracing. In Proceedings of the 45th Inter- national ACM SIGIR Conference on Research and Devel- opment in Information Retrieval, pages 2601-2606, 2022.
  17. [Li et al., 2024] Qian Li, Zhuo Chen, Cheng Ji, Shiqi Jiang, and Jianxin Li. Llm-based multi-level knowledge gen- eration for few-shot knowledge graph completion. In Proceedings of the Thirty-Third International Joint Con- ference on Artificial Intelligence, IJCAI-24, pages 2135- 2143. International Joint Conferences on Artificial Intelli- gence Organization, 8 2024. Main Track. IJCAI
  18. [Liang et al., 2022] Y. Liang, T. Peng, Y. Pu, et al. Help- dkt: an interpretable cognitive model of how students learn programming based on deep knowledge tracing. Scientific Reports, 12:4012, 2022.
  19. [Liu et al., 2021a] Qi Liu, Zhenya Huang, Yu Yin, En- hong Chen, Hui Xiong, Yu Su, and Guoping Hu. Ekt: Exercise-aware knowledge tracing for student perfor- mance prediction. IEEE Trans. on Knowl. and Data Eng., 33(1):100-115, 2021.
  20. [Liu et al., 2021b] Qi Liu, Shuanghong Shen, Zhenya Huang, Enhong Chen, and Yonghe Zheng. A survey of knowledge tracing. CoRR, abs/2105.15106, 2021.
  21. [Liu et al., 2022] Naiming Liu, Zichao Wang, Richard Bara- niuk, and Andrew Lan. Open-ended knowledge tracing for computer science education. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022.
  22. [Marwan et al., 2019] Samiha Marwan, Joseph Jay Williams, and Thomas Price. An evaluation of the impact of automated programming hints on per- formance and learning. In Proceedings of the 2019 ACM Conference on International Computing Education Research, pages 61-70, 2019.
  23. [McKeithen et al., 1981] Katherine B McKeithen, Judith S Reitman, Henry H Rueter, and Stephen C Hirtle. Knowl- edge organization and skill differences in computer pro- grammers. Cognitive Psychology, 13(3):307-325, 1981.
  24. [Park et al., 2023] Joon Sung Park, Joseph O'Brien, Car- rie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interactive sim- ulacra of human behavior. In Proceedings of the 36th an- nual acm symposium on user interface software and tech- nology, pages 1-22, 2023.
  25. [Park et al., 2024] Minju Park, Sojung Kim, Seunghyun Lee, Soonwoo Kwon, and Kyuseok Kim. Empowering per- sonalized learning through a conversation-based tutoring system with student modeling. In Extended Abstracts of the CHI Conference on Human Factors in Computing Sys- tems, pages 1-10, 2024.
  26. [Piech et al., 2015] Chris Piech, Jonathan Bassen, Jonathan Huang, Surya Ganguli, Mehran Sahami, Leonidas J Guibas, and Jascha Sohl-Dickstein. Deep knowledge trac- ing. Advances in neural information processing systems, 28, 2015.
  27. [Puri et al., 2021] Ruchir Puri, David S Kung, Geert Janssen, Wei Zhang, Giacomo Domeniconi, Vladimir Zolotov, Ju- lian Dolby, Jie Chen, Mihir Choudhury, Lindsey Decker, et al. Codenet: A large-scale ai for code dataset for learning a diversity of coding tasks. arXiv preprint arXiv:2105.12655, 2021.
  28. [Qadir, 2023] Junaid Qadir. Engineering education in the era of chatgpt: Promise and pitfalls of generative ai for edu- cation. In 2023 IEEE Global Engineering Education Con- ference (EDUCON), pages 1-9. IEEE, 2023.
  29. [Reddy et al., 2022] Surendranadha Reddy Byrapu Reddy, Prabu Ravichandran, Srihari Maruthi, Mohan Raparthi, Praveen Thunki, and Sarath Babu Dodda. Ethical con- siderations in ai and data science-addressing bias, privacy, and fairness. Australian Journal of Machine Learning Re- search & Applications, 2(1):1-12, 2022.
  30. [Ren et al., 2020] Shuo Ren, Daya Guo, Shuai Lu, Long Zhou, Shujie Liu, Duyu Tang, Neel Sundaresan, Ming Zhou, Ambrosio Blanco, and Shuai Ma. Codebleu: a method for automatic evaluation of code synthesis. arXiv preprint arXiv:2009.10297, 2020.
  31. [Wang et al., 2017] Lisa Wang, Angela Sy, Larry Liu, and Chris Piech. Learning to represent student knowledge on programming exercises using deep learning. International Educational Data Mining Society, 2017.
  32. [Wang et al., 2025] Tianfu Wang, Yi Zhan, Jianxun Lian, Zhengyu Hu, Nicholas Jing Yuan, Qi Zhang, Xing Xie, and Hui Xiong. Llm-powered multi-agent framework for goal-oriented learning in intelligent tutoring system. In ACM Web Conference, 2025.
  33. [Wei et al., 2022] Jason Wei, Xuezhi Wang, Dale Schuur- mans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824-24837, 2022.
  34. [Xu et al., 2024] Songlin Xu, Xinyu Zhang, and Lianhui Qin. Eduagent: Generative student agents in learning. arXiv preprint arXiv:2404.07963, 2024.
  35. [Yuan et al., 2024] Yu Yuan, Lili Zhao, Kai Zhang, Guangt- ing Zheng, and Qi Liu. Do llms overcome shortcut learn- ing? an evaluation of shortcut challenges in large language models. In Proceedings of the 2024 Conference on Em- pirical Methods in Natural Language Processing, pages 12188-12200, 2024.
  36. Zhang et al., ] Zheng Zhang, Wei Song, Qi Liu, Qingyang Mao, Yiyan Wang, Weibo Gao, Zhenya Huang, Shijin Wang, and Enhong Chen. Towards accurate and fair cog- nitive diagnosis via monotonic data augmentation. In The Thirty-eighth Annual Conference on Neural Information Processing Systems.
  37. [Zhang et al., 2024] Zheng Zhang, Le Wu, Qi Liu, Jiayu Liu, Zhenya Huang, Yu Yin, Yan Zhuang, Weibo Gao, and Enhong Chen. Understanding and improving fairness in cognitive diagnosis. Science China Information Sciences, 67(5):152106, 2024.
  38. [Zhao et al., 2023] Guanhao Zhao, Zhenya Huang, Yan Zhuang, Jiayu Liu, Qi Liu, Zhiding Liu, Jinze Wu, and En- hong Chen. Simulating student interactions with two-stage imitation learning for intelligent educational systems. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, pages 3423- 3432, 2023.
  39. [Zhou et al., 2024] Zihao Zhou, Bin Hu, Chenyang Zhao, Pu Zhang, and Bin Liu. Large language model as a pol- icy teacher for training reinforcement learning agents. In Proceedings of the Thirty-Third International Joint Con- ference on Artificial Intelligence, IJCAI-24, pages 5671- 5679. International Joint Conferences on Artificial Intelli- gence Organization, 8 2024. Main Track. IJCAI
  40. [Zhu et al., 2022] Renyu Zhu, Dongxiang Zhang, Chengcheng Han, Ming Gaol, Xuesong Lu, Weining Qian, and Aoying Zhou. Programming knowledge tracing: A comprehensive dataset and a new model. In 2022 IEEE International Conference on Data Mining Workshops (ICDMW), pages 298-307. IEEE, 2022.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards