Proceedings

THGAgents: Traceable Biomedical Hypothesis Generation via Dynamic Causal Reasoning

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. AI and Health. Pages 6975-6983.

https://doi.org/10.24963/ijcai.2026/776

Abstract

While Large Language Models (LLMs) offer promise in scientific discovery, leveraging LLMs to drive biomedical research requires the scientific discovery process to be performed in combination with cutting-edge biomedical research and rigorous mechanistic causal chains. As such, both current Retrieval-augmented generation methods lacking causal reasoning capabilities, and the static traditional knowledge graphs failing to reflect evolving scientific knowledge, present obstacles to utilizing LLMs as scientific discovery tools. In response to these ongoing challenges, we present THGAgents. THGAgents utilize collaborative and dynamically updating agents to build a Traceable Causal Knowledge Graph, which serves as the foundation for the evidence-based knowledge structure. Crucially, we employ an LLM-driven heuristic search algorithm to traverse the complex network, balancing both novelty and rigor to deduce strict, evidence-based mechanistic causal chains. Additionally, THGAgents utilize a generator-critic loop to support hypothesis refinement. In experimental benchmarks across both cancer systems and neuroscience, THGAgents achieved up to a 0.80 hit rate in predicting validated scientific discoveries, providing an almost 9.5% increase in hypothesis quality scores versus current state-of-the-art systems, and decreasing the mechanistic hallucination rate to 1.12%. Our code is available at https://github.com/yangCode-res/THGAgents/.

  1. [Achiam et al., 2023] Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Alt- man, Shyamal Anadkat, et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774, 2023.
  2. [Baek et al., 2025] Jinheon Baek, Sujay Kumar Jauhar, Sil- viu Cucerzan, and Sung Ju Hwang. Researchagent: Itera- tive research idea generation over scientific literature with large language models. In Proceedings of the 2025 Confer- ence of the Nations of the Americas Chapter of the Asso- ciation for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 6709-6738, 2025.
  3. [Bastian et al., 2010] Hilda Bastian, Paul Glasziou, and Iain Chalmers. Seventy-five trials and eleven systematic re- views a day: how will we ever keep up? PLoS medicine, 7(9):e1000326, 2010.
  4. [Bornmann et al., 2021] Lutz Bornmann, Robin Haunschild, and Rüdiger Mutz. Growth rates of modern science: a la- tent piecewise growth curve approach to model publication numbers from established and new literature databases. Humanities and Social Sciences Communications, 8(1):1- 15, 2021.
  5. [Ciucȃ et al., 2023] Ioana Ciucȃ, Yuan-Sen Ting, Sandor Kruk, and Kartheik Iyer. Harnessing the power of ad- versarial prompting and large language models for ro- bust hypothesis generation in astronomy. arXiv preprint arXiv:2306.11648, 2023.
  6. Mike D'Arcy, Tom Hope, Larry Birn- baum, and Doug Downey. Marg: Multi-agent re- view generation for scientific papers. arXiv preprint arXiv:2401.04259, 2024.
  7. [Das et al., 2017] Rajarshi Das, Shehzaad Dhuliawala, Manzil Zaheer, Luke Vilnis, Ishan Durugkar, Akshay Krishnamurthy, Alex Smola, and Andrew McCallum. Go for a walk and arrive at the answer: Reasoning over paths in knowledge bases using reinforcement learning. arXiv preprint arXiv:1711.05851, 2017.
  8. [Gao et al., 2023] Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yixin Dai, Jiawei Sun, Haofen Wang, and Haofen Wang. Retrieval-augmented generation for large language models: A survey. arXiv preprint arXiv:2312.10997, 2(1), 2023.
  9. [Google, 2025] Google. Gemini 3 pro -best for com- plex tasks and bringing creative concepts to life. https: //deepmind.google/models/gemini/pro/, 2025. Link
  10. [Guo et al., 2024] Zirui Guo, Lianghao Xia, Yanhua Yu, Tu Ao, and Chao Huang. Lightrag: Simple and fast retrieval-augmented generation. arXiv preprint arXiv:2410.05779, 2024.
  11. [Hou et al., 2021] Zhongni Hou, Xiaolong Jin, Zixuan Li, and Long Bai. Rule-aware reinforcement learning for knowledge graph reasoning. In Findings of the association for computational linguistics: ACL-IJCNLP 2021, pages 4687-4692, 2021.
  12. [Hu et al., 2023] Linmei Hu, Zeyi Liu, Ziwang Zhao, Lei Hou, Liqiang Nie, and Juanzi Li. A survey of knowledge enhanced pre-trained language models. IEEE Transactions on Knowledge and Data Engineering, 36(4):1413-1430, 2023.
  13. [Hu et al., 2024] Xiang Hu, Hongyu Fu, Jinge Wang, Yifeng Wang, Zhikun Li, Renjun Xu, Yu Lu, Yaochu Jin, Lili Pan, and Zhenzhong Lan. Nova: An iterative planning and search approach to enhance novelty and diversity of llm generated ideas. arXiv preprint arXiv:2410.14255, 2024.
  14. [Huang et al., 2025] Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qiang- long Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, et al. A survey on hallucination in large language models: Prin- ciples, taxonomy, challenges, and open questions. ACM Transactions on Information Systems, 43(2):1-55, 2025.
  15. [Ifargan et al., 2025] Tal Ifargan, Lukas Hafner, Maor Kern, Ori Alcalay, and Roy Kishony. Autonomous llm-driven research-from data to human-verifiable research papers. NEJM AI, 2(1):AIoa2400555, 2025.
  16. [Ji et al., 2023] Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. Survey of halluci- nation in natural language generation. ACM computing surveys, 55(12):1-38, 2023.
  17. [Jin et al., 2024] Bowen Jin, Chulin Xie, Jiawei Zhang, Kashob Kumar Roy, Yu Zhang, Zheng Li, Ruirui Li, Xian- feng Tang, Suhang Wang, Yu Meng, et al. Graph chain-of- thought: Augmenting large language models by reasoning on graphs. arXiv preprint arXiv:2404.07103, 2024.
  18. [Kalil et al., 2021] Andre C Kalil, Thomas F Patterson, Aneesh K Mehta, et al. Baricitinib plus remdesivir for hospitalized adults with covid-19. New England Journal of Medicine, 384(9):795-807, 2021.
  19. [Lao and Cohen, 2010] Ni Lao and William W Cohen. Re- lational retrieval using a combination of path-constrained random walks. Machine learning, 81(1):53-67, 2010.
  20. [Lewis et al., 2020] Patrick Lewis, Ethan Perez, Aleksan- dra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in neural infor- mation processing systems, 33:9459-9474, 2020.
  21. [Li et al., 2024] Long Li, Weiwen Xu, Jiayan Guo, Ruochen Zhao, Xingxuan Li, Yuqian Yuan, Boqiang Zhang, Yum- ing Jiang, Yifei Xin, Ronghao Dang, et al. Chain of ideas: Revolutionizing research via novel idea development with llm agents. arXiv preprint arXiv:2410.13185, 2024.
  22. [Liu et al., 2021] Fangyu Liu, Ivan Vulić, Anna Korhonen, and Nigel Collier. Learning domain-specialised represen- tations for cross-lingual biomedical entity linking. arXiv preprint arXiv:2105.14398, 2021.
  23. [Liu et al., 2024a] Haoyang Liu, Yijiang Li, Jinglin Jian, Yuxuan Cheng, Jianrong Lu, Shuyi Guo, Jinglei Zhu, Mianchen Zhang, Miantong Zhang, and Haohan Wang. Toward a team of ai-made scientists for scientific dis- covery from gene expression data. arXiv preprint arXiv:2402.12391, 2024.
  24. [Liu et al., 2024b] Shengchao Liu, Jiongxiao Wang, Yijin Yang, Chengpeng Wang, Ling Liu, Hongyu Guo, and Chaowei Xiao. Conversational drug editing using retrieval and domain feedback. In The twelfth international confer- ence on learning representations, 2024.
  25. [Liu et al., 2025] Aixin Liu, Aoxue Mei, Bangcai Lin, Bing Xue, Bingxuan Wang, Bingzheng Xu, Bochao Wu, Bowei Zhang, Chaofan Lin, Chen Dong, et al. Deepseek-v3. 2: Pushing the frontier of open large language models. arXiv preprint arXiv:2512.02556, 2025.
  26. [Marconi et al., 2021] Vincent C Marconi, Athimalaipet V Ramanan, Sujatro de Bono, et al. Efficacy and safety of baricitinib for the treatment of hospitalised adults with covid-19 (cov-barrier): a randomised, double-blind, parallel-group, placebo-controlled phase 3 trial. The Lancet Respiratory Medicine, 9(12):1407-1418, 2021.
  27. [Mazumder and Liu, 2017] Sahisnu Mazumder and Bing Liu. Context-aware path ranking for knowledge base com- pletion. arXiv preprint arXiv:1712.07745, 2017.
  28. [Qi et al., 2023] Biqing Qi, Kaiyan Zhang, Haoxiang Li, Kai Tian, Sihang Zeng, Zhang-Ren Chen, and Bowen Zhou. Large language models are zero shot hypothesis proposers. arXiv preprint arXiv:2311.05965, 2023.
  29. [Richardson et al., 2020] Peter Richardson, Ivan Griffin, Catherine Tucker, Dan Smith, Olly Oechsle, Anne Phelan, Michael Rawling, Edward Savory, and Justin Stebbing. Baricitinib as potential treatment for 2019-ncov acute res- piratory disease. The Lancet, 395(10223):e30-e31, 2020.
  30. [Si et al., 2024] Chenglei Si, Diyi Yang, and Tatsunori Hashimoto. Can llms generate novel research ideas? a large-scale human study with 100+ nlp researchers. arXiv preprint arXiv:2409.04109, 2024.
  31. [Singh et al., 2025] Aaditya Singh, Adam Fry, Adam Perel- man, Adam Tart, Adi Ganesh, Ahmed El-Kishky, Aidan McLaughlin, Aiden Low, AJ Ostrow, Akhila Ananthram, et al. Openai gpt-5 system card. arXiv preprint arXiv:2601.03267, 2025.
  32. [Su et al., 2024] Haoyang Su, Renqi Chen, Shixiang Tang, Xinzhe Zheng, Jinzhe Li, Zhenfei Yin, Wanli Ouyang, and Nanqing Dong. Two heads are better than one: A multi- agent system has the potential to improve scientific idea generation. 2024.
  33. [Sun et al., 2023] Jiashuo Sun, Chengjin Xu, Lumingyuan Tang, Saizhuo Wang, Chen Lin, Yeyun Gong, Lionel M Ni, Heung-Yeung Shum, and Jian Guo. Think-on-graph: Deep and responsible reasoning of large language model on knowledge graph. arXiv preprint arXiv:2307.07697, 2023.
  34. [Tong et al., 2024] Song Tong, Kai Mao, Zhen Huang, Yukun Zhao, and Kaiping Peng. Automating psycholog- ical hypothesis generation with ai: when large language models meet causal graph. Humanities and Social Sci- ences Communications, 11(1):1-14, 2024.
  35. [Wei et al., 2022] Jason Wei, Xuezhi Wang, Dale Schuur- mans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824-24837, 2022.
  36. [Wiggins and Tejani, 2022] Walter F Wiggins and Ali S Te- jani. On the opportunities and risks of foundation models for natural language processing in radiology. Radiology: Artificial Intelligence, 4(4):e220119, 2022.
  37. [Xiong et al., 2017] Wenhan Xiong, Thien Hoang, and William Yang Wang. Deeppath: A reinforcement learn- ing method for knowledge graph reasoning. arXiv preprint arXiv:1707.06690, 2017.
  38. [Xiong et al., 2025] Guangzhi Xiong, Eric Xie, Corey Williams, Myles Kim, Amir Hassan Shariatmadari, Sikun Guo, Stefan Bekiranov, and Aidong Zhang. Toward re- liable scientific hypothesis generation: Evaluating truth- fulness and hallucination in large language models. In Proceedings of the Thirty-Fourth International Joint Con- ference on Artificial Intelligence, IJCAI 2025, Montreal, Canada, August 16-22, 2025, pages 7849-7857. ijcai.org, 2025. IJCAI
  39. [Yan et al., 2024] Shi-Qi Yan, Jia-Chen Gu, Yun Zhu, and Zhen-Hua Ling. Corrective retrieval augmented genera- tion. 2024.
  40. [Zhou et al., 2024] Yangqiaoyu Zhou, Haokun Liu, Tejes Srivastava, Hongyuan Mei, and Chenhao Tan. Hypothe- sis generation with large language models. arXiv preprint arXiv:2404.04326, 2024.
  41. [Zhu et al., 2023] Zhaocheng Zhu, Xinyu Yuan, Michael Galkin, Louis-Pascal Xhonneux, Ming Zhang, Maxime Gazeau, and Jian Tang. A* net: A scalable path-based reasoning approach for knowledge graphs. Advances in Neural Information Processing Systems, 36:59323-59336, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards