Proceedings

Information-Needs-Guided Virtual Knowledge Graph Enrichment via Large Language Models

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 4026-4034.

https://doi.org/10.24963/ijcai.2026/448

Abstract

Virtual Knowledge Graphs (VKGs) provide an effective solution for data integration by mapping heterogeneous data sources to a unified ontology.

However, existing VKG construction frameworks primarily focus on one-shot construction, which often results in partial data coverage and support for only initial information needs.

After the VKG has been deployed, new information needs will inevitably arise over time.

Therefore, enriching VKGs to support evolving information needs remains an expert-intensive iterative task.

In this work, we formulate the task of Information-Needs-Guided VKG Enrichment (IN-VKGE), and propose an iterative framework that leverages large language models to assess whether information needs can be supported using SPARQL execution feedback and generate ontology and mapping enrichment proposals.

Experiments on two real-world VKGs show that our approach outperforms existing paradigms, and produces enrichment proposals that receive high expert ratings for effectively resolving the identified information needs.

  1. [Allemang and Sequeda, 2024] Dean Allemang and Juan Se- queda. Increasing the accuracy of LLM question- answering systems with ontologies. Proc. of ISWC'2024, 2024. [Anthropic, 2025] Anthropic. Introducing claude sonnet 4.5. Anthropic blog, 2025.
  2. [Aumueller et al., 2005] David Aumueller, Hong Hai Do, Sabine Massmann, et al. Schema and ontology matching with COMA++. In Proc. of SIGMOD'2005, pages 906- 908, 2005.
  3. [Avila et al., 2024] Caio Viktor S. Avila, Vânia M. P. Vi- dal, Wellington Franco, et al. Experiments with text-to- SPARQL based on ChatGPT. In Proc. of IEEE ICSC'2024, pages 277-284, 2024.
  4. [Azaria et al., 2024] Amos Azaria, Rina Azoulay, and Shu- lamit Reches. ChatGPT is a remarkable tool-for experts. Data Intelligence, 6(1):240-296, 2024.
  5. [Berant et al., 2013] Jonathan Berant, Andrew Chou, Roy Frostig, et al. Semantic parsing on freebase from question- answer pairs. In Proc. of EMNLP'2013, pages 1533-1544, 2013.
  6. [Bizer and Seaborne, 2004] Christian Bizer and Andy Seaborne. D2RQ-treating non-RDF databases as virtual RDF graphs. In Proc. of ISWC'2004, 2004.
  7. [Brei et al., 2025] Felix Brei, Lorenz Bühmann, Johannes Frey, et al. ARUQULA -an LLM based Text2SPARQL approach using ReAct and knowledge graph exploration utilities. In Proc. of TEXT2SPARQL Challenge at ESWC'2025, volume 4094 of CEUR Workshop Proceed- ings, pages 49-63, 2025.
  8. [Calvanese et al., 2007] Diego Calvanese, Giuseppe De Gia- como, Domenico Lembo, et al. Ontology-based database access. In SEBD, pages 324-331, 2007.
  9. [Calvanese et al., 2017] Diego Calvanese, Benjamin Cogrel, Sarah Komla-Ebri, et al. Ontop: Answering SPARQL queries over relational databases. Semantic Web, 8(3):471-487, 2017.
  10. [Calvanese et al., 2021] Diego Calvanese, Davide Lanti, Tarcisio Mendes De Farias, et al. Accessing scientific data through knowledge graphs with ontop. Patterns, 2(10), 2021.
  11. [Chen, 2024] Huajun Chen. Large knowledge model: Per- spectives and challenges. Data Intelligence, 6(3):587-620, 2024.
  12. [Cima et al., 2023] Gianluca Cima, Antonella Poggi, and Maurizio Lenzerini. The notion of abstraction in ontology-based data management. Artificial Intelligence, 323:103976, 2023.
  13. [Daraio et al., 2016] Cinzia Daraio, Maurizio Lenzerini, Claudio Leporelli, et al. Data integration for research and innovation policy: An ontology-based data management approach. Scientometrics, 106(2):857-871, 2016.
  14. [De Giacomo et al., 2012] Giuseppe De Giacomo, Domenico Lembo, Maurizio Lenzerini, et al. MAS- TRO: A reasoner for effective ontology-based data access. In Proc. of ORE'2012, volume 858, 2012.
  15. [de Medeiros et al., 2015] Luciano Frontino de Medeiros, Freddy Priyatna, and Óscar Corcho. MIRROR: Automatic R2RML mapping generation from relational databases. In Proc. of ICWE'2015, volume 9114, pages 326-343, 2015.
  16. [DeepSeek-AI, 2024] DeepSeek-AI. Deepseek-V3 technical report, 2024.
  17. [Dubey et al., 2019] Mohnish Dubey, Debayan Banerjee, Abdelrahman Abdelkawi, et al. Lc-quad 2.0: A large dataset for complex question answering over wikidata and dbpedia. In Proc. of ISWC'2019, pages 69-78. Springer, 2019.
  18. [Emonet et al., 2024] Vincent Emonet, Jerven Bolleman, Séverine Duvaud, et al. LLM-based SPARQL query gen- eration from natural language over federated knowledge graphs. Proc. of ISWC'2024 Special Session on Harmonis- ing Generative AI and Semantic Web Technologies, 2024.
  19. [Gao et al., 2023] Yunfan Gao, Yun Xiong, Xinyu Gao, et al. Retrieval-augmented generation for large language mod- els: A survey. arXiv preprint arXiv:2312.10997, 2023.
  20. [Google, 2025] Google. Gemini 3 pro: Best for complex tasks and bringing creative concepts to life. Google blog, 2025.
  21. [Herzig and Berant, 2017] Jonathan Herzig and Jonathan Berant. Neural semantic parsing over multiple knowledge- bases. In Proc. of ACL'2017, pages 623-628, 2017.
  22. [Hovland et al., 2017] Dag Hovland, Roman Kontchakov, Martin G. Skjæveland, et al. Ontology-based data ac- cess to Slegge. In Proc. of ISWC'2017, pages 120-129. Springer, 2017.
  23. [Jiang et al., 2023] Jinhao Jiang, Kun Zhou, Zican Dong, et al. StructGPT: A general framework for large lan- guage model to reason over structured data. In Proc. of EMNLP'2023, pages 9237-9251, 2023.
  24. [Jiménez-Ruiz et al., 2015] Ernesto Jiménez-Ruiz, Evgeny Kharlamov, Dmitriy Zheleznyakov, et al. BootOX: Practi- cal mapping of RDBs to OWL 2. In Proc. of ISWC'2015, pages 113-132, 2015.
  25. [Kharlamov et al., 2015] Evgeny Kharlamov, Dag Hovland, Ernesto Jiménez-Ruiz, et al. Ontology based access to ex- ploration data at statoil. In Proc. of ISWC'2015, pages 93-112. Springer, 2015.
  26. [Kuhn, 1955] Harold W. Kuhn. The hungarian method for the assignment problem. Naval research logistics quar- terly, 2(1-2):83-97, 1955.
  27. [Lanti et al., 2015] Davide Lanti, Martin Rezk, Guohui Xiao, et al. The NPD benchmark: Reality check for OBDA systems. In Proc. of EDBT'2015, pages 617-628, 2015.
  28. [Lenzerini, 2011] Maurizio Lenzerini. Ontology-based data management. In Proceedings of the 20th ACM interna- tional conference on Information and knowledge manage- ment, pages 5-6, 2011.
  29. [Luo et al., 2024] Linhao Luo, Yuan-Fang Li, Gholamreza Haffari, et al. Reasoning on graphs: Faithful and in- terpretable large language model reasoning. In Proc. of ICLR'2024, 2024.
  30. [Ma et al., 2025a] Chuangtao Ma, Yongrui Chen, Tianxing Wu, et al. Large language models meet knowledge graphs for question answering: Synthesis and opportunities. In Proc. of EMNLP'2025, pages 24589-24608, 2025.
  31. [Ma et al., 2025b] Shengjie Ma, Chengjin Xu, Xuhui Jiang, et al. Think-on-graph 2.0: Deep and faithful large lan- guage model reasoning with knowledge-guided retrieval augmented generation. In Proc. of ICLR'2025, 2025. [OpenAI, 2025] OpenAI. Introducing gpt-5.
  32. OpenAI blog, 2025.
  33. [Pinkel et al., 2013] Christoph Pinkel, Carsten Binnig, Evgeny Kharlamov, et al. IncMap: pay as you go matching of relational schemata to OWL ontologies. In OM, pages 37-48, 2013.
  34. [Rashid and McGuinness, 2025] Sabbir Rashid and Debo- rah L. McGuinness. Designing and evaluating an ensemble reasoning-based clinical decision support system. Data In- telligence, 7(1):1-39, 2025.
  35. [Rodriguez-Muro et al., 2013] Mariano Rodriguez-Muro, Roman Kontchakov, and Michael Zakharyaschev. Ontology-based data access: Ontop of databases. In Proc. of ISWC'2013, pages 558-573. Springer, 2013.
  36. [Sequeda and Miranker, 2017] Juan F. Sequeda and Daniel P. Miranker. A pay-as-you-go methodology for ontology- based data access. IEEE Internet Computing, 21(2):92-96, 2017.
  37. [Sequeda et al., 2023] Juan Sequeda, Dean Allemang, and Bryon Jacob. A benchmark to understand the role of knowledge graphs on large language model's accuracy for question answering on enterprise sql databases, 2023.
  38. [Soru et al., 2017] Tommaso Soru, Edgard Marx, Diego Moussallem, et al. SPARQL as a foreign language. In SEMANTiCS (Posters & Demos), 2017.
  39. [Soylu et al., 2014] Ahmet Soylu, Evgeny Kharlamov, Dmitriy Zheleznyakov, et al. OptiqueVQS: Visual query formulation for OBDA. CEUR Workshop Proceedings, 2014.
  40. [Sun et al., 2024] Jiashuo Sun, Chengjin Xu, Lumingyuan Tang, et al. Think-on-graph: Deep and responsible rea- soning of large language model on knowledge graph. In Proc. of ICLR'2024, 2024.
  41. [Wang et al., 2024] Yu Wang, Nedim Lipka, Ryan A. Rossi, et al. Knowledge graph prompting for multi-document question answering. In Proc. of AAAI'2024, pages 19206- 19214, 2024.
  42. [Xiao et al., 2018] Guohui Xiao, Diego Calvanese, Roman Kontchakov, et al. Ontology-based data access: A survey. 2018. IJCAI
  43. [Xiao et al., 2019] Guohui Xiao, Linfang Ding, Benjamin Cogrel, et al. Virtual knowledge graphs: An overview of systems and use cases. Data Intelligence, 1(3):201-223, 2019.
  44. [Xiao et al., 2025] Guohui Xiao, Lin Ren, Guilin Qi, et al. LLM4VKG: Leveraging large language models for virtual knowledge graph construction. In Proc. of IJCAI'2025, pages 4715-4723, 2025. IJCAI
  45. [Yao et al., 2023] Shunyu Yao, Jeffrey Zhao, Dian Yu, et al. React: Synergizing reasoning and acting in language mod- els. In Proc. of ICLR'2023, 2023.
  46. [Yu et al., 2018] Tao Yu, Rui Zhang, Kai Yang, et al. Spi- der: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-SQL task. In Proc. of EMNLP'2018, 2018.
  47. [Zahera et al., 2024] Hamada M. Zahera, Manzoor Ali, Mo- hamed Ahmed Sherif, et al. Generating SPARQL from natural language using chain-of-thoughts prompting. In Proc. of SEMANTiCS'2024, pages 353-368, 2024.
  48. [Zhang et al., 2024] Zhiqiang Zhang, Liqiang Wen, and Wen Zhao. A GAIL fine-tuned LLM enhanced framework for low-resource knowledge graph question answering. In Proc. of CIKM'2024, pages 3300-3309, 2024.
  49. [Zhang, 2023] Jiawei Zhang. Graph-toolformer: To em- power LLMs with graph reasoning ability via prompt aug- mented by ChatGPT. arXiv preprint arXiv:2304.11116, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards