• Home
  • Search
  • Unifying Large Language Models and Knowledge Graphs: A Roadmap
  • Open Access IconOpen Access
  • Cite Icon975
  • https://doi.org/10.1109/tkde.2024.3352100Copy DOI Icon

Unifying Large Language Models and Knowledge Graphs: A Roadmap

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Large language models (LLMs), such as ChatGPT and GPT4, are making new waves in the field of natural language processing and artificial intelligence, due to their emergent ability and generalizability. However, LLMs are black-box models, which often fall short of capturing and accessing factual knowledge. In contrast, Knowledge Graphs (KGs), Wikipedia and Huapu for example, are structured knowledge models that explicitly store rich factual knowledge. KGs can enhance LLMs by providing external knowledge for inference and interpretability. Meanwhile, KGs are difficult to construct and evolve by nature, which challenges the existing methods in KGs to generate new facts and represent unseen knowledge. Therefore, it is complementary to unify LLMs and KGs together and simultaneously leverage their advantages. In this article, we present a forward-looking roadmap for the unification of LLMs and KGs. Our roadmap consists of three general frameworks, namely, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1) KG-enhanced LLMs,</i> which incorporate KGs during the pre-training and inference phases of LLMs, or for the purpose of enhancing understanding of the knowledge learned by LLMs; <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2) LLM-augmented KGs,</i> that leverage LLMs for different KG tasks such as embedding, completion, construction, graph-to-text generation, and question answering; and <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3) Synergized LLMs + KGs</i> , in which LLMs and KGs play equal roles and work in a mutually beneficial way to enhance both LLMs and KGs for bidirectional reasoning driven by both data and knowledge. We review and summarize existing efforts within these three frameworks in our roadmap and pinpoint their future research directions.

Similar Papers
  • Conference Article
  • Citations3

Integrating Large Language Models and Knowledge Graphs for Next-level AGI

  • May 08, 2025
  • Linhao Luo +3
  • Research Article
  • Citations26

Knowledge Graphs and Their Reciprocal Relationship with Large Language Models

  • Apr 21, 2025
  • Machine Learning and Knowledge Extraction
  • Ramandeep Singh Dehal +2
  • Research Article
  • Citations15

The Interpretable Reasoning and Intelligent Decision-Making Based on Event Knowledge Graph With LLMs in Fault Diagnosis Scenarios

  • Jan 01, 2025
  • IEEE Transactions on Instrumentation and Measurement
  • Changhao Men +4
  • Front Matter
  • Citations1

Editorial: Large language models in work and business.

  • Nov 29, 2024
  • Frontiers in artificial intelligence
  • Şadi Evren Şeker
  • Research Article
  • Citations1

LLM-Based Natural Language to SPARQL Translation over Domain-Specific Knowledge Graph

  • Dec 15, 2025
  • Knowledge Organization
  • Mohammed H Rasheed +1
  • Research Article

Construction and evaluation of the knowledge graph and large model question-answering system for Jin San Zhen therapy: a tool study for primary care and general practice.

  • Jan 01, 2026
  • Frontiers in medicine
  • Junjie Chen +8
  • PDF
  • Research Article
  • Citations17

Knowledge graph-extended retrieval augmented generation for question answering

  • Nov 01, 2025
  • Applied Intelligence
  • Jasper Linders +1
  • Research Article
  • Citations11

How Can IJDS Authors, Reviewers, and Editors Use (and Misuse) Generative AI?

  • Apr 01, 2023
  • INFORMS Journal on Data Science
  • Galit Shmueli +7
  • Research Article
  • Citations4

Knowledge Graph Combined with Retrieval-Augmented Generation for Enhancing LMs Reasoning: A Survey

  • Feb 12, 2025
  • Academic Journal of Science and Technology
  • Haitao Wang +1
  • Supplementary Content
  • Citations2

A Review of Fault Diagnosis Methods: From Traditional Machine Learning to Large Language Model Fusion Paradigm

  • Jan 21, 2026
  • Sensors (Basel, Switzerland)
  • Qingwei Nie +2
  • Research Article
  • Citations25

Knowledge Graph Construction: Extraction, Learning, and Evaluation

  • Mar 28, 2025
  • Applied Sciences
  • Seungmin Choi +1
  • Research Article
  • Citations27

Detecting emergencies in patient portal messages using large language models and knowledge graph-based retrieval-augmented generation.

  • Apr 12, 2025
  • Journal of the American Medical Informatics Association : JAMIA
  • Siru Liu +5
  • Research Article
  • Citations7

A Survey on Unifying Large Language Models and Knowledge Graphs for Biomedicine and Healthcare.

  • Aug 03, 2025
  • KDD : proceedings. International Conference on Knowledge Discovery & Data Mining
  • Ran Xu +7
  • Research Article
  • Citations11

A Joint LLM-KG System for Disease Q&A.

  • Mar 01, 2025
  • IEEE journal of biomedical and health informatics
  • Prakash C Sukhwal +2
  • Book Chapter
  • Citations5

Enhancing Manufacturing Knowledge Access with LLMs and Context-Aware Prompting

  • Oct 16, 2024
  • Frontiers in artificial intelligence and applications
  • Sebastian Monka +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.