• Home
  • Search
  • A Systematic Exploration of Knowledge Graph Alignment with Large Language Models in Retrieval Augmented Generation
  • Cite Icon7
  • https://doi.org/10.1609/aaai.v39i24.34716Copy DOI Icon

A Systematic Exploration of Knowledge Graph Alignment with Large Language Models in Retrieval Augmented Generation

  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

Retrieval Augmented Generation (RAG) with Knowledge Graphs (KGs) is an effective way to enhance Large Language Models (LLMs). Due to the natural discrepancy between structured KGs and sequential LLMs, KGs must be linearized to text before being inputted into LLMs, leading to the problem of KG Alignment with LLMs (KGA). However, recent KG+RAG methods only consider KGA as a simple step without comprehensive and in-depth explorations, leaving three essential problems unclear: (1) What are the factors and their effects in KGA? (2) How do LLMs understand KGs? (3) How to improve KG+RAG by KGA? To fill this gap, we conduct systematic explorations on KGA, where we first define the problem of KGA and subdivide it into the graph transformation phase (graph-to-graph) and the linearization phase (graph-to-text). In the graph transformation phase, we study graph features at the node, edge, and full graph levels from low to high granularity. In the linearization phase, we study factors on formats, orders, and templates from structural to token levels. We conduct substantial experiments on 15 typical LLMs and three common datasets. Our main findings include: (1) The centrality of the KG affects the final generation; formats have the greatest impact on KGA; orders are model-dependent, without an optimal order adapting for all models; the templates with special token separators are better. (2) LLMs understand KGs by a unique mechanism, different from processing natural sentences, and separators play an important role. (3) We achieved 7.3% average performance improvements on four common LLMs on the KGQA task by combining the optimal factors to enhance KGA.

Similar Papers
  • Research Article
  • Citations975

Unifying Large Language Models and Knowledge Graphs: A Roadmap

  • Jul 01, 2024
  • IEEE Transactions on Knowledge and Data Engineering
  • Shirui Pan +5
  • Research Article
  • Citations1

LLM-Based Natural Language to SPARQL Translation over Domain-Specific Knowledge Graph

  • Dec 15, 2025
  • Knowledge Organization
  • Mohammed H Rasheed +1
  • Research Article

Construction and evaluation of the knowledge graph and large model question-answering system for Jin San Zhen therapy: a tool study for primary care and general practice.

  • Jan 01, 2026
  • Frontiers in medicine
  • Junjie Chen +8
  • Book Chapter
  • Citations5

Enhancing Manufacturing Knowledge Access with LLMs and Context-Aware Prompting

  • Oct 16, 2024
  • Frontiers in artificial intelligence and applications
  • Sebastian Monka +6
  • Research Article
  • Citations27

Detecting emergencies in patient portal messages using large language models and knowledge graph-based retrieval-augmented generation.

  • Apr 12, 2025
  • Journal of the American Medical Informatics Association : JAMIA
  • Siru Liu +5
  • Front Matter
  • Citations1

Editorial: Large language models in work and business.

  • Nov 29, 2024
  • Frontiers in artificial intelligence
  • Şadi Evren Şeker
  • Conference Article
  • Citations10

SymAgent: A Neural-Symbolic Self-Learning Agent Framework for Complex Reasoning over Knowledge Graphs

  • Apr 22, 2025
  • Ben Liu +5
  • Conference Article
  • Citations1

Filling the Gap: LLMs as Scaffolds for Competency Question Instantiation

  • Mar 22, 2026
  • Claire Mcnamara +2
  • Research Article
  • Citations14

LightPROF: A Lightweight Reasoning Framework for Large Language Model on Knowledge Graph

  • Apr 11, 2025
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Tu Ao +9
  • Research Article
  • Citations15

The Interpretable Reasoning and Intelligent Decision-Making Based on Event Knowledge Graph With LLMs in Fault Diagnosis Scenarios

  • Jan 01, 2025
  • IEEE Transactions on Instrumentation and Measurement
  • Changhao Men +4
  • Research Article
  • Citations26

Knowledge Graphs and Their Reciprocal Relationship with Large Language Models

  • Apr 21, 2025
  • Machine Learning and Knowledge Extraction
  • Ramandeep Singh Dehal +2
  • Research Article
  • Citations70

Leveraging Medical Knowledge Graphs Into Large Language Models for Diagnosis Prediction: Design and Application Study.

  • Feb 24, 2025
  • JMIR AI
  • Yanjun Gao +8
  • Conference Article
  • Citations7

Construction and Application of Traffic Accident Knowledge Graph Based on LLM

  • Feb 21, 2025
  • SAE technical papers on CD-ROM/SAE technical paper series
  • Yingqi Hou +3
  • Research Article
  • Citations7

Leveraging Retrieval-Augmented Large Language Models for Dietary Recommendations With Traditional Chinese Medicine’s Medicine Food Homology: Algorithm Development and Validation

  • Aug 21, 2025
  • JMIR Medical Informatics
  • Hangyu Sha +5
  • Research Article
  • Citations8

KLR-KGC: Knowledge-Guided LLM Reasoning for Knowledge Graph Completion

  • Dec 21, 2024
  • Electronics
  • Shengwei Ji +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.