• Home
  • Search
  • LightPROF: A Lightweight Reasoning Framework for Large Language Model on Knowledge Graph
  • Cite Icon14
  • https://doi.org/10.1609/aaai.v39i22.34510Copy DOI Icon

LightPROF: A Lightweight Reasoning Framework for Large Language Model on Knowledge Graph

  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

Large Language Models (LLMs) have impressive capabilities in text understanding and zero-shot reasoning. However, delays in knowledge updates may cause them to reason incorrectly or produce harmful results. Knowledge Graphs (KGs) provide rich and reliable contextual information for the reasoning process of LLMs by structurally organizing and connecting a wide range of entities and relations. Existing KG-based LLM reasoning methods only inject KGs' knowledge into prompts in a textual form, ignoring its structural information. Moreover, they mostly rely on close-source models or open-source models with large parameters, which poses challenges to high resource consumption. To address this, we propose a novel Lightweight and efficient Prompt learning-ReasOning Framework for KGQA (LightPROF), which leverages the full potential of LLMs to tackle complex reasoning tasks in a parameter-efficient manner. Specifically, LightPROF follows a “Retrieve-Embed-Reason” process, first accurately, and stably retrieving the corresponding reasoning graph from the KG through retrieval module. Next, through a Transformer-based Knowledge Adapter, it finely extracts and integrates factual and structural information from the KG, then maps this information to the LLM’s token embedding space, creating an LLM-friendly prompt to be used by the LLM for the final reasoning. Additionally, LightPROF only requires training Knowledge Adapter and can be compatible with any open-source LLM. Extensive experiments on two public KGQA benchmarks demonstrate that LightPROF achieves superior performance with small-scale LLMs. Furthermore, LightPROF shows significant advantages in terms of input token count and reasoning time.

Similar Papers
  • Research Article
  • Citations975

Unifying Large Language Models and Knowledge Graphs: A Roadmap

  • Jul 01, 2024
  • IEEE Transactions on Knowledge and Data Engineering
  • Shirui Pan +5
  • Research Article
  • Citations1

LLM-Based Natural Language to SPARQL Translation over Domain-Specific Knowledge Graph

  • Dec 15, 2025
  • Knowledge Organization
  • Mohammed H Rasheed +1
  • Research Article

Construction and evaluation of the knowledge graph and large model question-answering system for Jin San Zhen therapy: a tool study for primary care and general practice.

  • Jan 01, 2026
  • Frontiers in medicine
  • Junjie Chen +8
  • Book Chapter
  • Citations5

Enhancing Manufacturing Knowledge Access with LLMs and Context-Aware Prompting

  • Oct 16, 2024
  • Frontiers in artificial intelligence and applications
  • Sebastian Monka +6
  • Front Matter
  • Citations1

Editorial: Large language models in work and business.

  • Nov 29, 2024
  • Frontiers in artificial intelligence
  • Şadi Evren Şeker
  • Research Article
  • Citations27

Detecting emergencies in patient portal messages using large language models and knowledge graph-based retrieval-augmented generation.

  • Apr 12, 2025
  • Journal of the American Medical Informatics Association : JAMIA
  • Siru Liu +5
  • Research Article
  • Citations7

A Systematic Exploration of Knowledge Graph Alignment with Large Language Models in Retrieval Augmented Generation

  • Apr 11, 2025
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Shiyu Tian +7
  • Conference Article
  • Citations10

SymAgent: A Neural-Symbolic Self-Learning Agent Framework for Complex Reasoning over Knowledge Graphs

  • Apr 22, 2025
  • Ben Liu +5
  • Research Article
  • Citations15

The Interpretable Reasoning and Intelligent Decision-Making Based on Event Knowledge Graph With LLMs in Fault Diagnosis Scenarios

  • Jan 01, 2025
  • IEEE Transactions on Instrumentation and Measurement
  • Changhao Men +4
  • Research Article
  • Citations26

Knowledge Graphs and Their Reciprocal Relationship with Large Language Models

  • Apr 21, 2025
  • Machine Learning and Knowledge Extraction
  • Ramandeep Singh Dehal +2
  • Research Article

Improving LLM Accuracy and Minimizing Hallucinations with Query Refinement and Knowledge Graphs

  • Apr 16, 2025
  • International Research Journal on Advanced Engineering and Management (IRJAEM)
  • Akshaya A M +3
  • Research Article
  • Citations8

KLR-KGC: Knowledge-Guided LLM Reasoning for Knowledge Graph Completion

  • Dec 21, 2024
  • Electronics
  • Shengwei Ji +4
  • Conference Article
  • Citations7

Construction and Application of Traffic Accident Knowledge Graph Based on LLM

  • Feb 21, 2025
  • SAE technical papers on CD-ROM/SAE technical paper series
  • Yingqi Hou +3
  • Research Article
  • Citations7

Leveraging Retrieval-Augmented Large Language Models for Dietary Recommendations With Traditional Chinese Medicine’s Medicine Food Homology: Algorithm Development and Validation

  • Aug 21, 2025
  • JMIR Medical Informatics
  • Hangyu Sha +5
  • Research Article

Leveraging large language models for automated knowledge extraction from geological reports

  • Mar 01, 2026
  • Journal of Rock Mechanics and Geotechnical Engineering
  • Qi Ge +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.