• Cite Icon11
  • https://doi.org/10.1109/jbhi.2024.3514659Copy DOI Icon

A Joint LLM-KG System for Disease Q&A.

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Medical question answer (QA) assistants respond to lay users' health-related queries by synthesizing information from multiple sources using natural language processing and related techniques. They can serve as vital tools to alleviate issues of misinformation, information overload, and complexity of medical language, thus addressing lay users' information needs while reducing the burden on healthcare professionals. QA systems, the engines of such assistants, have often used large language models (LLMs) or knowledge graphs (KG), though the approaches could be complementary. LLM-based QA systems excel at understanding complex questions and providing well-formed answers but are prone to factual mistakes. KG-based QA systems, which represent facts well, are mostly limited to answering short-answer questions with pre-created templates. While a few studies have used both LLM and KG for text-based QA, the approaches are still prone to incomplete or inaccurate answers. Extant QA systems also have limitations in terms of automation and performance. We address these challenges by designing a novel, automated disease QA system named Disease Guru-Long-Form Question Answer (DG-LFQA), which effectively utilizes both LLM and KG techniques through a joint reasoning approach to answer disease-related questions appropriate for lay users. Our evaluation of the system using a range of quality metrics demonstrates its efficacy over related baseline systems.

Similar Papers
  • Book Chapter
  • Citations1

Designing an Interpretable Question Answering System for Vertical Domains Based on Large Language Model and Knowledge Graph

  • Jul 01, 2024
  • Xiaobin Huang +1
  • PDF
  • Research Article
  • Citations4

Application of large language models based on knowledge graphs in question-answering systems: A review

  • Aug 27, 2024
  • Applied and Computational Engineering
  • Yani Wang
  • Research Article
  • Citations975

Unifying Large Language Models and Knowledge Graphs: A Roadmap

  • Jul 01, 2024
  • IEEE Transactions on Knowledge and Data Engineering
  • Shirui Pan +5
  • Research Article

Construction and evaluation of the knowledge graph and large model question-answering system for Jin San Zhen therapy: a tool study for primary care and general practice.

  • Jan 01, 2026
  • Frontiers in medicine
  • Junjie Chen +8
  • PDF
  • Preprint Article

Knowledge Enhancement of Small-Scale Models in Medical Question Answering (Preprint)

  • Nov 03, 2024
  • Xinbai Li +3
  • Research Article
  • Citations6

Integrated Application of LLM Model and Knowledge Graph in Medical Text Mining and Knowledge Extraction

  • Jan 01, 2024
  • Social Medicine and Health Management
  • Jinzhu Yang
  • Book Chapter
  • Citations15

DSQA: A Domain Specific QA System for Smart Health Based on Knowledge Graph

  • Jan 01, 2020
  • Ming Sheng +7
  • Research Article
  • Citations21

Using Large Language Models to Automate Data Extraction From Surgical Pathology Reports: Retrospective Cohort Study

  • Apr 07, 2025
  • JMIR Formative Research
  • Denise Lee +6
  • Research Article
  • Citations10

Decoding the Mystery: How Can LLMs Turn Text Into Cypher in Complex Knowledge Graphs?

  • Jan 01, 2025
  • IEEE Access
  • Ioanna Mandilara +4
  • Conference Article
  • Citations7

Construction and Application of Traffic Accident Knowledge Graph Based on LLM

  • Feb 21, 2025
  • SAE technical papers on CD-ROM/SAE technical paper series
  • Yingqi Hou +3
  • Research Article
  • Citations1

LLM-Based Natural Language to SPARQL Translation over Domain-Specific Knowledge Graph

  • Dec 15, 2025
  • Knowledge Organization
  • Mohammed H Rasheed +1
  • PDF
  • Research Article
  • Citations12

Question answering system for chemistry—A semantic agent extension

  • May 05, 2022
  • Digital Chemical Engineering
  • Xiaochi Zhou +5
  • PDF
  • Research Article
  • Citations17

Knowledge graph-extended retrieval augmented generation for question answering

  • Nov 01, 2025
  • Applied Intelligence
  • Jasper Linders +1
  • Research Article

Medical question answering: A comprehensive multimodal and LLM-driven survey.

  • Oct 01, 2026
  • Computer methods and programs in biomedicine
  • Eya Mhedhbi +4
  • Research Article
  • Citations3

A comprehensive review of intelligent question-answering systems in traditional Chinese medicine based on LLMs.

  • Apr 01, 2026
  • Journal of pharmaceutical analysis
  • Qilan Xu +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.