• Home
  • Search
  • DAMON: Difference-Aware Medical Visual Question Answering via Multimodal Large Language Model.
  • https://doi.org/10.1109/jbhi.2026.3663420Copy DOI Icon

DAMON: Difference-Aware Medical Visual Question Answering via Multimodal Large Language Model.

Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

Difference-aware Medical Visual Question Answering (MVQA) aims to answer questions regarding disease-related content and the visual differences between the paired medical images, which is crucial for assessing disease progression and guiding further treatment planning. Although current medical Multimodal Large Language Models (MLLMs) have shown promising results in MVQA, they still exhibit poor generalization performance in difference-aware MVQA due to two key challenges. Firstly, existing difference-aware MVQA datasets are biased toward temporal variations of individual diseases, limiting their ability to model multi-disease coexistence and overlapping symptoms in real-world clinical scenarios. Secondly, disease-level semantic alignment becomes more challenging with multi-image inputs, as they introduce more redundant and interfering visual features. To address the first challenge, we introduce DAMON-QA, a large-scale difference-aware MVQA dataset designed to support visual difference analysis across multiple diseases. Leveraging this dataset, we train MLLMs and propose a Difference-Aware Medical visual questiON answering (DAMON) model. To tackle the second challenge, we further propose a Disease-driven Prompt Module (DPM) to identify the relevant diseases and guide the disease difference analysis process. Experiments on MIMIC-Diff-VQA show that our DAMON model achieves state-of-the-art (SOTA) performance.

Similar Papers
  • Dissertation

Fine-tuning multimodal large language models for medical visual question answering

  • Jan 01, 2025
  • Ankitaben Mungalpara
  • Research Article
  • Citations35

Interpretable medical image Visual Question Answering via multi-modal relationship graph learning

  • Jul 20, 2024
  • Medical Image Analysis
  • Xinyue Hu +7
  • Conference Article
  • Citations9

MLeVLM: Improve Multi-level Progressive Capabilities based on Multimodal Large Language Model for Medical Visual Question Answering

  • Jan 01, 2024
  • Dexuan Xu +10
  • PDF
  • Research Article
  • Citations16

DATLMedQA: A Data Augmentation and Transfer Learning Based Solution for Medical Question Answering

  • Nov 26, 2021
  • Applied Sciences
  • Shuohua Zhou +1
  • Research Article
  • Citations63

AMAM: An Attention-based Multimodal Alignment Model for Medical Visual Question Answering

  • Aug 27, 2022
  • Knowledge-Based Systems
  • Haiwei Pan +5
  • Research Article

Medical question answering: A comprehensive multimodal and LLM-driven survey.

  • Oct 01, 2026
  • Computer methods and programs in biomedicine
  • Eya Mhedhbi +4
  • Research Article
  • Citations1

Consistency Conditioned Memory Augmented Dynamic Diagnosis Model for Medical Visual Question Answering.

  • Feb 01, 2025
  • IEEE journal of biomedical and health informatics
  • Ting Yu +5
  • Research Article
  • Citations1

Caption-augmented reasoning model with Hierarchical rank LoRA finetuing for medical visual question Answering.

  • Dec 01, 2025
  • Journal of biomedical informatics
  • Yong Li +3
  • Research Article

Optimizing multimodal models for medical visual question answering: A comparative study of LoRA and AdaLoRA on VQA-RAD and SLAKE-VQA.

  • Jan 01, 2026
  • Computers in biology and medicine
  • Zahra Rezaei +2
  • Research Article

MediConfusion: Can you trust your AI radiologist? Probing the reliability of multimodal medical foundation models.

  • Apr 01, 2025
  • ... International Conference on Learning Representations
  • Mohammad Shahab Sepehri +3
  • Research Article

A medical visual question answering approach based on co-attention networks

  • Jun 25, 2024
  • Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi
  • Wencheng Cui +2
  • Book Chapter
  • Citations6

A Pre-trained Language Model for Medical Question Answering Based on Domain Adaption

  • Jan 01, 2022
  • Lang Liu +5
  • Research Article
  • Citations16

Integration of Multi-Source Medical Data for Medical Diagnosis Question Answering.

  • Mar 01, 2025
  • IEEE transactions on medical imaging
  • Qi Peng +8
  • Research Article

Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework

  • May 07, 2025
  • Mathematics
  • Yusong Ke +4
  • PDF
  • Conference Article
  • Citations4

ANU-CSIRO at MEDIQA 2019: Question Answering Using Deep Contextual Knowledge

  • Jan 01, 2019
  • Vincent Nguyen +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.