• Home
  • Search
  • Consistency Conditioned Memory Augmented Dynamic Diagnosis Model for Medical Visual Question Answering.
  • Cite Icon1
  • https://doi.org/10.1109/jbhi.2024.3492141Copy DOI Icon

Consistency Conditioned Memory Augmented Dynamic Diagnosis Model for Medical Visual Question Answering.

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Medical Visual Question Answering (Med-VQA) holds immense promise as an invaluable medical assistance aid, offering timely diagnostic outcomes based on medical images and accompanying questions, thereby supporting medical professionals in making accurate clinical decisions. However, Med-VQA is still in its infancy, with existing solutions falling short in imitating human diagnostic processes and ensuring result consistency. To address these challenges, we propose a Consistency Conditioned Memory augmented Dynamic diagnosis model (CoCoMeD), incorporating two core components: a dynamic memory diagnosis engine and a consistency-conditioned enforcer. The dynamic memory diagnosis engine enables intricate diagnostic interactions by retaining vital visual cues from medical images and iteratively updating pertinent memories. This dynamic reasoning capability mirrors the cognitive processes observed in skilled medical diagnosticians, thus effectively enhancing the model's ability to reason over diverse medical visual facts and patient-specific questions. Moreover, to strengthen diagnostic coherence, the consistency-conditioned enforcer imposes coherence constraints linking interrelated questions with identical medical facts, ensuring the credibility and reliability of its diagnostic outcomes. Additionally, we present C-SLAKE, an extended Med-VQA dataset encompassing diverse medical image types, and categorized diagnostic question-answer pairs for consistent Med-VQA evaluation on rich medical sources. Comprehensive experiments on DME and C-SLAKE showcase CoCoMeD's superior performance and potential to advance trustworthy multi-source medical question answering.

Similar Papers
  • Research Article

Medical question answering: A comprehensive multimodal and LLM-driven survey.

  • Oct 01, 2026
  • Computer methods and programs in biomedicine
  • Eya Mhedhbi +4
  • Research Article

Comparative Analysis of Denoising Methods to Improve Image Quality for Medical Visual Question Answering

  • Dec 17, 2024
  • International Journal of Next-Generation Computing
  • Rikita D Parekh +1
  • Research Article
  • Citations16

Integration of Multi-Source Medical Data for Medical Diagnosis Question Answering.

  • Mar 01, 2025
  • IEEE transactions on medical imaging
  • Qi Peng +8
  • PDF
  • Research Article
  • Citations117

CGMVQA: A New Classification and Generative Model for Medical Visual Question Answering

  • Jan 01, 2020
  • IEEE Access
  • Fuji Ren +1
  • Research Article
  • Citations22

Developing ChatGPT for biology and medicine: a complete review of biomedical question answering.

  • Jan 01, 2024
  • Biophysics reports
  • Qing Li +2
  • Research Article
  • Citations4

Hierarchical Modeling for Medical Visual Question Answering with Cross-Attention Fusion

  • Apr 24, 2025
  • Applied Sciences
  • Junkai Zhang +2
  • Research Article

Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework

  • May 07, 2025
  • Mathematics
  • Yusong Ke +4
  • Research Article
  • Citations8

Parallel multi-head attention and term-weighted question embedding for medical visual question answering.

  • Mar 11, 2023
  • Multimedia Tools and Applications
  • Sruthy Manmadhan +1
  • Conference Article

Construction of a Knowledge Graph-based Medical Question Answer System

  • Nov 24, 2022
  • Xiao Lizhong +2
  • Research Article
  • Citations19

Anomaly Matters: An Anomaly-Oriented Model for Medical Visual Question Answering.

  • Nov 01, 2022
  • IEEE Transactions on Medical Imaging
  • Fuze Cong +3
  • Book Chapter
  • Citations6

A Pre-trained Language Model for Medical Question Answering Based on Domain Adaption

  • Jan 01, 2022
  • Lang Liu +5
  • Research Article

A medical visual question answering approach based on co-attention networks

  • Jun 25, 2024
  • Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi
  • Wencheng Cui +2
  • Research Article
  • Citations3

MedBLIP: A multimodal method of medical question-answering based on fine-tuning large language model.

  • Sep 01, 2025
  • Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society
  • Lejun Gong +3
  • Research Article
  • Citations23

A Bi-level representation learning model for medical visual question answering

  • Aug 28, 2022
  • Journal of Biomedical Informatics
  • Yong Li +7
  • Dissertation

Fine-tuning multimodal large language models for medical visual question answering

  • Jan 01, 2025
  • Ankitaben Mungalpara
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.