• Home
  • Search
  • A comprehensive interpretation for medical VQA: Datasets, techniques, and challenges
  • Cite Icon4
  • https://doi.org/10.3233/jifs-222569Copy DOI Icon

A comprehensive interpretation for medical VQA: Datasets, techniques, and challenges

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Recent technological developments and improvement in the medical domain demands advancement, to address the issue of early disease detection. Also, the current pandemic has resulted in considerable progress of improvement in the medical domain, through online consultation by physicians for different diseases using clinical reports and medical images. A similar process is adopted in developing a Visual Question Answering (VQA) system in the medical field. In this paper, existing medical VQA datasets, appropriate techniques, suitable quantitative metrics, real time challenges and, the implementation of one VQA approach with algorithms and performance evaluation are discussed. The medical VQA datasets collected from multiple sources are represented in different perspectives (organwise, planewise, modality-type and abnormality-type) for a better understanding and visualization. Then the techniques used in VQA are subsequently grouped and explained, based on evolution, complexity in the dataset and the need for semantics in understanding the questions. In addition, the implementation of a VQA approach using VGGNet and LSTM is carried out for existing and improved datasets, and analyzed with accuracy and BLEU score metrics. The improved datasets, created through dataset reduction and augmentation approaches, resulted in better performance than the existing datasets. Finally, the challenges of the medical VQA domain are examined in terms of datasets, combining techniques, and modifying the parameters of existing performance metrics for future research.

Similar Papers
  • Conference Article

Bridging the Gap: Leveraging Textual and Visual Contexts for PreciseMedical Visual Question Answering

  • Aug 08, 2024
  • Pratiksh Kumar +3
  • PDF
  • Research Article
  • Citations5

Advancing Accuracy in Multimodal Medical Tasks Through Bootstrapped Language-Image Pretraining (BioMedBLIP): Performance Evaluation Study

  • Aug 05, 2024
  • JMIR Medical Informatics
  • Usman Naseem +2
  • Research Article
  • Citations49

Medical knowledge-based network for Patient-oriented Visual Question Answering

  • Dec 21, 2022
  • Information Processing & Management
  • Jian Huang +7
  • Research Article
  • Citations24

Visual question answering in the medical domain based on deep learning approaches: A comprehensive study

  • Oct 01, 2021
  • Pattern Recognition Letters
  • Aisha Al-Sadi +3
  • PDF
  • Research Article
  • Citations86

MedFuseNet:\xa0An\xa0attention-based multimodal deep learning model for visual question answering in the medical domain

  • Oct 06, 2021
  • Scientific Reports
  • Dhruv Sharma +2
  • Conference Article
  • Citations1

Adversarial Learning to Improve Question Image Embedding in Medical Visual Question Answering

  • Jul 27, 2022
  • Kaveesha Silva +3
  • Research Article
  • Citations75

Hierarchical deep multi-modal network for medical visual question answering

  • Oct 01, 2020
  • Expert Systems with Applications
  • Deepak Gupta +2
  • Research Article
  • Citations35

Interpretable medical image Visual Question Answering via multi-modal relationship graph learning

  • Jul 20, 2024
  • Medical Image Analysis
  • Xinyue Hu +7
  • Research Article

Visual question answering for medical diagnosis

  • Sep 01, 2025
  • Intelligent Systems with Applications
  • Nawel Ben Chaabane +1
  • Research Article

Medical Vision-Language Modeling With Semantic Interaction and Adaptive Refinement Prompting for Bias Mitigation.

  • Jan 01, 2025
  • IEEE journal of biomedical and health informatics
  • Cheng Li +5
  • Conference Article
  • Citations142

MMBERT: Multimodal BERT Pretraining for Improved Medical VQA

  • Apr 13, 2021
  • Yash Khare +5
  • Conference Article
  • Citations2

LifeLens: Deep Learning Based Application for the Visually Impaired

  • Dec 07, 2021
  • S Balasubramanian +4
  • Conference Article
  • Citations14

MoBVQA: A Modality based Medical Image Visual Question Answering System

  • Oct 01, 2019
  • A Lubna +2
  • Conference Article

SpineBench: Benchmarking Multimodal LLMs for Spinal Pathology Analysis

  • Oct 27, 2025
  • Chenghanyu Zhang +7
  • Conference Article
  • Citations13

A Sequence-to-Sequence Model Approach for ImageCLEF 2018 Medical Domain Visual Question Answering

  • Dec 01, 2018
  • Rahul Ambati +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.