• Home
  • Search
  • An approach to medical visual question generation based on question categories
  • https://doi.org/10.1080/02533839.2025.2558180Copy DOI Icon

An approach to medical visual question generation based on question categories

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

ABSTRACT The Visual Question Generation (VQG) is a research field that aims to generate natural language questions for given images. These images are of two types, namely natural and medical images. VQG for medical images has gained attention in the last few years for two reasons: (i) It allows the user to ask the question based on the input image, (ii) It reduces the burden on medical annotators. Even though there has been considerable improvement in Medical VQG (MVQG), it is still in the developing stage. This is because the dataset scarcity problem and a generalized model for different VQG questions are yet to be resolved. To address these issues, a MVQG system is proposed to reduce the data scarcity problem to some extent. The developed MVQG system generates all possible questions based on different categories (organ, plane, modality and abnormality) using deep learning techniques. The Convolutional Neural Network (CNN), Multi-Layer Perceptron (MLP) and Long Short Term Memory (LSTM) along with latent space encoding are used in generating questions for three datasets namely, VQA-RAD, VQA-MED 2019 and VQA-MED 2021. As a result, the proposed approach attained the BLEU score of 37.0%, 35.5% and 31.6% for VQA-RAD, VQA-MED 2019 and VQA-MED 2021 datasets respectively. The questions generated from the proposed MVQG approach can be used to develop an improved Medical Visual Question Answering (MVQA) system.

Similar Papers
  • Book Chapter
  • Citations1

Automated Question Generation and Answer Verification Using Visual Data

  • Jan 01, 2020
  • Shrey Nahar +4
  • PDF
  • Research Article
  • Citations8

Goal-Driven Visual Question Generation from Radiology Images

  • Aug 20, 2021
  • Information
  • Mourad Sarrouti +2
  • PDF
  • Research Article
  • Citations8

Diversity Learning Based on Multi-Latent Space for Medical Image Visual Question Generation

  • Jan 17, 2023
  • Sensors (Basel, Switzerland)
  • He Zhu +3
  • Conference Article
  • Citations9

K-VQG: Knowledge-aware Visual Question Generation for Common-sense Acquisition

  • Jan 01, 2023
  • Kohei Uehara +1
  • PDF
  • Conference Article
  • Citations16

Visual Question Generation from Radiology Images

  • Jan 01, 2020
  • Mourad Sarrouti +2
  • Research Article
  • Citations18

A comparative analysis of deep learning models for soil temperature prediction in cold climates

  • Dec 13, 2023
  • Theoretical and Applied Climatology
  • Hanifeh Imanian +6
  • Research Article
  • Citations22

Visual Question Generation

  • May 28, 2020
  • ACM Computing Surveys
  • Charulata Patil +1
  • PDF
  • Research Article
  • Citations327

Groundwater level forecasting with artificial neural networks: a comparison of long short-term memory (LSTM), convolutional neural networks (CNNs), and non-linear autoregressive networks with exogenous input (NARX)

  • Apr 01, 2021
  • Hydrology and Earth System Sciences
  • Andreas Wunsch +2
  • Book Chapter
  • Citations1

Gujarati Task Oriented Dialogue Slot Tagging Using Deep Neural Network Models

  • Jan 01, 2021
  • Rachana Parikh +1
  • Research Article

Semantic based medical visual question answering with explainable artificial intelligence

  • Jun 01, 2025
  • IAES International Journal of Artificial Intelligence (IJ-AI)
  • Sheerin Sitara Noor Mohamed +2
  • PDF
  • Research Article
  • Citations10

Cybersecurity in Deep Learning Techniques: Detecting Network Attacks

  • Jan 01, 2022
  • International Journal of Advanced Computer Science and Applications
  • Shatha Fawaz Ghazal +1
  • PDF
  • Research Article
  • Citations43

Convolutional neural network and long short-term memory models for ice-jam predictions

  • Apr 22, 2022
  • The Cryosphere
  • Fatemehalsadat Madaeni +5
  • Conference Article
  • Citations211

Visual Question Generation as Dual Task of Visual Question Answering

  • Jun 01, 2018
  • Yikang Li +6
  • Preprint Article
  • Citations8

Performance comparison of single and ensemble CNN, LSTM and traditional ANN models for short-term electricity load forecasting

  • Oct 27, 2022
  • Arurun Kathirgamanathan +4
  • Preprint Article

Performance comparison of single and ensemble CNN, LSTM and traditional ANN models for short-term electricity load forecasting

  • Oct 27, 2022
  • Arurun Kathirgamanathan +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.