• Home
  • Search
  • Visual Question Generation from Radiology Images
  • Cite Icon16
  • https://doi.org/10.18653/v1/2020.alvr-1.3Copy DOI Icon

Visual Question Generation from Radiology Images

  • Jan 1, 2020
  • Mourad Sarrouti +2 more
Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Visual Question Generation (VQG), the task of generating a question based on image contents, is an increasingly important area that combines natural language processing and computer vision. Although there are some recent works that have attempted to generate questions from images in the open domain, the task of VQG in the medical domain has not been explored so far. In this paper, we introduce an approach to generation of visual questions about radiology images called VQGR, i.e. an algorithm that is able to ask a question when shown an image. VQGR first generates new training data from the existing examples, based on contextual word embeddings and image augmentation techniques. It then uses the variational auto-encoders model to encode images into a latent space and decode natural language questions. Experimental automatic evaluations performed on the VQA-RAD dataset of clinical visual questions show that VQGR achieves good performances compared with the baseline system. The source code is available at https://github.com/ sarrouti/vqgr.

Loading PDF

Similar Papers
  • PDF
  • Research Article
  • Citations8

Goal-Driven Visual Question Generation from Radiology Images

  • Aug 20, 2021
  • Information
  • Mourad Sarrouti +2
  • Book Chapter
  • Citations1

Automated Question Generation and Answer Verification Using Visual Data

  • Jan 01, 2020
  • Shrey Nahar +4
  • Research Article

An approach to medical visual question generation based on question categories

  • Oct 16, 2025
  • Journal of the Chinese Institute of Engineers
  • N Sheerin Sitara +3
  • PDF
  • Research Article
  • Citations8

Diversity Learning Based on Multi-Latent Space for Medical Image Visual Question Generation

  • Jan 17, 2023
  • Sensors (Basel, Switzerland)
  • He Zhu +3
  • Conference Article
  • Citations211

Visual Question Generation as Dual Task of Visual Question Answering

  • Jun 01, 2018
  • Yikang Li +6
  • Research Article
  • Citations22

Visual Question Generation

  • May 28, 2020
  • ACM Computing Surveys
  • Charulata Patil +1
  • Conference Article
  • Citations7

Generating Natural Questions from Images for Multimodal Assistants

  • Jun 06, 2021
  • Alkesh Patel +4
  • Supplementary Content
  • Citations114

Automatic question generation: a review of methodologies, datasets, evaluation metrics, and applications

  • Jan 01, 2023
  • Progress in Artificial Intelligence
  • Nikahat Mulla +1
  • Conference Article
  • Citations8

Deconfounded Visual Question Generation with Causal Inference

  • Oct 26, 2023
  • Jiali Chen +4
  • Research Article
  • Citations4

Ask Questions With Double Hints: Visual Question Generation With Answer-Awareness and Region-Reference.

  • Dec 01, 2024
  • IEEE transactions on pattern analysis and machine intelligence
  • Kai Shen +6
  • Research Article
  • Citations1

ConVQG: Contrastive Visual Question Generation with Multimodal Guidance

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Li Mi +5
  • Conference Article
  • Citations9

K-VQG: Knowledge-aware Visual Question Generation for Common-sense Acquisition

  • Jan 01, 2023
  • Kohei Uehara +1
  • Conference Article
  • Citations4

Attention-based Visual Question Generation

  • Mar 05, 2021
  • Charulata Patil +1
  • Conference Article
  • Citations4

UAV-VQG: Visual Question Generation Framework on UAV Images

  • Dec 15, 2021
  • Argho Sarkar +1
  • Research Article
  • Citations21

Exploring Duality in Visual Question-Driven Top-Down Saliency.

  • Jan 01, 2019
  • IEEE Transactions on Neural Networks and Learning Systems
  • Shengfeng He +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.