• Home
  • Search
  • Diversity Learning Based on Multi-Latent Space for Medical Image Visual Question Generation
  • Cite Icon8
  • https://doi.org/10.3390/s23031057Copy DOI Icon

Diversity Learning Based on Multi-Latent Space for Medical Image Visual Question Generation

Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Auxiliary clinical diagnosis has been researched to solve unevenly and insufficiently distributed clinical resources. However, auxiliary diagnosis is still dominated by human physicians, and how to make intelligent systems more involved in the diagnosis process is gradually becoming a concern. An interactive automated clinical diagnosis with a question-answering system and a question generation system can capture a patient’s conditions from multiple perspectives with less physician involvement by asking different questions to drive and guide the diagnosis. This clinical diagnosis process requires diverse information to evaluate a patient from different perspectives to obtain an accurate diagnosis. Recently proposed medical question generation systems have not considered diversity. Thus, we propose a diversity learning-based visual question generation model using a multi-latent space to generate informative question sets from medical images. The proposed method generates various questions by embedding visual and language information in different latent spaces, whose diversity is trained by our newly proposed loss. We have also added control over the categories of generated questions, making the generated questions directional. Furthermore, we use a new metric named similarity to accurately evaluate the proposed model’s performance. The experimental results on the Slake and VQA-RAD datasets demonstrate that the proposed method can generate questions with diverse information. Our model works with an answering model for interactive automated clinical diagnosis and generates datasets to replace the process of annotation that incurs huge labor costs.

Loading PDF

Similar Papers
  • Research Article

An approach to medical visual question generation based on question categories

  • Oct 16, 2025
  • Journal of the Chinese Institute of Engineers
  • N Sheerin Sitara +3
  • Book Chapter
  • Citations1

Automated Question Generation and Answer Verification Using Visual Data

  • Jan 01, 2020
  • Shrey Nahar +4
  • PDF
  • Conference Article
  • Citations16

Visual Question Generation from Radiology Images

  • Jan 01, 2020
  • Mourad Sarrouti +2
  • Supplementary Content
  • Citations114

Automatic question generation: a review of methodologies, datasets, evaluation metrics, and applications

  • Jan 01, 2023
  • Progress in Artificial Intelligence
  • Nikahat Mulla +1
  • Research Article
  • Citations1

ConVQG: Contrastive Visual Question Generation with Multimodal Guidance

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Li Mi +5
  • PDF
  • Research Article
  • Citations8

Goal-Driven Visual Question Generation from Radiology Images

  • Aug 20, 2021
  • Information
  • Mourad Sarrouti +2
  • Dissertation

Automatic question generation from natural language texts

  • Jan 01, 2022
  • Zhen Cao
  • Conference Article
  • Citations8

Deconfounded Visual Question Generation with Causal Inference

  • Oct 26, 2023
  • Jiali Chen +4
  • Conference Article
  • Citations6

Thematic Question Generation over Knowledge Bases

  • Dec 01, 2018
  • Tanguy Raynaud +2
  • Conference Article
  • Citations7

Weak Supervision Enhanced Generative Network for Question Generation

  • Aug 01, 2019
  • Yutong Wang +5
  • PDF
  • Research Article
  • Citations16

DATLMedQA: A Data Augmentation and Transfer Learning Based Solution for Medical Question Answering

  • Nov 26, 2021
  • Applied Sciences
  • Shuohua Zhou +1
  • Conference Article
  • Citations9

K-VQG: Knowledge-aware Visual Question Generation for Common-sense Acquisition

  • Jan 01, 2023
  • Kohei Uehara +1
  • PDF
  • Conference Article
  • Citations20

Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needs

  • Jan 01, 2022
  • Xu Wang +3
  • Video Transcripts

Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needs

  • Jun 27, 2022
  • Underline Science Inc.
  • Simin Fan +3
  • Video Transcripts

Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needs

  • Jun 27, 2022
  • Underline Science Inc.
  • Lu Wang +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.