• Home
  • Search
  • Visual Question Generation From Remote Sensing Images
  • Cite Icon20
  • https://doi.org/10.1109/jstars.2023.3261361Copy DOI Icon

Visual Question Generation From Remote Sensing Images

  • Abstract
  • Highlights & Summary
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Visual question generation (VQG) is a fundamental task in vision-language understanding that aims to generate relevant questions about the given input image. In this paper, we propose a paragraph-based VQG approach for generating intelligent questions in natural language about remote sensing (RS) images. Specifically, our proposed framework consists of two transformer-based vision and language models. First, we employ a swin-transformer encoder to generate a multi-scale representative visual feature from the image. Then, this feature is used as a prefix to guide a generative pre-trained transformer-2 (GPT-2) decoder in generating multiple questions in the form of a paragraph to cover the abundant visual information contained in the RS scene. To train the model, the language decoder is fine-tuned on RS dataset to generate a set of relevant questions from the RS image. We evaluate our model on two visual question-answering (VQA) datasets in RS. Additionally, we construct a new dataset termed TextRS-VQA for better evaluation for our VQG model. This dataset consists of questions completely annotated by humans which addresses the high redundancy of the questions in prior VQA datasets. Extensive experiments using several accuracy and diversity metrics demonstrate the effectiveness of our proposed VQG model in generating meaningful, valid, and diverse questions from RS images. The TextRS-VQA dataset is available at: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/yakoubbazi/TextRS</uri> .

Similar Papers
  • Conference Article
  • Citations3

RSVLM-QA: A Benchmark Dataset for Remote Sensing Vision Language Model-based Question Answering

  • Oct 27, 2025
  • Xing Zi +6
  • Book Chapter

Multi-view Visual Question Answering Dataset for Real Environment Applications

  • Jan 01, 2020
  • Yue Qiu +3
  • Conference Article
  • Citations127

VQS: Linking Segmentations to Questions and Answers for Supervised Attention in VQA and Question-Focused Semantic Segmentation

  • Oct 01, 2017
  • Chuang Gan +4
  • Conference Article
  • Citations603

VizWiz Grand Challenge: Answering Visual Questions from Blind People

  • Jun 01, 2018
  • Danna Gurari +7
  • Book Chapter
  • Citations49

Visual Question Answering Using Deep Learning: A Survey and Performance Analysis

  • Jan 01, 2021
  • Yash Srivastava +3
  • Research Article

Visual question answering-based image-finding generation for pulmonary nodules on chest CT from structured annotations.

  • Mar 27, 2026
  • International journal of computer assisted radiology and surgery
  • Maiko Nagao +5
  • Conference Article
  • Citations2

A Survey on Visual Question Answering

  • Oct 01, 2021
  • Mrinal Banchhor +1
  • PDF
  • Conference Article
  • Citations150

ConceptBert: Concept-Aware Representation for Visual Question Answering

  • Jan 01, 2020
  • François Gardères +3
  • Research Article

Incorporating Verb Semantic Information in Visual Question Answering Through Multitask Learning Paradigm

  • Jun 01, 2020
  • International Journal of Semantic Computing
  • Mehrdad Alizadeh +1
  • Book Chapter

Multimodal Attention for Visual Question Answering

  • Nov 02, 2018
  • Lorena Kodra +1
  • Research Article
  • Citations23

Dual Attention and Question Categorization-Based Visual Question Answering

  • Feb 01, 2023
  • IEEE Transactions on Artificial Intelligence
  • Aakansha Mishra +2
  • Research Article
  • Citations503

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Sep 11, 2018
  • International Journal of Computer Vision
  • Yash Goyal +5
  • Research Article

Visual Question Generation from Remote Sensing Images Using Gemini API

  • Mar 31, 2024
  • International Journal for Research in Applied Science and Engineering Technology
  • M Kamala
  • Conference Article
  • Citations2

CarParkingVQA: Visual Question Answering application on Car parking occupancy detection

  • Nov 24, 2022
  • Vikash Hela +2
  • Conference Article
  • Citations211

Visual Question Generation as Dual Task of Visual Question Answering

  • Jun 01, 2018
  • Yikang Li +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.