• Home
  • Search
  • Exploring Duality in Visual Question-Driven Top-Down Saliency.
  • Cite Icon21
  • https://doi.org/10.1109/tnnls.2019.2933439Copy DOI Icon

Exploring Duality in Visual Question-Driven Top-Down Saliency.

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Top-down, goal-driven visual saliency exerts a huge influence on the human visual system for performing visual tasks. Text generations, like visual question answering (VQA) and visual question generation (VQG), have intrinsic connections with top-down saliency, which is usually involved in both VQA and VQG processes in an unsupervised manner. However, it is shown that the regions that humans choose to look at to answer questions are very different from the unsupervised attention models. In this brief, we aim to explore the intrinsic relationship between top-down saliency and text generations, and to figure out whether an accurate saliency response benefits text generation. To this end, we propose a dual supervised network with dynamic parameter prediction. Dual-supervision explicitly exploits the probabilistic correlation between the primal task top-down saliency detection and the dual task text generation, while dynamic parameter prediction encodes the given text (i.e., question or answer) into the fully convolutional network. Extensive experiments show the proposed top-down saliency method achieves the best correlation with human attention among various baselines. In addition, the proposed model can be guided by either questions or answers, and output the counterpart. Furthermore, we show that combining human-like visual question-saliency improves the performance of both answer and question generations.

Similar Papers
  • Conference Article
  • Citations211

Visual Question Generation as Dual Task of Visual Question Answering

  • Jun 01, 2018
  • Yikang Li +6
  • Book Chapter
  • Citations1

Automated Question Generation and Answer Verification Using Visual Data

  • Jan 01, 2020
  • Shrey Nahar +4
  • Conference Article
  • Citations7

Generating Natural Questions from Images for Multimodal Assistants

  • Jun 06, 2021
  • Alkesh Patel +4
  • Research Article
  • Citations74

Radial Graph Convolutional Network for Visual Question Generation.

  • Apr 01, 2021
  • IEEE Transactions on Neural Networks and Learning Systems
  • Xing Xu +4
  • Research Article

VTFCGNet: a novel cross-modal reasoning network integrating Fourier self-attention and graph attention for visual text question answering

  • Feb 01, 2026
  • Neural Computing and Applications
  • Yujie Huo +3
  • Research Article
  • Citations22

Visual Question Generation

  • May 28, 2020
  • ACM Computing Surveys
  • Charulata Patil +1
  • Conference Article
  • Citations4

UAV-VQG: Visual Question Generation Framework on UAV Images

  • Dec 15, 2021
  • Argho Sarkar +1
  • PDF
  • Conference Article
  • Citations27

Improving Visual Question Answering by Referring to Generated Paragraph Captions

  • Jan 01, 2019
  • Hyounghun Kim +1
  • Research Article
  • Citations36

Answer Questions with Right Image Regions: A Visual Attention Regularization Approach

  • Mar 04, 2022
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Yibing Liu +6
  • Conference Article

GIICS: A dataset for gaze-direction-based intention inference in complex visual scenes

  • Nov 28, 2025
  • Qianxi Yu +5
  • Conference Article
  • Citations110

Two Can Play This Game: Visual Dialog with Discriminative Question Generation and Answering

  • Jun 01, 2018
  • Unnat Jain +2
  • Research Article
  • Citations15

MobiVQA

  • Jul 04, 2022
  • Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
  • Qingqing Cao +3
  • Research Article

An approach to medical visual question generation based on question categories

  • Oct 16, 2025
  • Journal of the Chinese Institute of Engineers
  • N Sheerin Sitara +3
  • Conference Article
  • Citations7

Learning to Ask Informative Sub-Questions for Visual Question Answering

  • Jun 01, 2022
  • Kohei Uehara +2
  • Conference Article
  • Citations29

Contrast and Classify: Training Robust VQA Models

  • Oct 01, 2021
  • Yash Kant +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.