• Home
  • Search
  • Coarse-to-Fine Reasoning for Visual Question Answering
  • Open Access IconOpen Access
  • Cite Icon48
  • https://doi.org/10.1109/cvprw56347.2022.00502Copy DOI Icon

Coarse-to-Fine Reasoning for Visual Question Answering

  • Jun 1, 2022
  • Binh X Nguyen +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Bridging the semantic gap between image and question is an important step to improve the accuracy of the Visual Question Answering (VQA) task. However, most of the existing VQA methods focus on attention mechanisms or visual relations for reasoning the answer, while the features at different semantic levels are not fully utilized. In this paper, we present a new reasoning framework to fill the gap between visual features and semantic clues in the VQA task. Our method first extracts the features and predicates from the image and question. We then propose a new reasoning framework to effectively jointly learn these features and predicates in a coarse-to-fine manner. The intensively experimental results on three large-scale VQA datasets show that our proposed approach achieves superior accuracy comparing with other state-of-the-art methods. Furthermore, our reasoning framework also provides an explainable way to understand the decision of the deep neural network when predicting the answer. Our source codes can be found at: https://github.com/aioz-ai/CFR_VQA

Similar Papers
  • Research Article
  • Citations30

Improving Automatic VQA Evaluation Using Large Language Models

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Oscar Mañas +2
  • Research Article
  • Citations27

Toward Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baseline

  • Jun 01, 2023
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Lichen Zhao +8
  • Research Article
  • Citations2

Hierarchical Attention Networks for Multimodal Machine Learning

  • Mar 01, 2022
  • Journal of Physics Conference Series
  • Haotian Liang +1
  • Research Article

Visual Question Answering Using Semantic Information from Image Descriptions

  • Apr 18, 2021
  • The International FLAIRS Conference Proceedings
  • Tasmia Tasmia +2
  • Research Article
  • Citations6

Explanation vs. attention: A two-player game to obtain attention for VQA and visual dialog

  • Jul 23, 2022
  • Pattern Recognition
  • Badri N Patro +2
  • Research Article
  • Citations29

Explanation vs Attention: A Two-Player Game to Obtain Attention for VQA

  • Apr 03, 2020
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Badri Patro +2
  • Research Article
  • Citations3

Enhancing visual question answering with a two‐way co‐attention mechanism and integrated multimodal features

  • Dec 21, 2023
  • Computational Intelligence
  • Mayank Agrawal +2
  • PDF
  • Conference Article
  • Citations23

Recommending Themes for Ad Creative Design via Visual-Linguistic Representations

  • Apr 20, 2020
  • Yichao Zhou +4
  • Conference Article
  • Citations2558

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Jul 01, 2017
  • Yash Goyal +4
  • Book Chapter
  • Citations5

Neural Networks for Detecting Irrelevant Questions During Visual Question Answering

  • Jan 01, 2020
  • Mengdi Li +2
  • Conference Article
  • Citations211

Visual Question Generation as Dual Task of Visual Question Answering

  • Jun 01, 2018
  • Yikang Li +6
  • Book Chapter

Multi-view Visual Question Answering Dataset for Real Environment Applications

  • Jan 01, 2020
  • Yue Qiu +3
  • Research Article
  • Citations19

Achieving Human Parity on Visual Question Answering

  • Apr 04, 2023
  • ACM Transactions on Information Systems
  • Ming Yan +11
  • Research Article
  • Citations472

The multi-modal fusion in visual question answering: a review of attention mechanisms.

  • May 30, 2023
  • PeerJ Computer Science
  • Siyu Lu +5
  • Conference Article
  • Citations2

Estimating Viewed Images with Natural Language Question Answering from fMRI Data

  • Mar 01, 2020
  • Saya Takada +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.