• Home
  • Search
  • Toward Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baseline
  • Open Access IconOpen Access
  • Cite Icon27
  • https://doi.org/10.1109/tcsvt.2022.3229081Copy DOI Icon

Toward Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baseline

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Recently, 3D vision-and-language tasks have attracted increasing research interest. Compared to other vision-and-language tasks, the 3D visual question answering (VQA) task is less exploited and is more susceptible to language priors and co-reference ambiguity. Meanwhile, a couple of recently proposed 3D VQA datasets do not well support 3D VQA task due to their limited scale and annotation methods. In this work, we formally define and address a 3D grounded VQA task by collecting a new 3D VQA dataset, referred to as FE-3DGQA, with diverse and relatively free-form question-answer pairs, as well as dense and completely grounded bounding box annotations. To achieve more explainable answers, we label the objects appeared in the complex QA pairs with different semantic types, including answer-grounded objects (both appeared and not appeared in the questions), and contextual objects for answer-grounded objects. We also propose a new 3D VQA framework to effectively predict the completely visually grounded and explainable answer. Extensive experiments verify that our newly collected bench-mark datasets can be effectively used to evaluate various 3D VQA methods from different aspects and our newly proposed framework also achieves the state-of-the-art performance on the new benchmark dataset. The datasets and the source code are available via https://github.com/zlccccc/3DVL_Codebase.

Similar Papers
  • Research Article
  • Citations30

Improving Automatic VQA Evaluation Using Large Language Models

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Oscar Mañas +2
  • Conference Article
  • Citations48

Coarse-to-Fine Reasoning for Visual Question Answering

  • Jun 01, 2022
  • Binh X Nguyen +5
  • Research Article
  • Citations6

Explanation vs. attention: A two-player game to obtain attention for VQA and visual dialog

  • Jul 23, 2022
  • Pattern Recognition
  • Badri N Patro +2
  • Research Article
  • Citations29

Explanation vs Attention: A Two-Player Game to Obtain Attention for VQA

  • Apr 03, 2020
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Badri Patro +2
  • Research Article
  • Citations2

Hierarchical Attention Networks for Multimodal Machine Learning

  • Mar 01, 2022
  • Journal of Physics Conference Series
  • Haotian Liang +1
  • Research Article

Visual Question Answering Using Semantic Information from Image Descriptions

  • Apr 18, 2021
  • The International FLAIRS Conference Proceedings
  • Tasmia Tasmia +2
  • PDF
  • Conference Article
  • Citations23

Recommending Themes for Ad Creative Design via Visual-Linguistic Representations

  • Apr 20, 2020
  • Yichao Zhou +4
  • Conference Article
  • Citations2558

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Jul 01, 2017
  • Yash Goyal +4
  • Book Chapter
  • Citations5

Neural Networks for Detecting Irrelevant Questions During Visual Question Answering

  • Jan 01, 2020
  • Mengdi Li +2
  • Book Chapter

Multi-view Visual Question Answering Dataset for Real Environment Applications

  • Jan 01, 2020
  • Yue Qiu +3
  • Research Article

NeSyVQA: Neurosymbolic Visual Question Answering with Knowledge-Enriched Scene Graphs

  • Jan 01, 2025
  • IEEE Access
  • M Jaleed Khan +2
  • Conference Article
  • Citations211

Visual Question Generation as Dual Task of Visual Question Answering

  • Jun 01, 2018
  • Yikang Li +6
  • Research Article
  • Citations19

Achieving Human Parity on Visual Question Answering

  • Apr 04, 2023
  • ACM Transactions on Information Systems
  • Ming Yan +11
  • Research Article
  • Citations9

VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Ziyi Yin +7
  • Research Article
  • Citations53

Visual Question Answering: A Tutorial

  • Nov 01, 2017
  • IEEE Signal Processing Magazine
  • Damien Teney +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.