• Home
  • Search
  • Visual Question Answering over Scene Graph
  • Cite Icon28
  • https://doi.org/10.1109/gc46384.2019.00015Copy DOI Icon

Visual Question Answering over Scene Graph

  • Sep 1, 2019
  • Soohyeong Lee +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Visual question answering (VQA) is a task that takes an image and a related natural language question as input, and produces an answer as output. A successful VQA algorithm requires two key components: to obtain a structured representation of an image and to process a natural language question on the structured representation. While traditional VQA tasks work on raw images or image segmentation, recent VQA datasets such as CLEVR and GQA provide scene graphs that capture objects and their relationships expressed inside an image. However, even when the ground-truth scene graph is given, it is non-trivial to get the right answer to a natural language question, as it needs a sophisticated algorithm to process the scene graph and the question together. We propose to encode a scene graph and a question using Graph Network (GN). Then, we feed the encoded graph with the question to the Memory, Attention, and Composition (MAC) model to classify the answer. By including the question as a global vector in GN, we achieved the accuracy of 96.3% in GQA, surpassing 83.5% of the baseline method reported by the authors of GQA, which also used MAC to classify the answer. Our work suggests that a context-based encoding of the scene graph is crucial for graph-based reasoning tasks such as graph-related question answering.

Similar Papers
  • Research Article

NeSyVQA: Neurosymbolic Visual Question Answering with Knowledge-Enriched Scene Graphs

  • Jan 01, 2025
  • IEEE Access
  • M Jaleed Khan +2
  • Conference Article
  • Citations22

Lightweight Visual Question Answering using Scene Graphs

  • Oct 26, 2021
  • Sai Vidyaranya Nuthalapati +6
  • Research Article
  • Citations62

Scene Graph Refinement Network for Visual Question Answering

  • Jan 01, 2023
  • IEEE Transactions on Multimedia
  • Tianwen Qian +4
  • Book Chapter
  • Citations16

Learning Convolutional Text Representations for Visual Question Answering

  • May 07, 2018
  • Zhengyang Wang +1
  • Conference Article
  • Citations2

Estimating Viewed Images with Natural Language Question Answering from fMRI Data

  • Mar 01, 2020
  • Saya Takada +3
  • Conference Article
  • Citations59

Visual Question Answering as Reading Comprehension

  • Jun 01, 2019
  • Hui Li +3
  • Research Article
  • Citations11

VQA as a factoid question answering problem: A novel approach for knowledge-aware and explainable visual question answering

  • Oct 24, 2021
  • Image and Vision Computing
  • Abhishek Narayanan +3
  • Conference Article
  • Citations11

Memory-Based Network for Scene Graph with Unbalanced Relations

  • Oct 12, 2020
  • Weitao Wang +5
  • Research Article
  • Citations127

NuScenes-QA: A Multi-Modal Visual Question Answering Benchmark for Autonomous Driving Scenario

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Tianwen Qian +4
  • Research Article
  • Citations10

Visual Question Answering

  • Jul 13, 2022
  • International Journal of Advanced Research in Science, Communication and Technology
  • Dr Sai Madhavi D +3
  • Research Article
  • Citations624

VQA: Visual Question Answering

  • Nov 08, 2016
  • International Journal of Computer Vision
  • Aishwarya Agrawal +6
  • PDF
  • Research Article
  • Citations1

Visual Experience-Based Question Answering with Complex Multimodal Environments

  • Nov 19, 2020
  • Mathematical Problems in Engineering
  • Incheol Kim
  • Research Article
  • Citations49

Spatiotemporal-Textual Co-Attention Network for Video Question Answering

  • Apr 30, 2019
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Zheng-Jun Zha +3
  • Conference Article
  • Citations2

EdgeNet for efficient scene graph classification

  • Jul 18, 2022
  • Vivek B.S +4
  • Research Article

DSGEM: Dual scene graph enhancement module‐based visual question answering

  • Mar 07, 2023
  • IET Computer Vision
  • Boyue Wang +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.