• Home
  • Search
  • Towards Open Ended and Free Form Visual Question Answering: Modeling VQA as a Factoid Question Answering Problem
  • Cite Icon1
  • https://doi.org/10.1007/978-981-15-9774-9_69Copy DOI Icon

Towards Open Ended and Free Form Visual Question Answering: Modeling VQA as a Factoid Question Answering Problem

  • Jan 1, 2021
  • Abhishek Narayanan +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Visual Question Answering (VQA) is a multi disciplinary challenging problem involving various fields such as Natural Language Processing, Computer Vision, Deep Learning and Knowledge Representation, which has garnered much interest among researchers, especially with the recent advancements in machine perception. The problem at hand not only involves reasoning over visual elements present in the image or natural language understanding of the input query, but also may involve outside world knowledge in order to infer the answer. In this paper, we convert the VQA problem to a factoid question answering task over a set of natural language facts extracted from images in the Visual Genome Dataset [1]. Recent literatures in textual question answering have established the effectiveness of End to End Memory Networks (MemN2N) over the standard LSTMs. Inspired by the approaches incorporated by researchers in this direction, as a first step to create an explainable VQA model, this paper proposes the incorporation of MemN2N with soft attention for inferring the answer from a set of regional facts extracted from the image. We also experiment with the addition of a Bayesian Neural layer for posterior reasoning of the answer from a fixed vocabulary, as proposed in [2] which shows a significant improvement in the accuracy score compared to the other models tested.

Similar Papers
  • PDF
  • Research Article
  • Citations2

Visual Question Answering for Intelligent Interaction

  • Jul 06, 2022
  • Mobile Information Systems
  • Panpan Gao +4
  • Dissertation
  • Citations1

A Convolutional Neural Network Based Approach For Visual Question Answering

  • Apr 01, 2018
  • Lavanya Abhinaya Koduri
  • Research Article

Overcoming the Limitations of Learning-Based VQA for Counting Questions with Zero-Shot Learning

  • Aug 20, 2024
  • International Journal on Artificial Intelligence Tools
  • A Lubna +1
  • Research Article
  • Citations17

Inner Knowledge-based Img2Doc Scheme for Visual Question Answering

  • Mar 04, 2022
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Qun Li +4
  • Book Chapter
  • Citations1

Towards Fine-Tuning of VQA Models in Public Datasets

  • Nov 03, 2020
  • Miguel E Ortiz +4
  • Research Article

Bridging the Gap Between Question and Answer: A Comprehensive Analysis on Medical Question Answering Systems

  • Feb 25, 2025
  • Journal of Information Systems Engineering and Management
  • Keerthana Sm
  • Conference Article
  • Citations2

Visual Question Answering Using Deep Learning

  • Nov 27, 2021
  • Deepika Kanakamedala +4
  • Research Article
  • Citations11

VQA as a factoid question answering problem: A novel approach for knowledge-aware and explainable visual question answering

  • Oct 24, 2021
  • Image and Vision Computing
  • Abhishek Narayanan +3
  • Research Article
  • Citations297

Visual question answering: Datasets, algorithms, and future challenges

  • Jun 13, 2017
  • Computer Vision and Image Understanding
  • Kushal Kafle +1
  • Conference Article
  • Citations47

Quantifying and Alleviating the Language Prior Problem in Visual Question Answering

  • Jul 18, 2019
  • Yangyang Guo +5
  • Conference Article
  • Citations3

NLP Meets Vision for Visual Interpretation - A Retrospective Insight and Future directions

  • May 20, 2021
  • Ahmed Jamshed +1
  • Conference Article
  • Citations2

A Survey on Visual Question Answering

  • Oct 01, 2021
  • Mrinal Banchhor +1
  • Research Article
  • Citations78

Rich Visual Knowledge-Based Augmentation Network for Visual Question Answering

  • Sep 17, 2020
  • IEEE Transactions on Neural Networks and Learning Systems
  • Liyang Zhang +6
  • PDF
  • Conference Article
  • Citations27

Improving Visual Question Answering by Referring to Generated Paragraph Captions

  • Jan 01, 2019
  • Hyounghun Kim +1
  • Conference Article
  • Citations2

Beyond Words: Exploring Co-Attention with BERT in Visual Question Answering

  • May 24, 2024
  • Vibhashree B S +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.