• Home
  • Search
  • Multimodal Attention for Visual Question Answering
  • https://doi.org/10.1007/978-3-030-01174-1_60Copy DOI Icon

Multimodal Attention for Visual Question Answering

  • Nov 2, 2018
  • Lorena Kodra +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Visual Question Answering (VQA) is a task where given an image and a natural language question about the image the aim is to provide an accurate natural language answer. In recent years a lot of work has been done in this area in order to address the challenges that this task presents and improve the accuracy of the models. One of the new concepts that have been recently introduced is the attention mechanism where the model focuses on specific parts of the input in order to generate the answer. In this paper, we present a novel LSTM architecture for VQA that uses multimodal attention to focus over specific parts of the image and also on specific words of the question in order to generate a more precise answer. We evaluate our proposed solution on the VQA dataset and show that it performs better compared with state-of-the-art models.

Similar Papers
  • Book Chapter
  • Citations49

Visual Question Answering Using Deep Learning: A Survey and Performance Analysis

  • Jan 01, 2021
  • Yash Srivastava +3
  • Research Article
  • Citations23

Dual Attention and Question Categorization-Based Visual Question Answering

  • Feb 01, 2023
  • IEEE Transactions on Artificial Intelligence
  • Aakansha Mishra +2
  • Research Article

Incorporating Verb Semantic Information in Visual Question Answering Through Multitask Learning Paradigm

  • Jun 01, 2020
  • International Journal of Semantic Computing
  • Mehrdad Alizadeh +1
  • Book Chapter

Multi-view Visual Question Answering Dataset for Real Environment Applications

  • Jan 01, 2020
  • Yue Qiu +3
  • Conference Article
  • Citations2

A Survey on Visual Question Answering

  • Oct 01, 2021
  • Mrinal Banchhor +1
  • Conference Article
  • Citations59

Visual Question Answering as Reading Comprehension

  • Jun 01, 2019
  • Hui Li +3
  • PDF
  • Conference Article
  • Citations150

ConceptBert: Concept-Aware Representation for Visual Question Answering

  • Jan 01, 2020
  • François Gardères +3
  • Conference Article
  • Citations2

Estimating Viewed Images with Natural Language Question Answering from fMRI Data

  • Mar 01, 2020
  • Saya Takada +3
  • Research Article
  • Citations503

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Sep 11, 2018
  • International Journal of Computer Vision
  • Yash Goyal +5
  • Dissertation
  • Citations1

A Convolutional Neural Network Based Approach For Visual Question Answering

  • Apr 01, 2018
  • Lavanya Abhinaya Koduri
  • Conference Article
  • Citations603

VizWiz Grand Challenge: Answering Visual Questions from Blind People

  • Jun 01, 2018
  • Danna Gurari +7
  • Conference Article
  • Citations2

CarParkingVQA: Visual Question Answering application on Car parking occupancy detection

  • Nov 24, 2022
  • Vikash Hela +2
  • Conference Article

Bridging the Gap: Leveraging Textual and Visual Contexts for PreciseMedical Visual Question Answering

  • Aug 08, 2024
  • Pratiksh Kumar +3
  • Research Article
  • Citations624

VQA: Visual Question Answering

  • Nov 08, 2016
  • International Journal of Computer Vision
  • Aishwarya Agrawal +6
  • Conference Article
  • Citations1

S-VQA: Sentence-Based Visual Question Answering

  • Dec 15, 2023
  • Sanchit Pathak +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.