• Home
  • Search
  • Semantic Reanalysis of Scene Words in Visual Question Answering
  • https://doi.org/10.1007/978-3-030-31654-9_40Copy DOI Icon

Semantic Reanalysis of Scene Words in Visual Question Answering

  • Jan 1, 2019
  • Shiling Jiang +8 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Visual Question Answering (VQA) is a joint task that aims to answer questions based on the given images. The correct analysis of multiple album aggregate issues to remain a key issue in the VQA case, especially when answering question from multiple albums, how to correctly understand album images and corresponding question is an urgent problem. Under the influence of multiple photo albums and the presence of scene words in the question, it may lead to understanding the wrong scene and outputting the wrong answer, resulting in a decrease in VQA performance. In order to solve this problem, this paper proposes a new image and sentence similarity matching model, which outputs the correct image representation by learning the semantic concept. Due to the scene word is not an entity, sometimes the information which the model extracted may be incorrect. Therefore, we can try to reanalyse the question in another different way and give the answer by the similarity between the question and the visual-text. Our model was tested on the MemexQA dataset. The experimental results show that our model not only produces meaningful text sentences to prove the correctness of the answer, but also improves the accuracy by nearly 10%.

Similar Papers
  • Conference Article
  • Citations11

CS-VQA: Visual Question Answering with Compressively Sensed Images

  • Oct 01, 2018
  • Li-Chi Huang +5
  • Research Article
  • Citations17

Accuracy vs. complexity: A trade-off in visual question answering models

  • Jun 12, 2021
  • Pattern Recognition
  • Moshiur Farazi +2
  • Conference Article
  • Citations1

Dynamic Co-attention Network for Visual Question Answering

  • Nov 26, 2021
  • Doaa B Ebaid +2
  • Research Article

VTFCGNet: a novel cross-modal reasoning network integrating Fourier self-attention and graph attention for visual text question answering

  • Feb 01, 2026
  • Neural Computing and Applications
  • Yujie Huo +3
  • PDF
  • Research Article
  • Citations59

Multimodal Encoder-Decoder Attention Networks for Visual Question Answering

  • Jan 01, 2020
  • IEEE Access
  • Chongqing Chen +2
  • PDF
  • Conference Article
  • Citations16

VQA-MHUG: A Gaze Dataset to Study Multimodal Neural Attention in Visual Question Answering

  • Jan 01, 2021
  • Ekta Sood +4
  • Research Article
  • Citations11

Fair-VQA: Fairness-Aware Visual Question Answering Through Sensitive Attribute Prediction

  • Jan 01, 2020
  • IEEE Access
  • Sungho Park +3
  • Research Article
  • Citations13

Local relation network with multilevel attention for visual question answering

  • Jan 20, 2020
  • Journal of Visual Communication and Image Representation
  • Bo Sun +3
  • Conference Article
  • Citations15

Feature Enhancement in Attention for Visual Question Answering

  • Jul 01, 2018
  • Yuetan Lin +3
  • PDF
  • Conference Article
  • Citations57

Generating Question Relevant Captions to Aid Visual Question Answering

  • Jan 01, 2019
  • Jialin Wu +2
  • Conference Article
  • Citations4

An Empirical Study on the Language Modal in Visual Question Answering

  • Aug 01, 2023
  • Daowan Peng +4
  • Conference Article
  • Citations3

Multi-Channel Co-Attention Network for Visual Question Answering

  • Jul 01, 2020
  • Weidong Tian +3
  • Research Article
  • Citations503

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Sep 11, 2018
  • International Journal of Computer Vision
  • Yash Goyal +5
  • Research Article
  • Citations15

MobiVQA

  • Jul 04, 2022
  • Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
  • Qingqing Cao +3
  • Conference Article
  • Citations59

Visual Question Answering as Reading Comprehension

  • Jun 01, 2019
  • Hui Li +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.