• Home
  • Search
  • Flexible Sentence Analysis Model for Visual Question Answering Network
  • https://doi.org/10.1145/3278198.3278207Copy DOI Icon

Flexible Sentence Analysis Model for Visual Question Answering Network

  • Sep 19, 2018
  • Wei Deng +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Nowadays, visual question answering (VQA) has attracted much attention in both computer vision and natural language processing. Generally, a VQA system adopts sentence analysis models that decompose the sentence to short parts to analyze the user's attempt and merge partial results to get final answer. Despite the success of those models, the correct analysis of long length questions still remains as a key problem in VQA case. Especially, when a sentence produces comprehensive deviation due to different situation or customs of questioners, the sentence analysis model might output a wrong answer and lead to severe performance drop of the VQA system. To tackle the problem, a new sentence comprehension model has been proposed in this paper. The model is named flexible analysis model and is mainly used to deal with the sentences related to object counting. In human dialogue case, when the first answer went wrong, people would change a way to comprehend the sentence for finding the correct answer. Inspired by the mechanism, the flexible sentence analysis model tries another different way to comprehend the sentence after the sentence is given a wrong number answer, and the VQA system can generate a new answer according to the new output. Our model was tested on CLEVR dataset, and the experiment result shows that our method improved the accuracy nearly 10.5% in long sentence cases. It proves that our network has better performance on both correctness and robustness.

Similar Papers
  • Conference Article
  • Citations2

VQAR: Review on Information Retrieval Techniques based on Computer Vision and Natural Language Processing

  • Mar 01, 2019
  • Shivangi Modi +1
  • Book Chapter
  • Citations2

A VQA System for Medical Image Classification Using Transfer Learning

  • Jan 01, 2021
  • C Dhanush +2
  • Book Chapter
  • Citations3

Optimal Image Feature Ranking and Fusion for Visual Question Answering

  • Sep 09, 2020
  • Sruthy Manmadhan +1
  • Book Chapter
  • Citations2

A-VQA: Attention Based Visual Question Answering Technique for Handling Improper Count of Occluded Object

  • Jan 01, 2021
  • Shivangi Modi +1
  • PDF
  • Research Article
  • Citations2

Visual Question Answering for Intelligent Interaction

  • Jul 06, 2022
  • Mobile Information Systems
  • Panpan Gao +4
  • Conference Article
  • Citations4

Visual Question Answering: Methodologies and Challenges

  • Oct 09, 2020
  • Liyana Sahir Kallooriyakath +3
  • Research Article
  • Citations1

Counting in Visual Question Answering: Methods, Datasets, and Future Work

  • Oct 20, 2023
  • International Journal of Image and Graphics
  • Tesfayee Meshu Welde +1
  • Research Article
  • Citations2

VADS: Visuo-Adaptive DualStrike attack on visual question answer

  • Aug 31, 2024
  • Computer Vision and Image Understanding
  • Boyuan Zhang +4
  • PDF
  • Research Article
  • Citations86

MedFuseNet:\xa0An\xa0attention-based multimodal deep learning model for visual question answering in the medical domain

  • Oct 06, 2021
  • Scientific Reports
  • Dhruv Sharma +2
  • Research Article
  • Citations64

Computer Vision and Natural Language Processing

  • Dec 12, 2016
  • ACM Computing Surveys
  • Peratham Wiriyathammabhum +3
  • Abstract

Understanding the diagnosis and management of external eye disease: Gurwood AS: Br J Optom Disp 1995;3:155–163

  • May 01, 1996
  • International Contact Lens Clinic
  • Research Article
  • Citations45

A survey of methods, datasets and evaluation metrics for visual question answering

  • Oct 15, 2021
  • Image and Vision Computing
  • Himanshu Sharma +1
  • Research Article
  • Citations49

Medical knowledge-based network for Patient-oriented Visual Question Answering

  • Dec 21, 2022
  • Information Processing & Management
  • Jian Huang +7
  • Research Article
  • Citations297

Visual question answering: Datasets, algorithms, and future challenges

  • Jun 13, 2017
  • Computer Vision and Image Understanding
  • Kushal Kafle +1
  • Conference Article
  • Citations2

Visual Question Answering Using Deep Learning

  • Nov 27, 2021
  • Deepika Kanakamedala +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.