• Home
  • Search
  • Unsupervised Keyword Extraction for Full-Sentence VQA
  • Cite Icon1
  • https://doi.org/10.18653/v1/2020.nlpbt-1.6Copy DOI Icon

Unsupervised Keyword Extraction for Full-Sentence VQA

  • Jan 1, 2020
  • Kohei Uehara +1 more
Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In the majority of the existing Visual Question Answering (VQA) research, the answers consist of short, often single words, as per instructions given to the annotators during dataset construction. This study envisions a VQA task for natural situations, where the answers are more likely to be sentences rather than single words. To bridge the gap between this natural VQA and existing VQA approaches, a novel unsupervised keyword extraction method is proposed. The method is based on the principle that the full-sentence answers can be decomposed into two parts: one that contains new information answering the question (i.e. keywords), and one that contains information already included in the question. Discriminative decoders were designed to achieve such decomposition, and the method was experimentally implemented on VQA datasets containing full-sentence answers. The results show that the proposed model can accurately extract the keywords without being given explicit annotations describing them.

Loading PDF

Similar Papers
  • Book Chapter

Multi-view Visual Question Answering Dataset for Real Environment Applications

  • Jan 01, 2020
  • Yue Qiu +3
  • Research Article
  • Citations503

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Sep 11, 2018
  • International Journal of Computer Vision
  • Yash Goyal +5
  • Conference Article
  • Citations603

VizWiz Grand Challenge: Answering Visual Questions from Blind People

  • Jun 01, 2018
  • Danna Gurari +7
  • Research Article

Incorporating Verb Semantic Information in Visual Question Answering Through Multitask Learning Paradigm

  • Jun 01, 2020
  • International Journal of Semantic Computing
  • Mehrdad Alizadeh +1
  • Conference Article
  • Citations2558

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Jul 01, 2017
  • Yash Goyal +4
  • Conference Article

Bridging the Gap: Leveraging Textual and Visual Contexts for PreciseMedical Visual Question Answering

  • Aug 08, 2024
  • Pratiksh Kumar +3
  • Research Article

Visual question answering-based image-finding generation for pulmonary nodules on chest CT from structured annotations.

  • Mar 27, 2026
  • International journal of computer assisted radiology and surgery
  • Maiko Nagao +5
  • Conference Article
  • Citations2

VQAR: Review on Information Retrieval Techniques based on Computer Vision and Natural Language Processing

  • Mar 01, 2019
  • Shivangi Modi +1
  • Conference Article
  • Citations2

Explainable Visual Question Answering via Hybrid Neural-Logical Reasoning

  • Jun 30, 2024
  • Jingying Gao +2
  • Research Article
  • Citations9

VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Ziyi Yin +7
  • Conference Article
  • Citations4

3DVQA: Visual Question Answering for 3D Environments

  • May 01, 2022
  • Yasaman Etesam +2
  • Conference Article
  • Citations15

More Than An Answer

  • Oct 19, 2017
  • Yiyi Zhou +4
  • Research Article

VTFCGNet: a novel cross-modal reasoning network integrating Fourier self-attention and graph attention for visual text question answering

  • Feb 01, 2026
  • Neural Computing and Applications
  • Yujie Huo +3
  • Research Article
  • Citations297

Visual question answering: Datasets, algorithms, and future challenges

  • Jun 13, 2017
  • Computer Vision and Image Understanding
  • Kushal Kafle +1
  • PDF
  • Research Article
  • Citations24

Multi-Modal Explicit Sparse Attention Networks for Visual Question Answering

  • Nov 26, 2020
  • Sensors (Basel, Switzerland)
  • Zihan Guo +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.