• Home
  • Search
  • A Study of Visual Question Answering Techniques Based on Collaborative Multi-Head Attention
  • Cite Icon1
  • https://doi.org/10.1109/acctcs58815.2023.00037Copy DOI Icon

A Study of Visual Question Answering Techniques Based on Collaborative Multi-Head Attention

  • Feb 1, 2023
  • Yingli Yang +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In visual question answering task, the dominant approach recently has been to use a unified model for pre- training and fine tuning it. This unified model typically uses a transformer to fuse image and text information. In order to optimize the performance of the model on visual question answering task, this paper proposes a transformer architecture based on a collaborative multi-head attention mechanism to address the key/value projection redundancy problem in the multi-head attention mechanism of the transformer. In addition, this paper uses the Swin transformer model as the image feature extractor to extract multi-scale image information. Validation experiments are conducted on the VQA v2 dataset in this paper, and the experimental results show that applying the collaborative multi-head attention approach and the Swin transformer backbone to the visual question answering model can effectively improve the correct rate of the visual question answering task.

Similar Papers
  • Research Article
  • Citations30

Improving Automatic VQA Evaluation Using Large Language Models

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Oscar Mañas +2
  • Research Article
  • Citations2

Hierarchical Attention Networks for Multimodal Machine Learning

  • Mar 01, 2022
  • Journal of Physics Conference Series
  • Haotian Liang +1
  • Conference Article
  • Citations48

Coarse-to-Fine Reasoning for Visual Question Answering

  • Jun 01, 2022
  • Binh X Nguyen +5
  • Research Article
  • Citations20

A framework for visual question answering with the integration of scene-text using PHOCs and fisher vectors

  • Nov 07, 2021
  • Expert Systems with Applications
  • Himanshu Sharma +1
  • PDF
  • Conference Article
  • Citations23

Recommending Themes for Ad Creative Design via Visual-Linguistic Representations

  • Apr 20, 2020
  • Yichao Zhou +4
  • Research Article
  • Citations6

Explanation vs. attention: A two-player game to obtain attention for VQA and visual dialog

  • Jul 23, 2022
  • Pattern Recognition
  • Badri N Patro +2
  • Research Article
  • Citations29

Explanation vs Attention: A Two-Player Game to Obtain Attention for VQA

  • Apr 03, 2020
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Badri Patro +2
  • Research Article
  • Citations27

Toward Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baseline

  • Jun 01, 2023
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Lichen Zhao +8
  • Book Chapter
  • Citations5

Neural Networks for Detecting Irrelevant Questions During Visual Question Answering

  • Jan 01, 2020
  • Mengdi Li +2
  • Research Article

Visual Question Answering Using Semantic Information from Image Descriptions

  • Apr 18, 2021
  • The International FLAIRS Conference Proceedings
  • Tasmia Tasmia +2
  • Conference Article
  • Citations1

Visual Question Answering Based on Position Alignment

  • Oct 23, 2021
  • Qihao Xia +5
  • Conference Article
  • Citations211

Visual Question Generation as Dual Task of Visual Question Answering

  • Jun 01, 2018
  • Yikang Li +6
  • Research Article
  • Citations15

MobiVQA

  • Jul 04, 2022
  • Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
  • Qingqing Cao +3
  • Research Article

Analysis of Deep Learning Models on VQA(Toloka)Dataset

  • Oct 06, 2025
  • The Asian Bulletin of Big Data Management
  • Fariha Shoukat +3
  • Conference Article
  • Citations2558

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Jul 01, 2017
  • Yash Goyal +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.