• Home
  • Search
  • Visual Question Answering using Transformer Architectures: Applying Transformer Models to Improve Performance in VQA Tasks
  • Cite Icon12
  • https://doi.org/10.47363/jaicc/2022(1)e228Copy DOI Icon

Visual Question Answering using Transformer Architectures: Applying Transformer Models to Improve Performance in VQA Tasks

  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

Visual Question Answering (VQA) programs are an area of subject and field in computer science that seeks to develop technologies that enable the client to answer questions based on displayed images. Bert, Vision Transformers (ViTs), and multimodal transformers have aided the VQA systems significantly in understanding the relations between vision and text data. In this paper, these architectures are considered in relation to the scalability, dynamic attention mechanism, and multimodal pre-trained models of the prior CN-RNN hybrid models’ weaknesses. Feedback activities connected with assistive technologies, healthcare, retail, self-driving vehicles, and creative industries indicate how VQA might be easily introduced and provide examples of likely relative positive and negative societal impacts such as bias, privacy, and inclusion. VQA systems are slowly becoming paramount for improving accessibility solutions, for instance, where a visually impaired person talks to the system to explain what a picture is about. However, VQA systems based on current transformers have some issues, notably from the point of view of computational complexity and reasoning capability. This paper covers the current state of research, issues, and the direction of further development, going further and noting that more attention should be paid to lightweight models, datasets from multiple domains, as well as the integration of human-generated data with AI. Accordingly, the identified results show that VQA systems can become one of the elements of context-aware, inquiry-based solutions for advanced applications in various fields.

Similar Papers
  • Research Article
  • Citations1

Counting in Visual Question Answering: Methods, Datasets, and Future Work

  • Oct 20, 2023
  • International Journal of Image and Graphics
  • Tesfayee Meshu Welde +1
  • Conference Article
  • Citations2

VQAR: Review on Information Retrieval Techniques based on Computer Vision and Natural Language Processing

  • Mar 01, 2019
  • Shivangi Modi +1
  • Book Chapter
  • Citations3

Optimal Image Feature Ranking and Fusion for Visual Question Answering

  • Sep 09, 2020
  • Sruthy Manmadhan +1
  • PDF
  • Research Article
  • Citations86

MedFuseNet:\xa0An\xa0attention-based multimodal deep learning model for visual question answering in the medical domain

  • Oct 06, 2021
  • Scientific Reports
  • Dhruv Sharma +2
  • Research Article
  • Citations30

Improving Automatic VQA Evaluation Using Large Language Models

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Oscar Mañas +2
  • Book Chapter
  • Citations2

A VQA System for Medical Image Classification Using Transfer Learning

  • Jan 01, 2021
  • C Dhanush +2
  • Research Article
  • Citations49

Medical knowledge-based network for Patient-oriented Visual Question Answering

  • Dec 21, 2022
  • Information Processing & Management
  • Jian Huang +7
  • Book Chapter
  • Citations276

Revisiting Visual Question Answering Baselines

  • Jan 01, 2016
  • Allan Jabri +2
  • Book Chapter
  • Citations2

A-VQA: Attention Based Visual Question Answering Technique for Handling Improper Count of Occluded Object

  • Jan 01, 2021
  • Shivangi Modi +1
  • Abstract

Understanding the diagnosis and management of external eye disease: Gurwood AS: Br J Optom Disp 1995;3:155–163

  • May 01, 1996
  • International Contact Lens Clinic
  • Research Article
  • Citations45

A survey of methods, datasets and evaluation metrics for visual question answering

  • Oct 15, 2021
  • Image and Vision Computing
  • Himanshu Sharma +1
  • Conference Article
  • Citations1

An Visual Question Answering System using Cross-Attention Network

  • Aug 17, 2023
  • R Dhana Lakshmi +1
  • Conference Article

Bridging the Gap: Leveraging Textual and Visual Contexts for PreciseMedical Visual Question Answering

  • Aug 08, 2024
  • Pratiksh Kumar +3
  • Conference Article
  • Citations1

A Visual Question Answering System using YOLO Model

  • Dec 01, 2021
  • Soumya Priyadarsini Panda +1
  • Conference Article
  • Citations2

Beyond Words: Exploring Co-Attention with BERT in Visual Question Answering

  • May 24, 2024
  • Vibhashree B S +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.