• Home
  • Search
  • A Comparative Analysis of Transformer-Based Models for Document Visual Question Answering
  • Cite Icon2
  • https://doi.org/10.1007/978-981-99-0609-3_16Copy DOI Icon

A Comparative Analysis of Transformer-Based Models for Document Visual Question Answering

  • Jan 1, 2023
  • Vijay Kumari +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Visual question answering (VQA) is one of the most exciting problems of computer vision and natural language processing tasks. It requires understanding and reasoning of the image to answer a human query. Text Visual Question Answering (Text-VQA) and Document Visual Question Answering (DocVQA) are the two sub problems of the VQA, which require extracting the text from the usual scene and document images. Since answering questions about documents requires an understanding of the layout and writing patterns, the models that perform well on the Text-VQA task perform poorly on the DocVQA task. As the transformer-based models achieve state-of-the-art results in deep learning fields, we train and fine-tune various transformer-based models (such as BERT, ALBERT, RoBERTa, ELECTRA, and Distil-BERT) to examine their validation accuracy. This paper provides a detailed analysis of various transformer models and compares their accuracies on the DocVQA task.

Similar Papers
  • Conference Article

GIICS: A dataset for gaze-direction-based intention inference in complex visual scenes

  • Nov 28, 2025
  • Qianxi Yu +5
  • Book Chapter
  • Citations2

GQA-it: Italian Question Answering on Image Scene Graphs

  • Jan 01, 2022
  • Danilo Croce +3
  • Conference Article
  • Citations2

VQAR: Review on Information Retrieval Techniques based on Computer Vision and Natural Language Processing

  • Mar 01, 2019
  • Shivangi Modi +1
  • Research Article
  • Citations2

VADS: Visuo-Adaptive DualStrike attack on visual question answer

  • Aug 31, 2024
  • Computer Vision and Image Understanding
  • Boyuan Zhang +4
  • Research Article

Analysis of Deep Learning Models on VQA(Toloka)Dataset

  • Oct 06, 2025
  • The Asian Bulletin of Big Data Management
  • Fariha Shoukat +3
  • Research Article
  • Citations297

Visual question answering: Datasets, algorithms, and future challenges

  • Jun 13, 2017
  • Computer Vision and Image Understanding
  • Kushal Kafle +1
  • PDF
  • Research Article
  • Citations61

Measurement of Semantic Textual Similarity in Clinical Texts: Comparison of Transformer-Based Models.

  • Nov 23, 2020
  • JMIR Medical Informatics
  • Xi Yang +5
  • Research Article
  • Citations9

VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Ziyi Yin +7
  • PDF
  • Research Article
  • Citations26

Adapting transformer-based language models for heart disease detection and risk factors extraction

  • Apr 04, 2024
  • Journal of Big Data
  • Essam H Houssein +3
  • Research Article
  • Citations18

AI-Based Request Augmentation to Increase Crowdsourcing Participation

  • Oct 28, 2019
  • Proceedings of the AAAI Conference on Human Computation and Crowdsourcing
  • Junwon Park +4
  • Research Article
  • Citations17

EVJVQA CHALLENGE: MULTILINGUAL VISUAL QUESTION ANSWERING

  • Sep 26, 2023
  • Journal of Computer Science and Cybernetics
  • Ngan Luu-Thuy Nguyen +4
  • Book Chapter
  • Citations16

Learning Convolutional Text Representations for Visual Question Answering

  • May 07, 2018
  • Zhengyang Wang +1
  • Research Article

VTFCGNet: a novel cross-modal reasoning network integrating Fourier self-attention and graph attention for visual text question answering

  • Feb 01, 2026
  • Neural Computing and Applications
  • Yujie Huo +3
  • Conference Article
  • Citations4

3DVQA: Visual Question Answering for 3D Environments

  • May 01, 2022
  • Yasaman Etesam +2
  • Book Chapter
  • Citations3

Optimal Image Feature Ranking and Fusion for Visual Question Answering

  • Sep 09, 2020
  • Sruthy Manmadhan +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.