• Home
  • Search
  • Debiasing Visual Question Answering via Ensemble Gradient Detection and Iterative Attention Forgetting
  • https://doi.org/10.31449/inf.v49i24.9013Copy DOI Icon

Debiasing Visual Question Answering via Ensemble Gradient Detection and Iterative Attention Forgetting

Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

In Visual Question Answering (VQA), the model’s ability to understand and reason across different modalities—language, visual, and multimodal—is crucial for accurate predictions. However, recent studies have identified a significant challenge of language bias in VQA models, where the model’s reasoning often hinges on incorrect linguistic associations rather than genuine multimodal understanding. To addressthis issue, We propose a novel Ensemble Bias Gradient Debiasing Approach (EBGDA) that combines bias detection with a dynamic forgetting mechanism. Our method utilizes a bias detector to identify and score biases across linguistic, visual, and multimodal data, enabling the model to focus on unbiased informationfor more accurate predictions. Additionally, inspired by human reasoning, we introduce the Forgotten Attention Algorithm (FAA), which iteratively “forgets” irrelevant visual content, progressively concentrating attention on the image regions most relevant to the question. This combination of bias mitigation andattention focusing enhances the model’s ability to make multimodal inferences, reducing bias and improving overall performance. Extensive experiments on the VQA-CP v2, VQA v2, VQA-VS, GQA-OOD, and VQA-CE datasets demonstrate the effectiveness of our approach, showing state-of-the-art performance inmitigating biases and excelling in complex multimodal scenarios. Our approach achieves a 21.32% improvement over UpDn on VQA-CP v2, establishing a new state-of-the-art among methods without data augmentation.

Similar Papers
  • Research Article
  • Citations1

Adversarial Sample Synthesis for Visual Question Answering

  • Nov 21, 2024
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Chuanhao Li +4
  • Research Article
  • Citations503

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Sep 11, 2018
  • International Journal of Computer Vision
  • Yash Goyal +5
  • Research Article

Visual Question Answering Model Using Transformer-Based Multi-Head Cross Attention Network with Optimized Gold Rush Octave Convolution Network

  • Oct 28, 2025
  • International Journal of Image and Graphics
  • J Jinu Sophia +2
  • Conference Article
  • Citations668

Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answering

  • Jun 01, 2018
  • Aishwarya Agrawal +3
  • Research Article
  • Citations3

HCCL: Hierarchical Counterfactual Contrastive Learning for Robust Visual Question Answering

  • Oct 29, 2024
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Dongze Hao +3
  • Research Article
  • Citations24

Enhancing robust VQA via contrastive and self-supervised learning

  • Nov 02, 2024
  • Pattern Recognition
  • Runlin Cao +4
  • Research Article
  • Citations16

Fair Attention Network for Robust Visual Question Answering

  • Sep 01, 2024
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Yandong Bi +4
  • Conference Article
  • Citations15

Feature Enhancement in Attention for Visual Question Answering

  • Jul 01, 2018
  • Yuetan Lin +3
  • PDF
  • Conference Article
  • Citations2

Can Pre-training help VQA with Lexical Variations?

  • Jan 01, 2020
  • Shailza Jolly +1
  • Research Article

VTFCGNet: a novel cross-modal reasoning network integrating Fourier self-attention and graph attention for visual text question answering

  • Feb 01, 2026
  • Neural Computing and Applications
  • Yujie Huo +3
  • Conference Article
  • Citations2558

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Jul 01, 2017
  • Yash Goyal +4
  • Research Article
  • Citations91

Exploring Human-Like Attention Supervision in Visual Question Answering

  • Apr 27, 2018
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Tingting Qiao +2
  • Research Article
  • Citations42

Knowledge-Routed Visual Question Reasoning: Challenges for Deep Representation Embedding.

  • Jan 01, 2021
  • IEEE Transactions on Neural Networks and Learning Systems
  • Qingxing Cao +4
  • Conference Article
  • Citations11

Rankvqa: Answer Re-Ranking For Visual Question Answering

  • Jul 01, 2020
  • Yanyuan Qiao +2
  • Conference Article
  • Citations2

Contrastive Learning Framework by Maximizing Mutual Information for Visual Question Answering

  • Jun 18, 2021
  • Rong Lin +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.