• Home
  • Search
  • GFSNet: Gaussian Fourier with sparse attention network for visual question answering
  • Cite Icon13
  • https://doi.org/10.1007/s10462-025-11163-4Copy DOI Icon

GFSNet: Gaussian Fourier with sparse attention network for visual question answering

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Visual question answering (VQA), a core task in multimodal learning, requires models to effectively integrate visual and natural language information to perform reasoning and semantic understanding in complex scenarios. However, self-attention mechanisms often struggle to capture multi-scale information and key region features within images comprehensively. Moreover, VQA involves multidimensional and deep reasoning about image content, particularly in scenarios involving spatial relationships and frequency-domain features. Existing methods face limitations in modeling multi-scale features and filtering irrelevant information effectively. This paper proposes an innovative Gaussian Fourier with Sparse Attention Network (GFSNet) to address these challenges. GFSNet leverages Fourier transforms to map image attention weights generated by the self-attention mechanism from the spatial domain to the frequency domain, enabling comprehensive modeling of multi-scale frequency information. This enhances the model’s adaptability to complex structures and its capacity for relational modeling. To further improve feature robustness, a Gaussian filter is introduced to suppress high-frequency noise in the frequency domain, preserving critical visual information. Additionally, a sparse attention mechanism dynamically selects optimized frequency-domain features, effectively reducing interference from redundant information while improving interpretability and computational efficiency. Without increasing parameter counts or computational complexity, GFSNet achieves efficient modeling of multi-scale visual information. Experimental results on benchmark VQA datasets (VQA v2, GQA, and CLEVR) demonstrate that GFSNet significantly enhances reasoning capabilities and cross-modal alignment performance, validating its superiority and effectiveness. The code is available at https://github.com/shenxiang-vqa/GFSNet.

Similar Papers
  • Research Article

VTFCGNet: a novel cross-modal reasoning network integrating Fourier self-attention and graph attention for visual text question answering

  • Feb 01, 2026
  • Neural Computing and Applications
  • Yujie Huo +3
  • Research Article
  • Citations503

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Sep 11, 2018
  • International Journal of Computer Vision
  • Yash Goyal +5
  • Research Article
  • Citations78

Rich Visual Knowledge-Based Augmentation Network for Visual Question Answering

  • Sep 17, 2020
  • IEEE Transactions on Neural Networks and Learning Systems
  • Liyang Zhang +6
  • Research Article
  • Citations91

Exploring Human-Like Attention Supervision in Visual Question Answering

  • Apr 27, 2018
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Tingting Qiao +2
  • Research Article
  • Citations3

HCCL: Hierarchical Counterfactual Contrastive Learning for Robust Visual Question Answering

  • Oct 29, 2024
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Dongze Hao +3
  • Conference Article
  • Citations2558

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Jul 01, 2017
  • Yash Goyal +4
  • Research Article
  • Citations26

See and Learn More: Dense Caption-Aware Representation for Visual Question Answering

  • Feb 01, 2024
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Yandong Bi +4
  • Conference Article
  • Citations16

A Deep Learning-Based Bengali Visual Question Answering System

  • Dec 17, 2022
  • Mahamudul Hasan Rafi +5
  • Research Article
  • Citations8

Attacking VQA Systems via Adversarial Background Noise

  • Aug 01, 2020
  • IEEE Transactions on Emerging Topics in Computational Intelligence
  • Akshay Chaturvedi +1
  • PDF
  • Research Article
  • Citations24

Multi-Modal Explicit Sparse Attention Networks for Visual Question Answering

  • Nov 26, 2020
  • Sensors (Basel, Switzerland)
  • Zihan Guo +1
  • Conference Article
  • Citations90

Multi-Modality Latent Interaction Network for Visual Question Answering

  • Oct 01, 2019
  • Gao Peng +4
  • Research Article

Visual Question Answering Model Using Transformer-Based Multi-Head Cross Attention Network with Optimized Gold Rush Octave Convolution Network

  • Oct 28, 2025
  • International Journal of Image and Graphics
  • J Jinu Sophia +2
  • Research Article
  • Citations36

Answer Questions with Right Image Regions: A Visual Attention Regularization Approach

  • Mar 04, 2022
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Yibing Liu +6
  • Research Article
  • Citations43

Multitask Learning for Visual Question Answering.

  • Mar 01, 2023
  • IEEE Transactions on Neural Networks and Learning Systems
  • Jie Ma +5
  • Research Article
  • Citations4

Self-supervised knowledge distillation in counterfactual learning for VQA

  • Nov 25, 2023
  • Pattern Recognition Letters
  • Yandong Bi +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.