• Home
  • Search
  • Multi-Channel Co-Attention Network for Visual Question Answering
  • Cite Icon3
  • https://doi.org/10.1109/ijcnn48605.2020.9207058Copy DOI Icon

Multi-Channel Co-Attention Network for Visual Question Answering

  • Jul 1, 2020
  • Weidong Tian +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Visual Question Answering (VQA) is to reason out correct answers based on input questions and images. Significant progresses have been made by learning rich embedding features from images and questions by bilinear models. Attention mechanisms are widely used to focus on specific visual and textual information in VQA reasoning process. However, most state-of-the-art methods concentrate on fusing the global multi-modal features, while neglect local features. Besides, the dimension is reduced excessively (from K×2048 to 2048) in general visual attention, which causes a mass of visual information loss. In this paper, we propose a novel multi-channel co-attention network (MC-CAN), which integrates multi-modal features from global level to local level. We design different multi-channel attention mechanisms separately for visual (from K×2048 to M×2048) and textual features at different level of integrations. Additionally, we further improve our proposed approach by combining it with the complementary modules such as the MLB and the Count modules. Experiments on benchmark datasets show that our approach achieves better VQA performance than other state-of-the-art methods.

Similar Papers
  • Book Chapter
  • Citations96

Question-Guided Hybrid Convolution for Visual Question Answering

  • Jan 01, 2018
  • Peng Gao +6
  • Conference Article
  • Citations1

Dynamic Co-attention Network for Visual Question Answering

  • Nov 26, 2021
  • Doaa B Ebaid +2
  • Conference Article
  • Citations15

Feature Enhancement in Attention for Visual Question Answering

  • Jul 01, 2018
  • Yuetan Lin +3
  • Research Article
  • Citations17

Accuracy vs. complexity: A trade-off in visual question answering models

  • Jun 12, 2021
  • Pattern Recognition
  • Moshiur Farazi +2
  • Research Article
  • Citations3

Enhancing visual question answering with a two‐way co‐attention mechanism and integrated multimodal features

  • Dec 21, 2023
  • Computational Intelligence
  • Mayank Agrawal +2
  • Research Article
  • Citations13

Local relation network with multilevel attention for visual question answering

  • Jan 20, 2020
  • Journal of Visual Communication and Image Representation
  • Bo Sun +3
  • PDF
  • Research Article
  • Citations1

Multi-modality guided cross-attention for visual question answering

  • Jul 25, 2025
  • Multimedia Tools and Applications
  • Muhammad Zeeshan Khan +4
  • Conference Article
  • Citations59

Visual Question Answering as Reading Comprehension

  • Jun 01, 2019
  • Hui Li +3
  • Research Article
  • Citations82

Co-Attending Free-Form Regions and Detections With Multi-Modal Multiplicative Feature Embedding for Visual Question Answering

  • Apr 27, 2018
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Pan Lu +4
  • Conference Article
  • Citations11

CS-VQA: Visual Question Answering with Compressively Sensed Images

  • Oct 01, 2018
  • Li-Chi Huang +5
  • PDF
  • Research Article
  • Citations59

Multimodal Encoder-Decoder Attention Networks for Visual Question Answering

  • Jan 01, 2020
  • IEEE Access
  • Chongqing Chen +2
  • Research Article
  • Citations71

Multimodal feature fusion by relational reasoning and attention for visual question answering

  • Aug 19, 2019
  • Information Fusion
  • Weifeng Zhang +4
  • Research Article
  • Citations472

The multi-modal fusion in visual question answering: a review of attention mechanisms.

  • May 30, 2023
  • PeerJ Computer Science
  • Siyu Lu +5
  • Research Article
  • Citations91

Exploring Human-Like Attention Supervision in Visual Question Answering

  • Apr 27, 2018
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Tingting Qiao +2
  • Conference Article

VIG: Visual Information-Guided Knowledge-Based Visual Question Answering

  • May 08, 2024
  • Heng Liu +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.