• Home
  • Search
  • A medical visual question answering approach based on co-attention networks
  • https://doi.org/10.7507/1001-5515.202307057Copy DOI Icon

A medical visual question answering approach based on co-attention networks

  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Recent studies have introduced attention models for medical visual question answering (MVQA). In medical research, not only is the modeling of "visual attention" crucial, but the modeling of "question attention" is equally significant. To facilitate bidirectional reasoning in the attention processes involving medical images and questions, a new MVQA architecture, named MCAN, has been proposed. This architecture incorporated a cross-modal co-attention network, FCAF, which identifies key words in questions and principal parts in images. Through a meta-learning channel attention module (MLCA), weights were adaptively assigned to each word and region, reflecting the model's focus on specific words and regions during reasoning. Additionally, this study specially designed and developed a medical domain-specific word embedding model, Med-GloVe, to further enhance the model's accuracy and practical value. Experimental results indicated that MCAN proposed in this study improved the accuracy by 7.7% on free-form questions in the Path-VQA dataset, and by 4.4% on closed-form questions in the VQA-RAD dataset, which effectively improves the accuracy of the medical vision question answer.

Similar Papers
  • Research Article
  • Citations22

Developing ChatGPT for biology and medicine: a complete review of biomedical question answering.

  • Jan 01, 2024
  • Biophysics reports
  • Qing Li +2
  • Research Article

Medical question answering: A comprehensive multimodal and LLM-driven survey.

  • Oct 01, 2026
  • Computer methods and programs in biomedicine
  • Eya Mhedhbi +4
  • Research Article
  • Citations3

Medical education and artificial intelligence: Question answering for medical questions based on intelligent interaction

  • Apr 08, 2024
  • Concurrency and Computation: Practice and Experience
  • Lei Chen
  • Research Article

Finding Key Words in a Question Stem

  • Nov 01, 2013
  • Journal of Wound, Ostomy & Continence Nursing
  • Lea Crestodina +2
  • Research Article
  • Citations1

Consistency Conditioned Memory Augmented Dynamic Diagnosis Model for Medical Visual Question Answering.

  • Feb 01, 2025
  • IEEE journal of biomedical and health informatics
  • Ting Yu +5
  • Research Article
  • Citations16

Integration of Multi-Source Medical Data for Medical Diagnosis Question Answering.

  • Mar 01, 2025
  • IEEE transactions on medical imaging
  • Qi Peng +8
  • Research Article
  • Citations63

AMAM: An Attention-based Multimodal Alignment Model for Medical Visual Question Answering

  • Aug 27, 2022
  • Knowledge-Based Systems
  • Haiwei Pan +5
  • Research Article

Correctness Coverage Evaluation for Medical Multiple-Choice Question Answering Based on the Enhanced Conformal Prediction Framework

  • May 07, 2025
  • Mathematics
  • Yusong Ke +4
  • Book Chapter
  • Citations6

A Pre-trained Language Model for Medical Question Answering Based on Domain Adaption

  • Jan 01, 2022
  • Lang Liu +5
  • Conference Article

Construction of a Knowledge Graph-based Medical Question Answer System

  • Nov 24, 2022
  • Xiao Lizhong +2
  • Research Article

General Words Representation Method for Modern Language Model

  • Mar 29, 2023
  • Journal of Telecommunication Electronic and Computer Engineering (JTEC)
  • Abbas Saliimi Lokman +2
  • PDF
  • Research Article
  • Citations117

CGMVQA: A New Classification and Generative Model for Medical Visual Question Answering

  • Jan 01, 2020
  • IEEE Access
  • Fuji Ren +1
  • PDF
  • Research Article
  • Citations29

BPI-MVQA: a bi-branch model for medical visual question answering

  • Apr 29, 2022
  • BMC medical imaging
  • Shengyan Liu +3
  • Research Article
  • Citations22

VG-CALF: A vision-guided cross-attention and late-fusion network for radiology images in Medical Visual Question Answering

  • Oct 24, 2024
  • Neurocomputing
  • Aiman Lameesa +2
  • Research Article
  • Citations4

Hierarchical Modeling for Medical Visual Question Answering with Cross-Attention Fusion

  • Apr 24, 2025
  • Applied Sciences
  • Junkai Zhang +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.