• Home
  • Search
  • Semantic based medical visual question answering with explainable artificial intelligence
  • https://doi.org/10.11591/ijai.v14.i3.pp2169-2177Copy DOI Icon

Semantic based medical visual question answering with explainable artificial intelligence

Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

The medical visual question answering (MVQA) system takes the advantage of both computer vision (CV) and natural language processing (NLP) to accept the medical image and corresponding question as input and generates the respective answer as output. One step further, the MVQA system capable of generating the answer based on the semantics has a distinct place and hence semantic based medical visual question answering (SMVQA) system is proposed in this research. In SMVQA, the semantics for input image and question are generated using layerwise relevance propagation explainable artificial intelligence (LRP XAI) technique and the answer is derived using deductive reasoning method. For this, seven MVQA datasets are used for model creation, testing and validation. The training phase of the SMVQA system is implemented using VGGNet, long short-term memory (LSTM), LRP XAI, ResNet and bidirectional encoder representations from transformers (BERT) to generate a model file. Then the inference is derived in the testing phase based on the generated model file for the test set. Finally, the answer is derived from the inference using natural language toolkit (NLTK) library, term frequency-inverse document frequency (TF-IDF), cosine similarity, best match25 (BM25) techniques along with deductive reasoning. As a result, the proposed SMVQA system gives improved performance then the existing MVQA system especially for abnormality type samples.

Similar Papers
  • PDF
  • Research Article
  • Citations13

BERT+vnKG: Using Deep Learning and Knowledge Graph to Improve Vietnamese Question Answering System

  • Jan 01, 2020
  • International Journal of Advanced Computer Science and Applications
  • Truong H V Phan +1
  • Conference Article

Predictive Sentiment Analysis of Skincare Product Reviews: A Natural Language Processing Approach with BERT-Enhanced Sequential Model (BESM)

  • Dec 01, 2025
  • Sky Nurimba +4
  • PDF
  • Research Article
  • Citations18

Bidirectional encoders to state-of-the-art: a review of BERT and its transformative impact on natural language processing

  • Mar 02, 2024
  • Информатика. Экономика. Управление - Informatics. Economics. Management
  • Rajesh Gupta
  • Research Article
  • Citations14

Do the US president's tweets better predict oil prices? An empirical examination using long short-term memory networks

  • May 30, 2023
  • International Journal of Production Research
  • Stephanie Beyer Díaz +4
  • Abstract
  • Citations5

Bert model fine-tuning for text classification in knee OA radiology reports

  • Apr 01, 2020
  • Osteoarthritis and Cartilage
  • L Chen +5
  • PDF
  • Research Article
  • Citations39

Automatic detection of actionable radiology reports using bidirectional encoder representations from transformers

  • Sep 11, 2021
  • BMC Medical Informatics and Decision Making
  • Yuta Nakamura +8
  • Research Article
  • Citations3

Improving the BERT model for long text sequences in question answering domain

  • Mar 01, 2024
  • International Journal of Advances in Applied Sciences
  • Vijayan Ramaraj +3
  • Research Article
  • Citations26

Reading comprehension based question answering system in Bangla language with transformer-based learning

  • Oct 01, 2022
  • Heliyon
  • Tanjim Taharat Aurpa +4
  • Research Article
  • Citations1

A Comparative Analysis of Natural Language Processing Models: BERT and LSTM in Enhancing Business Communication

  • Apr 26, 2025
  • International Journal of Innovative Science and Research Technology
  • Manan Sharma
  • Discussion
  • Citations142

Classifying social determinants of health from unstructured electronic health records using deep learning-based natural language processing

  • Jan 07, 2022
  • Journal of Biomedical Informatics
  • Sifei Han +9
  • Research Article

METAHEURISTIC-DRIVEN HYPERPARAMETER OPTIMIZATION FOR BERT IN SENTIMENT ANALYSIS

  • Oct 30, 2025
  • Archives for Technical Sciences
  • Alaa A El-Demerdash +1
  • Research Article
  • Citations4

AI-Powered Sentiment Analytics in Banking: A BERT and LSTM Perspective.

  • May 24, 2025
  • International Interdisciplinary Business Economics Advancement Journal
  • Md Tarake Siddique +9
  • Research Article
  • Citations7

Short text automatic scoring system based on BERT-BiLSTM model

  • May 01, 2022
  • Journal of Shenzhen University Science and Engineering
  • Linzhong Xia +5
  • Research Article
  • Citations7

Sentiment analysis with hotel customer reviews using FNet

  • Apr 01, 2024
  • Bulletin of Electrical Engineering and Informatics
  • Shovan Bhowmik +3
  • Research Article

Predicting functional outcomes after a stroke event by clinical text notes: A comparative study of traditional machine learning and deep learning methods.

  • Feb 01, 2025
  • Health informatics journal
  • Yu-Hsiang Su +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.