• Home
  • Search
  • Development of Counting Based Visual Question Answering System by Using Transformer and Pyramid Networks with Hybrid Deep Learning Model
  • https://doi.org/10.59544/fswn5535/ngcesi23p38Copy DOI Icon

Development of Counting Based Visual Question Answering System by Using Transformer and Pyramid Networks with Hybrid Deep Learning Model

  • Aug 5, 2023
  • Nigisha S +1 more
Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

Visual Question Answering (VQA) merges images and natural language processing, that enables machines to respond to queries about visual content with prowess by comprehending visual features and contextual cues in text. VQA aims to bridge the gap between human-like understanding and visual comprehension. Counting-based VQA is a specific subfield within VQA that focuses on answering questions related to counting objects or quantities in images. The objective of counting-based VQA is to develop algorithms and models capable of accurately answering questions that involve counting specific objects or quantities in visual data. Our Model consists of Bidirectional Encoder Representations from Transformers (BERT) to extract the texture features from the Question part and for the visual part, Feature Pyramid Network (FPN) is used to extract the deep features from images. Both the textual and visual features are integrated to form a combined set of features. These fused features are fed in to a hybrid model for answer prediction. This hybrid model is an integration of Gated Recurrent Unit (GRU) and One-Dimensional Convolutional Neural Network (1DCNN).

Similar Papers
  • PDF
  • Research Article
  • Citations18

Bidirectional encoders to state-of-the-art: a review of BERT and its transformative impact on natural language processing

  • Mar 02, 2024
  • Информатика. Экономика. Управление - Informatics. Economics. Management
  • Rajesh Gupta
  • PDF
  • Research Article
  • Citations25

Identification of asthma control factor in clinical notes using a hybrid deep learning model

  • Nov 01, 2021
  • BMC Medical Informatics and Decision Making
  • Bhavani Singh Agnikula Kshatriya +6
  • Research Article

METAHEURISTIC-DRIVEN HYPERPARAMETER OPTIMIZATION FOR BERT IN SENTIMENT ANALYSIS

  • Oct 30, 2025
  • Archives for Technical Sciences
  • Alaa A El-Demerdash +1
  • Conference Article
  • Citations13

The Transformers’ Ability to Implement for Solving Intricacies of Language Processing

  • Aug 26, 2022
  • Paras Nath Singh +1
  • Book Chapter
  • Citations8

Natural Language Processing with “More Than Words – BERT”

  • Jan 01, 2021
  • Saranlita Chotirat +1
  • PDF
  • Research Article
  • Citations20

Deep Modular Bilinear Attention Network for Visual Question Answering

  • Jan 28, 2022
  • Sensors (Basel, Switzerland)
  • Feng Yan +2
  • Abstract
  • Citations5

Bert model fine-tuning for text classification in knee OA radiology reports

  • Apr 01, 2020
  • Osteoarthritis and Cartilage
  • L Chen +5
  • Research Article
  • Citations20

Oversampling effect in pretraining for bidirectional encoder representations from transformers (BERT) to localize medical BERT and enhance biomedical BERT

  • May 05, 2024
  • Artificial Intelligence In Medicine
  • Shoya Wada +6
  • Conference Article
  • Citations4

A Novel Approach to Efficient Multilabel Text Classification: BERT-Federated Learning Fusion

  • Dec 13, 2023
  • Arefin Abu Isha Md Sadot +2
  • Conference Article
  • Citations10

Classification of Fire Related Tweets on Twitter Using Bidirectional Encoder Representations from Transformers (BERT)

  • Nov 28, 2021
  • Jairus Mingua +2
  • Book Chapter

Multi-modal Universal Embedding Representations for Language Understanding

  • Jan 01, 2022
  • Xi Luo +2
  • Research Article
  • Citations1

Phishing website detection using novel integration of BERT and XLNet with deep learning sequential models

  • Nov 01, 2024
  • Indonesian Journal of Electrical Engineering and Computer Science
  • Kongara Srinivasa Rao +5
  • PDF
  • Research Article
  • Citations13

BERT+vnKG: Using Deep Learning and Knowledge Graph to Improve Vietnamese Question Answering System

  • Jan 01, 2020
  • International Journal of Advanced Computer Science and Applications
  • Truong H V Phan +1
  • PDF
  • Research Article
  • Citations28

Automatic text classification of actionable radiology reports of tinnitus patients using bidirectional encoder representations from transformer (BERT) and in-domain pre-training (IDPT)

  • Jul 30, 2022
  • BMC Medical Informatics and Decision Making
  • Jia Li +10
  • Research Article
  • Citations8

GRU-BERT for NILM: A Hybrid Deep Learning Architecture for Load Disaggregation

  • Sep 22, 2025
  • AI
  • Annysha Huzzat +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.