• Home
  • Search
  • English Visual Question Answering: Building a Culturally Relevant Dataset from Image Captions
  • https://doi.org/10.55041/ijsrem57750Copy DOI Icon

English Visual Question Answering: Building a Culturally Relevant Dataset from Image Captions

  • Abstract
  • Literature Map
  • Similar Papers
Abstract

Abstract - Visual Question Answering (VQA) is a challenging multimodal task requiring joint understanding of visual content and natural language questions. Traditional VQA systems rely on complex attention-based architectures demanding significant computational resources and GPU training. This paper proposes an efficient and scalable VQA system using a pretrained CLIP (Contrastive Language–Image Pretraining) ViT-B/32 model for open-ended English language queries. The proposed approach extracts semantically aligned image and question embeddings using a frozen CLIP backbone and combines them through a lightweight Multi-Layer Perceptron (MLP) classifier for answer prediction. Experiments on the VizWiz dataset — a real-world benchmark of images captured by visually impaired users — demonstrate competitive performance, achieving a Top-1 accuracy of 40.6% and Top-5 accuracy of 71.7%, trained entirely on CPU without end-to-end fine-tuning. A Flask-based web application supporting user authentication, image upload, and real-time Top-5 predictions with confidence scores is also demonstrated. Key Words: Visual Question Answering, CLIP, VizWiz Dataset, MLP Classifier, Multimodal Learning, Deep Learning

Similar Papers
  • PDF
  • Research Article
  • Citations86

MedFuseNet:\xa0An\xa0attention-based multimodal deep learning model for visual question answering in the medical domain

  • Oct 06, 2021
  • Scientific Reports
  • Dhruv Sharma +2
  • Conference Article
  • Citations2

VQAR: Review on Information Retrieval Techniques based on Computer Vision and Natural Language Processing

  • Mar 01, 2019
  • Shivangi Modi +1
  • Research Article
  • Citations1

Counting in Visual Question Answering: Methods, Datasets, and Future Work

  • Oct 20, 2023
  • International Journal of Image and Graphics
  • Tesfayee Meshu Welde +1
  • Book Chapter
  • Citations49

Visual Question Answering Using Deep Learning: A Survey and Performance Analysis

  • Jan 01, 2021
  • Yash Srivastava +3
  • Book Chapter
  • Citations2

A-VQA: Attention Based Visual Question Answering Technique for Handling Improper Count of Occluded Object

  • Jan 01, 2021
  • Shivangi Modi +1
  • Book Chapter
  • Citations2

A VQA System for Medical Image Classification Using Transfer Learning

  • Jan 01, 2021
  • C Dhanush +2
  • Research Article
  • Citations49

Medical knowledge-based network for Patient-oriented Visual Question Answering

  • Dec 21, 2022
  • Information Processing & Management
  • Jian Huang +7
  • PDF
  • Research Article
  • Citations12

Multi-Layer Perceptron Classifier with the Proposed Combined Feature Vector of 3D CNN Features and Lung Radiomics Features for COPD Stage Classification.

  • Jan 01, 2023
  • Journal of Healthcare Engineering
  • Yingjian Yang +9
  • Research Article

VTFCGNet: a novel cross-modal reasoning network integrating Fourier self-attention and graph attention for visual text question answering

  • Feb 01, 2026
  • Neural Computing and Applications
  • Yujie Huo +3
  • Conference Article
  • Citations2

Visual Question Answering Using Deep Learning

  • Nov 27, 2021
  • Deepika Kanakamedala +4
  • Research Article
  • Citations8

Attacking VQA Systems via Adversarial Background Noise

  • Aug 01, 2020
  • IEEE Transactions on Emerging Topics in Computational Intelligence
  • Akshay Chaturvedi +1
  • Conference Article
  • Citations59

Visual Question Answering as Reading Comprehension

  • Jun 01, 2019
  • Hui Li +3
  • Conference Article
  • Citations4

Visual Question Answering: Methodologies and Challenges

  • Oct 09, 2020
  • Liyana Sahir Kallooriyakath +3
  • Research Article
  • Citations12

Visual Question Answering using Transformer Architectures: Applying Transformer Models to Improve Performance in VQA Tasks

  • Mar 31, 2022
  • Journal of Artificial Intelligence & Cloud Computing
  • Vedant Singh
  • Abstract

Understanding the diagnosis and management of external eye disease: Gurwood AS: Br J Optom Disp 1995;3:155–163

  • May 01, 1996
  • International Contact Lens Clinic
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.