• Home
  • Search
  • Text-based visual question answering with knowledge base
  • Open Access IconOpen Access
  • Cite Icon1
  • https://doi.org/10.1145/3444685.3446306Copy DOI Icon

Text-based visual question answering with knowledge base

  • Mar 7, 2021
  • Fang Zhou +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Text-based Visual Question Answering(VQA) usually needs to analyze and understand the text in a picture to give a correct answer for the given question. In this paper, a generic Text-based VQA with Knowledge Base (KB) is proposed, which performs text-based search on text information obtained by optical character recognition (OCR) in images, constructs task-oriented knowledge information and integrates it into the existing models. Due to the complexity of the image scene, the accuracy of OCR is not very high, and there are often cases where the words have individual character that is incorrect, resulting in inaccurate text information; here, some correct words can be found with help of KB, and the correct image text information can be added. Moreover, the knowledge information constructed with KB can better explain the image information, allowing the model to fully understand the image and find the appropriate text answer. The experimental results on the TextVQA dataset show that our method improves the accuracy, and the maximum increment is 39.2%.

Similar Papers
  • Conference Article
  • Citations38

Beyond OCR + VQA

  • Oct 17, 2021
  • Gangyan Zeng +3
  • Book Chapter
  • Citations18

Building Super-Resolution Image Generator for OCR Accuracy Improvement

  • Jan 01, 2020
  • Xujun Peng +1
  • Research Article
  • Citations29

Beyond OCR + VQA: Towards end-to-end reading and reasoning for robust and accurate textvqa

  • Jan 21, 2023
  • Pattern Recognition
  • Gangyan Zeng +7
  • PDF
  • Research Article
  • Citations2

Pixel-Level Degradation for Text Image Super-Resolution and Recognition

  • Nov 05, 2023
  • Electronics
  • Xiaohong Qian +4
  • Research Article
  • Citations3

Improving Tesseract OCR Accuracy Using SymSpell Algorithm on Passport Data

  • Jan 27, 2025
  • Sinkron
  • Iqbaluddin Syam Had +2
  • Research Article
  • Citations300

Optical Character Recognition by Open source OCR Tool Tesseract: A Case Study

  • Oct 20, 2012
  • International Journal of Computer Applications
  • Chirag Patel +2
  • Research Article
  • Citations6

Reading in the mist: high-quality optical character recognition based on freely available early modern digitized books

  • Apr 06, 2022
  • Digital Scholarship in the Humanities
  • Andrea Sangiacomo +4
  • Conference Article
  • Citations2

Geolocation on the iPhone by automatic street sign reading

  • Nov 01, 2010
  • Joshua Oosterman +1
  • Book Chapter
  • Citations1

Automatic Annotation Method for Document Image Binarization in Real Systems

  • Jan 01, 2020
  • Ryosuke Odate
  • Conference Article

GIICS: A dataset for gaze-direction-based intention inference in complex visual scenes

  • Nov 28, 2025
  • Qianxi Yu +5
  • PDF
  • Research Article
  • Citations7

IRIS: Smart Phone Aided Intelligent Reimbursement System Using Deep Learning

  • Jan 01, 2019
  • IEEE Access
  • Yang Meng +4
  • Book Chapter
  • Citations1

Fast and Accurate Tree-Based Clustering for Japanese/Chinese Character Recognition

  • Jan 01, 2013
  • Yuichi Abe +2
  • Conference Article
  • Citations4

Feature Extraction Method of Machine Translation Equivalent Pairs in Chinese-English Comparable Corpus based OCR Recognition

  • Jun 03, 2021
  • Bo Wang
  • Research Article
  • Citations6

Deep Learning-Based Multifunctional End-to-End Model for Optical Character Classification and Denoising

  • Nov 15, 2023
  • Journal of Computational Methods in Engineering Applications
  • Shuguang Xiong +2
  • Conference Article
  • Citations63

A Fast Alignment Scheme for Automatic OCR Evaluation of Books

  • Jan 01, 2011
  • Ismet Zeki Yalniz +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.