• Home
  • Search
  • Unambiguous Text Localization, Retrieval, and Recognition for Cluttered Scenes.
  • Cite Icon16
  • https://doi.org/10.1109/tpami.2020.3018491Copy DOI Icon

Unambiguous Text Localization, Retrieval, and Recognition for Cluttered Scenes.

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Text instance as one category of self-described objects provides valuable information for understanding and describing cluttered scenes. The rich and precise high-level semantics embodied in the text could drastically benefit the understanding of the world around us. While most recent visual phrase grounding approaches focus on general objects, this paper explores extracting designated texts and predicting unambiguous scene text information, i.e., to accurately localize and recognize a specific targeted text instance in a cluttered image from natural language descriptions (referring expressions). To address this issue, first a novel recurrent dense text localization network (DTLN) is proposed to sequentially decode the intermediate convolutional representations of a cluttered scene image into a set of distinct text instance detections. Our approach avoids repeated text detections at multiple scales by recurrently memorizing previous detections, and effectively tackles crowded text instances in close proximity. Second, we propose a context reasoning text retrieval (CRTR) model, which jointly encodes text instances and their context information through a recurrent network, and ranks localized text bounding boxes by a scoring function of context compatibility. Third, a recurrent text recognition module is introduced to extend the applicability of aforementioned DTLN and CRTR models, via text verification or transcription. Quantitative evaluations on standard scene text extraction benchmarks and a newly collected scene text retrieval dataset demonstrate the effectiveness and advantages of our models for the joint scene text localization, retrieval, and recognition task.

Similar Papers
  • Conference Article
  • Citations33

Unambiguous Text Localization and Retrieval for Cluttered Scenes

  • Jul 01, 2017
  • Xuejian Rong +2
  • Dissertation
  • Citations3

Thai scene text recognition

  • Jan 01, 2019
  • Thananop Kobchaisawat
  • Research Article
  • Citations4

An End-to-End Scene Text Recognition for Bilingual Text

  • Sep 09, 2024
  • Big Data and Cognitive Computing
  • Bayan M Albalawi +3
  • Research Article
  • Citations4

Open set text recognition technology

  • Jan 01, 2023
  • Journal of Image and Graphics
  • Chun Yang +5
  • Conference Article
  • Citations12

Occluded Text Detection and Recognition in the Wild

  • May 01, 2022
  • Zobeir Raisi +1
  • Research Article
  • Citations44

Unambiguous Scene Text Segmentation with Referring Expression Comprehension.

  • Jul 26, 2019
  • IEEE Transactions on Image Processing
  • Xuejian Rong +2
  • Conference Article
  • Citations6

Research on Text Location and Recognition in Natural Images with Deep Learning

  • Oct 06, 2018
  • Ping Zhang +2
  • Conference Article
  • Citations3

Improving text recognition by distinguishing scene and overlay text

  • Feb 12, 2015
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Bernhard Quehl +2
  • Research Article
  • Citations117

Scene text detection and recognition with advances in deep learning: a survey

  • Mar 27, 2019
  • International Journal on Document Analysis and Recognition (IJDAR)
  • Xiyan Liu +2
  • Supplementary Content
  • Citations3

Text-detection and -recognition from natural images

  • Feb 10, 2020
  • Figshare
  • Hanaa F Mahmood
  • Book Chapter
  • Citations7

How Far Deep Learning Systems for Text Detection and Recognition in Natural Scenes are Affected by Occlusion?

  • Jan 01, 2021
  • Aline Geovanna Soares +2
  • Conference Article
  • Citations9

STIRER: A Unified Model for Low-Resolution Scene Text Image Recovery and Recognition

  • Oct 26, 2023
  • Minyi Zhao +3
  • Conference Article
  • Citations2

Scene text dataset in Turkish

  • May 01, 2017
  • Nesli Erdogmus
  • Conference Article
  • Citations13

A Model for Automatic Recognition of Vertical Texts in Natural Scene Images

  • Nov 01, 2018
  • Ong Yi Ling +3
  • Conference Article
  • Citations112

On Combining Multiple Segmentations in Scene Text Recognition

  • Aug 01, 2013
  • Luka Neumann +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.