• Home
  • Search
  • ESIR: End-To-End Scene Text Recognition via Iterative Image Rectification
  • Open Access IconOpen Access
  • Cite Icon378
  • https://doi.org/10.1109/cvpr.2019.00216Copy DOI Icon

ESIR: End-To-End Scene Text Recognition via Iterative Image Rectification

  • Jun 1, 2019
  • Fangneng Zhan +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Automated recognition of texts in scenes has been a research challenge for years, largely due to the arbitrary text appearance variation in perspective distortion, text line curvature, text styles and different types of imaging artifacts. The recent deep networks are capable of learning robust representations with respect to imaging artifacts and text style changes, but still face various problems while dealing with scene texts with perspective and curvature distortions. This paper presents an end-to-end trainable scene text recognition system (ESIR) that iteratively removes perspective distortion and text line curvature as driven by better scene text recognition performance. An innovative rectification network is developed, where a line-fitting transformation is designed to estimate the pose of text lines in scenes. Additionally, an iterative rectification framework is developed which corrects scene text distortions iteratively towards a fronto-parallel view. The ESIR is also robust to parameter initialization and easy to train, where the training needs only scene text images and word-level annotations as required by most scene text recognition systems. Extensive experiments over a number of public datasets show that the proposed ESIR is capable of rectifying scene text distortions accurately, achieving superior recognition performance for both normal scene text images and those suffering from perspective and curvature distortions.

Similar Papers
  • Research Article
  • Citations25

Image-to-Character-to-Word Transformers for Accurate Scene Text Recognition.

  • Jan 01, 2023
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Chuhui Xue +5
  • Conference Article
  • Citations9

STIRER: A Unified Model for Low-Resolution Scene Text Image Recovery and Recognition

  • Oct 26, 2023
  • Minyi Zhao +3
  • Conference Article
  • Citations68

Dictionary-guided Scene Text Recognition

  • Jun 01, 2021
  • Nguyen Nguyen +6
  • Conference Article
  • Citations5

Scene text detection and recognition system for visually impaired people in real world

  • Oct 09, 2018
  • Lei Fei +5
  • Conference Article
  • Citations16

Scene Text Recognition via Gated Cascade Attention

  • Jul 01, 2019
  • Siwei Wang +4
  • PDF
  • Research Article
  • Citations21

Arabic Cursive Text Recognition from Natural Scene Images

  • Jan 10, 2019
  • Applied Sciences
  • Saad Bin Ahmed +3
  • Book Chapter
  • Citations287

Accurate Scene Text Recognition Based on Recurrent Neural Network

  • Jan 01, 2015
  • Bolan Su +1
  • Conference Article
  • Citations12

Occluded Text Detection and Recognition in the Wild

  • May 01, 2022
  • Zobeir Raisi +1
  • Conference Article

STV2k

  • Aug 19, 2016
  • Pingping Xiao +3
  • Conference Article
  • Citations2

Scene text dataset in Turkish

  • May 01, 2017
  • Nesli Erdogmus
  • Conference Article
  • Citations1

Scene Text Recognition With Linear Constrained Rectification

  • Dec 01, 2020
  • Gang Wang +2
  • Book Chapter

Scene-Text Analysis

  • Jun 30, 2021
  • Tanima Dutta +2
  • Book Chapter
  • Citations4

Scene Character and Text Recognition: The State-of-the-Art

  • Jan 01, 2015
  • Chongmu Chen +2
  • Book Chapter
  • Citations7

How Far Deep Learning Systems for Text Detection and Recognition in Natural Scenes are Affected by Occlusion?

  • Jan 01, 2021
  • Aline Geovanna Soares +2
  • Video Transcripts

MEAN: Multi-Element Attention Network for Scene Text Recognition

  • Dec 29, 2020
  • Underline Science Inc.
  • Ruijie Yan
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.