• Home
  • Search
  • Text detection and recognition in images and video sequences
  • Cite Icon17
  • https://doi.org/10.5075/epfl-thesis-2863Copy DOI Icon

Text detection and recognition in images and video sequences

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Text characters embedded in images and video sequences represents a rich source of information for content-based indexing and retrieval applications. However, these text characters are difficult to be detected and recognized due to their various sizes, grayscale values and complex backgrounds. This thesis investigates methods for building an efficient application system for detecting and recognizing text of any grayscale values embedded in images and video sequences. Both empirical image processing methods and statistical machine learning and modeling approaches are studied in two sub-problems: text detection and text recognition. Applying machine learning methods for text detection encounters difficulties due to character size, grayscale variations and heavy computation cost. To overcome these problems, we propose a two-step localization/verification approach. The first step aims at quickly localizing candidate text lines, enabling the normalization of characters into a unique size. In the verification step, a trained support vector machine or multi-layer perceptrons is applied on background independent features to remove the false alarms. Text recognition, even from the detected text lines, remains a challenging problem due to the variety of fonts, colors, the presence of complex backgrounds and the short length of the text strings. Two schemes are investigated addressing the text recognition problem: bi-modal enhancement scheme and multi-modal segmentation scheme. In the bi-modal scheme, we propose a set of filters to enhance the contrast of black and white characters and produce a better binarization before recognition. For more general cases, the text recognition is addressed by a text segmentation step followed by a traditional optical character recognition (OCR) algorithm within a multi-hypotheses framework. In the segmentation step, we model the distribution of grayscale values of pixels using a Gaussian mixture model or a Markov Random Field. The resulting multiple segmentation hypotheses are post-processed by a connected component analysis and a grayscale consistency constraint algorithm. Finally, they are processed by an OCR software. A selection algorithm based on language modeling and OCR statistics chooses the text result from all the produced text strings. Additionally, methods for using temporal information of video text are investigated. A Monte Carlo video text segmentation method is proposed for adapting the segmentation parameters along temporal text frames. Furthermore, a ROVER (Recognizer Output Voting Error Reduction) algorithm is studied for improving the final recognition text string by voting the characters through temporal frames.

Similar Papers
  • PDF
  • Book Chapter
  • Citations13

Decision Tree as an Accelerator for Support Vector Machines

  • Nov 07, 2012
  • Fu Chang +1
  • Conference Article

KazakhOCR: A Synthetic Benchmark for Evaluating Multimodal Models in Low-Resource Kazakh Script OCR

  • Jan 01, 2026
  • Henry Gagnier +2
  • Conference Article
  • Citations78

Video text detection and recognition: Dataset and benchmark

  • Mar 01, 2014
  • Phuc Xuan Nguyen +2
  • Research Article
  • Citations4

Frame selection for OCR from video stream of book flipping

  • Jan 06, 2017
  • Multimedia Tools and Applications
  • Dibyayan Chakraborty +4
  • Research Article
  • Citations5

A hierarchical recursive method for text detection in natural scene images

  • Dec 12, 2016
  • Multimedia Tools and Applications
  • Xiaobing Wang +3
  • Conference Article
  • Citations32

Deep Learning for Text Detection and Recognition in Complex Engineering Diagrams

  • Jul 01, 2020
  • Laura Jamieson +2
  • Research Article
  • Citations8

Reading the legends of Roman Republican coins

  • Feb 13, 2014
  • Journal on Computing and Cultural Heritage
  • Albert Kavelar +2
  • Conference Article
  • Citations19

Robust video text segmentation and recognition with multiple hypotheses

  • Jun 25, 2003
  • Proceedings - International Conference on Image Processing
  • J.-M Dobez +1
  • Research Article
  • Citations5

A Deep Learning-Based Text Detection and Recognition Approach for Natural Scenes

  • Oct 27, 2022
  • Journal of Circuits, Systems and Computers
  • Xuexiang Li
  • Research Article

Automated Handwritten Text Recognition for Banking Application using OCR

  • May 11, 2025
  • INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT
  • Saraswathi G
  • Research Article
  • Citations2

Generative AI-Powered Document Processing at Scale with Fraud Detection for Large Financial Organizations

  • Oct 31, 2024
  • International Journal of Scientific Research in Computer Science, Engineering and Information Technology
  • Sachin Dixit
  • Conference Article
  • Citations2

An Empirical Review for Character Recognition in Video Frames using Text Detection Algorithms

  • Jan 19, 2023
  • Nagendra Babu Rajaboina +2
  • Research Article
  • Citations287

Text detection and recognition in images and video frames

  • Oct 04, 2003
  • Pattern Recognition
  • Datong Chen +2
  • Conference Article
  • Citations14

Text Detection Using Delaunay Triangulation in Video Sequence

  • Apr 01, 2014
  • Liang Wu +3
  • Research Article
  • Citations4

Segmentation and recognition of characters on Tulu palm leaf manuscripts

  • Jan 01, 2019
  • International Journal of Computational Vision and Robotics
  • P.J Antony +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.