• Home
  • Search
  • Text-detection and -recognition from natural images
  • Cite Icon3
  • https://doi.org/10.26174/thesis.lboro.11816487.v1Copy DOI Icon

Text-detection and -recognition from natural images

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Text detection and recognition from images could have numerous functional applications for document analysis, such as assistance for visually impaired people; recognition of vehicle license plates; evaluation of articles containing tables, street signs, maps, and diagrams; keyword-based image exploration; document retrieval; recognition of parts within industrial automation; content-based extraction; object recognition; address block location; and text-based video indexing. This research exploited the advantages of artificial intelligence (AI) to detect and recognise text from natural images. Machine learning and deep learning were used to accomplish this task.In this research, we conducted an in-depth literature review on the current detection and recognition methods used by researchers to identify the existing challenges, wherein the differences in text resulting from disparity in alignment, style, size, and orientation combined with low image contrast and a complex background make automatic text extraction a considerably challenging and problematic task. Therefore, the state-of-the-art suggested approaches obtain low detection rates (often less than 80%) and recognition rates (often less than 60%). This has led to the development of new approaches. The aim of the study was to develop a robust text detection and recognition method from natural images with high accuracy and recall, which would be used as the target of the experiments. This method could detect all the text in the scene images, despite certain specific features associated with the text pattern. Furthermore, we aimed to find a solution to the two main problems concerning arbitrarily shaped text (horizontal, multi-oriented, and curved text) detection and recognition in a low-resolution scene and with various scales and of different sizes.In this research, we propose a methodology to handle the problem of text detection by using novel combination and selection features to deal with the classification algorithms of the text/non-text regions. The text-region candidates were extracted from the grey-scale images by using the MSER technique. A machine learning-based method was then applied to refine and validate the initial detection. The effectiveness of the features based on the aspect ratio, GLCM, LBP, and HOG descriptors was investigated. The text-region classifiers of MLP, SVM, and RF were trained using selections of these features and their combinations. The publicly available datasets ICDAR 2003 and ICDAR 2011 were used to evaluate the proposed method. This method achieved the state-of-the-art performance by using machine learning methodologies on both databases, and the improvements were significant in terms of Precision, Recall, and F-measure. The F-measure for ICDAR 2003 and ICDAR 2011 was 81% and 84%, respectively. The results showed that the use of a suitable feature combination and selection approach could significantly increase the accuracy of the algorithms.A new dataset has been proposed to fill the gap of character-level annotation and the availability of text in different orientations and of curved text. The proposed dataset was created particularly for deep learning methods which require a massive completed and varying range of training data. The proposed dataset includes 2,100 images annotated at the character and word levels to obtain 38,500 samples of English characters and 12,500 words. Furthermore, an augmentation tool has been proposed to support the proposed dataset. The missing of object detection augmentation tool encroach to proposed tool which has the ability to update the position of bounding boxes after applying transformations on images. This technique helps to increase the number of samples in the dataset and reduce the time of annotations where no annotation is required. The final part of the thesis presents a novel approach for text spotting, which is a new framework for an end-to-end character detection and recognition system designed using an improved SSD convolutional neural network, wherein layers are added to the SSD networks and the aspect ratio of the characters is considered because it is different from that of the other objects. Compared with the other methods considered, the proposed method could detect and recognise characters by training the end-to-end model completely. The performance of the proposed method was better on the proposed dataset; it was 90.34. Furthermore, the F-measure of the method’s accuracy on ICDAR 2015, ICDAR 2013, and SVT was 84.5, 91.9, and 54.8, respectively. On ICDAR13, the method achieved the second-best accuracy. The proposed method could spot text in arbitrarily shaped (horizontal, oriented, and curved) scene text.

Similar Papers
  • Conference Article
  • Citations1

Vehicle license plate recognition based on geometry restraints and multi-feature decision

  • Oct 10, 2005
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Jianwei Wu +1
  • Research Article
  • Citations3

Performance Evaluation of Efficient and Accurate Text Detection and Recognition in Natural Scenes Images Using EAST and OCR Fusion

  • Jan 01, 2025
  • International Journal of Advanced Computer Science and Applications
  • Vishnu Kant Soni +5
  • Research Article
  • Citations25

Cursive-Text: A Comprehensive Dataset for End-to-End Urdu Text Recognition in Natural Scene Images

  • May 21, 2020
  • Data in Brief
  • Asghar Ali Chandio +3
  • Research Article
  • Citations69

SEE: Towards Semi-Supervised End-to-End Scene Text Recognition

  • Apr 27, 2018
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Christian Bartz +2
  • Conference Article
  • Citations78

Video text detection and recognition: Dataset and benchmark

  • Mar 01, 2014
  • Phuc Xuan Nguyen +2
  • Conference Article

Application of Geometry Rectification to Deformed Characters Recognition

  • Jan 01, 2016
  • Liqun Wang +1
  • Research Article
  • Citations4

An End-to-End Scene Text Recognition for Bilingual Text

  • Sep 09, 2024
  • Big Data and Cognitive Computing
  • Bayan M Albalawi +3
  • Research Article
  • Citations16

Unambiguous Text Localization, Retrieval, and Recognition for Cluttered Scenes.

  • Aug 21, 2020
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Xuejian Rong +2
  • Research Article
  • Citations5

A Deep Learning-Based Text Detection and Recognition Approach for Natural Scenes

  • Oct 27, 2022
  • Journal of Circuits, Systems and Computers
  • Xuexiang Li
  • Book Chapter
  • Citations7

How Far Deep Learning Systems for Text Detection and Recognition in Natural Scenes are Affected by Occlusion?

  • Jan 01, 2021
  • Aline Geovanna Soares +2
  • Conference Article
  • Citations2

Detecting of Vertically-Oriented Texts in Images Containing Natural Scenes

  • Dec 07, 2020
  • Yi Ling Ong +3
  • Research Article
  • Citations10

Soft set-based MSER end-to-end system for occluded scene text detection, recognition and prediction

  • Oct 18, 2024
  • Knowledge-Based Systems
  • Alloy Das +4
  • Research Article
  • Citations265

Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapes.

  • Jan 11, 2021
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Minghui Liao +5
  • Research Article

An Enhanced YOLOv8 Model Integrated with CNN for Real-Time Vehicle License Plate Recognition

  • Jan 30, 2026
  • JOIV : International Journal on Informatics Visualization
  • Ndaru Ruseno +4
  • Conference Article
  • Citations5

Scene text detection and recognition system for visually impaired people in real world

  • Oct 09, 2018
  • Lei Fei +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.