• Home
  • Search
  • IMTLM-Net: improved multi-task transformer based on localization mechanism network for handwritten English text recognition
  • Cite Icon4
  • https://doi.org/10.1007/s40747-024-01713-8Copy DOI Icon

IMTLM-Net: improved multi-task transformer based on localization mechanism network for handwritten English text recognition

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Intelligence technology has widely empowered education. As an example, Optical Character Recognition (OCR) can be used in smart education scenarios such as online homework correction and teaching data analysis. One of the fundamental yet challenging tasks is to recognize images of handwritten English text as editable text accurately. This is because handwritten text tends to have different writing habits as well as smearing and overlapping, resulting in hard alignment between the image and the real text. Additionally, the lack of data on handwritten text further leads to a lower recognition rate. To address the above issue, on the one hand, this paper extends the existing dataset and introduces hyphenated data annotation to provide data support for improving the robustness and discrimination of the model; on the other hand, a novel framework named Improved Multi-task Transformer based on Localization Mechanism Network (IMTLM-Net) is proposed for handwritten English text recognition. IMTLM-Net contains two parts, namely the encoding and decoding modules. The encoding module introduces a dual-stream processing mechanism. That is, in the simultaneous processing of text and images, a Vision Transformer (VIT) is utilized to encode images, and a Permutation Language Model (PLM) is designed for word arrangement. Two Multiple Head Attention (MHA) units are employed in the decoding module, focusing on text sequences and image sequences. Moreover, the localization mechanism (LM) is applied to enhance font structure feature extraction from image data, which in turn improves the model’s ability to capture complex details. Numerous experiments demonstrate that the proposed method achieves state-of-the-art results in handwritten text recognition.

Similar Papers
  • Book Chapter
  • Citations22

Scaled Conjugate Gradient Algorithm in Neural Network Based Approach for Handwritten Text Recognition

  • Jan 01, 2011
  • Haradhan Chel +2
  • Conference Article

Deep Learning Analysis in Development of Handwritten and Plain Text Classification API

  • Sep 21, 2022
  • Danny Gani +4
  • PDF
  • Research Article
  • Citations10

Impact of Deep Learning on Localizing and Recognizing Handwritten Text in Lecture Videos

  • Jan 01, 2021
  • International Journal of Advanced Computer Science and Applications
  • Lakshmi Haritha Medida +1
  • Book Chapter
  • Citations9

Recent Results of Online Japanese Handwriting Recognition and Its Applications

  • Mar 12, 2008
  • Masaki Nakagawa +5
  • Research Article
  • Citations23

KOHTD: Kazakh offline handwritten text dataset

  • Jul 16, 2022
  • Signal Processing: Image Communication
  • Nazgul Toiganbayeva +6
  • Conference Article
  • Citations1

LLM Powered HTR: Integrating Handwritten Text Recognition System with Large Language Model

  • Jun 21, 2024
  • Mehar Prateek Kalra +2
  • Dissertation

Improving transformer for scene text and handwritten text recognition

  • Jan 01, 2024
  • Yew Lee Tan
  • Conference Article
  • Citations13

Hand-Written and Machine-Printed Text Classification in Architecture, Engineering & Construction Documents

  • Aug 01, 2018
  • Supriya Das +6
  • Single Book
  • Citations66

Fundamentals in Handwriting Recognition

  • Jan 01, 1994
  • PDF
  • Research Article
  • Citations16

Enhancing handwritten text recognition accuracy with gated mechanisms

  • Jul 22, 2024
  • Scientific Reports
  • Ravikumar Chinthaginjala +7
  • Conference Article
  • Citations12

HaFT: A handwritten Farsi text database

  • Sep 01, 2013
  • Reza Safabaksh +2
  • Research Article

Biomechanics-inspired analysis of the recognition function of recurrent neural networks in primary school math homework under low carbon background

  • Mar 13, 2025
  • Molecular & Cellular Biomechanics
  • Jing Xu +3
  • Research Article
  • Citations1

RanPil: New Dataset and Benchmark for Offline Handwritten Korean Text Recognition

  • Jun 20, 2025
  • International Journal on Data Science and Technology
  • Hyon-Gwang O +4
  • Research Article
  • Citations5

Learning confidence transformation for handwritten Chinese text recognition

  • Nov 05, 2013
  • International Journal on Document Analysis and Recognition (IJDAR)
  • Da-Han Wang +1
  • Research Article
  • Citations29

Generative adversarial network based adaptive data augmentation for handwritten Arabic text recognition.

  • Jan 25, 2022
  • PeerJ Computer Science
  • Mohamed Eltay +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.