• Home
  • Search
  • TrOCR Meets Language Models: An End-to-End Post-correction Approach
  • Cite Icon2
  • https://doi.org/10.1007/978-3-031-70645-5_2Copy DOI Icon

TrOCR Meets Language Models: An End-to-End Post-correction Approach

  • Jan 1, 2024
  • Yung-Hsin Chen +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

This study aims to enhance handwritten text recognition (HTR) performance and domain adaptability by combining an optical character recognition (OCR) model with a language model (LM) that serves as a corrector. This integration addresses three principal challenges: over-correction, which compromises text authenticity; poor domain adaptation; and the scarcity of annotated images. We explore the synergy between TrOCR, a state-of-the-art OCR model, and CharBERT, a BERT-based LM. A novel aspect of our research involves introducing common errors made by the recogniser into the LM, enabling it to consider these errors during correction, thereby improving overall performance. Our findings reveal that the hybrid TrOCR-CharBERT model effectively balances visual and linguistic information, preserving the authenticity of the original texts. Furthermore, the model is able to adapt to historical data even when the recogniser is trained solely on contemporary data, mitigating the need for a large number of annotated historical handwritten images.

Similar Papers
  • Research Article
  • Citations5

Smart Parking System based on Improved OCR Model

  • Nov 01, 2020
  • IOP Conference Series: Materials Science and Engineering
  • Rami Bassam +1
  • Conference Article

When Vision Fails: Text Attacks Against ViT and OCR

  • Oct 13, 2025
  • Nicholas Boucher +4
  • Research Article
  • Citations1

Development of Optical Character Recognition-Based Quality Control Process of Paper-Based Consent Forms.

  • Feb 17, 2026
  • Biopreservation and biobanking
  • Juyoung Lee +5
  • Research Article
  • Citations4

Enhancing image-based virtual try-on with Multi-Controlled Diffusion Models.

  • Sep 01, 2025
  • Neural networks : the official journal of the International Neural Network Society
  • Weihao Luo +2
  • Research Article

A comparative analysis of optical character recognition models for extracting and classifying texts in natural scenes

  • Apr 01, 2025
  • IAES International Journal of Artificial Intelligence (IJ-AI)
  • Puneeth Prakash +1
  • PDF
  • Research Article
  • Citations8

A Smart Visual Sensing Concept Involving Deep Learning for a Robust Optical Character Recognition under Hard Real-World Conditions

  • Aug 12, 2022
  • Sensors (Basel, Switzerland)
  • Kabeh Mohsenzadegan +2
  • Conference Article
  • Citations6

Unsupervised OCR Model Evaluation Using GAN

  • Sep 01, 2019
  • Abhash Sinha +3
  • Research Article
  • Citations1

Artificial intelligence powered OCR models for digitizing ayurveda manuscripts

  • Oct 16, 2024
  • Journal of Ayurveda and Holistic Medicine (JAHM)
  • Haritha T Jayaraj +2
  • Research Article
  • Citations3

IMPROVED OCR QUALITY FOR SMART SCANNED DOCUMENT MANAGEMENT SYSTEM

  • May 14, 2022
  • Journal of Science and Technique
  • Viet Anh Pham
  • Conference Article
  • Citations1

Enhancing Text Recognition of Damaged Documents through Synergistic OCR and Large Language Models

  • Nov 09, 2024
  • Thomas Asselborn +4
  • Research Article
  • Citations1

Comparative Study of Character Recognition for Handwritten Characters

  • Apr 24, 2025
  • Communications on Applied Nonlinear Analysis
  • Tarun Kumar
  • Book Chapter
  • Citations2

US Traffic Sign Recognition by Using Partial OCR and Inbuilt Dictionary

  • Nov 08, 2022
  • Sakshita Jaiswal +3
  • Conference Article
  • Citations74

A generative probabilistic OCR model for NLP applications

  • Jan 01, 2003
  • Okan Kolak +2
  • Research Article

Testing Optical Character Recognition of Home Blood Pressure Measurements, a Randomized Trial

  • Nov 19, 2025
  • American Journal of Hypertension
  • Austin J Strom +8
  • PDF
  • Research Article
  • Citations73

Optical character recognition with neural networks and post-correction with finite state methods

  • Aug 20, 2020
  • International Journal on Document Analysis and Recognition (IJDAR)
  • Senka Drobac +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.