• Home
  • Search
  • Optimizing OCR Performance for Programming Videos: The Role of Image Super-Resolution and Large Language Models
  • Cite Icon8
  • https://doi.org/10.3390/math12071036Copy DOI Icon

Optimizing OCR Performance for Programming Videos: The Role of Image Super-Resolution and Large Language Models

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The rapid evolution of video programming tutorials as a key educational resource has highlighted the need for effective code extraction methods. These tutorials, varying widely in video quality, present a challenge for accurately transcribing the embedded source code, crucial for learning and software development. This study investigates the impact of video quality on the performance of optical character recognition (OCR) engines and the potential of large language models (LLMs) to enhance code extraction accuracy. Our comprehensive empirical analysis utilizes a rich dataset of programming screencasts, involving manual transcription of source code and the application of both traditional OCR engines, like Tesseract and Google Vision, and advanced LLMs, including GPT-4V and Gemini. We investigate the efficacy of image super-resolution (SR) techniques, namely, enhanced deep super-resolution (EDSR) and multi-scale deep super-resolution (MDSR), in improving the quality of low-resolution video frames. The findings reveal significant improvements in OCR accuracy with the use of SR, particularly at lower resolutions such as 360p. LLMs demonstrate superior performance across all video qualities, indicating their robustness and advanced capabilities in diverse scenarios. This research contributes to the field of software engineering by offering a benchmark for code extraction from video tutorials and demonstrating the substantial impact of SR techniques and LLMs in enhancing the readability and reusability of code from these educational resources.

Loading PDF

Similar Papers
  • Research Article

LLM-Based Transcription of Botanical Catalogues for Digital Access to Special Collections

  • Dec 23, 2025
  • Biodiversity Information Science and Standards
  • Ishaipiriyan Karunakularatnam +3
  • Conference Article
  • Citations24

A Study on the Accuracy of OCR Engines for Source Code Transcription from Programming Screencasts

  • Jun 29, 2020
  • Abdulkarim Malkadi +2
  • Conference Article
  • Citations26

CNN-based text image super-resolution tailored for OCR

  • Dec 01, 2017
  • Haochen Zhang +2
  • PDF
  • Research Article
  • Citations7

An OCR Engine for Printed Receipt Images using Deep Learning Techniques

  • Jan 01, 2023
  • International Journal of Advanced Computer Science and Applications
  • Cagri Sayallar +2
  • Conference Article
  • Citations1

Benchmarking commercial OCR engines for technical drawings indexing

  • Sep 10, 2001
  • J.C Lecoq +3
  • Conference Article
  • Citations1

Opportunities and Challenges of LLMs as Post-OCR Correctors

  • Oct 15, 2025
  • Radoslav Koynov +1
  • Conference Article
  • Citations1

Rescuing historical climate observations to support hydrological research

  • Aug 16, 2021
  • Ogundepo Odunayo +7
  • Book Chapter
  • Citations18

Building Super-Resolution Image Generator for OCR Accuracy Improvement

  • Jan 01, 2020
  • Xujun Peng +1
  • Research Article
  • Citations2

A conclusive methodology for rating OCR performance

  • Jul 26, 2005
  • Journal of the American Society for Information Science and Technology
  • Nathan E Brener +2
  • Research Article
  • Citations1

Smartphone based approximate localization using user highlighted texts from images

  • Feb 21, 2018
  • Pervasive and Mobile Computing
  • Taeyu Im +3
  • Conference Article
  • Citations45

OmniPage vs. Sakhr: paired model evaluation of two Arabic OCR products

  • Jan 07, 1999
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Tapas Kanungo +2
  • PDF
  • Research Article
  • Citations2

Pixel-Level Degradation for Text Image Super-Resolution and Recognition

  • Nov 05, 2023
  • Electronics
  • Xiaohong Qian +4
  • Conference Article
  • Citations1

Towards a Higher Accuracy of Optical Character Recognition of Chinese Rare Books in Making Use of Text Model

  • May 08, 2019
  • Hsiang-An Wang +1
  • Conference Article
  • Citations5

Performance evaluation of OCR on poor resolution text document images using different pre processing steps

  • Oct 01, 2014
  • G V S S K R Naganjaneyulu +2
  • Research Article

An End-to-End AI System for Automated Verification of Indian Identity Documents Using OCR and Large Language Models

  • Nov 17, 2025
  • International Journal of Advanced Research in Science, Communication and Technology
  • Prof S B Raghuvanshi +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.