• Home
  • Search
  • Creating electronic resources for African languages through digitisation: a technical report
  • Cite Icon1
  • https://doi.org/10.55492/dhasa.v4i01.4441Copy DOI Icon

Creating electronic resources for African languages through digitisation: a technical report

  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

The need for electronic resources for (under-resourced) African languages is an often stated one. These resources are needed for language research in general, and more specifically for the development of Human Language Technology (HLT) applications such as machine translation, speech recognition, electronic dictionaries, spelling and grammar checkers, and optical character recognition. These technologies rely on large quantities of high-quality electronic data. Digitisation is one of the strategies that can be used to collect such data. For the purpose of this paper, digitisation is understood as the conversion of analogue text, audio and video data into digital form, as well as the provision of born digital data that is currently not available in a format that enables downstream processing. There is a general perception that the African languages are under-resourced with regard to sufficient digitisation tools to function effectively in the modern digital world. Our paper is presented as a technical report, detailing the tools, procedures, best practices and standards that are utilised by the UP digitisation node to digitise text, audio and audio-visual material for the African languages. The digitisation effort is part of the South African Digital Languages Resources (SADiLaR) project (https://www.sadilar.org/index.php/en/), funded by the Department of Science and Innovation. Our report is based on a best practices document, developed through the course of our digitisation project and forms part of the deliverables as per contractual agreement between the UP digitisation node and the SADiLaR Hub. The workflow as explained in this document was designed with this specific project in mind; software and hardware utilised were also selected based on the constraints with regard to capacity and available technical skills in mind. We motivate our choice of Optical Character Recognition (OCR) software by referring to an earlier experiment in which we evaluated three commercially available OCR programmes. We did not attempt a full-scale evaluation of all available OCR software, but rather focused on selecting one that renders high quality outputs. We also reflect on one of the challenges specific to our project, i.e. copyright clearance. This is particularly relevant with regard to published material. In the absence of newspapers for specifically the African Languages (isiZulu being a notable exception), the biggest portion of textual material available for digitisation consists of printed material such as textbooks, novels, dramas, short stories and other literary genres. The digitisation process is driven by the availability of material for the different languages. Furthermore, obtaining copyright clearance from publishers is a prerequisite for digitisation and especially for the release of any digitised text data for further use and/or processing. Having information on a relatively small-scale digitisation workflow and best practices readily available will enable other interested parties to participate in the digitisation effort, thus contributing to the collection of electronic data for the African languages.

Similar Papers
  • Conference Article
  • Citations4

Part of Speech Tagging for Setswana African Language

  • Nov 01, 2019
  • M.A Dibitso +2
  • PDF
  • Research Article
  • Citations2

Optical Character Recognition and text cleaning in the indigenous South African languages

  • Jan 01, 2022
  • Stellenbosch Papers in Linguistics Plus
  • Danie Prinsloo +2
  • Research Article
  • Citations2

Teaching and Learning Guide for: Africa’s Linguistic Diversity

  • Sep 01, 2009
  • Language and Linguistics Compass
  • Bonny Sands
  • Conference Article
  • Citations3

Developing and evaluating a pipeline for Setswana OCR

  • Nov 01, 2017
  • Gideon Kotze +1
  • Book Chapter
  • Citations4

African Languages and Human Language Technologies

  • May 16, 2019
  • Justus C Roux +1
  • Conference Article
  • Citations13

OCR performance prediction using cross-OCR alignment

  • Aug 01, 2015
  • Ahmed Ben Salah +3
  • Research Article

The Role of Machine Translation in African Languages: Potentials and Pitfalls

  • Aug 31, 2025
  • Uirtus
  • Ulrich Douo
  • Single Report
  • Citations3

Reliable Electronic Text: The Elusive Prerequisite for a Host of Human Language Technologies

  • Sep 30, 2010
  • Paul M Herceg +1
  • Research Article
  • Citations27

Supervised OCR Error Detection and Correction Using Statistical and Neural Machine Translation Methods

  • Jan 01, 2018
  • Zurich Open Repository and Archive (University of Zurich)
  • Chantal Amrhein +1
  • PDF
  • Research Article
  • Citations18

Enhancing African low-resource languages: Swahili data for language modelling

  • Jun 30, 2020
  • Data in Brief
  • Casper S Shikali +1
  • Supplementary Content

Endangered African Languages Featured in a Digital Collection: The Case of the ǂKhomani San | Hugh Brody Collection

  • May 21, 2020
  • Open University of Cape Town (University of Cape Town)
  • Kerry Jones +1
  • Research Article
  • Citations7

Systematic Literature Review of Machine Learning Models and Applications for Text Recognition

  • Jan 01, 2025
  • IEEE Access
  • Nuzhat Khan +7
  • Research Article
  • Citations24

Development of reusable resources for Human Language Technologies (HLT) applications: practice and experience

  • Jan 01, 2005
  • South African Journal of African Languages
  • Jackie Jones +3
  • Research Article
  • Citations1

Endangered African Languages Featured in a Digital Collection: The Case of the ǂKhomani San | Hugh Brody Collection

  • Oct 25, 2020
  • Open University of Cape Town (University of Cape Town)
  • Kerry Jones +1
  • Research Article
  • Citations57

The South African Human Language Technology Audit

  • Jun 24, 2011
  • Language Resources and Evaluation
  • Aditi Sharma Grover +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.