• Home
  • Search
  • Real-Time Hand Detection using Convolutional Neural Networks for Costa Rican Sign Language Recognition
  • Cite Icon13
  • https://doi.org/10.1109/contie49246.2019.00042Copy DOI Icon

Real-Time Hand Detection using Convolutional Neural Networks for Costa Rican Sign Language Recognition

  • Oct 1, 2019
  • Juan Zamora-Mora +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Sign language is the natural language for the deaf, something that comes naturally as a form of non-verbal communication between signers, ruled by a set of grammars that is in constant evolution as the universe of signs represents a small fraction of all words in Spanish. This limitation combined with the lack of knowledge in sign language by verbal speakers creates a separation where both parties (signers and non-signers) are unable to efficiently communicate, a problem that increases under a specific context such as emergency situations, where first-response teams such as EMTs, firefighters or police officers might be unable to properly attend an emergency as interactions between the involved parties becomes a barrier for decision making when time is scarce. Developing a cognitive-capable tool that serves to recognize sign language in a ubiquitous way, is a must to reduce barriers between the deaf and emergency corps under this context. Hand detection is the first step toward building a Costa Rican sign language (LESCO) recognition framework. Important advances in computing, particularly in the area of deep learning, open a new frontier for object recognition that can be leveraged to build a hand detection module. This study trains the MobileNet V1 convolutional neural network against the EgoHands dataset from Indiana University's UI Computer Vision Lab to determine if the dataset itself is sufficient to detect hands in LESCO videos, from five different signers that wear short-sleeve shirts and under complex backgrounds. Those requirements are key to determine the usefulness of the solution as consulted bibliography performs tests with single-color backgrounds and long-sleeve shirts that ease the classification tasks under controlled environments only. The two-step experiment obtained 1) a mean average precision of 96.1% for the EgoHands dataset and 2) a 91% average accuracy for hand detection across the five LESCO videos. Despite the high accuracy reported by the tests in this paper, the hand detection module was unable to detect certain hand shapes such as closed fists and open hands pointing perpendicular to the camera lens, which suggests that the complex egocentric views as captured in the EgoHands dataset might be insufficient for proper hand detection for Costa Rican sign language.

Similar Papers
  • Research Article

A Unified Hand-Landmark-Based Deep Learning Framework for Static and Dynamic Vietnamese Sign Language Recognition

  • Apr 13, 2026
  • EAI Endorsed Transactions on Intelligent Systems and Machine Learning Applications
  • Linh Duong Thanh +1
  • Dissertation

Hand detection and hand shape and posture analysis in images

  • Jan 01, 2015
  • Xiaolong Zhu
  • Research Article
  • Citations3

Indian sign language recognition and search results

  • Aug 22, 2023
  • Journal of Autonomous Intelligence
  • Sandeep Musale +4
  • Conference Article

Sign Language Recognition using Deep Learning with Media pipe Integration

  • Sep 24, 2025
  • Saira Banu.J +4
  • Book Chapter
  • Citations6

Deformable Part Model Based Hand Detection against Complex Backgrounds

  • Jan 01, 2016
  • Chunyu Zou +3
  • Research Article
  • Citations1

Znakovni jezici - nekad i sad

  • Jan 01, 2020
  • Зборник радова Филозофског факултета у Приштини
  • Ljubica Isaković +2
  • Research Article
  • Citations1

Sign Language Translator and Teaching System

  • Feb 28, 2023
  • International Journal for Research in Applied Science and Engineering Technology
  • Aditee Kore +3
  • Conference Article
  • Citations13

An encoding and identification approach for the static sign language recognition

  • Jul 01, 2012
  • Fu-Hua Chou +1
  • Research Article
  • Citations500

Sign Language Recognition: A Deep Survey

  • Aug 06, 2020
  • Expert Systems with Applications
  • Razieh Rastgoo +2
  • Research Article
  • Citations2

A Review of Sign Language Recognition Techniques

  • Dec 07, 2021
  • International Journal of Information Systems and Computer Sciences
  • Britannica +51
  • Research Article

Korean Sign Language Recognition and Sentence Generation through Data Augmentation

  • Jan 01, 2026
  • Computers, materials & continua/Computers, materials & continua (Print)
  • Soo-Yeon Jeong +2
  • Conference Article
  • Citations5

An integrated sign language recognition system

  • Oct 07, 2013
  • Warren Nel +2
  • Research Article
  • Citations1

Sign languages . Ed. by Diane Brentari. Cambridge: Cambridge University Press, 2010. Pp. xxi, 691. ISBN 9780521883702. $160 (Hb).

  • Dec 01, 2011
  • Language
  • Donna Jo Napoli
  • Research Article

Alphabet Recognition of American Sign Language Using Machine Learning

  • Jul 15, 2024
  • International Journal For Multidisciplinary Research
  • Saloni Tiwari - +4
  • Research Article
  • Citations4

MyWSL: Malaysian words sign language dataset

  • Jun 22, 2023
  • Data in Brief
  • Rina Tasia Johari +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.