• Home
  • Search
  • Continuous Sign Language Recognition and Translation Using Deep Learning Approach
  • https://doi.org/10.1109/icvadv63329.2025.10960956Copy DOI Icon

Continuous Sign Language Recognition and Translation Using Deep Learning Approach

  • Mar 4, 2025
  • Rakesh Kumar M +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

This paper introduces a novel approach for sign language gesture recognition which leverages the fusion of spatial and skeletal features. The proposed system uses spatial feature extracted from RGB images of the signer via ResNet and skeletal features are obtained via MediaPipe, thus achieving both precise and complete data representation. A robust preprocessing pipeline is adopted for processing input data. It includes data cleaning, normalization, denoising, and frame sequence alignment. The hybrid TCN-LSTM model is the core of the system. The concatenated feature vector with both spatial and skeletal information is fed into the model. The system undergoes intensive training and testing to guarantee excellent accuracy and performance in the prediction of semantic meanings of gestures. The TCN captures local temporal dependencies and LSTM handles long range dependencies. Results demonstrate a considerable gain in recognition accuracy, which proves the effectiveness of this strategy. This research makes a contribution toward real-time gesture recognition systems, with applications relevant to the facilitation of communication for individuals with hearing or speech impairments.

Similar Papers
  • Research Article

Continuous Chinese Sign Language Recognition Using Millimeter-Wave Radar with DeepSeek Semantic Enhancement

  • Jan 01, 2025
  • IEEE Sensors Journal
  • Lei Zhang +5
  • Research Article
  • Citations500

Sign Language Recognition: A Deep Survey

  • Aug 06, 2020
  • Expert Systems with Applications
  • Razieh Rastgoo +2
  • Book Chapter

Conversational Algerian Sign Language Recognition Using the Deep Learning Approach

  • May 29, 2025
  • Lila Meddeber +1
  • Research Article

Enhanced sign language translation using three stream multimodal occlusion resilient transformer

  • Nov 07, 2025
  • Discover Computing
  • Rina Damdoo +1
  • Supplementary Content

Entropy-Regularized Joint CTC–Attention Learning for Low-Resource Continuous Sign Language Recognition

  • Feb 09, 2026
  • Research Square
  • Hanan A Taher +1
  • Research Article
  • Citations16

Improving Continuous Sign Language Recognition with Consistency Constraints and Signer Removal

  • Mar 08, 2024
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Ronglai Zuo +1
  • Book Chapter
  • Citations1

Spatial-Temporal Graph Transformer for Skeleton-Based Sign Language Recognition

  • Jan 01, 2023
  • Zhengye Xiao +4
  • Research Article
  • Citations19

Swin-MSTP: Swin transformer with multi-scale temporal perception for continuous sign language recognition

  • Feb 01, 2025
  • Neurocomputing
  • Sarah Alyami +1
  • Research Article
  • Citations12

Gloss Prior Guided Visual Feature Learning for Continuous Sign Language Recognition.

  • Jan 01, 2024
  • IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
  • Leming Guo +5
  • Research Article
  • Citations8

A multi-modal fusion framework for continuous sign language recognition based on multi-layer self-attention mechanism

  • Aug 10, 2022
  • Journal of Intelligent & Fuzzy Systems
  • Cuihong Xue +5
  • Conference Article
  • Citations3

Continuous Sign Language Recognition Using MediaPipe

  • Oct 19, 2023
  • Khang B Tran +2
  • Conference Article
  • Citations3

Sign Language Translation Techniques Using Artificial Intelligence for the Hearing Impaired Community in Sri Lanka: A Review

  • Nov 23, 2023
  • Malith Priyankara +2
  • Conference Article
  • Citations89

Transition movement models for large vocabulary continuous sign language recognition

  • Jan 01, 2004
  • Wen Gao +3
  • PDF
  • Research Article

Sequential particle filter with covariance features classified with artificial neural nets for continuous Indian sign language recognition

  • Dec 21, 2017
  • International Journal of Engineering & Technology
  • P Praveen Kumar +2
  • Research Article

A dual-stream deep learning framework for continuous sign language recognition to enhance communication accessibility in the Ha'il region.

  • Feb 03, 2026
  • Scientific reports
  • Haifa Harrouch +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.