• Home
  • Search
  • A Continuous Sign Language Recognition Method Based on Temporal Modeling and Semantic Alignment
  • https://doi.org/10.1145/3784013.3784039Copy DOI Icon

A Continuous Sign Language Recognition Method Based on Temporal Modeling and Semantic Alignment

  • Nov 14, 2025
  • J Li +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Sign language is a primary means of communication for the deaf community. Continuous sign language recognition (CSLR) remains challenging due to its large vocabulary, flexible grammar, and co-articulation effects. This paper proposes an end-to-end framework that integrates temporal modeling with semantic alignment. The method employs MediaPipe to extract and normalize 42 hand keypoints per frame. A multi-constraint Transformer encoder, incorporating Word Existence and Word Count constraints, enhances temporal dependency modeling. A semantic alignment module bridges the gap between visual and textual representations, and a CTC-BERT bidirectional decoder enhances sentence coherence. Experiments on Chinese continuous sign language datasets achieve a Word Error Rate (WER) below 20%, demonstrating the method's high recognition accuracy and strong semantic consistency.

Similar Papers
  • Research Article

Continuous Chinese Sign Language Recognition Using Millimeter-Wave Radar with DeepSeek Semantic Enhancement

  • Jan 01, 2025
  • IEEE Sensors Journal
  • Lei Zhang +5
  • Supplementary Content

Entropy-Regularized Joint CTC–Attention Learning for Low-Resource Continuous Sign Language Recognition

  • Feb 09, 2026
  • Research Square
  • Hanan A Taher +1
  • Conference Article
  • Citations89

Transition movement models for large vocabulary continuous sign language recognition

  • Jan 01, 2004
  • Wen Gao +3
  • Research Article
  • Citations8

A multi-modal fusion framework for continuous sign language recognition based on multi-layer self-attention mechanism

  • Aug 10, 2022
  • Journal of Intelligent & Fuzzy Systems
  • Cuihong Xue +5
  • Research Article

A dual-stream deep learning framework for continuous sign language recognition to enhance communication accessibility in the Ha'il region.

  • Feb 03, 2026
  • Scientific reports
  • Haifa Harrouch +3
  • Research Article
  • Citations12

Gloss Prior Guided Visual Feature Learning for Continuous Sign Language Recognition.

  • Jan 01, 2024
  • IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
  • Leming Guo +5
  • Research Article
  • Citations19

Swin-MSTP: Swin transformer with multi-scale temporal perception for continuous sign language recognition

  • Feb 01, 2025
  • Neurocomputing
  • Sarah Alyami +1
  • Research Article
  • Citations16

Improving Continuous Sign Language Recognition with Consistency Constraints and Signer Removal

  • Mar 08, 2024
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Ronglai Zuo +1
  • Conference Article
  • Citations24

Vision-based system for continuous Arabic Sign Language recognition in user dependent mode

  • May 01, 2008
  • Khaled Assaleh +4
  • Research Article
  • Citations500

Sign Language Recognition: A Deep Survey

  • Aug 06, 2020
  • Expert Systems with Applications
  • Razieh Rastgoo +2
  • Conference Article
  • Citations59

A continuous Chinese sign language recognition system

  • Jan 01, 2000
  • Jiyong Ma +3
  • Book Chapter
  • Citations1

Spatial-Temporal Graph Transformer for Skeleton-Based Sign Language Recognition

  • Jan 01, 2023
  • Zhengye Xiao +4
  • Conference Article
  • Citations26

Continuous gesture recognition system for Korean sign language based on fuzzy logic and hidden Markov model

  • Aug 07, 2002
  • Jung-Bae Kim +3
  • Conference Article
  • Citations3

Continuous Sign Language Recognition Using MediaPipe

  • Oct 19, 2023
  • Khang B Tran +2
  • Conference Article
  • Citations34

Read and Attend: Temporal Localisation in Sign Language Videos

  • Jun 01, 2021
  • Gul Varol +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.