• Home
  • Search
  • Spatial-Temporal Graph Transformer for Skeleton-Based Sign Language Recognition
  • Cite Icon1
  • https://doi.org/10.1007/978-981-99-1645-0_12Copy DOI Icon

Spatial-Temporal Graph Transformer for Skeleton-Based Sign Language Recognition

  • Jan 1, 2023
  • Zhengye Xiao +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

For continuous sign language recognition (CSLR), the skeleton sequence is insusceptible to environmental variances and achieves much attention. Previous studies mainly employ hand-craft features or the spatial-temporal graph convolution networks for skeleton modality and neglect the importance of capturing the information between distant nodes and the long-term context in CSLR. To learn more robust spatial-temporal features for CSLR, we propose a Spatial-Temporal Graph Transformer (STGT) model for skeleton-based CSLR. With the self-attention mechanism, the human skeleton graph is treated as a fully connected graph, and the relationship between distant nodes can be established directly in the spatial dimension. In the temporal dimension, the long-term context can be learned easily due to the characteristic of the transformer. Moreover, we propose graph positional embedding and graph multi-head self-attention to help the STGT distinguish the meanings of different nodes. We conduct the ablation study on the action recognition dataset to validate the effectiveness and analyze the advantages of our method. The experimental results on two CSLR datasets demonstrate the superiority of the STGT on skeleton-based CSLR.

Similar Papers
  • Research Article

Continuous Chinese Sign Language Recognition Using Millimeter-Wave Radar with DeepSeek Semantic Enhancement

  • Jan 01, 2025
  • IEEE Sensors Journal
  • Lei Zhang +5
  • Supplementary Content

Entropy-Regularized Joint CTC–Attention Learning for Low-Resource Continuous Sign Language Recognition

  • Feb 09, 2026
  • Research Square
  • Hanan A Taher +1
  • Research Article
  • Citations16

Improving Continuous Sign Language Recognition with Consistency Constraints and Signer Removal

  • Mar 08, 2024
  • ACM Transactions on Multimedia Computing, Communications, and Applications
  • Ronglai Zuo +1
  • Research Article
  • Citations8

A multi-modal fusion framework for continuous sign language recognition based on multi-layer self-attention mechanism

  • Aug 10, 2022
  • Journal of Intelligent & Fuzzy Systems
  • Cuihong Xue +5
  • Research Article
  • Citations19

Swin-MSTP: Swin transformer with multi-scale temporal perception for continuous sign language recognition

  • Feb 01, 2025
  • Neurocomputing
  • Sarah Alyami +1
  • Research Article
  • Citations12

Gloss Prior Guided Visual Feature Learning for Continuous Sign Language Recognition.

  • Jan 01, 2024
  • IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
  • Leming Guo +5
  • Conference Article

A Continuous Sign Language Recognition Method Based on Temporal Modeling and Semantic Alignment

  • Nov 14, 2025
  • J Li +5
  • Conference Article
  • Citations89

Transition movement models for large vocabulary continuous sign language recognition

  • Jan 01, 2004
  • Wen Gao +3
  • Research Article

A dual-stream deep learning framework for continuous sign language recognition to enhance communication accessibility in the Ha'il region.

  • Feb 03, 2026
  • Scientific reports
  • Haifa Harrouch +3
  • Conference Article

Continuous Sign Language Recognition and Translation Using Deep Learning Approach

  • Mar 04, 2025
  • Rakesh Kumar M +2
  • Research Article
  • Citations500

Sign Language Recognition: A Deep Survey

  • Aug 06, 2020
  • Expert Systems with Applications
  • Razieh Rastgoo +2
  • Book Chapter

Conversational Algerian Sign Language Recognition Using the Deep Learning Approach

  • May 29, 2025
  • Lila Meddeber +1
  • Conference Article
  • Citations3

Continuous Sign Language Recognition Using MediaPipe

  • Oct 19, 2023
  • Khang B Tran +2
  • Conference Article
  • Citations59

A continuous Chinese sign language recognition system

  • Jan 01, 2000
  • Jiyong Ma +3
  • Conference Article
  • Citations24

Vision-based system for continuous Arabic Sign Language recognition in user dependent mode

  • May 01, 2008
  • Khaled Assaleh +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.