• Home
  • Search
  • Reconstructing hand gestures with synergies extracted from dance movements
  • Cite Icon1
  • https://doi.org/10.1038/s41598-025-25563-7Copy DOI Icon

Reconstructing hand gestures with synergies extracted from dance movements

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Comprehending and replicating human hand gestures is crucial for advancements in robotics, sign language interpretation and human-computer interactions. While extensive research has focused on improving hand gesture recognition, the therapeutic benefits of dance movements have often been overlooked. This study introduces a novel approach to understanding hand gestures through structured movement primitives derived from hand gestures (mudras) used in Indian classical dance form known as Bharatanatyam. Hand gesture synergies were extracted using Gaussian-modeled joint angular velocities and represented as fundamental syllables of motion. These syllables were then employed to reconstruct 75 diverse hand gestures, including American Sign Language (ASL) postures, a dataset of natural hand grasps and traditional mudras. Comparative analysis between mudra-derived synergies achieved superior reconstruction accuracy (95.78% for natural grasps and 92.99% for mudras) compared to synergies derived from natural grasps (88.92% for natural grasps and 82.51% for mudras). The results suggest that the structured and intentional nature of Bharatanatyam mudras leads to much stronger representation of syllables of movements that have superior generalizability and precision. Additionally, the reconstructed gestures were successfully mapped onto Mitra, a humanoid robot with five degree of freedom hand using a continuous joint-mapping approach. This research highlights the potential of dance inspired structured learning in enhancing dexterity, rehabilitation, and motor control, paving the way for more efficient gesture-based interaction models in robotics, prosthetics and rehabilitation.

Similar Papers
  • Research Article
  • Citations40

Hidden Markov model for human to computer interaction: a study on human hand gesture recognition

  • Dec 28, 2011
  • Artificial Intelligence Review
  • Sara Bilal +3
  • Research Article
  • Citations1

Face and Hand Gesture Recognition System for Controlling VLC Media Player

  • Jul 02, 2021
  • International Journal of Scientific Research in Science and Technology
  • K M Bilvika +3
  • Research Article
  • Citations5

The Politics and Practice of Voice: Representing American Sign Language on the Screen in Two Recent Television Crime Dramas

  • Jun 30, 2010
  • M/C Journal
  • Jennifer Rayman
  • Research Article
  • Citations366

Deep learning in vision-based static hand gesture recognition

  • Apr 11, 2016
  • Neural Computing and Applications
  • Oyebade K Oyedotun +1
  • Conference Article
  • Citations4

Gesture Recognition Glove For American Sign Language Using Accelerometers

  • May 05, 2023
  • Swayam Sa +5
  • Research Article
  • Citations3

The Shape of Air: American Sign Language as Narrative Prosthesis in 21st Century North American Media

  • Oct 09, 2019
  • M/C Journal
  • Pamela J Kincheloe
  • Research Article
  • Citations92

The Signs of Language Revisited: An Anthology to Honor Ursula Bellugi and Edward Klima (review)

  • Dec 01, 2001
  • Language
  • Cecile Mckee
  • Research Article
  • Citations1

Sign Language Translator and Teaching System

  • Feb 28, 2023
  • International Journal for Research in Applied Science and Engineering Technology
  • Aditee Kore +3
  • Research Article
  • Citations6

Legal and Ethical Imperatives for Using Certified Sign Language Interpreters in Health Care Settings: How to "Do No Harm" When "It's (All) Greek" (Sign Language) to You.

  • Sep 01, 2016
  • Care Management Journals
  • Angela M Nonaka
  • Conference Article
  • Citations9

Dynamic Cross-Feature Fusion for American Sign Language Translation

  • Dec 15, 2021
  • Tejaswini Ananthanarayana +5
  • Research Article
  • Citations3

Virtual steering with gesture control using 3D hand modeling

  • Feb 23, 2023
  • IET Conference Proceedings
  • G Bhavana +2
  • Research Article
  • Citations1

Sign Language to Speech Translation

  • Jun 05, 2023
  • International Journal of Innovative Research in Engineering
  • Salman Bagwan +3
  • PDF
  • Research Article
  • Citations11

A Novel String Grammar Unsupervised Possibilistic C-Medians Algorithm for Sign Language Translation Systems

  • Dec 19, 2017
  • Symmetry
  • Atcharin Klomsae +2
  • Research Article
  • Citations10

Explainable federated learning for privacy-preserving bangla sign language detection

  • May 28, 2024
  • Engineering Applications of Artificial Intelligence
  • Bidita Sarkar Diba +5
  • Video Transcripts

Recognizing American Sign Language Nonmanual Signal Grammar Errors in Continuous Videos

  • Dec 29, 2020
  • Underline Science Inc.
  • Elahe Vahdani
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.