- Conference Article
- 10.1145/3670105.3670151
YNU-Dance: A Multimodal Ethnic Dance Action Dataset
- May 24, 2024
- Shouzheng Sun + 5 more +5
This paper propose a novel dance action dataset – YNU-Dance. To preserve and inherit ethnic dances, we have collected and constructed a dataset of ethnic dance actions. The dataset encompasses unique dances from 10 different ethnic groups, including multi-view synchronized RGB images and precise motion data captured using motion capture devices. The dataset comprises 256320 frames of RGB images, with a total video duration of 1 hour and 11 minutes, and consists of 3402 action data segments. We compare the YNU-Dance dataset with other publicly available 3D action recognition datasets, highlighting its uniqueness and importance in the field of dance action. Furthermore, we evaluate the YNU-Dance dataset using skeleton action recognition methods and introduces a Prototypical Spatial Temporal model based on prototype networks (ProtoST) to address the small-sample challenge and achieve improved ethnic dance action classification. Dance action data is segmented into time segments suitable for the current model, and data augmentation is applied to enhance model generalization performance. The experiments show that the YNU-Dance dataset, with its multimodal and multi-view characteristics, provides a more complex challenge for action recognition models. This emphasizes the practical research value of the ethnic dance dataset we have constructed and encourages further in-depth studies on this dataset. The video and motion data will be made available for download in the subsequent stages.
Read more