- Research Article
- 10.1088/2631-8695/ae68d8
A video action segmentation method based on multi-scale temporal features
- May 01, 2026
- Engineering Research Express
- Bo Yang + 5 more +5
Abstract Video action segmentation is a key technology for understanding videos. Due to the limitations of existing video action segmentation methods, this paper proposed a video action segmentation network based on an improved ASFormer with multiscale temporal features. Aiming at the problem of local temporal feature disappearance caused by the multilayer structure of ASFormer network, we first introduce the multi-scale temporal feature extraction module and the multi-scale attention module to improve the network's temporal feature extraction capability of actions. Second, to improve the network’s ability to localize action boundaries, action boundary detection loss is introduced to enhance the network’s attention at action boundaries. Then, a smoothing post-processing operation is introduced to suppress over-segmentation caused by mutated frames. To verify the effectiveness of the method proposed in this paper, an experimental study is finally performed on a publicly available dataset.
Read more