• Home
  • Search
  • Metric-Based Attention Feature Learning for Video Action Recognition
  • Cite Icon15
  • https://doi.org/10.1109/access.2021.3064934Copy DOI Icon

Metric-Based Attention Feature Learning for Video Action Recognition

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Conventional approaches for video action recognition were designed to learn feature maps using 3D convolutional neural networks (CNNs). For better action recognition, they trained the large-scale video datasets with the representation power of 3D CNN. However, action recognition is still a challenging task. Since the previous methods rarely distinguish human body from environment, they often overfit background scenes. Note that separating human body from background allows to learn distinct representations of human action. This paper proposes a novel attention module aiming at only action part(s), while neglecting non-action part(s) such as background. First, the attention module employs triplet loss to differentiate active features from non-active or less active features. Second, two attention modules based on spatial and channel domains are proposed to enhance the feature representation ability for action recognition. The spatial attention module is to learn spatial correlation of features, and the channel attention module is to learn channel correlation. Experimental results show that the proposed method achieves state-of-the-art performance of 41.41% and 55.21% on Diving48 and Something-V1 datasets, respectively. In addition, the proposed method provides competitive performance even on UCF101 and HMDB-51 datasets, i.e., 95.83% on UCF-101 and 74.33% on HMDB-51.

Loading PDF

Similar Papers
  • PDF
  • Research Article
  • Citations36

One Spatio-Temporal Sharpening Attention Mechanism for Light-Weight YOLO Models Based on Sharpening Spatial Attention

  • Nov 28, 2021
  • Sensors (Basel, Switzerland)
  • Mengfan Xue +4
  • Conference Article
  • Citations4

3D Residual Networks with Channel-Spatial Attention Module for Action Recognition

  • Nov 06, 2020
  • Ziwen Yi +3
  • PDF
  • Research Article
  • Citations34

Two-Level Attention Module Based on Spurious-3D Residual Networks for Human Action Recognition

  • Feb 03, 2023
  • Sensors (Basel, Switzerland)
  • Bo Chen +3
  • PDF
  • Research Article
  • Citations17

Action Recognition Using Deep 3D CNNs with Sequential Feature Aggregation and Attention

  • Jan 12, 2020
  • Electronics
  • Fazliddin Anvarov +2
  • PDF
  • Research Article
  • Citations14

An End to End Framework With Adaptive Spatio-Temporal Attention Module for Human Action Recognition

  • Jan 01, 2020
  • IEEE Access
  • Shaocan Liu +3
  • PDF
  • Research Article
  • Citations92

CSA-MSO3DCNN: Multiscale Octave 3D CNN with Channel and Spatial Attention for Hyperspectral Image Classification

  • Jan 05, 2020
  • Remote Sensing
  • Qin Xu +3
  • Research Article
  • Citations2

Channel-spatial attention modules in convolutional neural networks for image classification

  • Dec 11, 2025
  • Scientific Reports
  • Mohammad Zolfaghari +2
  • Research Article
  • Citations80

Fully convolutional attention network for biomedical image segmentation

  • Jun 05, 2020
  • Artificial Intelligence in Medicine
  • Junlong Cheng +4
  • Conference Article
  • Citations6

SCA Net: Sparse Channel Attention Module for Action Recognition

  • Jan 10, 2021
  • Hang Song +2
  • Conference Article
  • Citations4

A Spatio-temporal Hybrid Network for Action Recognition

  • Dec 01, 2019
  • Song Li +2
  • PDF
  • Research Article
  • Citations19

A Symmetric Efficient Spatial and Channel Attention (ESCA) Module Based on Convolutional Neural Networks

  • Jul 25, 2024
  • Symmetry
  • Huaiyu Liu +2
  • Research Article
  • Citations9

FAM: focal attention module for lesion segmentation of COVID-19 CT images.

  • Sep 04, 2022
  • Journal of real-time image processing
  • Xiaoxin Wu +8
  • Research Article
  • Citations1

HLAE-Net: A Hierarchical Lightweight Attention-Enhanced Strategy for Remote Sensing Scene Image Classification

  • Sep 24, 2025
  • Remote Sensing
  • Mingyuan Yang +5
  • Research Article
  • Citations13

Large-Scale Image Retrieval with Deep Attentive Global Features.

  • Feb 25, 2023
  • International Journal of Neural Systems
  • Yingying Zhu +4
  • Conference Article

An Efficient Lightweight Spatio-temporal Attention Module for Action Recognition

  • Nov 17, 2022
  • Zhonghua Sun +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.