• Home
  • Search
  • Learning Transferable Self-Attentive Representations for Action Recognition in Untrimmed Videos with Weak Supervision
  • Cite Icon80
  • https://doi.org/10.1609/aaai.v33i01.33019227Copy DOI Icon

Learning Transferable Self-Attentive Representations for Action Recognition in Untrimmed Videos with Weak Supervision

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Action recognition in videos has attracted a lot of attention in the past decade. In order to learn robust models, previous methods usually assume videos are trimmed as short sequences and require ground-truth annotations of each video frame/sequence, which is quite costly and time-consuming. In this paper, given only video-level annotations, we propose a novel weakly supervised framework to simultaneously locate action frames as well as recognize actions in untrimmed videos. Our proposed framework consists of two major components. First, for action frame localization, we take advantage of the self-attention mechanism to weight each frame, such that the influence of background frames can be effectively eliminated. Second, considering that there are trimmed videos publicly available and also they contain useful information to leverage, we present an additional module to transfer the knowledge from trimmed videos for improving the classification performance in untrimmed ones. Extensive experiments are conducted on two benchmark datasets (i.e., THUMOS14 and ActivityNet1.3), and experimental results clearly corroborate the efficacy of our method.

Similar Papers
  • Book Chapter
  • Citations4

Action Recognition in Untrimmed Videos with Composite Self-attention Two-Stream Framework

  • Jan 01, 2020
  • Dong Cao +2
  • Conference Article
  • Citations33

Understanding action recognition in still images

  • Jun 01, 2020
  • Deeptha Girish +2
  • Research Article
  • Citations10

GA-STIP: Action Recognition in Multi-Channel Videos With Geometric Algebra Based Spatio-Temporal Interest Points

  • Jan 01, 2018
  • IEEE Access
  • Rui Wang +4
  • Conference Article
  • Citations3

Human action recognition in surveillance video of a computer laboratory

  • Aug 01, 2016
  • Abdul-Lateef Yussiff +2
  • Book Chapter
  • Citations6

Audio and Video Feature Fusion for Activity Recognition in Unconstrained Videos

  • Jan 01, 2006
  • José Lopes +1
  • Book Chapter

Action Recognition in Haze Using an Efficient Fusion of Spatial and Temporal Features

  • Jan 01, 2021
  • Sri Girinadh Tanneru +1
  • PDF
  • Research Article
  • Citations17

Hierarchical dynamic depth projected difference images–based action recognition in videos with convolutional neural networks

  • Jan 01, 2019
  • International Journal of Advanced Robotic Systems
  • Hanbo Wu +2
  • Conference Article
  • Citations28

DarkLight Networks for Action Recognition in the Dark

  • Jun 01, 2021
  • Rui Chen +4
  • Research Article
  • Citations41

Learning to recognise 3D human action from a new skeleton‐based representation using deep convolutional neural networks

  • Mar 04, 2019
  • IET Computer Vision
  • Huy‐Hieu Pham +4
  • Conference Article

Accelerated action recognition and segmentation in videos

  • Apr 07, 2021
  • Emna Ghodhbani +2
  • PDF
  • Research Article
  • Citations6

Enhancing Zero-Shot Action Recognition in Videos by Combining GANs with Text and Images

  • May 05, 2023
  • SN Computer Science
  • Kaiqiang Huang +2
  • Book Chapter
  • Citations2

Exploiting Sub-region Deep Features for Specific Action Recognition in Combat Sports Video

  • Jan 01, 2018
  • Yongqiang Kong +4
  • Book Chapter
  • Citations1

Action Recognition in Videos with Temporal Segments Fusions

  • Jan 01, 2020
  • Yuanye Fang +3
  • Dissertation

Robust and efficient deep learning methods for vision-based action recognition

  • Jan 01, 2021
  • Yuecong Xu
  • Research Article
  • Citations6

Analysis of CNN Architectures for Human Action Recognition in Video

  • Jun 30, 2022
  • Computación y Sistemas
  • David Silva +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.