• Home
  • Search
  • Multi-stream with Deep Convolutional Neural Networks for Human Action Recognition in Videos
  • Cite Icon9
  • https://doi.org/10.1007/978-3-030-04167-0_23Copy DOI Icon

Multi-stream with Deep Convolutional Neural Networks for Human Action Recognition in Videos

  • Jan 1, 2018
  • Xiao Liu +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Recently, convolutional neural networks (CNNs) have been extensively applied for human action recognition in videos with the fusion of appearance and motion information by two-stream network. However, for human action recognition in videos, the performance over still images recognition is so far away because of difficulty in extracting the temporal information. In this paper, we propose a multi-stream architecture with convolutional neural networks for human action recognition in videos to extract more temporal features. We make the three contributions: (a) we present a multi-stream with 3D and 2D convolutional neural networks by using still RGB frames, dense optical flows and gradient maps as the input of networks separately; (b) we propose a novel 3D convolutional neural network with residual blocks, use deep 2D convolutional neural network as the pre-train network which is added attention blocks to extract the major motion information; (c) we fuse the multi-stream networks by weights not only for networks but also for every action category to take advantage of the optimal performance of each network. Our networks are trained and evaluated on the standard video action benchmarks of UCF-101 and HMDB-51 datasets, and result shows that our method achieves considerable and comparable recognition performance to the state-of-the-art.

Similar Papers
  • Research Article
  • Citations1

A heterogeneous two-stream network for human action recognition

  • Aug 21, 2023
  • AI Communications
  • Shengbin Liao +2
  • PDF
  • Research Article
  • Citations22

Distinct Two-Stream Convolutional Networks for Human Action Recognition in Videos Using Segment-Based Temporal Modeling

  • Nov 11, 2020
  • Data
  • Ashok Sarabu +1
  • Research Article
  • Citations6

Analysis of CNN Architectures for Human Action Recognition in Video

  • Jun 30, 2022
  • Computación y Sistemas
  • David Silva +4
  • Research Article
  • Citations8

Learning correlations for human action recognition in videos

  • Feb 10, 2017
  • Multimedia Tools and Applications
  • Yun Yi +2
  • Conference Article
  • Citations3

Human action recognition in surveillance video of a computer laboratory

  • Aug 01, 2016
  • Abdul-Lateef Yussiff +2
  • PDF
  • Research Article
  • Citations52

Analysis of Deep Neural Networks for Human Activity Recognition in Videos—A Systematic Literature Review

  • Jan 01, 2021
  • IEEE Access
  • Hadiqa Aman Ullah +4
  • Research Article
  • Citations9

Learning Video Actions in Two Stream Recurrent Neural Network

  • Nov 01, 2021
  • Pattern Recognition Letters
  • Ehtesham Hassan
  • Conference Article
  • Citations33

SCNN: Sequential convolutional neural network for human action recognition in videos

  • Sep 01, 2017
  • Hao Yang +3
  • Conference Article
  • Citations198

AdaScan: Adaptive Scan Pooling in Deep Convolutional Neural Networks for Human Action Recognition in Videos

  • Jul 01, 2017
  • Amlan Kar +3
  • Conference Article
  • Citations16

Actlets: A novel local representation for human action recognition in video

  • Sep 01, 2012
  • Muhammad Muneeb Ullah +1
  • Research Article
  • Citations49

A fast human action recognition network based on spatio-temporal features

  • Nov 24, 2020
  • Neurocomputing
  • Jie Xu +5
  • Research Article

A Detail Study of Support Vector Machine, K-Nearest Neighbours and Convolutional Neural Network for Human Action Recognition in Videos

  • May 28, 2025
  • Power System Technology
  • Tammmarguddi Mahmad Husen, Swamy L N
  • Book Chapter
  • Citations4

Action Recognition Using 3D CNN and LSTM for Video Analytics

  • Jan 01, 2020
  • A Umamakeswari +4
  • Research Article
  • Citations11

Multi-level channel attention excitation network for human action recognition in videos

  • Feb 15, 2023
  • Signal Processing: Image Communication
  • Hanbo Wu +2
  • Conference Article
  • Citations21

Multi-stream Convolutional Neural Networks for Action Recognition in Video Sequences Based on Adaptive Visual Rhythms

  • Dec 01, 2018
  • Darwin Ttito Concha +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.