• Home
  • Search
  • PM-GANs: Discriminative Representation Learning for Action Recognition Using Partial-Modalities
  • Open Access IconOpen Access
  • Cite Icon33
  • https://doi.org/10.1007/978-3-030-01231-1_24Copy DOI Icon

PM-GANs: Discriminative Representation Learning for Action Recognition Using Partial-Modalities

  • Jan 1, 2018
  • Lan Wang +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Data of different modalities generally convey complimentary but heterogeneous information, and a more discriminative representation is often preferred by combining multiple data modalities like the RGB and infrared features. However in reality, obtaining both data channels is challenging due to many limitations. For example, the RGB surveillance cameras are often restricted from private spaces, which is in conflict with the need of abnormal activity detection for personal security. As a result, using partial data channels to build a full representation of multi-modalities is clearly desired. In this paper, we propose a novel Partial-modal Generative Adversarial Networks (PM-GANs) that learns a full-modal representation using data from only partial modalities. The full representation is achieved by a generated representation in place of the missing data channel. Extensive experiments are conducted to verify the performance of our proposed method on action recognition, compared with four state-of-the-art methods. Meanwhile, a new Infrared-Visible Dataset for action recognition is introduced, and will be the first publicly available action dataset that contains paired infrared and visible spectrum. (The dataset will be available at http://www.escience.cn/people/gaochenqiang/Publications.html).

Similar Papers
  • Research Article
  • Citations39

Spatial and temporal saliency based four-stream network with multi-task learning for action recognition

  • Dec 05, 2022
  • Applied Soft Computing
  • Ming Zong +3
  • Conference Article
  • Citations4

Human motion analysis using dynamic textures

  • May 01, 2012
  • Behnaz Abdolahi +2
  • Research Article
  • Citations69

Multi-view action recognition based on action volumes, fuzzy distances and cluster discriminant analysis

  • Sep 17, 2012
  • Signal Processing
  • Alexandros Iosifidis +2
  • Conference Article
  • Citations40

Time-Frequency Masking Based Online Speech Enhancement with Multi-Channel Data Using Convolutional Neural Networks

  • Sep 01, 2018
  • Soumitro Chakrabarty +2
  • Conference Article
  • Citations1

DeepPear: Deep Pose Estimation and Action Recognition

  • Jan 10, 2021
  • You-Ying Jhuang +1
  • Research Article
  • Citations684

Recognizing 50 human action categories of web videos

  • Nov 16, 2012
  • Machine Vision and Applications
  • Kishore K Reddy +1
  • Conference Article
  • Citations1

Heterogeneous Features Fusion with Collaborative Representation Learning for 3D Action Recognition

  • Dec 01, 2017
  • Chengwu Liang +3
  • PDF
  • Research Article
  • Citations5

Duplex-Hierarchy Representation Learning for Remote Sensing Image Classification.

  • Feb 09, 2024
  • Sensors
  • Xiaobin Yuan +5
  • Book Chapter
  • Citations3

Sequential Deep Learning for Action Recognition with Synthetic Multi-view Data from Depth Maps

  • Jan 01, 2019
  • Bin Liang +2
  • Research Article
  • Citations66

A Pairwise Attentive Adversarial Spatiotemporal Network for Cross-Domain Few-Shot Action Recognition-R2.

  • Nov 24, 2020
  • IEEE Transactions on Image Processing
  • Zan Gao +5
  • Research Article
  • Citations50

Adaptive Label-Aware Graph Convolutional Networks for Cross-Modal Retrieval

  • Jan 01, 2022
  • IEEE Transactions on Multimedia
  • Shengsheng Qian +3
  • Conference Article
  • Citations29

Spatial-temporal motion information integration for action detection and recognition in non-static background

  • Aug 01, 2013
  • Dianting Liu +2
  • Research Article
  • Citations10

Campus Abnormal Behavior Recognition With Temporal Segment Transformers

  • Jan 01, 2023
  • IEEE Access
  • Hai Chuan Liu +4
  • Research Article
  • Citations16

Knowledge memorization and generation for action recognition in still images

  • Jul 20, 2021
  • Pattern Recognition
  • Jian Dong +3
  • Conference Article
  • Citations6

TinyHAR: Benchmarking Human Activity Recognition Systems in Resource Constrained Devices

  • Oct 26, 2022
  • Sheikh Nooruddin +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.