• Home
  • Search
  • Video Representation Learning with Graph Contrastive Augmentation
  • Open Access IconOpen Access
  • Cite Icon6
  • https://doi.org/10.1145/3474085.3475510Copy DOI Icon

Video Representation Learning with Graph Contrastive Augmentation

  • Oct 17, 2021
  • Jingran Zhang +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Contrastive-based self-supervised learning for image representations has significantly closed the gap with supervised learning. A natural extension of image-based contrastive learning methods to the video domain is to fully exploit the temporal structure presented in videos. We propose a novel contrastive self-supervised video representation learning framework, termed Graph Contrastive Augmentation (GCA), by constructing a video temporal graph and devising a graph augmentation that is designed to enhance the correlation across frames of videos and developing a new view for exploring temporal structure in videos. Specifically, we construct the temporal graph in the video by leveraging the relational knowledge behind the correlated sequence video features. Afterwards, we apply the proposed graph augmentation to generate another graph view by cooperating random corruption of the original graph to enhance the diversity of the intrinsic structure of the temporal graph. To this end, we provide two different kinds of contrastive learning methods to train our framework using temporal relationships concealed in videos as self-supervised signals. We perform empirical experiments on downstream tasks, action recognition and video retrieval, using the learned video representation, and the results demonstrate that with the graph view of temporal structure, our proposed GCA remarkably improves performance against or on par with the recent methods.

Similar Papers
  • Research Article
  • Citations7

Self-Supervised Video Representation Learning by Video Incoherence Detection.

  • Jun 01, 2024
  • IEEE transactions on cybernetics
  • Haozhi Cao +7
  • Research Article
  • Citations1

Self-Supervised Video Representation Learning via Capturing Semantic Changes Indicated by Saccades

  • Aug 01, 2024
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Qiuxia Lai +5
  • Research Article

Abstract 5059: Self-supervised representation learning of somatic mutational data

  • Apr 21, 2025
  • Cancer Research
  • Marzieh Haghighi +2
  • Conference Article
  • Citations31

SSAN: Separable Self-Attention Network for Video Representation Learning

  • Jun 01, 2021
  • Xudong Guo +2
  • Conference Article
  • Citations7

Boosting Video Representation Learning with Multi-Faceted Integration

  • Jun 01, 2021
  • Zhaofan Qiu +5
  • Conference Article
  • Citations19

A Self-supervised Riemannian GNN with Time Varying Curvature for Temporal Graph Learning

  • Oct 17, 2022
  • Li Sun +3
  • Conference Article
  • Citations3

Self-Supervised Mutual Learning for Video Representation Learning

  • Jul 05, 2021
  • Jinpeng Wang +4
  • Book Chapter
  • Citations1

Temporal Reachability in Fuzzy Graphs for Geographic Information Systems

  • Jan 01, 2020
  • Alexander Bozhenyuk +3
  • Research Article
  • Citations8

Self-Supervised Video Representation Learning via Latent Time Navigation

  • Jun 26, 2023
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Di Yang +6
  • Research Article
  • Citations22

DrasCLR: A self-supervised framework of learning disease-related and anatomy-specific representation for 3D lung CT images

  • Dec 09, 2023
  • Medical image analysis
  • Ke Yu +5
  • Conference Article
  • Citations1

K2SSL: A Faster and Better Framework for Self-Supervised Speech Representation Learning

  • Jun 30, 2025
  • Yifan Yang +11
  • Research Article
  • Citations16

Sleep Stage Classification Via Multi-View Based Self-Supervised Contrastive Learning of EEG.

  • Dec 01, 2024
  • IEEE journal of biomedical and health informatics
  • Chen Zhao +5
  • Book Chapter
  • Citations10

MaCLR: Motion-Aware Contrastive Learning of Representations for Videos

  • Jan 01, 2022
  • Fanyi Xiao +2
  • Research Article

Beyond Static Boundaries: Unraveling Temporal Overlapping Communities with Information Bottleneck Guidance

  • May 22, 2025
  • ACM Transactions on Knowledge Discovery from Data
  • Moli Lu +2
  • Conference Article
  • Citations23

Cross-Architecture Self-supervised Video Representation Learning

  • Jun 01, 2022
  • Sheng Guo +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.