• Home
  • Search
  • Self-Supervised Mutual Learning for Video Representation Learning
  • Cite Icon3
  • https://doi.org/10.1109/icme51207.2021.9428338Copy DOI Icon

Self-Supervised Mutual Learning for Video Representation Learning

  • Jul 5, 2021
  • Jinpeng Wang +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

This work tackles the problem of self-supervised learning of video representation tasks. The related works construct different surrogate supervision signals from data itself. Instead of proposing novel signal, our main insight is that the field of self-supervised learning can be benefited from mutual learning, that is, these supervision signals can learn from others and the combination between them leads to better representation. Unifying these two approaches, we present a frame-work called Self-supervised Mutual (SSM) Learning: a simple framework for mutual learning of video representation under the content of self-supervised. In order to understand what enables the task to learn useful representation, we systematically study the major components of our framework. We show that (1) surrogate supervision signal can learn from others effectively under the framework of mutual learning; (2) introducing a learnable align unit between the deep features supervised by multiple supervision signals in hidden space improves the quality of the learned representation. By combining these findings, we are able to considerably outperform previous methods for self-supervised learning on HMDB51 and UCF101 when applied to action recognition tasks.

Similar Papers
  • Research Article
  • Citations2

Spatiotemporal self-supervised predictive learning for atmospheric variable prediction via multi-group multi-attention

  • Jun 13, 2024
  • Knowledge-Based Systems
  • Zhensheng Shi +2
  • Research Article

Abstract 5059: Self-supervised representation learning of somatic mutational data

  • Apr 21, 2025
  • Cancer Research
  • Marzieh Haghighi +2
  • Research Article
  • Citations28

Improving quantitative MRI using self-supervised deep learning with model reinforcement: Demonstration for rapid T1 mapping.

  • Feb 11, 2024
  • Magnetic resonance in medicine
  • Wanyu Bian +2
  • PDF
  • Research Article
  • Citations67

To Compress or Not to Compress-Self-Supervised Learning and Information Theory: A Review.

  • Mar 12, 2024
  • Entropy
  • Ravid Shwartz Ziv +1
  • Research Article
  • Citations168

Video Cloze Procedure for Self-Supervised Spatio-Temporal Learning

  • Apr 03, 2020
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Dezhao Luo +6
  • Research Article

Self-supervised transfer learning for few-shot classification on marine plankton images

  • Jan 22, 2026
  • Frontiers in Marine Science
  • Xuxiang Zhong +3
  • Conference Article
  • Citations1

K2SSL: A Faster and Better Framework for Self-Supervised Speech Representation Learning

  • Jun 30, 2025
  • Yifan Yang +11
  • PDF
  • Research Article

Research on positive and negative sample sampling strategies in contrastive learning

  • Nov 08, 2024
  • Applied and Computational Engineering
  • Wenyi Liu
  • Research Article
  • Citations4

Non-parametric Representation Learning with Kernels

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Pascal Esser +2
  • Research Article
  • Citations27

COVID-19 detection based on self-supervised transfer learning using chest X-ray images.

  • Dec 20, 2022
  • International journal of computer assisted radiology and surgery
  • Guang Li +3
  • PDF
  • Research Article

Auxiliary self-supervision to metric learning for music similarity-based retrieval and auto-tagging.

  • Nov 30, 2023
  • PloS one
  • Taketo Akama +4
  • Conference Article
  • Citations23

Cross-Architecture Self-supervised Video Representation Learning

  • Jun 01, 2022
  • Sheng Guo +6
  • Research Article
  • Citations16

Sleep Stage Classification Via Multi-View Based Self-Supervised Contrastive Learning of EEG.

  • Dec 01, 2024
  • IEEE journal of biomedical and health informatics
  • Chen Zhao +5
  • Book Chapter
  • Citations47

Self-supervised Visual Representation Learning for Histopathological Images

  • Jan 01, 2021
  • Pengshuai Yang +4
  • Conference Article
  • Citations6

Video Representation Learning with Graph Contrastive Augmentation

  • Oct 17, 2021
  • Jingran Zhang +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.