• Home
  • Search
  • Self-Supervised Representation Learning with Meta Comprehensive Regularization
  • Cite Icon5
  • https://doi.org/10.1609/aaai.v38i3.27966Copy DOI Icon

Self-Supervised Representation Learning with Meta Comprehensive Regularization

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the shared information among multiple augmented views of samples, while disregarding the non-shared information that may be beneficial for downstream tasks. To address this issue, we introduce a module called CompMod with Meta Comprehensive Regularization (MCR), embedded into existing self-supervised frameworks, to make the learned representations more comprehensive. Specifically, we update our proposed model through a bi-level optimization mechanism, enabling it to capture comprehensive features. Additionally, guided by the constrained extraction of features using maximum entropy coding, the self-supervised learning model learns more comprehensive features on top of learning consistent features. In addition, we provide theoretical support for our proposed method from information theory and causal counterfactual perspective. Experimental results show that our method achieves significant improvement in classification, object detection and semantic segmentation tasks on multiple benchmark datasets.

Similar Papers
  • Research Article
  • Citations7

Randomly shuffled convolution for self-supervised representation learning

  • Nov 14, 2022
  • Information Sciences
  • Youngjin Oh +3
  • Conference Article
  • Citations2

A Novel Multi-Task Self-Supervised Representation Learning Paradigm

  • May 28, 2021
  • Control theory & applications
  • Yinggang Li +5
  • Book Chapter
  • Citations7

CaSS: A Channel-Aware Self-supervised Representation Learning Framework for Multivariate Time Series Classification

  • Jan 01, 2022
  • Yijiang Chen +4
  • Research Article
  • Citations14

Benchmarking Self-Supervised Contrastive Learning Methods for Image-Based Plant Phenotyping

  • Jan 01, 2023
  • Plant Phenomics
  • Franklin C Ogidi +2
  • Conference Article
  • Citations15

TriBYOL: Triplet BYOL for Self-Supervised Representation Learning

  • May 23, 2022
  • Guang Li +3
  • Conference Article
  • Citations16

A Novel Solution for EEG-based Emotion Recognition

  • Oct 13, 2021
  • Zhuofan Xie +2
  • Research Article
  • Citations2063

Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey.

  • May 04, 2020
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Longlong Jing +1
  • Research Article
  • Citations48

CS-CO: A Hybrid Self-Supervised Visual Representation Learning Method for H&E-stained Histopathological Images.

  • Oct 01, 2022
  • Medical Image Analysis
  • Pengshuai Yang +6
  • Research Article
  • Citations1

Self-supervised representation learning on gene expression data

  • Oct 01, 2025
  • Bioinformatics
  • Kevin Dradjat +3
  • Conference Article
  • Citations18

Self-supervised Visual Attribute Learning for Fashion Compatibility

  • Oct 01, 2021
  • Donghyun Kim +5
  • Research Article
  • Citations9

One-step progressive representation transfer learning for bird sound classification

  • Sep 01, 2023
  • Applied Acoustics
  • Chengyun Zhang +4
  • Research Article
  • Citations13

LPCL: Localized prominence contrastive learning for self-supervised dense visual pre-training

  • Nov 14, 2022
  • Pattern Recognition
  • Zihan Chen +5
  • Research Article

Self-supervised representation learning for cloud detection using Sentinel-2 images

  • Mar 01, 2026
  • Remote Sensing of Environment
  • Yawogan Jean Eudes Gbodjo +4
  • PDF
  • Research Article
  • Citations4

Self-supervised representation learning using feature pyramid siamese networks for colorectal polyp detection

  • Dec 08, 2023
  • Scientific Reports
  • Tianyuan Gan +5
  • Research Article
  • Citations20

Self-supervised visual learning in the low-data regime: A comparative evaluation

  • Mar 01, 2025
  • Neurocomputing
  • Sotirios Konstantakos +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.