• Home
  • Search
  • Self-supervised Learning: A Succinct Review
  • Cite Icon259
  • https://doi.org/10.1007/s11831-023-09884-2Copy DOI Icon

Self-supervised Learning: A Succinct Review

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Machine learning has made significant advances in the field of image processing. The foundation of this success is supervised learning, which necessitates annotated labels generated by humans and hence learns from labelled data, whereas unsupervised learning learns from unlabeled data. Self-supervised learning (SSL) is a type of un-supervised learning that helps in the performance of downstream computer vision tasks such as object detection, image comprehension, image segmentation, and so on. It can develop generic artificial intelligence systems at a low cost using unstructured and unlabeled data. The authors of this review article have presented detailed literature on self-supervised learning as well as its applications in different domains. The primary goal of this review article is to demonstrate how images learn from their visual features using self-supervised approaches. The authors have also discussed various terms used in self-supervised learning as well as different types of learning, such as contrastive learning, transfer learning, and so on. This review article describes in detail the pipeline of self-supervised learning, including its two main phases: pretext and downstream tasks. The authors have shed light on various challenges encountered while working on self-supervised learning at the end of the article.

Similar Papers
  • Research Article
  • Citations174

Review on self-supervised image recognition using deep neural networks

  • Apr 29, 2021
  • Knowledge-Based Systems
  • Kriti Ohri +1
  • Research Article

The science of voice: A book on the singing and speaking voice based upon the latest research in physics andphysiology, with advice to those interested in talking movies and other mechanical reproducing devices, by Douglas Stanley, M.S. (New York University), A. C. G. I. (London University). With a Preface by H. H. Sheldon, Ph.D. (Professor of Physics at New York

  • Feb 01, 1931
  • Journal of the Franklin Institute
  • T.K Cleveland
  • Conference Article
  • Citations13

Multi-Modal Self-Supervised Representation Learning for Earth Observation

  • Jul 11, 2021
  • Pallavi Jain +2
  • Research Article
  • Citations20

Self-supervised visual learning in the low-data regime: A comparative evaluation

  • Mar 01, 2025
  • Neurocomputing
  • Sotirios Konstantakos +6
  • Conference Article
  • Citations12

Conformer-Based Self-Supervised Learning For Non-Speech Audio Tasks

  • May 23, 2022
  • Sangeeta Srivastava +6
  • Research Article
  • Citations16

Self-supervised in-domain representation learning for remote sensing image scene classification

  • Sep 14, 2024
  • Heliyon
  • Ali Ghanbarzadeh +1
  • Conference Article
  • Citations2

A Novel Multi-Task Self-Supervised Representation Learning Paradigm

  • May 28, 2021
  • Control theory & applications
  • Yinggang Li +5
  • Research Article
  • Citations11

Joint Self-Supervised Image-Volume Representation Learning with Intra-inter Contrastive Clustering

  • Jun 26, 2023
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Duy M H Nguyen +9
  • PDF
  • Research Article
  • Citations1

CDEST: Class Distinguishability-Enhanced Self-Training Method for Adopting Pre-Trained Models to Downstream Remote Sensing Image Semantic Segmentation

  • Apr 06, 2024
  • Remote Sensing
  • Ming Zhang +7
  • Preprint Article

Self-Supervised Learning Principles Challenges and Emerging Directions

  • Feb 24, 2025
  • Preprints.org
  • Jenifer Nadine
  • Conference Article
  • Citations9

DATA: Domain-Aware and Task-Aware Self-supervised Learning

  • Jun 01, 2022
  • Qing Chang +6
  • Research Article
  • Citations14

Benchmarking Self-Supervised Contrastive Learning Methods for Image-Based Plant Phenotyping

  • Jan 01, 2023
  • Plant Phenomics
  • Franklin C Ogidi +2
  • Conference Article
  • Citations18

Self-supervised Visual Attribute Learning for Fashion Compatibility

  • Oct 01, 2021
  • Donghyun Kim +5
  • Conference Article
  • Citations3

Audio-Visual Predictive Coding for Self-Supervised Visual Representation Learning

  • Jan 10, 2021
  • Mani Kumar Tellamekala +3
  • Research Article
  • Citations23

DrasCLR: A self-supervised framework of learning disease-related and anatomy-specific representation for 3D lung CT images

  • Dec 09, 2023
  • Medical image analysis
  • Ke Yu +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.