• Home
  • Search
  • Self-Supervised Contrastive Representation Learning in Computer Vision
  • Cite Icon13
  • https://doi.org/10.5772/intechopen.104785Copy DOI Icon

Self-Supervised Contrastive Representation Learning in Computer Vision

  • Dec 21, 2022
  • Yalin Bastanlar +1 more
Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Although its origins date a few decades back, contrastive learning has recently gained popularity due to its achievements in self-supervised learning, especially in computer vision. Supervised learning usually requires a decent amount of labeled data, which is not easy to obtain for many applications. With self-supervised learning, we can use inexpensive unlabeled data and achieve a training on a pretext task. Such a training helps us to learn powerful representations. In most cases, for a downstream task, self-supervised training is fine-tuned with the available amount of labeled data. In this study, we review common pretext and downstream tasks in computer vision and we present the latest self-supervised contrastive learning techniques, which are implemented as Siamese neural networks. Lastly, we present a case study where self-supervised contrastive learning was applied to learn representations of semantic masks of images. Performance was evaluated on an image retrieval task and results reveal that, in accordance with the findings in the literature, fine-tuning the self-supervised training showed the best performance.

Loading PDF

Similar Papers
  • Conference Article
  • Citations2

A Novel Multi-Task Self-Supervised Representation Learning Paradigm

  • May 28, 2021
  • Control theory & applications
  • Yinggang Li +5
  • Research Article
  • Citations20

Self-supervised visual learning in the low-data regime: A comparative evaluation

  • Mar 01, 2025
  • Neurocomputing
  • Sotirios Konstantakos +6
  • Conference Article
  • Citations4

Conditional Independence for Pretext Task Selection in Self-Supervised Speech Representation Learning

  • Aug 30, 2021
  • Salah Zaiem +2
  • Research Article
  • Citations13

Self-supervised representation learning for detection of ACL tear injury in knee MR videos

  • Feb 01, 2022
  • Pattern Recognition Letters
  • Siladittya Manna +2
  • Conference Article
  • Citations2

DETECTren: Vehicle Object Detection Using Self-Supervised Learning based on Light-Weight Network for Low-Power Devices

  • Jun 14, 2021
  • Hans Fuhrmann +3
  • Book Chapter
  • Citations7

CaSS: A Channel-Aware Self-supervised Representation Learning Framework for Multivariate Time Series Classification

  • Jan 01, 2022
  • Yijiang Chen +4
  • Conference Article

Self-supervised multi-task learning for semantic segmentation of urban scenes

  • Sep 12, 2021
  • Jonathan Gonzalez-Santiago +2
  • Research Article

SELF-SUPERVISED VISION TRANSFORMERS FOR CROSS-MODAL LEARNING (REVIEW)

  • Jan 01, 2025
  • Computer Design Systems. Theory and Practice
  • Olena Stankevych +1
  • Preprint Article

Self-Supervised Learning Principles Challenges and Emerging Directions

  • Feb 24, 2025
  • Preprints.org
  • Jenifer Nadine
  • Research Article
  • Citations8

Self-supervised learning for heterogeneous graph via structure information based on metapath

  • May 12, 2023
  • Applied Soft Computing
  • Shuai Ma +2
  • Conference Article
  • Citations58

LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech

  • Aug 30, 2021
  • Solène Evain +17
  • Research Article

Self-Supervised Deep Learning Models for Low-Resource NLP Applications

  • Feb 26, 2026
  • International Journal of Research and Review in Applied Science, Humanities, and Technology
  • Pardeep Kaur
  • Research Article
  • Citations14

Benchmarking Self-Supervised Contrastive Learning Methods for Image-Based Plant Phenotyping

  • Jan 01, 2023
  • Plant Phenomics
  • Franklin C Ogidi +2
  • Research Article
  • Citations1808

Self-supervised Learning: Generative or Contrastive

  • Jan 01, 2021
  • IEEE Transactions on Knowledge and Data Engineering
  • Xiao Liu +6
  • Conference Article
  • Citations64

Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwriting

  • Jun 01, 2021
  • Ayan Kumar Bhunia +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.