• Home
  • Search
  • CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understanding
  • Open Access IconOpen Access
  • Cite Icon94
  • https://doi.org/10.1109/tgrs.2023.3268232Copy DOI Icon

CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understanding

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Self-supervised learning (SSL) has gained widespread attention in the remote sensing (RS) and earth observation (EO) communities owing to its ability to learn task-agnostic representations without human-annotated labels. Nevertheless, most existing RS SSL methods are limited to learning either global semantic separable or local spatial perceptible representations. We argue that this learning strategy is suboptimal in the realm of RS, since the required representations for different RS downstream tasks are often varied and complex. In this study, we proposed a unified SSL framework that is better suited for RS images representation learning. The proposed SSL framework, Contrastive Mask Image Distillation (CMID), is capable of learning representations with both global semantic separability and local spatial perceptibility by combining contrastive learning (CL) with masked image modeling (MIM) in a self-distillation way. Furthermore, our CMID learning framework is architecture-agnostic, which is compatible with both convolutional neural networks (CNN) and vision transformers (ViT), allowing CMID to be easily adapted to a variety of deep learning (DL) applications for RS understanding. Comprehensive experiments have been carried out on four downstream tasks (i.e. scene classification, semantic segmentation, object-detection, and change detection) and the results show that models pre-trained using CMID achieve better performance than other state-of-the-art SSL methods on multiple downstream tasks. The code and pre-trained models will be made available at https://github.com/NJU-LHRS/official-CMID to facilitate SSL research and speed up the development of RS images DL applications.

Similar Papers
  • PDF
  • Research Article
  • Citations16

A Generic Self-Supervised Learning (SSL) Framework for Representation Learning from Spectral–Spatial Features of Unlabeled Remote Sensing Imagery

  • Nov 03, 2023
  • Remote Sensing
  • Xin Zhang +1
  • Research Article
  • Citations14

Benchmarking Self-Supervised Contrastive Learning Methods for Image-Based Plant Phenotyping

  • Jan 01, 2023
  • Plant Phenomics
  • Franklin C Ogidi +2
  • PDF
  • Research Article
  • Citations74

Self-Supervised Learning for Scene Classification in Remote Sensing: Current State of the Art and Perspectives

  • Aug 17, 2022
  • Remote Sensing
  • Paul Berg +2
  • Research Article
  • Citations44

Index Your Position: A Novel Self-Supervised Learning Method for Remote Sensing Images Semantic Segmentation

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Dilxat Muhtar +2
  • PDF
  • Research Article
  • Citations1

CDEST: Class Distinguishability-Enhanced Self-Training Method for Adopting Pre-Trained Models to Downstream Remote Sensing Image Semantic Segmentation

  • Apr 06, 2024
  • Remote Sensing
  • Ming Zhang +7
  • Conference Article
  • Citations18

Self-supervised Visual Attribute Learning for Fashion Compatibility

  • Oct 01, 2021
  • Donghyun Kim +5
  • Conference Article
  • Citations2

A Novel Multi-Task Self-Supervised Representation Learning Paradigm

  • May 28, 2021
  • Control theory & applications
  • Yinggang Li +5
  • Research Article
  • Citations1

Contrastive Masked Feature Modeling for Self-Supervised Representation Learning of High-Resolution Remote Sensing Images

  • Feb 17, 2026
  • Remote Sensing
  • Shiyan Pang +4
  • Research Article
  • Citations20

Self-supervised visual learning in the low-data regime: A comparative evaluation

  • Mar 01, 2025
  • Neurocomputing
  • Sotirios Konstantakos +6
  • PDF
  • Research Article
  • Citations20

Self-supervised learning for remote sensing scene classification under the few shot scenario

  • Jan 09, 2023
  • Scientific Reports
  • Najd Alosaimi +4
  • Conference Article
  • Citations9

DATA: Domain-Aware and Task-Aware Self-supervised Learning

  • Jun 01, 2022
  • Qing Chang +6
  • PDF
  • Research Article

Advancements in Self-Supervised Learning for Remote Sensing Scene Classification: Present Innovations and Future Outlooks

  • Apr 23, 2024
  • Journal of Artificial Intelligence General science (JAIGS) ISSN 3006-4023
  • José Gabriel Carrasco Ramírez
  • PDF
  • Research Article
  • Citations1

Advancements in Self-Supervised Learning for Remote Sensing Scene Classification: Present Innovations and Future Outlooks

  • Apr 23, 2024
  • Journal of Artificial Intelligence General science (JAIGS) ISSN 3006-4023
  • José Gabriel Carrasco Ramírez
  • Research Article
  • Citations48

CS-CO: A Hybrid Self-Supervised Visual Representation Learning Method for H&E-stained Histopathological Images.

  • Oct 01, 2022
  • Medical Image Analysis
  • Pengshuai Yang +6
  • Research Article
  • Citations12

DenseCL: A simple framework for self-supervised dense visual pre-training

  • Sep 24, 2022
  • Visual Informatics
  • Xinlong Wang +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.