• Home
  • Search
  • Contrastive Masked Feature Modeling for Self-Supervised Representation Learning of High-Resolution Remote Sensing Images
  • Cite Icon1
  • https://doi.org/10.3390/rs18040626Copy DOI Icon

Contrastive Masked Feature Modeling for Self-Supervised Representation Learning of High-Resolution Remote Sensing Images

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

As an emerging learning paradigm, self-supervised learning (SSL) has attracted extensive attention due to its ability to mine features with effective representation from massive unlabeled data. In particular, SSL, driven by contrastive learning and masked modeling, shows great potential in general visual tasks. However, because of the diversity of ground target types, the complexity of spectral radiation characteristics, and changes in environmental conditions, existing SSL frameworks exhibit limited feature extraction accuracy and generalization ability when applied to complex remote sensing scenarios. To address this issue, we propose a hybrid SSL framework that integrates the advantages of contrastive learning and masked modeling to extract more robust and reliable features from remote sensing images. The proposed framework includes two parallel branches: one branch uses a contrastive learning strategy to strengthen global feature representation and capture image structural information by constructing positive and negative sample pairs; the other branch adopts a masked modeling strategy, focusing on the fine analysis of local details and predicting the features of masked areas, thereby establishing connections between global and local features. Additionally, to better integrate local and global features, we adopt a hybrid CNN+Transformer architecture, which is particularly suitable for intensive downstream tasks such as semantic segmentation. Extensive experimental results demonstrate that the proposed framework not only exhibits superior feature extraction ability and higher accuracy in small-sample scenarios but also outperforms state-of-the-art mainstream SSL frameworks on large-scale datasets.

Similar Papers
  • PDF
  • Research Article
  • Citations16

A Generic Self-Supervised Learning (SSL) Framework for Representation Learning from Spectral–Spatial Features of Unlabeled Remote Sensing Imagery

  • Nov 03, 2023
  • Remote Sensing
  • Xin Zhang +1
  • Research Article
  • Citations26

Joint Coding of Local and Global Deep Features in Videos for Visual Search.

  • Jan 01, 2020
  • IEEE Transactions on Image Processing
  • Lin Ding +4
  • Research Article
  • Citations94

CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understanding

  • Jan 01, 2023
  • IEEE Transactions on Geoscience and Remote Sensing
  • Dilxat Muhtar +4
  • Peer Review Report
  • Citations1

Author response: A connectomics-based taxonomy of mammals

  • Oct 10, 2022
  • Laura E Suarez +6
  • Conference Article
  • Citations63

Solving Inefficiency of Self-supervised Representation Learning

  • Oct 01, 2021
  • Guangrun Wang +4
  • Book Chapter
  • Citations26

InfoSeg: Unsupervised Semantic Image Segmentation with Mutual Information Maximization

  • Jan 01, 2021
  • Robert Harb +1
  • Book Chapter
  • Citations7

CaSS: A Channel-Aware Self-supervised Representation Learning Framework for Multivariate Time Series Classification

  • Jan 01, 2022
  • Yijiang Chen +4
  • Research Article
  • Citations8

OBI-CMF: Self-supervised learning with contrastive masked frequency modeling for oracle bone inscription recognition

  • Mar 01, 2025
  • npj Heritage Science
  • Jie Liu +5
  • Research Article
  • Citations1

Self-Supervised Attentive Feature Learning for Alzheimer’s Disease Detection

  • Sep 26, 2025
  • International Journal of Interactive Multimedia and Artificial Intelligence
  • Hela Elmannai +3
  • Conference Article
  • Citations2

A Novel Multi-Task Self-Supervised Representation Learning Paradigm

  • May 28, 2021
  • Control theory & applications
  • Yinggang Li +5
  • Research Article

Self-Supervised Deep Learning Models for Low-Resource NLP Applications

  • Feb 26, 2026
  • International Journal of Research and Review in Applied Science, Humanities, and Technology
  • Pardeep Kaur
  • PDF
  • Research Article
  • Citations1

CDEST: Class Distinguishability-Enhanced Self-Training Method for Adopting Pre-Trained Models to Downstream Remote Sensing Image Semantic Segmentation

  • Apr 06, 2024
  • Remote Sensing
  • Ming Zhang +7
  • Conference Article
  • Citations5

Fusing Deep Local and Global Features for Remote Sensing Image Scene Classification

  • Jul 01, 2019
  • Keli Yan +3
  • Research Article

A Self-Supervised Contrastive Learning Framework Based on Multi-Scale Convolution and Informer for Quantitative Identification of Mining Wire Rope Damage

  • Dec 31, 2025
  • Machines
  • Chun Zhao +2
  • Research Article
  • Citations10

GLFRNet: Global-Local Feature Refusion Network for Remote Sensing Image Instance Segmentation

  • Jan 01, 2025
  • IEEE Transactions on Geoscience and Remote Sensing
  • Jiaqi Zhao +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.