• Home
  • Search
  • RingMo: A Remote Sensing Foundation Model With Masked Image Modeling
  • Cite Icon286
  • https://doi.org/10.1109/tgrs.2022.3194732Copy DOI Icon

RingMo: A Remote Sensing Foundation Model With Masked Image Modeling

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Deep learning approaches have contributed to the rapid development of remote sensing (RS) image interpretation. The most widely used training paradigm is to use ImageNet pretrained models to process RS data for specified tasks. However, there are issues such as domain gap between natural and RS scenes and the poor generalization capacity of RS models. It makes sense to develop a foundation model with general RS feature representation. Since a large amount of unlabeled data is available, the self-supervised method has more development significance than the fully supervised method in RS. However, most of the current self-supervised methods use contrastive learning, whose performance is sensitive to data augmentation, additional information, and selection of positive and negative pairs. In this article, we leverage the benefits of generative self-supervised learning (SSL) for RS images and propose an RS foundation <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">mo</b> del framework called RingMo, which consists of two parts. First, a large-scale dataset is constructed by collecting two million RS images from satellite and aerial platforms, covering multiple scenes and objects around the world. Second, we propose an RS foundation model training method designed for dense and small objects in complicated RS scenes. We show that the foundation model trained on our dataset with RingMo method achieves state-of-the-art (SOTA) on eight datasets across four downstream tasks, demonstrating the effectiveness of the proposed framework. Through in-depth exploration, we believe it is time for RS researchers to embrace generative SSL and leverage its general representation capabilities to speed up the development of RS applications.

Similar Papers
  • PDF
  • Research Article
  • Citations20

Self-supervised learning for remote sensing scene classification under the few shot scenario

  • Jan 09, 2023
  • Scientific Reports
  • Najd Alosaimi +4
  • PDF
  • Research Article
  • Citations1

CDEST: Class Distinguishability-Enhanced Self-Training Method for Adopting Pre-Trained Models to Downstream Remote Sensing Image Semantic Segmentation

  • Apr 06, 2024
  • Remote Sensing
  • Ming Zhang +7
  • PDF
  • Research Article
  • Citations16

A Generic Self-Supervised Learning (SSL) Framework for Representation Learning from Spectral–Spatial Features of Unlabeled Remote Sensing Imagery

  • Nov 03, 2023
  • Remote Sensing
  • Xin Zhang +1
  • Research Article

Spatial-Frequency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images

  • Jan 01, 2026
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Yujia Fu +3
  • Preprint Article

Generalist Geospatial Foundation Model PhilEO on Satellite Sentinel-2 MajorTOM Multi-Spectral Data

  • Mar 15, 2025
  • Nikolaos Dionelis +9
  • Research Article
  • Citations174

Global and Local Contrastive Self-Supervised Learning for Semantic Segmentation of HR Remote Sensing Images

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Haifeng Li +6
  • Research Article
  • Citations22

AiRs: Adapter in Remote Sensing for Parameter-Efficient Transfer Learning

  • Jan 01, 2024
  • IEEE Transactions on Geoscience and Remote Sensing
  • Leiyi Hu +5
  • Research Article
  • Citations5

Contrastive Self-supervised EEG Representation Learning for Emotion Classification.

  • Jul 15, 2024
  • Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
  • Keya Hu +5
  • PDF
  • Research Article

Advancements in Self-Supervised Learning for Remote Sensing Scene Classification: Present Innovations and Future Outlooks

  • Apr 23, 2024
  • Journal of Artificial Intelligence General science (JAIGS) ISSN 3006-4023
  • José Gabriel Carrasco Ramírez
  • PDF
  • Research Article
  • Citations1

Advancements in Self-Supervised Learning for Remote Sensing Scene Classification: Present Innovations and Future Outlooks

  • Apr 23, 2024
  • Journal of Artificial Intelligence General science (JAIGS) ISSN 3006-4023
  • José Gabriel Carrasco Ramírez
  • Research Article

S3CD: A Self-Supervised Semantic Change Detection Method by Mining Transition Patterns and Consistency in Remote Sensing Images.

  • Mar 01, 2026
  • IEEE transactions on cybernetics
  • Yang Qu +3
  • PDF
  • Research Article
  • Citations74

Self-Supervised Learning for Scene Classification in Remote Sensing: Current State of the Art and Perspectives

  • Aug 17, 2022
  • Remote Sensing
  • Paul Berg +2
  • Research Article
  • Citations94

CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understanding

  • Jan 01, 2023
  • IEEE Transactions on Geoscience and Remote Sensing
  • Dilxat Muhtar +4
  • Preprint Article

Earth Observation embeddings at the test: A novel benchmark to evaluate (neural) compression for satellite imagery

  • Mar 15, 2025
  • Rikard Vinge +3
  • Research Article
  • Citations41

Brain-Inspired Remote Sensing Foundation Models and Open Problems: A Comprehensive Survey

  • Jan 01, 2023
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Licheng Jiao +23
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.