• Home
  • Search
  • Scalable Efficient Compression in Large-Scale Earth Observation
  • https://doi.org/10.5194/egusphere-egu25-19016Copy DOI Icon

Scalable Efficient Compression in Large-Scale Earth Observation

  • Mar 15, 2025
  • Erik Scheurer +9 more
Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

Earth observation (EO) yields large-scale, multimodal datasets collected from various satellite missions, DEMs, land-use data, and textual metadata. Foundation models like 4M (Massively Multimodal Masked Modeling) can learn a joint embedding space that bridges modality gaps, mitigates missing data issues, and facilitates partial spatio-temporal alignment [1]. However, directly training such foundation models on the vast, high-dimensional original EO datasets is not only computationally intensive but also imposes substantial demands on storage resources.To address this, one can leverage VQ-VAE (Vector Quantized-Variational AutoEncoder) as neural compressors to transform high-dimension multimodal inputs into a few discrete indices, significantly reducing data volume while preserving critical information. By inverting the tokenization process, we can reconstruct the original high-dimensional data with minimal quality loss, aided by adversarial and perceptual losses that enhance reconstruction fidelity.Traditional VQ-based approaches, however, face challenges such as inefficient codebook utilization and limited latent space representation. To overcome these, we propose scaling strategies that complement 4M’s tokenizer-based architecture. By expanding the codebook size, latent dimensions, and network depth, our method captures the complexity of EO modalities more effectively. Specifically, we employ spherical quantization techniques like Grouped Spherical Quantization (GSQ) to address limitations in traditional approaches [2]. GSQ constrains codebook vectors to a spherical surface, stabilizing training, preventing code collapse, and promoting uniform codebook usage. Unlike standard VQ, GSQ uses spherical initialization and normalization to maintain consistent distances among codebook entries, ensuring robust latent space coverage even under extreme compression or large codebooks. From our empirical and ablation studies, alternative methods like LFQ (Lookup-Free Quantization), FSQ (Finite Scalar Quantization), and RVQ (Residual Vector Quantizer) often exhibit limitations, such as tightly coupling the latent dimension to codebook size or relying on specialized training losses. In contrast, spherical-based techniques effectively decouple latent dimensions from codebook vocabulary, providing greater flexibility and scalability as data demands increase.Our approach enables neural compressors to adapt to varying scales of compression and complexity without compromising performance. Comprehensive scalability experiments—examining large codebooks, deeper networks, and diverse compression ratios—assessed the generalizability of the proposed compression strategies and demonstrated their effectiveness on high-dimensional, large-scale EO data with minimal information loss. By integrating advanced compression techniques with scalable architectures, this framework establishes a robust foundation for addressing multimodal challenges in EO research that significantly reduces the difficulty of training foundation models on multimodal high-dimensional EO data.

Similar Papers
  • Preprint Article

Forest Disturbance Monitoring with Geospatial Foundation Models

  • Mar 14, 2026
  • Damien Robert +1
  • Conference Article
  • Citations4

Implementing next-generation national Earth Observation data infrastructure to integrate distributed big Earth Observation data

  • Jul 01, 2016
  • Jibo Xie +1
  • Research Article
  • Citations8

Citizen science for Earth Observation (Citzens4EO): understanding current use in the UK

  • Apr 18, 2022
  • International Journal of Remote Sensing
  • Doreen S Boyd +5
  • Preprint Article

Reproducible and Scalable cloud-native EO data analysis using openEO

  • Mar 13, 2026
  • Pratichhya Sharma +2
  • PDF
  • Research Article
  • Citations28

SimSphere model sensitivity analysis towards establishing its use for deriving key parameters characterising land surface interactions

  • Sep 02, 2014
  • Geoscientific Model Development
  • G P Petropoulos +4
  • PDF
  • Research Article

Towards Standardization of the Earth Observation Data Product Supply Chain – Are OCI Artifacts the Key to Ubiquitous and Scalable EO Data Handling?

  • Jul 11, 2025
  • The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
  • Stefan Achtsnit +2
  • Research Article
  • Citations20

Use of remote sensing to test and update simulated snow cover in hydrological models

  • Sep 01, 1999
  • Hydrological Processes
  • Owen Turpin +2
  • Dissertation
  • Citations2

Earth observation data for assessing global urbanization-sustainability nexuses

  • Jun 06, 2023
  • Yunyu Tian
  • Preprint Article

ArtEO - Environmental Data for Artists: Lessons from the Pioneer Phase

  • Mar 18, 2025
  • Ravi Kapur
  • Research Article
  • Citations54

RF-CLASS: A remote-sensing-based flood crop loss assessment cyber-service system for supporting crop statistics and insurance decision-making

  • Feb 01, 2017
  • Journal of Integrative Agriculture
  • Liping Di +4
  • Conference Article

Application of Photon Recollision Probability Theory for Compatibility Check Between Foliage Clumping and Leaf Area Index Products Obtained from Earth Observation Data

  • Jul 01, 2018
  • Jan Pisek +14
  • Preprint Article
  • Citations1

The data cube system to EO datasets: the DCS4COP project

  • Mar 23, 2020
  • João Felipe Cardoso Dos Santos +2
  • Research Article
  • Citations105

SSL4EO-S12: A large-scale multimodal, multitemporal dataset for self-supervised learning in Earth observation [Software and Data Sets

  • Sep 01, 2023
  • IEEE Geoscience and Remote Sensing Magazine
  • Yi Wang +5
  • Conference Article
  • Citations2

Innovative data mining techniques in support of GEOSS: A workshop's findings

  • Sep 01, 2011
  • Roger King +3
  • Preprint Article
  • Citations1

Copernicus Data Space Ecosystem - Platform That Enables Federated Earth Observation Services and Applications

  • Jan 20, 2025
  • Grega Milcinski +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.