• Home
  • Search
  • Transferable image synthesis for remote sensing semantic segmentation via joint reference-semantic fusion
  • Cite Icon1
  • https://doi.org/10.1016/j.inffus.2025.103839Copy DOI Icon

Transferable image synthesis for remote sensing semantic segmentation via joint reference-semantic fusion

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

With the advancement of diffusion model-based generative methods, synthesizing pixel-level training datasets has emerged as a promising approach to mitigate the scarcity of annotated data in semantic segmentation tasks. However, a noticeable gap persists between data synthesis and semantic segmentation tasks in the remote sensing (RS) domain. Due to the diversity of RS data across sensors and spatial scales, relying solely on limited annotated data and pre-trained generative foundation models to synthesize training data brings minor improvements in RS semantic segmentation tasks. Therefore, it becomes crucial to incorporate large volumes of unlabeled external data into downstream tasks to enable more transferable image synthesis. Unlike training-free approaches that introduce reference (Ref) images primarily for shallow feature transfer, we propose a joint learning strategy that integrates Ref images, semantic masks, and text prompts during training. This facilitates multi-modal interaction and allows the model to capture deeper features such as content. To achieve effective multi-modal information fusion, the proposed Transferable Image Synthesis method (TISynth) avoids directly using real Ref images during training. Instead, it generates Ref images from augmented input images, and facilitates interaction between Ref images and semantic information through text prompts and an all-in-attention module. As a data augmentation approach for semantic segmentation task, TISynth improve the OA/mIoU/mAcc by 1.52%/2.32%/3.04% on FUSU-4k, 1.33%/1.06%/3.04% on GID-26k, and 1.15%/1.67%/2.04% on LoveDA (Rural → Urban), compared to the baseline trained only on the original data. Moreover, compared to state-of-the-art segmentation training data synthesis methods, our approach achieves superior performance across datasets of varying scales, resolutions, segmentation complexities, and domains. Our code is available at https://github.com/dongrunmin/TISynth.git .

Similar Papers
  • Research Article
  • Citations16

A Semantic Change Detection Network Based on Boundary Detection and Task Interaction for High-Resolution Remote Sensing Images.

  • Sep 01, 2025
  • IEEE transactions on neural networks and learning systems
  • Yingjie Tang +5
  • PDF
  • Research Article
  • Citations1

CDEST: Class Distinguishability-Enhanced Self-Training Method for Adopting Pre-Trained Models to Downstream Remote Sensing Image Semantic Segmentation

  • Apr 06, 2024
  • Remote Sensing
  • Ming Zhang +7
  • Research Article
  • Citations59

Fine-Scale Urban Informal Settlements Mapping by Fusing Remote Sensing Images and Building Data via a Transformer-Based Multimodal Fusion Network

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Runyu Fan +5
  • Research Article
  • Citations21

GraSS: Contrastive Learning With Gradient-Guided Sampling Strategy for Remote Sensing Image Semantic Segmentation

  • Jan 01, 2023
  • IEEE Transactions on Geoscience and Remote Sensing
  • Zhaoyang Zhang +5
  • Research Article

A Unified Deep Architecture for Segmentation in Remote Sensing Images

  • Jan 01, 2025
  • Applied Computational Intelligence and Soft Computing
  • Nagamani Gonthina +1
  • Research Article
  • Citations10

A Novel Semantic Segmentation Algorithm for RGB-D Images Based on Non-Symmetry and Anti-Packing Pattern Representation Model

  • Jan 01, 2023
  • IEEE Access
  • Yunping Zheng +5
  • Research Article
  • Citations72

High-Resolution Aerial Images Semantic Segmentation Using Deep Fully Convolutional Network With Channel Attention Mechanism

  • Sep 01, 2019
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Haifeng Luo +4
  • PDF
  • Research Article
  • Citations45

Deep Learning Methods for Semantic Segmentation in Remote Sensing with Small Data: A Survey

  • Oct 16, 2023
  • Remote Sensing
  • Anzhu Yu +9
  • Research Article

Spatial-Frequency Contrastive Learning for Self-Supervised Semantic Segmentation of Remote Sensing Images

  • Jan 01, 2026
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Yujia Fu +3
  • PDF
  • Research Article
  • Citations37

A Dynamic Effective Class Balanced Approach for Remote Sensing Imagery Semantic Segmentation of Imbalanced Data

  • Mar 25, 2023
  • Remote Sensing
  • Zheng Zhou +6
  • Research Article

EventSegNet: Direct Sparse Semantic Segmentation from Event Data

  • Dec 29, 2024
  • Remote Sensing
  • Pengju Li +7
  • Research Article
  • Citations1

Towards Open-Vocabulary Video Semantic Segmentation

  • Jan 01, 2025
  • IEEE Transactions on Multimedia
  • Xinhao Li +5
  • Research Article
  • Citations11

Entropy-weighted reconstruction adversary and curriculum pseudo labeling for domain adaptation in semantic segmentation

  • Jul 26, 2022
  • Neurocomputing
  • Xiwen Bi +3
  • Research Article
  • Citations32

Joint Multiclass Object Detection and Semantic Segmentation for Autonomous Driving

  • Jan 01, 2023
  • IEEE Access
  • Shakhboz Abdigapporov +3
  • Research Article
  • Citations2

Optimal transport-based domain adaptation for semantic segmentation of remote sensing images

  • Jan 16, 2024
  • International Journal of Remote Sensing
  • Ziyang Shen +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.