• Home
  • Search
  • Rethinking Transformers for Semantic Segmentation of Remote Sensing Images
  • Cite Icon87
  • https://doi.org/10.1109/tgrs.2023.3302024Copy DOI Icon

Rethinking Transformers for Semantic Segmentation of Remote Sensing Images

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Transformer has been widely applied in image processing tasks as a substitute for Convolutional Neural Networks (CNNs) for feature extraction due to its superiority in global context modeling and flexibility in model generalization. However, the existing transformer-based methods for semantic segmentation of Remote Sensing (RS) images are still with several limitations, which can be summarized into two main aspects: 1) the transformer encoder is generally combined with CNN-based decoder, leading to inconsistency in feature representations; 2) the strategies for global and local context information utilization are not sufficiently effective. Therefore, in this paper, a Global-Local Transformer Segmentor (GLOTS) framework is proposed for semantic segmentation of RS images to acquire consistent feature representations by adopting transformers for both encoding and decoding, in which a Masked Image Modeling (MIM) pretrained transformer encoder is adopted to learn semantic-rich representations of input images, and a multi-scale global-local transformer decoder is designed to fully exploit the global and local features. Specifically, the transformer decoder uses a feature separation-aggregation module (FSAM) to utilize the feature adequately at different scales and adopts a global-local attention module (GLAM) containing Global Attention Block (GAB) and Local Attention Block (LAB) to capture the global and local context information respectively. Furthermore, a Learnable Progressive Upsampling Strategy (LPUS) is proposed to restore the resolution progressively, which can flexibly recover the fine-grained details in the upsampling process. Experimental results on the three benchmark RS datasets demonstrate that the proposed GLOTS is capable of achieving better performance with some state-of-the-art methods, and the superiority of the proposed framework is also verified by ablation studies. The code will be available at https://github.com/lyhnsn/GLOTS.

Similar Papers
  • PDF
  • Research Article
  • Citations34

Learnable Gated Convolutional Neural Network for Semantic Segmentation in Remote-Sensing Images

  • Aug 17, 2019
  • Remote Sensing
  • Shichen Guo +5
  • Research Article
  • Citations122

Deep-Learning-Based Semantic Segmentation of Remote Sensing Images: A Survey

  • Jan 01, 2024
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Liwei Huang +4
  • Conference Article

Swin Transformer with Multi-Scale Residual Attention for Semantic Segmentation of Remote Sensing Images

  • Nov 17, 2022
  • Yuanyang Lin +3
  • Research Article
  • Citations3

A Prior-Guided Dual Branch Multi-Feature Fusion Network for Building Segmentation in Remote Sensing Images

  • Jul 02, 2024
  • Buildings
  • Yingbin Wu +5
  • Research Article
  • Citations44

Scale Sensitive Neural Network for Road Segmentation in High-Resolution Remote Sensing Images

  • Mar 23, 2020
  • IEEE Geoscience and Remote Sensing Letters
  • Xiaowei Tan +3
  • PDF
  • Research Article
  • Citations16

Dual Attention Feature Fusion and Adaptive Context for Accurate Segmentation of Very High-Resolution Remote Sensing Images

  • Sep 17, 2021
  • Remote Sensing
  • Hao Shi +3
  • Research Article

Local-Contextual Feature Fusion Network Based on Nonlinear Spiking Neural Model for Semantic Segmentation of Remote Sensing Images.

  • Mar 24, 2026
  • International journal of neural systems
  • Junhao Du +3
  • Research Article
  • Citations26

MFMamba: A Mamba-Based Multi-Modal Fusion Network for Semantic Segmentation of Remote Sensing Images

  • Nov 13, 2024
  • Sensors (Basel, Switzerland)
  • Yan Wang +2
  • Research Article
  • Citations4

Onet: Twin U-Net Architecture for Unsupervised Binary Semantic Segmentation in Radar and Remote Sensing Images.

  • Jan 01, 2025
  • IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
  • Yi Zhou +3
  • PDF
  • Research Article
  • Citations26

TCUNet: A Lightweight Dual-Branch Parallel Network for Sea–Land Segmentation in Remote Sensing Images

  • Sep 07, 2023
  • Remote Sensing
  • Xuan Xiong +4
  • PDF
  • Research Article

HDAM: Heuristic Difference Attention Module for Convolutional Neural Networks

  • Jan 01, 2022
  • Journal on Internet of Things
  • Yu Xue +1
  • PDF
  • Research Article
  • Citations9

Dynamic High-Resolution Network for Semantic Segmentation in Remote-Sensing Images

  • Apr 26, 2023
  • Remote Sensing
  • Shichen Guo +4
  • PDF
  • Research Article
  • Citations120

CCTNet: Coupled CNN and Transformer Network for Crop Segmentation of Remote Sensing Images

  • Apr 19, 2022
  • Remote Sensing
  • Hong Wang +4
  • Research Article
  • Citations3

Semantic Labeling of High-Resolution Images Combining a Self-Cascaded Multimodal Fully Convolution Neural Network with Fully Conditional Random Field

  • Sep 05, 2024
  • Remote Sensing
  • Qiongqiong Hu +3
  • PDF
  • Research Article
  • Citations39

SSCNet: A Spectrum-Space Collaborative Network for Semantic Segmentation of Remote Sensing Images

  • Dec 03, 2023
  • Remote Sensing
  • Xin Li +8
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.