• Home
  • Search
  • Research on the Applicability of Transformer Model in Remote-Sensing Image Segmentation
  • Cite Icon14
  • https://doi.org/10.3390/app13042261Copy DOI Icon

Research on the Applicability of Transformer Model in Remote-Sensing Image Segmentation

Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Transformer models have achieved great results in the field of computer vision over the past 2 years, drawing attention from within the field of remote sensing. However, there are still relatively few studies on this model in the field of remote sensing. Which method is more suitable for remote-sensing segmentation? In particular, how do different transformer models perform in the face of high-spatial resolution and the multispectral resolution of remote-sensing images? To explore these questions, this paper presents a comprehensive comparative analysis of three mainstream transformer models, including the segmentation transformer (SETRnet), SwinUnet, and TransUnet, by evaluating three aspects: a visual analysis of feature-segmentation results, accuracy, and training time. The experimental results show that the transformer structure has obvious advantages for the feature-extraction ability of large-scale remote-sensing data sets and ground objects, but the segmentation performance of different transfer structures in different scales of remote-sensing data sets is also very different. SwinUnet exhibits better global semantic interaction and pixel-level segmentation prediction on the large-scale Potsdam data set, and the SwinUnet model has the highest accuracy metrics for KAPPA, MIoU, and OA in the Potsdam data set, at 76.47%, 63.62%, and 85.01%, respectively. TransUnet has better segmentation results in the small-scale Vaihingen data set, and the three accuracy metrics of KAPPA, MIoU, and OA are the highest, at 80.54%, 56.25%, and 85.55%, respectively. TransUnet is better able to handle the edges and details of feature segmentation thanks to the network structure together built by its transformer and convolutional neural networks (CNNs). Therefore, TransUnet segmentation accuracy is higher when using a small-scale Vaihingen data set. Compared with SwinUnet and TransUnet, the segmentation performance of SETRnet in different scales of remote-sensing data sets is not ideal, so SETRnet is not suitable for the research task of remote-sensing image segmentation. In addition, this paper discusses the reasons for the performance differences between transformer models and discusses the differences between transformer models and CNN. This study further promotes the application of transformer models in remote-sensing image segmentation, improves the understanding of transformer models, and helps relevant researchers to select a more appropriate transformer model or model improvement method for remote-sensing image segmentation.

Loading PDF

Similar Papers
  • Research Article
  • Citations26

MFMamba: A Mamba-Based Multi-Modal Fusion Network for Semantic Segmentation of Remote Sensing Images

  • Nov 13, 2024
  • Sensors (Basel, Switzerland)
  • Yan Wang +2
  • PDF
  • Research Article
  • Citations34

Learnable Gated Convolutional Neural Network for Semantic Segmentation in Remote-Sensing Images

  • Aug 17, 2019
  • Remote Sensing
  • Shichen Guo +5
  • Research Article
  • Citations51

Hierarchical Weakly Supervised Learning for Residential Area Semantic Segmentation in Remote Sensing Images

  • May 29, 2019
  • IEEE Geoscience and Remote Sensing Letters
  • Libao Zhang +3
  • Research Article
  • Citations87

Rethinking Transformers for Semantic Segmentation of Remote Sensing Images

  • Jan 01, 2023
  • IEEE Transactions on Geoscience and Remote Sensing
  • Yuheng Liu +3
  • Research Article
  • Citations44

Scale Sensitive Neural Network for Road Segmentation in High-Resolution Remote Sensing Images

  • Mar 23, 2020
  • IEEE Geoscience and Remote Sensing Letters
  • Xiaowei Tan +3
  • Research Article
  • Citations23

Unsupervised Domain Adaptation Semantic Segmentation for Remote-Sensing Images via Covariance Attention

  • Jan 01, 2022
  • IEEE Geoscience and Remote Sensing Letters
  • Yikun Liu +4
  • Conference Article
  • Citations3

A MRF-based Multi-agent System for Remote Sensing Image Segmentation

  • Apr 01, 2017
  • Huifang Bao +3
  • PDF
  • Research Article
  • Citations3

Remote Sensing Image Segmentation Based on a Novel Gaussian Mixture Model and SURF Algorithm

  • Apr 26, 2023
  • International Journal of Swarm Intelligence Research
  • Shoulin Yin +4
  • PDF
  • Research Article
  • Citations16

Dual Attention Feature Fusion and Adaptive Context for Accurate Segmentation of Very High-Resolution Remote Sensing Images

  • Sep 17, 2021
  • Remote Sensing
  • Hao Shi +3
  • Research Article
  • Citations30

Remote sensing image segmentation based on the fuzzy deep convolutional neural network

  • Jun 16, 2021
  • International Journal of Remote Sensing
  • Tianyu Zhao +3
  • Conference Article
  • Citations24

Remote Sensing Image Segmentation Method based on HRNET

  • Sep 26, 2020
  • Zhi Cheng +1
  • Research Article
  • Citations3

Remote Sensing Image Segmentation Algorithm Based on Multi-agent and Fuzzy Clustering

  • Apr 25, 2017
  • DEStech Transactions on Environment, Energy and Earth Science
  • Lei Liu +2
  • Conference Article
  • Citations2

An unsupervised remote sensing image segmentation method based on hidden Markov model

  • Jun 01, 2023
  • Xinpeng Man +1
  • PDF
  • Research Article
  • Citations16

Transformer Models and Convolutional Networks with Different Activation Functions for Swallow Classification Using Depth Video Data

  • Jul 12, 2023
  • Mathematics
  • Derek Ka-Hei Lai +7
  • Research Article

A land parcel segmentation method for remote-sensing images based on an improved U-Net network

  • Oct 01, 2024
  • Journal of Physics: Conference Series
  • Zitang Wang
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.