• Home
  • Search
  • Homo–Heterogenous Transformer Learning Framework for RS Scene Classification
  • Cite Icon68
  • https://doi.org/10.1109/jstars.2022.3155665Copy DOI Icon

Homo–Heterogenous Transformer Learning Framework for RS Scene Classification

  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Remote sensing (RS) scene classification plays an essential role in the RS community and has attracted increasing attention due to its wide applications. Recently, benefiting from the powerful feature learning capabilities of convolutional neural networks (CNNs), the accuracy of the RS scene classification has significantly been improved. Although the existing CNN-based methods achieve excellent results, there is still room for improvement. First, the CNN-based methods are adept at capturing the global information from RS scenes. Still, the context relationships hidden in RS scenes cannot be thoroughly mined. Second, due to the specific structure, it is easy for normal CNNs to exploit the heterogenous information from RS scenes. Nevertheless, the homogenous information, which is also crucial to comprehensively understand complex contents within RS scenes, does not get the attention it deserves. Third, most CNNs focus on establishing the relationships between RS scenes and semantic labels. However, the similarities between them are not considered deeply, which are helpful to distinguish the intra-/interclass samples. To overcome the limitations mentioned previously, we propose a homo–heterogenous transformer learning (HHTL) framework for the RS scene classification in this article. First, a patch generation module is designed to generate homogenous and heterogenous patches. Then, a dual-branch feature learning module (FLM) is proposed to mine homogenous and heterogenous information within RS scenes simultaneously. In the FLM, based on vision transformer, not only the global information but also the local areas and their context information can be captured. Finally, we design a classification module, which consists of a fusion submodule and a metric-learning module. It can integrate homo–heterogenous information and compact/separate samples from the same/different RS scene categories. Extensive experiments are conducted on four public RS scene datasets. The encouraging results demonstrate that our HHTL framework can outperform many state-of-the-art methods. Our source codes are available at the below website.

Loading PDF

Similar Papers
  • Research Article
  • Citations137

EMTCAL: Efficient Multiscale Transformer and Cross-Level Attention Learning for Remote Sensing Scene Classification

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Xu Tang +5
  • Conference Article
  • Citations4

Resformer: Bridging Residual Network and Transformer for Remote Sensing Scene Classification

  • Jul 17, 2022
  • Mingteng Li +5
  • Research Article
  • Citations1

RDPN: Tackling the Data Shift Problem in Remote Sensing Scene Classification

  • Jan 01, 2022
  • IEEE Geoscience and Remote Sensing Letters
  • Xiang Zhang +4
  • PDF
  • Research Article
  • Citations29

Faster and Better: A Lightweight Transformer Network for Remote Sensing Scene Classification

  • Jul 21, 2023
  • Remote Sensing
  • Xinyan Huang +5
  • PDF
  • Research Article
  • Citations6

Noisy Remote Sensing Scene Classification via Progressive Learning Based on Multiscale Information Exploration

  • Dec 12, 2023
  • Remote Sensing
  • Xu Tang +3
  • PDF
  • Research Article
  • Citations71

When Self-Supervised Learning Meets Scene Classification: Remote Sensing Scene Classification Based on a Multitask Learning Framework

  • Oct 09, 2020
  • Remote Sensing
  • Zhicheng Zhao +4
  • PDF
  • Research Article
  • Citations18

A Deformable Convolutional Neural Network with Spatial-Channel Attention for Remote Sensing Scene Classification

  • Dec 14, 2021
  • Remote Sensing
  • Di Wang +1
  • PDF
  • Research Article
  • Citations18

Lightweight Channel Attention and Multiscale Feature Fusion Discrimination for Remote Sensing Scene Classification

  • Jan 01, 2021
  • IEEE Access
  • Huiyao Wan +7
  • Research Article
  • Citations26

Class-Level Prototype Guided Multiscale Feature Learning for Remote Sensing Scene Classification With Limited Labels

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Xu Tang +5
  • PDF
  • Research Article
  • Citations33

Multi-Output Network Combining GNN and CNN for Remote Sensing Scene Classification

  • Mar 18, 2022
  • Remote Sensing
  • Feifei Peng +5
  • Research Article
  • Citations173

Attention Consistent Network for Remote Sensing Scene Classification

  • Jan 01, 2021
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Xu Tang +5
  • Research Article
  • Citations105

Learning Deep Cross-Modal Embedding Networks for Zero-Shot Remote Sensing Image Scene Classification

  • Jan 14, 2021
  • IEEE Transactions on Geoscience and Remote Sensing
  • Yansheng Li +3
  • Research Article
  • Citations28

Contextual Information-Preserved Architecture Learning for Remote-Sensing Scene Classification

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Jie Chen +6
  • Research Article
  • Citations2

Remote Sensing Scene Classification via Pseudo-Category-Relationand Orthogonal Feature Learning

  • Jan 01, 2025
  • IEEE Transactions on Geoscience and Remote Sensing
  • Jinsheng Ji +4
  • Research Article
  • Citations74

SAGN: Semantic-Aware Graph Network for Remote Sensing Scene Classification.

  • Jan 01, 2023
  • IEEE Transactions on Image Processing
  • Yuqun Yang +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.