• Home
  • Search
  • EMTCAL: Efficient Multiscale Transformer and Cross-Level Attention Learning for Remote Sensing Scene Classification
  • Cite Icon137
  • https://doi.org/10.1109/tgrs.2022.3194505Copy DOI Icon

EMTCAL: Efficient Multiscale Transformer and Cross-Level Attention Learning for Remote Sensing Scene Classification

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In recent years, convolutional neural network (CNN)-based methods have been widely used for remote sensing (RS) scene classification tasks and achieved excellent results. However, CNNs are not good at exploring contextual information, which is essential for fully understanding RS scenes. A new model named transformer attracts researchers’ attention to address this problem, which is skilled in mining the latent contextual information in RS scenes. Nevertheless, since the contents of RS scenes are diverse in type and various in scale, the performance of the original transformer in RS scene classification cannot reach what we expect. In addition, due to the specific self-attention mechanism, the time costs of the transformer are high, which hinders its practicability in the RS community. To overcome the above limitations, we propose a new model named efficient multi-scale transformer and cross-level attention learning (EMTCAL) for RS scene classification in this paper. EMTCAL combines the advantages of CNN and transformer to mine information within RS scenes fully. First, it uses a multi-layer feature extraction module (MFEM) to acquire global visual features and multi-level convolutional features from RS scenes. Second, a contextual information extraction module (CIEM) is proposed to capture rich contextual information from multi-level features. In CIEM, taking the characteristics of RS scenes and the computational complexity into account, we propose an efficient multi-scale transformer (EMST). EMST can mine the abundant knowledge with various scales hidden in RS scenes and model their inherent relations at small-time costs. Third, a cross-level attention module (CLAM) is developed to aggregate and explore correlations of multi-level features. Finally, a class score fusion module (CSFM) is designed to integrate the contributions of global and aggregated multi-level features for the discriminative scene representations. Extensive experiments are conducted on three public RS scene data sets. The positive results demonstrate that our EMTCAL can achieve superior classification performance and outperform many state-of-the-art methods.

Similar Papers
  • PDF
  • Research Article
  • Citations68

Homo–Heterogenous Transformer Learning Framework for RS Scene Classification

  • Jan 01, 2022
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Jingjing Ma +5
  • PDF
  • Research Article
  • Citations29

Faster and Better: A Lightweight Transformer Network for Remote Sensing Scene Classification

  • Jul 21, 2023
  • Remote Sensing
  • Xinyan Huang +5
  • Conference Article
  • Citations4

Resformer: Bridging Residual Network and Transformer for Remote Sensing Scene Classification

  • Jul 17, 2022
  • Mingteng Li +5
  • Research Article
  • Citations1

RDPN: Tackling the Data Shift Problem in Remote Sensing Scene Classification

  • Jan 01, 2022
  • IEEE Geoscience and Remote Sensing Letters
  • Xiang Zhang +4
  • PDF
  • Research Article
  • Citations6

Noisy Remote Sensing Scene Classification via Progressive Learning Based on Multiscale Information Exploration

  • Dec 12, 2023
  • Remote Sensing
  • Xu Tang +3
  • Research Article
  • Citations28

Contextual Information-Preserved Architecture Learning for Remote-Sensing Scene Classification

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Jie Chen +6
  • Research Article
  • Citations74

SAGN: Semantic-Aware Graph Network for Remote Sensing Scene Classification.

  • Jan 01, 2023
  • IEEE Transactions on Image Processing
  • Yuqun Yang +4
  • PDF
  • Research Article
  • Citations6

HCFPN: Hierarchical Contextual Feature-Preserved Network for Remote Sensing Scene Classification

  • Jan 31, 2023
  • Remote Sensing
  • Jingwen Yuan +1
  • PDF
  • Research Article
  • Citations18

A Deformable Convolutional Neural Network with Spatial-Channel Attention for Remote Sensing Scene Classification

  • Dec 14, 2021
  • Remote Sensing
  • Di Wang +1
  • PDF
  • Research Article
  • Citations33

Multi-Output Network Combining GNN and CNN for Remote Sensing Scene Classification

  • Mar 18, 2022
  • Remote Sensing
  • Feifei Peng +5
  • PDF
  • Research Article
  • Citations18

Lightweight Channel Attention and Multiscale Feature Fusion Discrimination for Remote Sensing Scene Classification

  • Jan 01, 2021
  • IEEE Access
  • Huiyao Wan +7
  • PDF
  • Research Article
  • Citations71

When Self-Supervised Learning Meets Scene Classification: Remote Sensing Scene Classification Based on a Multitask Learning Framework

  • Oct 09, 2020
  • Remote Sensing
  • Zhicheng Zhao +4
  • Conference Article
  • Citations52

Convolutional Neural Networks Based Remote Sensing Scene Classification under Clear and Cloudy Environments

  • Oct 01, 2021
  • Huiming Sun +5
  • PDF
  • Research Article
  • Citations36

Remote Sensing Scene Classification Using Sparse Representation-Based Framework With Deep Feature Fusion

  • Jan 01, 2021
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Shaohui Mei +5
  • Conference Article

Compressed domain classification of remote sensing scene images based on sub-band data fusion

  • Oct 26, 2022
  • Berk Arican +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.