• Home
  • Search
  • Learning Deep Cross-Modal Embedding Networks for Zero-Shot Remote Sensing Image Scene Classification
  • Cite Icon105
  • https://doi.org/10.1109/tgrs.2020.3047447Copy DOI Icon

Learning Deep Cross-Modal Embedding Networks for Zero-Shot Remote Sensing Image Scene Classification

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Due to its wide applications, remote sensing (RS) image scene classification has attracted increasing research interest. When each category has a sufficient number of labeled samples, RS image scene classification can be well addressed by deep learning. However, in the RS big data era, it is extremely difficult or even impossible to annotate RS scene samples for all the categories in one time as the RS scene classification often needs to be extended along with the emergence of new applications that inevitably involve a new class of RS images. Hence, the RS big data era fairly requires a zero-shot RS scene classification (ZSRSSC) paradigm in which the classification model learned from training RS scene categories obeys the inference ability to recognize the RS image scenes from unseen categories, in common with the humans’ evolutionary perception ability. Unfortunately, zero-shot classification is largely unexploited in the RS field. This article proposes a novel ZSRSSC method based on locality-preservation deep cross-modal embedding networks (LPDCMENs). The proposed LPDCMENs, which can fully assimilate the pairwise intramodal and intermodal supervision in an end-to-end manner, aim to alleviate the problem of class structure inconsistency between two hybrid spaces (i.e., the visual image space and the semantic space). To pursue a stable and generalization ability, which is highly desired for ZSRSSC, a set of explainable constraints is specially designed to optimize LPDCMENs. To fully verify the effectiveness of the proposed LPDCMENs, we collect a new large-scale RS scene data set, including the instance-level visual images and class-level semantic representations (RSSDIVCS), where the general and domain knowledge is exploited to construct the class-level semantic representations. Extensive experiments show that the proposed ZSRSSC method based on LPDCMENs can obviously outperform the state-of-the-art methods, and the domain knowledge further improves the performance of ZSRSSC compared with the general knowledge. The collected RSSDIVCS will be made publicly available along with this article.

Similar Papers
  • Conference Article
  • Citations15

Representation Learning of Remote Sensing Knowledge Graph for Zero-Shot Remote Sensing Image Scene Classification

  • Jul 11, 2021
  • Yansheng Li +4
  • PDF
  • Research Article
  • Citations18

Lightweight Channel Attention and Multiscale Feature Fusion Discrimination for Remote Sensing Scene Classification

  • Jan 01, 2021
  • IEEE Access
  • Huiyao Wan +7
  • PDF
  • Research Article
  • Citations7

Evaluation of Ten Deep-Learning-Based Out-of-Distribution Detection Methods for Remote Sensing Image Scene Classification

  • Apr 24, 2024
  • Remote Sensing
  • Sicong Li +4
  • PDF
  • Research Article
  • Citations71

When Self-Supervised Learning Meets Scene Classification: Remote Sensing Scene Classification Based on a Multitask Learning Framework

  • Oct 09, 2020
  • Remote Sensing
  • Zhicheng Zhao +4
  • Conference Article
  • Citations6

Classification of Remote Sensing Scenes Based on Neural Architecture Search Network

  • Jul 01, 2019
  • Lingling Li +2
  • Conference Article
  • Citations6

Remote Scene Image Scene Classification Based on Adaptive Segmentation and Dynamic Graph Convolution

  • Jul 11, 2021
  • Yuqun Yang +5
  • Research Article
  • Citations1

RDPN: Tackling the Data Shift Problem in Remote Sensing Scene Classification

  • Jan 01, 2022
  • IEEE Geoscience and Remote Sensing Letters
  • Xiang Zhang +4
  • Research Article
  • Citations2

Remote Sensing Scene Classification via Pseudo-Category-Relationand Orthogonal Feature Learning

  • Jan 01, 2025
  • IEEE Transactions on Geoscience and Remote Sensing
  • Jinsheng Ji +4
  • Research Article
  • Citations7

Few-Shot Remote Sensing Scene Classification via Subspace Based on Multiscale Feature Learning

  • Jan 01, 2024
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Anyong Qin +5
  • Research Article
  • Citations137

EMTCAL: Efficient Multiscale Transformer and Cross-Level Attention Learning for Remote Sensing Scene Classification

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Xu Tang +5
  • PDF
  • Research Article
  • Citations34

An Attention Cascade Global–Local Network for Remote Sensing Scene Classification

  • Apr 24, 2022
  • Remote Sensing
  • Junge Shen +4
  • PDF
  • Research Article
  • Citations11

Self-Attention Network With Joint Loss for Remote Sensing Image Scene Classification

  • Jan 01, 2020
  • IEEE Access
  • Honglin Wu +4
  • PDF
  • Research Article
  • Citations20

Collaborative Consistent Knowledge Distillation Framework for Remote Sensing Image Scene Classification Network

  • Oct 17, 2022
  • Remote Sensing
  • Shiyi Xing +4
  • PDF
  • Research Article
  • Citations68

Homo–Heterogenous Transformer Learning Framework for RS Scene Classification

  • Jan 01, 2022
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Jingjing Ma +5
  • Research Article
  • Citations4

Label Embedding Based on Interclass Correlation Mining for Remote Sensing Image Scene Classification

  • Jan 01, 2024
  • IEEE Geoscience and Remote Sensing Letters
  • Jiang He +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.