• Home
  • Search
  • Evaluation of Ten Deep-Learning-Based Out-of-Distribution Detection Methods for Remote Sensing Image Scene Classification
  • Cite Icon7
  • https://doi.org/10.3390/rs16091501Copy DOI Icon

Evaluation of Ten Deep-Learning-Based Out-of-Distribution Detection Methods for Remote Sensing Image Scene Classification

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Although deep neural networks have made significant progress in tasks related to remote sensing image scene classification, most of these tasks assume that the training and test data are independently and identically distributed. However, when remote sensing scene classification models are deployed in the real world, the model will inevitably encounter situations where the distribution of the test set differs from that of the training set, leading to unpredictable errors during the inference and testing phase. For instance, in the context of large-scale remote sensing scene classification applications, it is difficult to obtain all the feature classes in the training phase. Consequently, during the inference and testing phases, the model will categorize images of unidentified unknown classes into known classes. Therefore, the deployment of out-of-distribution (OOD) detection within the realm of remote sensing scene classification is crucial for ensuring the reliability and safety of model application in real-world scenarios. Despite significant advancements in OOD detection methods in recent years, there remains a lack of a unified benchmark for evaluating various OOD methods specifically in remote sensing scene classification tasks. We designed different benchmarks on three classical remote sensing datasets to simulate scenes with different distributional shift. Ten different types of OOD detection methods were employed, and their performance was evaluated and compared using quantitative metrics. Numerous experiments were conducted to evaluate the overall performance of these state-of-the-art OOD detection methods under different test benchmarks. The comparative results show that the virtual-logit matching methods without additional training outperform the other types of methods on our benchmarks, suggesting that additional training methods are unnecessary for remote sensing image scene classification applications. Furthermore, we provide insights into OOD detection models and performance enhancement in real world. To the best of our knowledge, this study is the first evaluation and analysis of methods for detecting out-of-distribution data in remote sensing. We hope that this research will serve as a fundamental resource for future studies on out-of-distribution detection in remote sensing.

Loading PDF

Similar Papers
  • PDF
  • Research Article
  • Citations18

Lightweight Channel Attention and Multiscale Feature Fusion Discrimination for Remote Sensing Scene Classification

  • Jan 01, 2021
  • IEEE Access
  • Huiyao Wan +7
  • PDF
  • Research Article
  • Citations11

Self-Attention Network With Joint Loss for Remote Sensing Image Scene Classification

  • Jan 01, 2020
  • IEEE Access
  • Honglin Wu +4
  • Research Article
  • Citations4

Label Embedding Based on Interclass Correlation Mining for Remote Sensing Image Scene Classification

  • Jan 01, 2024
  • IEEE Geoscience and Remote Sensing Letters
  • Jiang He +4
  • Research Article
  • Citations32

Deep Semantic-Visual Alignment for zero-shot remote sensing image scene classification

  • Mar 14, 2023
  • ISPRS Journal of Photogrammetry and Remote Sensing
  • Wenjia Xu +4
  • Research Article
  • Citations105

Learning Deep Cross-Modal Embedding Networks for Zero-Shot Remote Sensing Image Scene Classification

  • Jan 14, 2021
  • IEEE Transactions on Geoscience and Remote Sensing
  • Yansheng Li +3
  • PDF
  • Research Article
  • Citations15

Aggregating Features From Dual Paths for Remote Sensing Image Scene Classification

  • Jan 01, 2022
  • IEEE Access
  • Donghang Yu +5
  • Research Article
  • Citations75

Remote Sensing Image Scene Classification Using Multiscale Feature Fusion Covariance Network With Octave Convolution

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Lin Bai +5
  • Research Article
  • Citations73

Multigranularity Decoupling Network With Pseudolabel Selection for Remote Sensing Image Scene Classification

  • Jan 01, 2023
  • IEEE Transactions on Geoscience and Remote Sensing
  • Wang Miao +2
  • PDF
  • Research Article
  • Citations20

Collaborative Consistent Knowledge Distillation Framework for Remote Sensing Image Scene Classification Network

  • Oct 17, 2022
  • Remote Sensing
  • Shiyi Xing +4
  • Research Article
  • Citations10

Fusing Deep Features by Kernel Collaborative Representation for Remote Sensing Scene Classification

  • Jan 01, 2021
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Xiaoning Chen +3
  • Conference Article
  • Citations6

Remote Scene Image Scene Classification Based on Adaptive Segmentation and Dynamic Graph Convolution

  • Jul 11, 2021
  • Yuqun Yang +5
  • Conference Article
  • Citations6

Classification of Remote Sensing Scenes Based on Neural Architecture Search Network

  • Jul 01, 2019
  • Lingling Li +2
  • PDF
  • Research Article
  • Citations64

CLRS: Continual Learning Benchmark for Remote Sensing Image Scene Classification.

  • Feb 24, 2020
  • Sensors
  • Haifeng Li +6
  • Research Article
  • Citations34

An Open Set Domain Adaptation Algorithm via Exploring Transferability and Discriminability for Remote Sensing Image Scene Classification

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Jun Zhang +5
  • Research Article
  • Citations19

Few-shot remote sensing image scene classification based on multiscale covariance metric network (MCMNet)

  • Apr 05, 2023
  • Neural Networks
  • Xiliang Chen +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.