• Home
  • Search
  • Collaborative Consistent Knowledge Distillation Framework for Remote Sensing Image Scene Classification Network
  • Cite Icon20
  • https://doi.org/10.3390/rs14205186Copy DOI Icon

Collaborative Consistent Knowledge Distillation Framework for Remote Sensing Image Scene Classification Network

Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

For remote sensing image scene classification tasks, the classification accuracy of the small-scale deep neural network tends to be low and fails to achieve accuracy in real-world application scenarios. However, although large deep neural networks can improve the classification accuracy of remote sensing image scenes to some extent, the corresponding deep neural networks also have more parameters and cannot be used on existing embedded devices. The main reason for this is that there are a large number of redundant parameters in large deep networks, which directly leads to the difficulty of application on embedded devices and also reduces the classification speed. Considering the contradiction between hardware equipment and classification accuracy requirements, we propose a collaborative consistent knowledge distillation method for improving the classification accuracy of remote sensing image scenes on embedded devices, called CKD. In essence, our method addresses two aspects: (1) We design a multi-branch fused redundant feature mapping module, which significantly improves the parameter redundancy problem. (2) To improve the classification accuracy of the deep model on embedded devices, we propose a knowledge distillation method based on mutually supervised learning. Experiments were conducted on two remote sensing image classification datasets, SIRI-WHU and NWPU-RESISC45, and the experimental results showed that our approach significantly reduced the number of redundant parameters in the deep network; the number of parameters decreased from 1.73 M to 0.90 M. In addition, compared to a series of student sub-networks obtained based on the existing different knowledge distillation methods, the performance of the student sub-networks obtained by CKD for remote sensing scene classification was significantly improved on two different datasets, with an average accuracy of 0.943 and 0.916, respectively.

Loading PDF

Similar Papers
  • Conference Article
  • Citations15

Representation Learning of Remote Sensing Knowledge Graph for Zero-Shot Remote Sensing Image Scene Classification

  • Jul 11, 2021
  • Yansheng Li +4
  • PDF
  • Research Article
  • Citations7

Evaluation of Ten Deep-Learning-Based Out-of-Distribution Detection Methods for Remote Sensing Image Scene Classification

  • Apr 24, 2024
  • Remote Sensing
  • Sicong Li +4
  • Research Article
  • Citations105

Learning Deep Cross-Modal Embedding Networks for Zero-Shot Remote Sensing Image Scene Classification

  • Jan 14, 2021
  • IEEE Transactions on Geoscience and Remote Sensing
  • Yansheng Li +3
  • PDF
  • Research Article
  • Citations3

A Novel Discriminative Enhancement Method for Few-Shot Remote Sensing Image Scene Classification

  • Sep 18, 2023
  • Remote Sensing
  • Yanqiao Chen +5
  • Research Article
  • Citations26

Marginal Center Loss for Deep Remote Sensing Image Scene Classification

  • Sep 26, 2019
  • IEEE Geoscience and Remote Sensing Letters
  • Tianyu Wei +4
  • Research Article
  • Citations1

Instance-Level Scaling and Dynamic Margin-Alignment Knowledge Distillation for Remote Sensing Image Scene Classification

  • Oct 17, 2024
  • Remote Sensing
  • Chuan Li +3
  • Research Article
  • Citations74

Robust Space–Frequency Joint Representation for Remote Sensing Image Scene Classification

  • Oct 01, 2019
  • IEEE Transactions on Geoscience and Remote Sensing
  • Jie Fang +3
  • Research Article
  • Citations28

A New Method for Scene Classification from the Remote Sensing Images

  • Jan 01, 2022
  • Computers, Materials & Continua
  • Purnachand Kollapudi +5
  • Research Article
  • Citations96

Task-specific contrastive learning for few-shot remote sensing image scene classification

  • Jul 20, 2022
  • ISPRS Journal of Photogrammetry and Remote Sensing
  • Qingjie Zeng +1
  • Conference Article
  • Citations6

Remote Scene Image Scene Classification Based on Adaptive Segmentation and Dynamic Graph Convolution

  • Jul 11, 2021
  • Yuqun Yang +5
  • PDF
  • Research Article
  • Citations64

CLRS: Continual Learning Benchmark for Remote Sensing Image Scene Classification.

  • Feb 24, 2020
  • Sensors
  • Haifeng Li +6
  • Conference Article
  • Citations18

A Novel Framework of CNN Integrated with Adaboost for Remote Sensing Scene Classification

  • Sep 26, 2020
  • Xudong Hu +2
  • Research Article
  • Citations970

Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities

  • Jan 01, 2020
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Gong Cheng +4
  • Research Article
  • Citations118

Vision Transformer: An Excellent Teacher for Guiding Small Networks in Remote Sensing Image Scene Classification

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Kejie Xu +2
  • Research Article
  • Citations34

An Open Set Domain Adaptation Algorithm via Exploring Transferability and Discriminability for Remote Sensing Image Scene Classification

  • Jan 01, 2022
  • IEEE Transactions on Geoscience and Remote Sensing
  • Jun Zhang +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.