Residual channel attention based sample adaptation few-shot learning for hyperspectral image classification

In Hyperspectral Image (HSI) classification, acquiring large quantities of high-quality labeled samples is typically costly and impractical. Traditional deep learning methods are limited in such scenarios due to their dependence on sample quantities. To address this challenge, researchers have turned to Few-Shot Learning (FSL). Although existing FSL methods improve classification performance by enhancing domain invariance through domain adaptation, they often overlook the critical issue of high inter-class similarity and large intra-class variability. Moreover, during domain alignment, features of different categories within the same domain may become confused. To address these issues, this paper proposes a novel Domain-Invariant Few-Shot Contrastive Learning (DIFSCL) method, which combines domain adaptation and contrastive learning strategies to not only learn domain-invariant features but also significantly enhance inter-class discriminability. Based on this, we further design a multi-scale adaptive attention mechanism for a hyperspectral feature extraction network to more effectively extract and optimize generalized features within the DIFSCL framework, significantly improving intra-class consistency and inter-class discriminative capability of features. Experimental results on three widely used HSI datasets demonstrate that our method significantly outperforms existing techniques in few-shot classification tasks.

Hyperspectral image (HSI) classification has become a hot topic in the field of remote sensing. In general, the complex characteristics of hyperspectral data make the accurate classification of such data challenging for traditional machine learning methods. In addition, hyperspectral imaging often deals with an inherently nonlinear relation between the captured spectral information and the corresponding materials. In recent years, deep learning has been recognized as a powerful feature-extraction tool to effectively address nonlinear problems and widely used in a number of image processing tasks. Motivated by those successful applications, deep learning has also been introduced to classify HSIs and demonstrated good performance. This survey paper presents a systematic review of deep learning-based HSI classification literatures and compares several strategies for this topic. Specifically, we first summarize the main challenges of HSI classification which cannot be effectively overcome by traditional machine learning methods, and also introduce the advantages of deep learning to handle these problems. Then, we build a framework that divides the corresponding works into spectral-feature networks, spatial-feature networks, and spectral-spatial-feature networks to systematically review the recent achievements in deep learning-based HSI classification. In addition, considering the fact that available training samples in the remote sensing field are usually very limited and training deep networks require a large number of samples, we include some strategies to improve classification performance, which can provide some guidelines for future studies on this topic. Finally, several representative deep learning-based classification methods are conducted on real HSIs in our experiments.

Hyperspectral image classification is an important topic in the field of remote sensing. However, the high dimensionality and high spatial-spectral correlation of hyperspectral image will easily lead to poor classification performance due to the Hughes phenomenon. In this paper, we proposed a adaptive group local Riemannian embedding, called AGLRE, to extract the spatial and spectral features from hyperspectral image. It firstly mapped original data into a Riemannian manifold by constructing region covariance matrices for each pixel of hyperspectral image. And the multiple local tangent space on Riemannian manifold were learned by adaptive neighbourhood strategy. Lastly, the local linear embedding was applied to reduce the dimensionality and merge multiple tangent space into a global coordinate. Experimental results on public hyperspectral data set showed that the proposed method can achieve higher classification performance than other competing algorithms.

Class incremental learning with analytic learning for hyperspectral image classification

The vision transformer (ViT) has become a hot topic in image processing due to its global feature extraction capabilities. However, the ViT suffers from over-smoothing in feature extraction and over-fitting in the training procedure, so it is hard to achieve satisfactory performance in hyperspectral image (HSI) classification. To address these issues, we propose a ViT with contrastive learning (CViT). The network architecture includes a patch embedding module, transformer blocks, and a classifier. The training of CViT can be considered as an optimization problem with a supervised contrastive loss, an unsupervised contrastive loss, and an ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> -regularizer with respect to linear self-attention weights. Specifically, the supervised contrastive loss is proposed to alleviate the negative effects of HSI features’ spectral variability and spatial diversity by increasing intra-class consistency. On the other hand, the unsupervised contrastive loss is exploited to reduce redundancy by reconstructing global structural information. In particular, regularized linear self-attention weights reduce the over-smoothing issue. Extensive experimental results on three HSI datasets demonstrate that the proposed CViT achieves competitive performance.

Due to a lack of labeled samples, deep learning methods generally tend to have poor classification performance in practical applications. Few-shot learning (FSL), as an emerging learning paradigm, has been widely utilized in hyperspectral image (HSI) classification with limited labeled samples. However, the existing FSL methods generally ignore the domain shift problem in cross-domain scenes and rarely explore the associations between samples in the source and target domain. To tackle the above issues, a graph-based domain adaptation FSL (GDAFSL) method is proposed for HSI classification with limited training samples, which utilizes the graph method to guide the domain adaptation learning process in a uniformed framework. First, a novel deep residual hybrid attention network (DRHAN) is designed to extract discriminative embedded features efficiently for few-shot HSI classification. Then, a graph-based domain adaptation network (GDAN), which combines graph construction with domain adversarial strategy, is proposed to fully explore the domain correlation between source and target embedded features. By utilizing the fully explored domain correlations to guide the domain adaptation process, a domain invariant feature metric space is learned for few-shot HSI classification. Comprehensive experimental results conducted on three public HSI datasets demonstrate that GDAFSL is superior to the state-of-the-art with a small sample size.

Variations in atmosphere, lighting, and imaging systems result in diverse category distributions in hyperspectral imagery, impacting the accuracy of cross-domain hyperspectral image classification (HSIC). Unsupervised domain adaptation (UDA) aims to address this issue by learning a model that generalizes effectively across domains, leveraging labels only from source domain (SD). Most existing UDA methods focus on aligning distributions between domains without fully considering the valuable information within individual domains. To fill this gap, this letter proposes a domain-collaborative contrastive learning (DCCL) method. DCCL integrates a novel pseudo-labeling strategy with a cross-domain contrastive learning (CL) framework. Specifically, in the pseudo-labeling phase, the confident examples in target domain (TD) are collaboratively labeled according to the labeled examples in SD and the class centers in TD. Then, the CL phase simultaneously minimizes in-domain and cross-domain contrastive loss to promote the aggregation of examples from the same category in both domains. Experimental results demonstrate that the DCCL achieves the accuracy rates of 93.47% and 54.59% on Pavia and Indiana datasets, respectively, surpassing the performance of other state-of-the-art UDA methods. Our source code is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/Leap-luohaiyang/DCCL-2024</uri>.

Multiclass feature learning for hyperspectral image classification: Sparse and hierarchical solutions

In this work, we propose a new semisupervised active learning approach for hyperspectral image classification. The proposed method aims at improving machine generalization by using pseudolabeled samples, both confident and informative, which are automatically and actively selected, via semisupervised learning. The learning is performed under two assumptions: a local one for the labeling via a superpixel-based constraint dedicated to the spatial homogeneity and adaptivity into the pseudolabels, and a global one modeling the data density by a multinomial logistic regressor with a Markov random field regularizer. Furthermore, we propose a density-peak-based augmentation strategy for pseudolabels, due to the fact that the samples without manual labels in their superpixel neighborhoods are out of reach for the automatic sampling. Three real hyperspectral datasets were used in our experiments to evaluate the effectiveness of the proposed superpixel-based semisupervised learning approach. The obtained results indicate that the proposed approach can greatly improve the potential for semisupervised learning in hyperspectral image classification.

Despite the rapid development of deep learning in hyperspectral image classification (HSIC), most models require a large amount of labeled data, which are both time-consuming and laborious to obtain. However, contrastive learning can extract spatial–spectral features from samples without labels, which helps to solve the above problem. Our focus is on optimizing the contrastive learning process and improving feature extraction from all samples. In this study, we propose the Unlocking-the-Potential-of-Data-Augmentation (UPDA) strategy, which involves adding superior data augmentation methods to enhance the representation of features extracted by contrastive learning. Specifically, we introduce three augmentation methods—band erasure, gradient mask, and random occlusion—to the Bootstrap-Your-Own-Latent (BYOL) structure. Our experimental results demonstrate that our method can effectively improve feature representation and thus improve classification accuracy. Additionally, we conduct ablation experiments to explore the effectiveness of different data augmentation methods.

Few-shot learning (FSL) has achieved promising performance in hyperspectral image classification (HSIC) with few labeled samples by designing a proper embedding feature extractor. However, the performance of embedding feature extractors relies on the design of efficient deep convolutional neural network architectures, which heavily depends on the expertise knowledge. Particularly, FSL requires extracting discriminative features effectively across different domains, which makes the construction even more challenging. In this paper, we propose a novel neural architecture search-based FSL model for HSI classification, called HCFSL-NAS. Three novel strategies are proposed in this work. First, a neural architecture search-based embedding feature extractor is developed to the FSL in HSIC, whose search space includes a group of proposed multi-scale convolutions with channel attention. Second, a multi-source learning framework is employed to aggregate abundant heterogeneous and homogeneous source data, which enables the powerful generalization of network to the HSIC with only few labeled samples. Finally, the pointwise-based cross-entropy loss and the pairwise-based adaptive sparse loss are jointly optimized to maximize inter-class distance and minimize the distance within a class simultaneously. Experimental results on four publicly hyperspectral data sets demonstrate that HCFSL-NAS outperforms both the exiting FSL methods and supervised learning methods for HSI classification with only few labeled samples. Code is available at: https://github.com/xh-captain/HCFSL-NAS.

Graph knowledge distillation-guided few-shot learning for hyperspectral image classification

Convolutional neural networks (CNNs) are becoming increasingly popular in modern remote sensing image processing tasks and exhibit outstanding capability for hyperspectral image (HSI) classification. However, for the existing CNN-based HSI-classification methods, most of them only consider single-scale feature extraction, which may neglect some important fine information and cannot guarantee to capture optimal spatial features. Moreover, many state-of-the-art methods have a huge number of network parameters needed to be tuned, which will cause high computational cost. To address the aforementioned two issues, a novel multiscale residual network (MSRN) is proposed for HSI classification. Specifically, the proposed MSRN introduces depthwise separable convolution (DSC) and replaces the ordinary depthwise convolution in DSC with mixed depthwise convolution (MDConv), which mixes up multiple kernel sizes in a single depthwise convolution operation. The DSC with mixed depthwise convolution (MDSConv) can not only explore features at different scales from each feature map but also greatly reduce learnable parameters in the network. In addition, a multiscale residual block (MRB) is designed by replacing the convolutional layer in an ordinary residual block with the MDSConv layer. The MRB is used as the major unit of the proposed MSRN. Furthermore, to enhance further the feature representation ability, the proposed network adds a high-level shortcut connection (HSC) on the cascaded two MRBs to aggregate lower level features and higher level features. Experimental results on three benchmark HSIs demonstrate the superiority of the proposed MSRN method over several state-of-the-art methods.

AN ASSESSMENT OF SPATIAL VARIATION OF LAND SURFACE CHARACTERISTICS OF MINNA, NIGER STATE NIGERIA FOR SUSTAINABLE URBANIZATION USING GEOSPATIAL TECHNIQUES

Hyperspectral Image (HSI) classification plays a key role remote sensing field. Recently, deep learning has demonstrated its effectiveness in HSI Classification field. This paper presents a spectral-spatial HSI classification technique established on the deep learning based deep belief network (DBN) for deep and abstract feature extraction and adaptive boundary adjustment based segmentation. Proposed approach focuses on integrating the deep learning based spectral features and segmentation based spatial features into a framework for improved performance. Specifically, first the deep DBN model is exploited as a spectral feature extraction based classifier to extract the deep spectral features. Second, spatial contextual features are obtained by utilizing effective adaptive boundary adjustment based segmentation technique. Finally, maximum voting based criteria is operated to integrate the results of extracted spectral and spatial information for improved HSI classification. In general, exploiting spectral features from DBN process and spatial features from segmentation and integration of spectral and spatial information by maximum voting based criteria, has a substantial effect on the performance of HSI classification. Experimental performance on real and widely used hyperspectral data sets with different contexts and resolutions demonstrates the accuracy of the proposed technique and performance is comparable to several recently proposed HSI classification techniques.