Multiclass feature learning for hyperspectral image classification: Sparse and hierarchical solutions

AN ASSESSMENT OF SPATIAL VARIATION OF LAND SURFACE CHARACTERISTICS OF MINNA, NIGER STATE NIGERIA FOR SUSTAINABLE URBANIZATION USING GEOSPATIAL TECHNIQUES

Hyperspectral image (HSI) classification has become a hot topic in the field of remote sensing. In general, the complex characteristics of hyperspectral data make the accurate classification of such data challenging for traditional machine learning methods. In addition, hyperspectral imaging often deals with an inherently nonlinear relation between the captured spectral information and the corresponding materials. In recent years, deep learning has been recognized as a powerful feature-extraction tool to effectively address nonlinear problems and widely used in a number of image processing tasks. Motivated by those successful applications, deep learning has also been introduced to classify HSIs and demonstrated good performance. This survey paper presents a systematic review of deep learning-based HSI classification literatures and compares several strategies for this topic. Specifically, we first summarize the main challenges of HSI classification which cannot be effectively overcome by traditional machine learning methods, and also introduce the advantages of deep learning to handle these problems. Then, we build a framework that divides the corresponding works into spectral-feature networks, spatial-feature networks, and spectral-spatial-feature networks to systematically review the recent achievements in deep learning-based HSI classification. In addition, considering the fact that available training samples in the remote sensing field are usually very limited and training deep networks require a large number of samples, we include some strategies to improve classification performance, which can provide some guidelines for future studies on this topic. Finally, several representative deep learning-based classification methods are conducted on real HSIs in our experiments.

Few-shot learning (FSL) uses prior knowledge and supervised experience to effectively classify hyperspectral images (HSIs), thereby reducing the cost of large numbers of labeled samples. However, existing few-shot methods ignore the correlation between cross-domain feature channels, and the feature representation ability is insufficient. To address above issue, this paper proposes a novel Residual Channel Attention Based Sample Adaptation Few-Shot Learning for Hyperspectral Image Classification(RCASA-FSL) for hyperspectral image classification (HSIC), which can capture and enhance cross-domain dependencies through multi-layer residual connection and random-based feature recalibration. Specifically, a Deep Residual Feature Channel Attention Mechanism (DRFCAM) is designed to obtain cross-domain dependencies by residual concatenation, and further the residual structure is stacked for mining depth discrimination information. Furthermore, a new Random-based Feature Recalibration Module (RFRM) is proposed to reassign the feature weights via random matrix, which fully explore feature weight relationships to guide the sample adaptation process. Besides, we design a joint loss function with combining the FSL loss and domain adaptive loss for further optimization model. Experiments conducted on several standard hyperspectral datasets demonstrate that the proposed RCASA-FSL is superior to other FSL techniques in both quantitative and qualitative aspects.

Convolutional neural networks (CNNs), a kind of feedforward neural network with a deep structure, are one of the representative methods in hyperspectral image (HSI) classification. However, redundant information and interclass interference are common and challenging problems in HSI classification. In addition, if the spectral and spatial information is not properly extracted and analyzed, it will affect the classification performance of the network to a great extent. Aiming at these issues, this article proposes an HSI classification method based on an adaptive hash attention mechanism and a lower triangular network (AHA-LT). First, the attention mechanism is introduced in the preprocessing stage, which is composed of the spectral attention module and the adaptive hash spatial attention module in series. Then, the data processed by the attention mechanism are introduced into the lower triangular network (LTNet) to obtain the fused high-dimensional semantic features. Finally, we compress the features and obtain the output classification results through several fully connected layers. Among them, LTNet is composed of 2-D–3-D CNN and multiscale features. The network integrates the characteristics of multibranch, feature fusion, feature compression, and skip connections. Extensive experiments on four widely used HSI data sets show that the proposed method can obtain a great improvement in performance compared with the existing methods.

Deep learning methods, especially convolutional neural networks(CNN), have been widely used in hyperspectral image(HSI) classification. Recently, graph convolutional networks (GCN) have shown great potential in HSI classification problem. However, the existing GCN-based methods have several problems. First, the existing methods rely too much on the adjacency matrix, which cannot be changed during training. Furthermore, most of them can only use a single kind of feature, and fail to extract the spectral-spatial information from the HSI. Finally, for the existing GCN-based methods, it is difficult to achieve the same accuracy as the mature CNN methods. In this paper, we propose a spectral-spatial hypergraph convolutional neural network (S²HCN) for HSI classification. Compared with the existing GCN-based methods, S²HCN has the following advantages. Different from the adjacency matrix that is fixed during training of GCN, S²HCN can dynamically update the weight of the hyperedge during training, which reduces the reliance on prior information to a certain extent. In addition, S²HCN generates hyperedges from the spectral and spatial features independently, and adopts the incidence matrix composed of all hyperedges to replace the adjacency matrix in GCN. In this way, the spectral and spatial features can be better integrated. Finally, compared to a simple graph structure, the hypergraph structure can express the high-dimensional relationships in the data, which is beneficial to classification problems. Sufficient experiments on two popular HSI datasets have proved the effectiveness of S²HCN.

Class incremental learning with analytic learning for hyperspectral image classification

Variations in atmosphere, lighting, and imaging systems result in diverse category distributions in hyperspectral imagery, impacting the accuracy of cross-domain hyperspectral image classification (HSIC). Unsupervised domain adaptation (UDA) aims to address this issue by learning a model that generalizes effectively across domains, leveraging labels only from source domain (SD). Most existing UDA methods focus on aligning distributions between domains without fully considering the valuable information within individual domains. To fill this gap, this letter proposes a domain-collaborative contrastive learning (DCCL) method. DCCL integrates a novel pseudo-labeling strategy with a cross-domain contrastive learning (CL) framework. Specifically, in the pseudo-labeling phase, the confident examples in target domain (TD) are collaboratively labeled according to the labeled examples in SD and the class centers in TD. Then, the CL phase simultaneously minimizes in-domain and cross-domain contrastive loss to promote the aggregation of examples from the same category in both domains. Experimental results demonstrate that the DCCL achieves the accuracy rates of 93.47% and 54.59% on Pavia and Indiana datasets, respectively, surpassing the performance of other state-of-the-art UDA methods. Our source code is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/Leap-luohaiyang/DCCL-2024</uri>.

In this work, we propose a new semisupervised active learning approach for hyperspectral image classification. The proposed method aims at improving machine generalization by using pseudolabeled samples, both confident and informative, which are automatically and actively selected, via semisupervised learning. The learning is performed under two assumptions: a local one for the labeling via a superpixel-based constraint dedicated to the spatial homogeneity and adaptivity into the pseudolabels, and a global one modeling the data density by a multinomial logistic regressor with a Markov random field regularizer. Furthermore, we propose a density-peak-based augmentation strategy for pseudolabels, due to the fact that the samples without manual labels in their superpixel neighborhoods are out of reach for the automatic sampling. Three real hyperspectral datasets were used in our experiments to evaluate the effectiveness of the proposed superpixel-based semisupervised learning approach. The obtained results indicate that the proposed approach can greatly improve the potential for semisupervised learning in hyperspectral image classification.

The vision transformer (ViT) has become a hot topic in image processing due to its global feature extraction capabilities. However, the ViT suffers from over-smoothing in feature extraction and over-fitting in the training procedure, so it is hard to achieve satisfactory performance in hyperspectral image (HSI) classification. To address these issues, we propose a ViT with contrastive learning (CViT). The network architecture includes a patch embedding module, transformer blocks, and a classifier. The training of CViT can be considered as an optimization problem with a supervised contrastive loss, an unsupervised contrastive loss, and an ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sub> -regularizer with respect to linear self-attention weights. Specifically, the supervised contrastive loss is proposed to alleviate the negative effects of HSI features’ spectral variability and spatial diversity by increasing intra-class consistency. On the other hand, the unsupervised contrastive loss is exploited to reduce redundancy by reconstructing global structural information. In particular, regularized linear self-attention weights reduce the over-smoothing issue. Extensive experimental results on three HSI datasets demonstrate that the proposed CViT achieves competitive performance.

Despite the rapid development of deep learning in hyperspectral image classification (HSIC), most models require a large amount of labeled data, which are both time-consuming and laborious to obtain. However, contrastive learning can extract spatial–spectral features from samples without labels, which helps to solve the above problem. Our focus is on optimizing the contrastive learning process and improving feature extraction from all samples. In this study, we propose the Unlocking-the-Potential-of-Data-Augmentation (UPDA) strategy, which involves adding superior data augmentation methods to enhance the representation of features extracted by contrastive learning. Specifically, we introduce three augmentation methods—band erasure, gradient mask, and random occlusion—to the Bootstrap-Your-Own-Latent (BYOL) structure. Our experimental results demonstrate that our method can effectively improve feature representation and thus improve classification accuracy. Additionally, we conduct ablation experiments to explore the effectiveness of different data augmentation methods.

Hyperspectral image classification is an important topic in the field of remote sensing. However, the high dimensionality and high spatial-spectral correlation of hyperspectral image will easily lead to poor classification performance due to the Hughes phenomenon. In this paper, we proposed a adaptive group local Riemannian embedding, called AGLRE, to extract the spatial and spectral features from hyperspectral image. It firstly mapped original data into a Riemannian manifold by constructing region covariance matrices for each pixel of hyperspectral image. And the multiple local tangent space on Riemannian manifold were learned by adaptive neighbourhood strategy. Lastly, the local linear embedding was applied to reduce the dimensionality and merge multiple tangent space into a global coordinate. Experimental results on public hyperspectral data set showed that the proposed method can achieve higher classification performance than other competing algorithms.

In Hyperspectral Image (HSI) classification, acquiring large quantities of high-quality labeled samples is typically costly and impractical. Traditional deep learning methods are limited in such scenarios due to their dependence on sample quantities. To address this challenge, researchers have turned to Few-Shot Learning (FSL). Although existing FSL methods improve classification performance by enhancing domain invariance through domain adaptation, they often overlook the critical issue of high inter-class similarity and large intra-class variability. Moreover, during domain alignment, features of different categories within the same domain may become confused. To address these issues, this paper proposes a novel Domain-Invariant Few-Shot Contrastive Learning (DIFSCL) method, which combines domain adaptation and contrastive learning strategies to not only learn domain-invariant features but also significantly enhance inter-class discriminability. Based on this, we further design a multi-scale adaptive attention mechanism for a hyperspectral feature extraction network to more effectively extract and optimize generalized features within the DIFSCL framework, significantly improving intra-class consistency and inter-class discriminative capability of features. Experimental results on three widely used HSI datasets demonstrate that our method significantly outperforms existing techniques in few-shot classification tasks.

For hyperspectral image classification, feature extraction is a crucial pre-process for avoiding the Hughes phenomena. Some feature extraction methods such as linear discriminant analysis (LDA), nonparametric weighted feature extraction (NWFE), and their kernel versions, generalized discriminant analysis (GDA) and kernel nonparametric weighted feature extraction method (KNWFE) have been shown that they can improve the classification performance. However, for GDA and KNWFE, it is hard to find the suitable kernel parameters. Hence, although they have been published about 14 or 6 years, respectively, researchers rarely implement them for dealing with hyperspectral image classification problem. An automatic kernel parameter selection method (APS) was proposed to predetermine the appropriate radial basis function (RBF) kernel for support vector machine (SVM) and GDA. In this study, APS was applied to find the suitable RBF kernel function for KNWFE. From the experiment results on PAVIA data set, the classification performance of KNWFE still outperforms those of GDA [10] and SVM [10]. The most important of this research, the kernel parameters of GDA and KNWFE based on RBF kernel can be “automatically” determined and the researcher can implement them directly without tuning the kernel parameter.

Hyperspectral image (HSI) classification has become one of the most significant tasks in the field of hyperspectral analysis. However, classifying each pixel in HSI accurately is challenging due to the curse of dimensionality and limited training samples. In this paper, we present an HSI classification architecture called camera spectral response network (CSR-Net), which can learn the optimal camera spectral response (CSR) function for HSI classification problems and effectively reduce the spectral dimensions of HSI. Specifically, we design a convolutional layer to simulate the capturing process of cameras, which learns the optimal CSR function for HSI classification. Then, spectral and spatial features are further extracted by spectral and spatial attention modules. On one hand, the learned CSR can be implemented physically and directly used to capture scenes, which makes the image acquisition process more convenient. On the other hand, compared with ordinary HSIs, we only need images with far fewer bands, without sacrificing the classification precision and avoiding the curse of dimensionality. The experimental results of four popular public hyperspectral datasets show that our method, with only a few image bands, outperforms state-of-the-art HSI classification methods which utilize the full spectral bands of images.

Active learning can effectively reduce labelling effort for remote sensing image classification. In this paper, we propose a new active learning method for hyperspectral image classification. We consider batch mode active learning and relatively large amount of data which can be a problem when using current state of the art algorithm based on kernel machines. The active learning procedure is based on the uncertainty sampling strategy and a deep neural network. Stacked autoencoders trained on redundant spatial and spectral features and a few labeled training samples are used to initialize a deep neural network. Uncertainty for a given sample is measured by the difference between the largest two class outputs of the neural network. The less difference there is, the more uncertainty the sample has. Batch of samples with most uncertainty will be selected after label query and added into the training set. Then the neural network is retrained. And such active batch selection will iterate until the budget (the upper limit of label queries) is reached. Experimental results on Pavia university dataset showed that our method outperforms the current support vector machines (SVMs) based multiclass/level uncertainty (MCLU) method both in classification accuracy and generalization capability.