Spectral–Spatial Hyperspectral Image Classification Using $\ell_{1/2}$ Regularized Low-Rank Representation and Sparse Representation-Based Graph Cuts

A new method for supervised hyperspectral data classification is proposed. In particular, the notion of Stochastic Minimum Spanning Forests (MSFs) is introduced. For a given hyper-spectral image, a pixelwise classification is first performed. From this classification map, M marker maps are generated by randomly selecting pixels and labeling them as markers for the construction of MSFs. The next step consists in building an MSF from each of the M marker maps. Finally, all the M realizations are aggregated with a maximum vote decision rule, resulting in a final classification map. The experimental results presented on an AVIRIS image of the vegetation area show that the proposed approach yields accurate classification maps, and thus is attractive for hyperspectral data analysis.

Hyperspectral Image (HSI) classification is one of the most pervasive issue in hyperspectral remote sensing field. Deep learning is an efficient learning algorithm that has been recently applied to HSI classification. This paper proposes a new spectralspatial HSI classification method based on the deep features extraction using stacked-auto-encoders (SAE) and unsupervised HIS segmentation. Specifically, first the SAE model is exploited as a classical spectral information-based classifier to extract the deep features. Second, spatial dominated information is extracted by using effective boundary adjustment based segmentation technique. Finally, maximum voting criteria is used to merge the extracted spectral and spatial features, which results into the accurate spectral-spatial HSI classification. Experimental results with widely-used hyperspectral data confirms that the new spectral and spatial classification approach is able to improve results significantly in terms of classification accuracies.

Spectral-spatial classification of hyperspectral image based on discriminant sparsity preserving embedding

Recently, the superpixel segmentation is introduced into the hyperspectral image (HSI) classification to exploit the spatial information. However, the size of superpixel is hard to determine since small superpixels lack enough spatial information and large superpixels usually result in error segmentation. Therefore, a multiscale superpixels based sparse representation (MSSR) algorithm is proposed to utilize the spatial-spectral information of multiscale superpixels for the HSI classification. Specifically, multiscale superpixels of a HSI are generated firstly. Then, the joint sparse representation classification (JSRC) is used to obtain the class labels of superpixels of different scales. Finally, the majority voting is applied on the labels of different scales to create the final class label for each pixel. Experimental results show that the proposed MSSR algorithm outperforms several well-known classification algorithms.

Hyperspectral Image (HSI) classification plays a key role remote sensing field. Recently, deep learning has demonstrated its effectiveness in HSI Classification field. This paper presents a spectral-spatial HSI classification technique established on the deep learning based deep belief network (DBN) for deep and abstract feature extraction and adaptive boundary adjustment based segmentation. Proposed approach focuses on integrating the deep learning based spectral features and segmentation based spatial features into a framework for improved performance. Specifically, first the deep DBN model is exploited as a spectral feature extraction based classifier to extract the deep spectral features. Second, spatial contextual features are obtained by utilizing effective adaptive boundary adjustment based segmentation technique. Finally, maximum voting based criteria is operated to integrate the results of extracted spectral and spatial information for improved HSI classification. In general, exploiting spectral features from DBN process and spatial features from segmentation and integration of spectral and spatial information by maximum voting based criteria, has a substantial effect on the performance of HSI classification. Experimental performance on real and widely used hyperspectral data sets with different contexts and resolutions demonstrates the accuracy of the proposed technique and performance is comparable to several recently proposed HSI classification techniques.

A spectral-spatial hyperspectral image classification is proposed in this paper. The proposed method has two main contributions. 1- It removes the useless spatial information such as noise and distortions by applying the proposed smoothing filter. 2- It adds useful spatial information such as shape and size of objects presented in scene image by applying morphological filters. Moreover, the proposed method copes with the small sample size problem by partitioning the hyperspectral image into several subsets of adjacent bands. Experimental results show that the proposed method is able to obtain higher classification accuracy compared to some state-of-the-art spectral-spatial classification methods.

In this paper, a novel approach is proposed for the spectral-spatial classification of hyperspectral images. The proposed classification approach is based on a novel filtering technique, here entitled as extended extinction profile (EEP). The proposed classification approach is applied on two well-known data sets: Pavia University and Indian Pines; and the obtained results have been compared with one of the strongest filtering approaches in the literature named extended attribute profile (EAP). Results confirm that the proposed approach is able to efficiently extract spatial information for the classification of hyperspectral images.

Recently, many spectral-special classification models have emerged one after another in the remote sensing community. These models aim to introduce the spatial information of the pixel to improve the accuracy of the class attribute of the pixel. However, for the spectral-spatial classification algorithms, not all pixels need to introduce the corresponding spatial information since the use of a large amount of spatial information has a costly time. To solve this problem, this paper proposes a robust dual-stage spatial embedding (RDSSE) model for spectral-spatial classification of hyperspectral image, which is composed of the following several main steps: First, an over-segmentation algorithm is employed to cluster original hyperspectral image into many superpixel blocks with shape adaptive characteristics. Then, we design a <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula> -peak criterion to fuse the spectral feature of pixels within and between superpixels. Next, a low time-consumption spectral classifier is introduced to conduct primary classification for a testing pixel to achieve the corresponding probability distribution. Specifically, the difference between the probability of the largest class and that of the second-largest class is served as class confidence. Finally, the predicted label of the low-confidence testing pixels is reclassified based on a high-accuracy spectral-spatial classification method. Experimental results on several real images illustrated that the proposed RDSSE method can obtain superior performance with respect to several competitive methods.

Convolutional neural networks (CNNs) have been widely used for hyperspectral image classification. As a common process, small cubes are first cropped from the hyperspectral image and then fed into CNNs to extract spectral and spatial features. It is well known that different spectral bands and spatial positions in the cubes have different discriminative abilities. If fully explored, this prior information will help improve the learning capacity of CNNs. Along this direction, we propose an attention-aided CNN model for spectral-spatial classification of hyperspectral images. Specifically, a spectral attention subnetwork and a spatial attention subnetwork are proposed for spectral and spatial classifications, respectively. Both of them are based on the traditional CNN model and incorporate attention modules to aid networks that focus on more discriminative channels or positions. In the final classification phase, the spectral classification result and the spatial classification result are combined together via an adaptively weighted summation method. To evaluate the effectiveness of the proposed model, we conduct experiments on three standard hyperspectral data sets. The experimental results show that the proposed model can achieve superior performance compared with several state-of-the-art CNN-related models.

We propose a new spectral-spatial method for hyperspectral image classification based on a graph cut. The classification task is formulated as an energy minimization problem on the graph of image pixels, and is solved by using the graph-cut α-expansion approach. The energy to optimize is computed as a sum of data and interaction energy terms, respectively. The data energy term is computed using the outputs of the probabilistic support vector machines classification. The second energy term, which expresses the interaction between spatially adjacent pixels, is computed by using dissimilarity measures between spectral vectors, such as vector norms, spectral angle mapper and spectral information divergence. Experimental results on hyperspectral images captured by the RO-SIS and the AVIRIS sensors reveal that the proposed method yields higher classification accuracies when compared to the recent state-of-the-art approaches.

SemanticFormer: Hyperspectral image classification via semantic transformer

Most hyperspectral image (HSI) classification methods assume that all classes in the test set are present during training. However, in real-world applications, acquiring labeled training samples is challenging. As a result, it is difficult for the training dataset to cover all possible land cover types, leading to the generalized zero-shot learning (GZSL) problem. Recently, vision-language models (VLMs) have provided rich semantic priors for land cover classes, offering promising potential for GZSL. However, two fundamental gaps hinder their application to HSI classification: the task paradigm gap, arising from the difference between image-level VLMs and the pixel-level HSI classification task; and the knowledge gap, due to the inconsistency between VLM features and HSI spectral–spatial representations. To bridge both gaps, a novel framework leveraging VLM semantic priors for GZSL in HSI classification is proposed, primarily using pseudo-labeling technique to provide knowledge for unseen classes. Specifically, a pseudo-label generation and enhancement module enables a paradigm transition from image-level understanding to pixel-level classification by incorporating HSI’s spatial information. A pseudo-label correction module then refines noisy labels using spectral cues to address the knowledge gap. Finally, a global learning strategy integrates pseudo-label distillation, supervised learning, and feature regularization to classify seen classes while enabling generalization to unseen ones. Experiments on benchmark HSI datasets demonstrate the proposed method’s superiority in generalized zero-shot classification. This work highlights the potential of VLMs in advancing HSI classification in practical applications.

We propose and investigate a complex hyperspectral image classification method with regard to the spatial proximity of pixels. Key feature of the method is that it uses common and relatively simple algorithms to attain high accuracy. The method combines the results of pixel-wise support vector machine classification and a set of contours derived from kmeans++ image clustering. To prevent redundant processing of similar data a principal component analysis is used. The method proposed enables the accuracy and speed of hyperspectral image classification to be enhanced.

Hyperspectral image (HSI) classification has attracted much attention and extensive research efforts over the past decade. Due to few labeled samples versus high dimensional features, it is a challenging problem in practice. Recently, combining the pixel spectral information and the spatial (neighborhood) information has been verified to be effective for HSI classification. In this paper, we introduce a novel method for HSI classification using set-to-set distance (SSD). Based on the assumption that neighbor pixels tend to belong to the same class with high probability, we model a test pixel and its neighbor pixels as a testing set (or a neighbor set) inspired by bilateral filtering. Meanwhile, the training pixels belong to the same class are modeled as a training set. Therefore, the classification is based on comparisons of sets distances. Experiments on a real HSI dataset show that our proposed method outperforms a number of existing state-of-the-art approaches.

Unmanned aerial vehicles (UAVs) provide a new research tool to obtain high spatial and temporal resolution imagery at a reduced cost. Rapid advances in miniature sensor technology are leading to greater potentials for ecological research. We demonstrate one of the first applications of UAV lidar and hyperspectral imagery and a fusion method for individual plant species identification and 3D characterization at submeter scales in south‐eastern Arizona, USA. The UAV lidar scanner characterized the individual vegetation canopy structure and bare ground elevation, whereas the hyperspectral sensor provided species‐specific spectral signatures for the dominant and target species at our study area in leaf‐on condition. We hypothesized that the fusion of the two different data sources would perform better than either data type alone in the arid and semi‐arid ecosystems with sparse vegetation. The fusion approach provides 84–89% overall accuracy (kappa values of 0.80–0.86) in target species classification at the canopy scale, leveraging a wide range of target spectral responses in the hyperspectral data and a high point density (50 points/m2) in the lidar data. In comparison, the hyperspectral image classification alone produced 72–76% overall accuracies (kappa values of 0.70 and 0.71). The UAV lidar‐derived digital elevation model (DEM) is also strongly correlated with manned airborne lidar‐derived DEM (R2 = 0.98 and 0.96), but was obtained at a lower cost. The lidar and hyperspectral data as well as the fusion method demonstrated here can be widely applied across a gradient of vegetation and topography to monitor and detect ecological changes at a local scale.