Hyperspectral Imagery Classification Based on Semi-Supervised Broad Learning System

Convolutional neural networks (CNNs) have been widely applied in hyperspectral imagery (HSI) classification. However, their classification performance might be limited by the scarcity of labeled data to be used for training and validation. In this paper, we propose a novel lightweight shuffled group convolutional neural network (abbreviated as SG-CNN) to achieve efficient training with a limited training dataset in HSI classification. SG-CNN consists of SG conv units that employ conventional and atrous convolution in different groups, followed by channel shuffle operation and shortcut connection. In this way, SG-CNNs have less trainable parameters, whilst they can still be accurately and efficiently trained with fewer labeled samples. Transfer learning between different HSI datasets is also applied on the SG-CNN to further improve the classification accuracy. To evaluate the effectiveness of SG-CNNs for HSI classification, experiments have been conducted on three public HSI datasets pretrained on HSIs from different sensors. SG-CNNs with different levels of complexity were tested, and their classification results were compared with fine-tuned ShuffleNet2, ResNeXt, and their original counterparts. The experimental results demonstrate that SG-CNNs can achieve competitive classification performance when the amount of labeled data for training is poor, as well as efficiently providing satisfying classification results.

Hyperspectral imagery has high spectral resolution, and spectrum of it has always been non-linear. The traditional classification methods cannot get better result when the number of samples is small. Combined with the theory of deep learning, a new semi-supervised method based on stacked autoencoders (SAE) is proposed for hyperspectral imagery classification. Firstly, with stacked autoencoders, a deep network model is constructed. Then, unsupervised pre-training is carried combined SOFTMAX classifier with unlabeled samples. Finally, fine-tuning the network model with small labeled samples, the SAE-based classifier can be got to learn implicit feature of spectrum of hyperspectral imagery and achieve classification of hyperspectral imagery. According to comparative experiments, the results indicate that the proposed method is effective to improve the hyperspectral imagery classification accuracy in case of small samples.

The paradigm shift brought by deep learning in land cover object classification in hyperspectral images (HSIs) is undeniable, particularly in addressing the intricate 3D cube structure inherent in HSI data. Leveraging convolutional neural networks (CNNs), despite their architectural constraints, offers a promising solution for precise spectral data classification. However, challenges persist in object classification in hyperspectral imagery or hyperspectral image classification, including the curse of dimensionality, data redundancy, overfitting, and computational costs. To tackle these hurdles, we introduce the spectrally segmented-enhanced neural network (SENN), a novel model integrating segmentation-based, multi-layer CNNs, SVM classification, and spectrally segmented dimensionality reduction. SENN adeptly integrates spectral–spatial data and is particularly crucial for agricultural land classification. By strategically fusing CNNs and support vector machines (SVMs), SENN enhances class differentiation while mitigating overfitting through dropout and early stopping techniques. Our contributions extend to effective dimensionality reduction, precise CNN-based classification, and enhanced performance via CNN-SVM fusion. SENN harnesses spectral information to surmount challenges in “hyperspectral image classification in hyperspectral imagery”, marking a significant advancement in accuracy and efficiency within this domain.

Hyperspectral imagery (HSI) classification is essential for remote sensing analysis, utilizing various image bands. Convolutional Neural Networks (CNNs) are prevalent in deep learning for visual data processing, with recent applications in HSI classification primarily employing 2D and 3D CNNs. However, 3D CNNs demand significant computational resources due to their complexity. This paper introduces a two-branch spatial-spectral joint convolutional neural network (SSDB) leveraging an attention mechanism for HSI classification. SSDB effectively extracts spectral and spatial information while reducing model complexity, resulting in a lightweight alternative to 3D CNNs. In this comprehensive hyperspectral image (HSI) classification experiments utilizing the Indian Pines, Pavia University, and Salinas Scene datasets, we benchmarked our findings against leading-edge handcrafted and end-to-end deep learning methodologies, demonstrating exceptionally commendable performance with the SSDB approach.

In this manuscript, we propose a sparse self-representation (SSR) method to select a band subset in hyperspectral imagery (HSI) classification. The SSR method improves from multiple measurement vectors (MMV) with the measurement matrix equals to the observation matrix. The SSR regards that each band could be represented as a linear combination of the representatives of all bands and accordingly all band vectors are reconstructed by themselves accompanied with a sparse coefficient matrix. The SSR finds the indices of nonzero rows of the coefficient matrix by convex optimization to help to estimate the band subset that are constituted with representatives. Preliminary classification results on two open HSI datasets show that the SSR offers comparable results to the linear constrained minimum variance-based band correlation constraint (LCMV-BCC) method, and achieves better results than the maximum-variance principal component analysis (MVPCA) and sparse based band selection (SPaBS) methods.

Band selection is an important step towards effective and efficient object classification in hyperspectral imagery. In this paper, we propose a semi-supervised learning method for band selection based on a sparse linear regression model. This model uses a least absolute shrinkage and selection operator to compute the regression coefficients from both labeled and unlabeled samples. These coefficients are then used to compute a contribution score for each band, which allows bands with high scores being selected for the testing step. During this process, unlabeled samples also contribute to the coefficients calculation. In order to propagate the labels to these samples, a hypergraph is first built to describe the relationship between labeled and unlabeled samples. This leads to an adjacency matrix whose entries are the sum of corresponding weights of hyperedges. Then matrix subspace learning method is used to estimate the labels of unlabeled samples. The proposed method is evaluated on the APHI dataset. Comparison with several baseline methods has shown the advantages of the proposed method on the pixel-level classification.

Feature extraction is known to be an effective way in both reducing computational complexity and increasing accuracy in hyperspectral imagery (HSI) classification. In this article, we propose a novel HSI feature extraction based on joint adaptive structure density (JASD), which can make full use of the texture feature of feature level and effectively utilize the spatial structure feature of pixel level. Specifically, the proposed JASD method considers two weak assumptions when exploiting the structure information contained in the HSI: 1) close pixels in spectral space have the same label and 2) all the pixels in a subregion belong to the same class. The JASD method consists of the following steps. First, a principal component analysis method is applied to the original high-dimensional HSI to obtain low-dimensional features in order to promote the separability of pixels between different classes and improve the execution efficiency of the proposed method. Then, the local density peak-assisted $k$ nearest neighbor idea is introduced into oversegmentation-based regions to define the structural spatial information of the HSI and overcome the aforementioned weak assumptions. Meanwhile, recursive filtering in the transform domain is applied to the above low-dimensional HSI to preserve global edge details. Next, the global edge details and the local spatial structure feature are fused based on the stacking method. Finally, the composite hyperspectral feature is fed into the supervised classifier to obtain the classification results. Experimental results on three widely used real HSI data sets demonstrated that the proposed JASD method is superior to several comparative classification methods in terms of classification accuracy and computational burden.

Different classification techniques are being designed and under usage for classification of hyper spectral images. The usage of these classifiers differ for different type of hyper spectral data and application domain. The performance of these classifiers are influenced by feature preprocessing stage. In this research work we have investigated the impact of feature preprocessing using Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA) on classification stage. The experiment is carried out using three sets of hyperspectral data. Classifications were carried out using three different classification techniques namely Maximum Likelihood Estimation (MLE), Constraint Energy Minimization (CEM) and Spectral Angle Mapper (SAM) on the preprocessed hyperspectral data. It is observed that the impact of PCA and LDA on the classification techniques are in two aspects (a) The preprocessing techniques facilitates to achieve high classification accuracy even with less number of training features and (b) Preprocessing expedites the classification process for large data sets. Also it can be concluded that PCA outperforms LDA in case of noisy data.

Hyperspectral imagery (HSI) is a remote sensing tool that precisely serves to define the classification of the regions. In fact, the coverage of several images of the ground truth, which provide relevant information, but some of them are influenced by atmospheric noise, and others contain a redundant information. To reduce the dimensionality of Hyperspectral Images, numerous studies using mutual information (MI) also the normalized Mutual information based heuristic to select the appropriate bands for the classification of HSI. Here we expect some methods present a filter strategy based on the measure of (MI), also there is wrapper strategies with error probability, the latter is more efficient than filter strategy, but more expensive. In this paper we will introduce a filter strategy with the error probability measure in order to have more precision in the selections bands with an optimal manner. This method can improve the filter strategy performance. The studies are conducted using HSI AVIRIC92AV3C.

This paper proposes a novel multiscale graph cut based analysis framework for the supervised classification of hyperspectral imagery. This framework is aimed at obtaining accurate and reliable maps by properly considering the spatial-context information. It is made up of two main blocks: 1) a feature-extraction block exploits an object-oriented analysis and representation of hyperspectral imagery that is obtained by multiscale graph cut (MGC) based segmentation; 2) a classifier, based on support vector machines (SVMs), capable of analyzing hyperdimensional feature spaces. Experimental results confirm the effectiveness of the proposed system for the analysis of hyperspectral imagery.

Significant advances in compressive sensing and sparse signal encoding have provided a rich set of mathematical tools for signal analysis and representation. In addition to novel formulations for enabling sparse solutions to underdetermined systems, exciting progress has taken place in efficiently solving these problems from an optimization theoretic viewpoint. The focus of the wide body of literature in compressive sensing/sparse signal representations has however been on the problem of signal recovery from a small number of measurements (equivalently a sparse coefficient vector). This tutorial will discuss the design of sparse signal representations explicitly for the purposes of signal classification. The tutorial will focus on and build upon two significant recent advances. First, the work by Wright et al. which advocates the use of a dictionary (or basis) matrix comprising of class-specific training sub-dictionaries. In this framework, a test signal is modeled as a sparse linear combination of training vectors in the dictionary, sparsity being enforced by the assertion that only coefficients corresponding to one class (from which the test signal is drawn) ought to be active. The second set of ideas we leverage are recent key contributions in model-based compressive sensing where prior information or constraints on sparse coefficients are used to enhance signal recovery. These ideas will be combined towards the exposition of current trends: namely the development of class-specific priors or constraints to capture structure on sparse coefficients that helps explicitly distinguish between signal classes. In the second part of the tutorial, applications will be discussed including: 1.) structured sparsity for classification of medical imagery for diagnostics, 2.) low-rank approximation and sparse recovery for visual data reconstruction, and 3.) sparse representations for target detection and classification in hyperspectral imagery (guest speaker from the US Army Research Lab).

Conventional remote sensing classification techniques that model the data in each class with a multivariate Gaussian distribution are inefficient, as this assumption is generally not valid in practice. We present a novel, independent component analysis (ICA) based approach for unsupervised classification of hyperspectral imagery. ICA, employed for a mixture model, estimates the data density in each class and models class distributions with nonGaussian structure, formulating the ICA mixture model (ICAMM). We apply the ICAMM for unsupervised classification of a test image from the AVIRIS sensor. Four feature extraction techniques namely principal component analysis, segmented principal component analysis, orthogonal subspace projection and projection pursuit have been considered as preprocessing steps for reducing the data dimensionality. The results demonstrate that the ICAMM significantly outperforms the K-means algorithm for land cover classification of hyperspectral imagery implemented on reduced data sets. Moreover, datasets extracted using segmented principal component analysis produce the highest classification accuracy.

Least squares unmixing methods are widely used to solve linear mixture problems for endmember abundance estimation in hyperspectral imagery. In this paper, a weighted least squares method is introduced as a generalization. When different weight matrix is used, a certain detector or classifier will be resulted. For accurate abundance fraction estimation, a constrained weighted least squares approach is developed by combining sum-to-one and nonnegativity constraints. The experimental results show that when a meaningful weight matrix is applied as a data pre-processing operator, the weighted least squares method will outperform ordinary least squares solution and the constrained methods will outperform unconstrained ones.

This paper aims to improve the accuracy and the efficiency of high resolution land cover mapping in urban area. To this end, an improved approach for classification of hyperspectral imagery is proposed and evaluated. This approach benefits from both inherent spectral and spatial information of an image. The weighted genetic (WG) algorithm is first used to obtain the subspace of hyperspectral data. The obtained features are then fed into the enhanced marker-based minimum spanning forest (EMSF) classification algorithm. In this algorithm, the markers are extracted from the classification maps obtained by both support vector machine and watershed segmentation algorithm classifiers. For this purpose, the class’s pixels with the largest population in the classification map are kept for each region of the segmentation map. Then, the most reliable classified pixels are chosen from among the exiting pixels as markers. To evaluate the efficiency of the proposed approach, three hyperspectral data sets acquired by ROSIS-03, Hymap and Hyper-Cam LWIR are used. Experimental results showed that the proposed WG–EMSF approach achieves approximately 9, 8 and 6% better overall accuracy than the original MSF-based algorithm for these data sets respectively.

High dimensionality of hyperspectral data and relatively limited training samples induce the Hughes phenomenon in hyperspectral image classification. To prevent this problem and decrease the computational cost, feature extraction often acts as pre-processing. In this paper, a subspace weighting kernel method combining clustering-based grouping is proposed for feature extraction in hyperspectral imagery classification. In the proposed method, spectral bands of hyperspectral data are firstly grouped into subspaces and a subspace-modulated kernel principal component analysis (SM-KPCA) is given for feature extraction, where the modulated kernel is determined by classification-oriented schemes. Support vector machine (SVM) classifier is performed on the extracted features to validate the performance. Experiments are conducted on real data and the results prove that the proposed SM-KPCA is effective on feature extraction for improving the accuracy of hyperspectral classification.