DRGCN: Dual Residual Graph Convolutional Network for Hyperspectral Image Classification

Fuzzy graph convolutional network for hyperspectral image classification

Dual selective fusion transformer network for hyperspectral image classification.

Although graph convolutional network (GCN) has achieved remarkable success in hyperspectral image (HSI) classification, most existing GCN-based approaches have failed to realize a deep network structure due to the oversmoothing problem. This problem largely limits the expression ability and feature extraction ability of GCN and hampers GCN's capacity to model long-range relationships between samples in hyperspectral (HS) scenes. Moreover, there is a lack of theoretical analysis in those works that constructed deep GCN for HSI classification to illustrate how they overcome the oversmoothing problem. Aside from this, the characteristics and complexity of HSI are often neglected when constructing deep GCN models in HSI classification. To address these problems, a novel deep graph network based on first-order smoothing is proposed for HSI classification. Specifically, a local and global topologically consistent graph is constructed to thoroughly explore the union between fine pixel information and semantic superpixel information. Subsequently, a novel propagation procedure is proposed to address the oversmoothing problem. We creatively build a residual connection to the first layer to emphasize the feature information aggregated from the first-order neighborhood, which adds node features that have not yet become indistinguishable into deep layer, and at the same time, it can be considered as a correction to the original pixels affected by spectral variation in the input graph. Finally, we demonstrate how first-order smoothing-based deep graph network (FSDGN) can slow down the convergence rate of the oversmoothing problem by analyzing the propagation of FSDGN from the standpoint of the Laplacian spectral domain. In addition, the results of experiments performed on three benchmark datasets demonstrate its superiority over other state-of-the-art methods.

Recently, deep learning methods, for example, convolutional neural networks (CNNs), have achieved high performance in hyperspectral image (HSI) classification. The limited training samples of HSI images make it hard to use deep learning methods with many layers and a large number of convolutional kernels as in large scale imagery tasks, and CNN-based methods usually need long training time. In this paper, we present a wide sliding window and subsampling network (WSWS Net) for HSI classification. It is based on layers of transform kernels with sliding windows and subsampling (WSWS). It can be extended in the wide direction to learn both spatial and spectral features more efficiently. The learned features are subsampled to reduce computational loads and to reduce memorization. Thus, layers of WSWS can learn higher level spatial and spectral features efficiently, and the proposed network can be trained easily by only computing linear weights with least squares. The experimental results show that the WSWS Net achieves excellent performance with different hyperspectral remotes sensing datasets compared with other shallow and deep learning methods. The effects of ratio of training samples, the sizes of image patches, and the visualization of features in WSWS layers are presented.

Although most deep learning-based methods have achieved excellent performance for hyperspectral image (HSI) classification, they are often limited by complex networks and require massive training samples in practical applications. Therefore, designing an efficient, lightweight model to obtain better classification results under small samples situations remains a challenging task. To alleviate this problem, a novel, lightweight parallel octave convolutional neural network (LPOCNN) for HSI classification is proposed in this paper. First, the HSI data is preprocessed to construct two three-dimensional (3D) patch cubes with different spatial and spectral scales for each central pixel, removing redundancy and focusing on extracting spatial features and spectral features, respectively. Next, two non- deep parallel branches are created for the two inputs, which design octave convolution rather than classical 3D convolution to facilitate light weighting of the model. Then two-dimensional convolutional neural network is used to extract deeper spectral-spatial features when fusing spectral-spatial features from different parallel layers. Moreover, the spectral-spatial attention is designed to promote the classification performance even further by adaptively adjusting the weights of different spectral-spatial features according to their contribution to classification. Experiments show that our suggested LPOCNN acquires a significant advantage on classification performance over other competitive methods under small sample situations.

Traditional hyperspectral image (HSI) classification methods mainly include machine learning and convolutional neural network. However, they extremely depend on the large training samples. To obtain high accuracy on limited training samples, we propose a novel end-to-end spectral-spatial multi-scale network (SSMSN) for HSI classification. The SSMSN uses the multi-scale spectral module and the multi-scale spatial module to extract discriminative multi-scale spectral and multi-scale spatial features separately. In the multi-scale spectral module and spatial module, the multi-scale Res2Net block structure can learn multi-scale features at a granular level and increase the range of receptive fields by constructing the hierarchical residual-like connection within one single residual block. To alleviate the overfitting problem and further improve the classification accuracy on limited training samples, we adopt a simple but effective hinge cross-entropy loss function to train the SSMSN at the dynamic learning rate. A large number of experimental results demonstrate that on the Indiana Pines, University of Pavia, Kennedy Space Center, and Salinas Scene data sets, the proposed SSMSN achieves higher classification accuracy than state-of-the-art methods on limited training samples. Meanwhile, our SSMSN obtains less training and testing time than the popular AUSSC method.

In hyperspectral image (HSI) classification task, effectively deriving and incorporating spatial information into spectral features is one of a key focus as it can largely influence the performance. Markov random fields (MRFs) are generative and flexible image texture models, and capable of effectively extracting spatial neighbourhood information along multiple spectral wavebands in an unsupervised way. Its parameter estimation process also shares strong compatibility with deep architecture, especially the convolutional neural networks. In this work, we propose an MRF based spectral-spatial fusion network (SSFNet) for HSI classification. Spatial features are extracted using MRF models and further fused with spectral information. Then the proposed SSFNet takes the fused features as input and produces reliable classification results. Comprehensive experiments conducted on the Indian pines and the Pavia university datasets are reported to verify the proposed method.

Recently, convolutional neural networks (CNNs) have demonstrated impressive capabilities in the representation and classification of hyperspectral remote sensing images. Traditional CNNs require massive data to sufficiently train the network. To tackle this problem, graph convolutional network (GCN) has been introduced for hyperspectral image classification. GCN methods usually construct the graph from either spectral or spatial domain, which has not adequately explored the information in the joint spectral–spatial domain. In this article, we propose a superpixel spectral–spatial feature fusion graph convolution network for hyperspectral image classification (S3FGCN). S3FGCN can comprehensively use information in spectral, spatial, and spectral–spatial domains with limited data. Moreover, to enhance the performance, we explore a shared weights’ GCN in the spectral–spatial domain. To further improve the efficiency, superpixels are used to construct the adjacency matrix. Finally, dynamic sampling is adopted to make the model focus more on difficult samples. In the experiments on four datasets, S3FGCN demonstrates better accuracy compared with the state-of-the-art hyperspectral image classification methods.

ABSTRACTConvolutional neural network (CNN) for hyperspectral image classification can provide excellent performance when the number of labeled samples for training is sufficiently large. Unfortunately, a small number of labeled samples are available for training in hyperspectral images. In this letter, a novel semi-supervised convolutional neural network is proposed for the classification of hyperspectral image. The proposed network can automatically learn features from complex hyperspectral image data structures. Furthermore, skip connection parameters are added between the encoder layer and decoder layer in order to make the network suitable for semi-supervised learning. Semi-supervised method is adopted to solve the problem of limited labeled samples. Finally, the network is trained to simultaneously minimize the sum of supervised and unsupervised cost functions. The proposed network is conducted on a widely used hyperspectral image data. The experimental results demonstrate that the proposed approach provides competitive results to state-of-the-art methods.

Hyperspectral image (HSI) classification is fundamental to a wide range of remote sensing applications, such as precision agriculture, environmental monitoring, and urban planning, because HSIs provide rich spectral signatures that enable the discrimination of subtle material differences. Deep learning approaches, including Convolutional Neural Networks (CNNs), Graph Convolutional Networks (GCNs), and Transformers, have achieved strong performance in learning spatial–spectral representations. However, these models often face difficulties in jointly modeling long-range dependencies, fine-grained local structures, and non-Euclidean spatial relationships, particularly when labeled training data are scarce. This paper proposes a Spectral–Spatial Graph Transformer Network (SSGTN), a dual-branch architecture that integrates superpixel-based graph modeling with Transformer-based global reasoning. SSGTN consists of four key components, namely (1) an LDA-SLIC superpixel graph construction module that preserves discriminative spectral–spatial structures while reducing computational complexity, (2) a lightweight spectral denoising module based on 1×1 convolutions and batch normalization to suppress redundant and noisy bands, (3) a Spectral–Spatial Shift Module (SSSM) that enables efficient multi-scale feature fusion through channel-wise and spatial-wise shift operations, and (4) a dual-branch GCN-Transformer block that jointly models local graph topology and global spectral–spatial dependencies. Extensive experiments on three public HSI datasets (Indian Pines, WHU-Hi-LongKou, and Houston2018) under limited supervision (1% training samples) demonstrate that SSGTN consistently outperforms state-of-the-art CNN-, Transformer-, Mamba-, and GCN-based methods in overall accuracy, Average Accuracy, and the κ coefficient. The proposed framework provides an effective baseline for HSI classification under limited supervision and highlights the benefits of integrating graph-based structural priors with global contextual modeling.

Recently, hybrid networks, combining graph convolutional networks (GCNs) and convolutional neural networks (CNNs) into a unified framework, have garnered significant attention in hyperspectral image (HSI) classification. However, existing hybrid networks have the following limitations: 1) Existing methods primarily utilize simple fusion strategies such as concatenation or direct addition, resulting in the ineffective utilization of advantageous features. 2) Traditional GCNs only consider the relationship between pairs of vertices, limiting their ability to capture complex high-order and long-range correlations. In this work, a novel differential feature fusion network (DF2Net) is proposed for HSI classification. Specifically, DF2Net utilizes two subnetworks to learn features at different abstraction levels: the spectral-spatial hypergraph convolutional network (S2HGCN) for capturing complex high-order and long-range correlations, and the spectral-spatial convolution network (S2CN) for pixel-level local information extraction. Subsequently, we introduce an advantageous feature differential enhancement fusion (AFDEF) module, in which mutual enhancement of advantageous features from different network structures is performed, thereby improving the classification robustness of different regions in HSI. The experiments on four HSI benchmark datasets demonstrate that our DF2Net exhibits superior advantages over state-of-the-art models, particularly when the training samples are limited.

Deep residual networks (ResNets) can learn deep feature representation from hyperspectral images (HSIs), and therefore have been widely used for HSI classification. Despite their high accuracies, there still exist a lot of challenging cases, such as open world recognition, limited-sample learning and visualization of learned classification features, which cannot be well addressed. Most of the challenges in HSI classification can be attributed to the dependence on softmax based loss function and classifiers, which cause the lack of robustness for deep learning models and the hardness to visualize the learned classification features. To improve the robustness and achieve the visualization of learned classification features, we propose a novel learning framework called Residual Prototype Learning Network, a combination of residual network and prototypes learning mechanism. Under the framework, a prototype learning based loss function is proposed to enhance intra-class compactness and the inter-class separation of these feature representations; in addition, a prototype learning based classifier is simultaneously proposed to achieve the 2D or 3D visualization of the classification features. The effectiveness of our proposed learning framework is evaluated on several publicly available HSI benchmarks, and the experimental results show that our approach achieve better results than traditional softmax based ResNets.

Convolutional neural networks (CNNs) have powerful feature extraction capabilities, but they perform poorly in small sample scenarios and have difficulty extracting complex spectral-spatial features. To solve the above problems, this paper proposes a multi-hop graph and synergistic attention convolutional fusion network (MGSACFN) designed for hyperspectral image classification. Specifically, the proposed algorithm comprises two main branches. The first is the multi-scale spectral-spatial synergistic attention fusion subnetwork (MS3AFsN), which establishes multiple scales of features through pooling and unspooling operations, enhancing the representational capability of each scale's features via spectral-spatial synergistic attention (SSSA). The second is the multi-hop graph convolutional reinforcement subnetwork (MGCRsN), which utilizes superpixel blocks derived from superpixel segmentation as graph nodes, aggregates multi-level node contextual information through multi-hop graph convolution, and further enhances feature representation via convolutional reinforcement. Finally, the two sub-networks features are concatenated and fused to obtain discriminative spectral-spatial features. The experimental results on the three benchmark hyperspectral datasets show that the proposed algorithm combines the advantages of both CNNs and graph convolutional networks to achieve overall accuracies up to 96.86%, 98.92% and 99.84% on the Pavia University, Salinas Valley, and Kennedy Space Center datasets, respectively under extremely low training samples. These results outperform other comparative methods.

A combination method of stacked autoencoder and 3D deep residual network for hyperspectral image classification

Supervised classification of hyperspectral image (HSI) is generally required to obtain better performance in spectral-spatial feature learning by fully using complex pixel- and superpixel-level interdependencies with small labeled samples. Limited by the local regular convolutions, convolutional neural networks (CNNs) can only exploit information from the short-range Euclidean neighbors of a target, hindering the effectiveness of feature representation. In contrast, graph convolutional networks (GCNs) can learn long-range dependencies between non-Euclidean neighbors but usually require the input of a full graph constructed from a whole HSI, making GCNs must be trained in a full-batch manner with tremendous computational consumption. In this work, we propose a composite neighbor-aware convolutional metric network (CNCMN), aiming to learn each target's representation from its composite neighbors (i.e., both Euclidean and non-Euclidean neighbors) in a batchwise manner. Specifically, for each target in an HSI, its Euclidean neighbors are the pixels in the local square region centered on itself, and its non-Euclidean neighbors are several related nodes selected from the constructed full graph. Correspondingly, a composite convolution (CoConv) is proposed by coupling an image convolution and a graph convolution, which can perform flexible convolutions on those composite neighbors and extract adaptively fused features from them. Besides, to further boost classification, we also propose a mini-batch metric classifier to dynamically optimize interclass and intraclass distances of samples batch by batch, which is then combined with the CoConv to form the mini-batch CNCMN. Extensive experiments on three real-world HSIs demonstrate the advantages of the proposed method over mini-batch deep learning algorithms and have obtained the state-of-the-art performance in these fields. The code is available at: https://github.com/qichaoliu/HSI-CNCMN.