Locally Similar Sparsity-Based Hyperspectral Compressive Sensing Using Unmixing

Hyperspectral (HS) image is a three dimensional data image where the 3rd dimension carries the wealth of spectrum information. HS image compression is one of the areas that has attracted increasing attention for big data processing and analysis. HS data has its own distinguishing feature which differs with video because without motion, also different with a still image because of redundancy along the wavelength axis. The prediction based method is playing an important role in the compression and research area. Reflectance distribution of HS based on our analysis indicates that there is some nonlinear relationship in intra-band. The Multilayer Propagation Neural Networks (MLPNN) with backpropagation training are particularly well suited for addressing the approximation function. In this paper, an MLPNN based predictive image compression method is presented. We propose a hybrid Adaptive Prediction Mechanism (APM) with MLPNN model (APM-MLPNN). MLPNN is trained to predict the succeeding bands by using current band information. The purpose is to explore whether MLPNN can provide better image compression results in HS images. Besides, it uses less computation cost than a deep learning model so we can easily validate the model. We encoded the weights vector and the bias vector of MLPNN as well as the residuals. That is the only few bytes it then sends to the decoder side. The decoder will reconstruct a band by using the same structure of the network. We call it an MLPNN decoder. The MLPNN decoder does not need to be trained as the weights and biases have already been transmitted. We can easily reconstruct the succeeding bands by the MLPNN decoder. APM constrained the correction offset between the succeeding band and the current spectral band in order to prevent HS image being affected by large predictive biases. The performance of the proposed algorithm is verified by several HS images from Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) reflectance dataset. MLPNN simulation results can improve prediction accuracy; reduce residual of intra-band with high compression ratio and relatively lower bitrates.

The majority of existing hyperspectral (HS) image denoising methods exploit local similarity in HS images by rearranging them into the matrix or vector forms. As the typical 3-D data, the inherent spatial and spectral properties in HS images should be simultaneously explored for denoising. Therefore, a 3-D geometrical kernel (3DGK) is developed in this article to describe the local structure. The proposed method assumes that the pixel can be represented by other pixels within a 3-D block efficiently owing to the local similarity with adjacent positions. Then, the HS image is modeled by the 3-D kernel regression with <italic>L</italic>₁-norm constraint, in which the local similarity is captured by the proposed 3DGK. To efficiently compute the parameters in 3DGK, geometrical structures, such as scale, shape, and orientation in the 3-D block, are estimated from the gradient information approximately. Finally, the noises are effectively removed while preserving the structures in HS images. Moreover, experimental results on simulated and real datasets demonstrate that the performance of 3DGK is better than those of the methods based on local similarity prior.

Nonnegative tensor Tucker decomposition (NTD) in a transform domain (e.g., 2D-DWT, etc) has been used in the compression of hyper-spectral images because it can remove redundancies between spectrum bands and also exploit spatial correlations of each band. However, the use of a NTD has a very high computational cost. In this paper, we propose a low complexity NTD-based compression method of hyper-spectral images. This method is based on a pair-wise multilevel grouping approach for the NTD to overcome its high computational cost. The proposed method has a low complexity under a slight decrease of the coding performance compared to conventional NTD. We experimentally confirm this method, which indicates that this method has the less processing time and keeps a better coding performance than the case that the NTD is not used. The proposed approach has a potential application in the loss compression of hyper-spectral or multi-spectral images

Hyperspectral image compression has become increasingly important in data exploitation because of enormous data volumes and high redundancy provided by hundreds of contiguous spectral channels. Since a hyperspectral image can be viewed as a 3-dimensional (3D) image cube, many efforts have been devoted to extending 2D image compression techniques to perform 3D image compression on hyperspectral image cubes. Unfortunately, some major issues generally encountered in hyperspectral data exploitation at low or very low-bit rate compression, for example, subpixels and mixed pixels which do not occur in traditional pure pixel-based image compression are often overlooked in such a 2D-to-3D compression. Accordingly, a direct application of 2D-to-3D compression techniques to hyperspectral image cubes without taking precaution may result in significant loss of crucial spectral information provided by subtle substances such as small objects, anomalies during low bit-rate lossy compression. This paper takes a rather different view by investigating lossy hyperspectral compression from a perspective of exploring spectral information, referred to as exploitation-based lossy compression and further develops spectral/spatial hyperspectral image compression to effectively preserve crucial and vital spectral information of objects which are generally missed by commonly used mean-squared error (MSE) or signal-to-noise ratio (SNR)-based compression techniques when lossy compression is performed at low bit rates. In order to demonstrate advantages of the proposed spectral/spatial compression approach applications of subpixel target detection and mixed pixel analysis are used for experiments for performance evaluation.

The high complexity of the reconstruction algorithm is the main bottleneck of the hyperspectral image (HSI) compression technology based on compressed sensing. Compressed sensing technology is an important tool for retrieving the maximum number of HSI scenes on the ground. However, the complexity of the compressed sensing algorithm is limited by the energy and hardware of spaceborne equipment. Aiming at the high complexity of compressed sensing reconstruction algorithm and low reconstruction accuracy, an equivalent model of the invertible transformation is theoretically derived by us in the paper, which can convert the complex invertible projection training model into the coupled dictionary training model. Besides, aiming at the invertible projection training model, the most competitive task-driven invertible projection matrix learning algorithm (TIPML) is proposed. In TIPML, we don’t need to directly train the complex invertible projection model, but indirectly train the invertible projection model through the training of the coupled dictionary. In order to improve the accuracy of reconstructed data, in the paper, the singular value transformation is proposed. It has been verified that the concentration of the dictionary is increased and that the expressive ability of the dictionary has not been reduced by the transformation. Besides, two-loop iterative training is established to improve the accuracy of data reconstruction. Experiments show that, compared with the traditional compressed sensing algorithm, the compressed sensing algorithm based on TIPML has higher reconstruction accuracy, and the reconstruction time is shortened by more than a hundred times. It is foreseeable that the TIPML algorithm will have a huge application prospect in the field of HSI compression.

Hyperspectral image (HSI) classification is an important technology for hyperspectral data analysis, which has the challenge of high dimensionality and limited training samples. Moreover, due to the spatial continuity of material distribution, it is reasonable to improve the performance of HSI classification from the local similarity viewpoint, i.e., pixels in the same local region have a high probability to share similar features. Therefore, in this paper, a novel method based on local similarity and kernel low-rank representation is proposed to improve the classification accuracy for HSI. First, taking into consideration that pixels in the same homogeneous region share similar spectral features (termed local similarity), the HSI is segmented by the superpixel segmentation algorithm to obtain the homogeneous regions. Then, a model of kernel low-rank representation based on local similarity (KLRRLS) is proposed for HSI classification. In the model of KLRRLS, the nonlinear structure characteristics of HSI are extracted by employing the kernel trick, and the low-rank constraint is used as a prior to restrict the recovery coefficient matrix in each segmentation region, thus efficiently solving the linear non-separable problem and exploiting the contextual information of HSI. Finally, the classification results are generated by fusing the result of each segmented map via the maximum voting mechanism. Experimental results on three real HSI datasets demonstrate that the proposed method can effectively improve the classification accuracy.

In this paper, we present a novel method for the acquisition and compression of hyperspectral images based on two concepts - distributed source coding and compressive sensing. Compressive sensing (CS) is a signal acquisition method that samples at sub Nyquist rates which is possible for signals that are sparse in some transform domain. Distributed source coding (DSC) is a method to encode correlated sources separately and decode them together in an attempt to shift complexity from the encoder to the decoder. Distributed compressive sensing (DCS) is a new framework suggested for jointly sparse signals which we apply to the correlated bands of hyperspectral images. We compressively sense each band of the hyperspectral image individually and can then recover the bands separately or using a joint recovery method. We use the Orthogonal Matching Pursuit (OMP) for individual recovery and Simultaneous Orthogonal Matching Pursuit (SOMP) for joint decoding and compare the two methods. The latter is shown to perform consistently better showing that the Distributed Compressive Sensing method that exploits the joint sparsity of the hyperspectral image is much better than individual recovery.

The compressed sensing (CS) theorem is a novel sampling approach that breaks through the conventional Nyquist sampling limit and brings a revolution in the field of signal processing. This article investigates the compression technique for CS hyperspectral images so as to illustrate the superiority provided by this new theorem. First, several comparative experiments are used to reveal that the drawback of prior compression techniques, designed for the data acquired by the conventional hyperspectral imaging system, is either low compression ratio or a waste of sampling resource. After a condensed analysis, we state that the CS theorem provides the probability of avoiding such defects. Then a straightforward scheme, which takes advantage of spectral correlation, is proposed to compress the CS hyperspectral images to reduce the data size further. Moreover, a flexible recovery strategy is designed to speed up the reconstruction of original bands from the corresponding CS images. The experimental results based on the actual hyperspectral images have demonstrated the efficiency of this proposed technique.

The compression of hyperspectral images (HSIs) has recently become a very attractive issue for remote sensing applications because of their volumetric data. In this paper, an efficient method for hyperspectral image compression is presented. The proposed algorithm, based on Discrete Wavelet Transform and Tucker Decomposition (DWT-TD), exploits both the spectral and the spatial information in the images. The core idea behind our proposed technique is to apply TD on the DWT coefficients of spectral bands of HSIs. We use DWT to effectively separate HSIs into different sub-images and TD to efficiently compact the energy of sub-images. We evaluate the effect of the proposed method on real HSIs and also compare the results with the well-known compression methods. The obtained results show a better performance of the proposed method. Moreover, we show the impact of compression HSIs on the supervised classification and linear unmixing.

We propose a novel multi-spectral imaging method based on compressive sensing (CS). In CS theory, the enhancement of signal sparsity is important for accurate signal reconstruction. The main novelty of the proposed method is the employment of a self-correlation of an image, that is a local intensity similarity and multi-spectral correlation, to enhance the sparsity of the multi-spectral image to be recovered. Local intensity similarity, which is based on the concept that spatial changes in intensity are likely to be similar within local regions, contributes to sparsity enhancement. Furthermore, we exploit multi-spectral correlation to improve the sparsity of the multi-spectral components to be recovered. In order to simultaneously exploit different types of characteristics (i.e., local intensity similarity and multi-spectral correlation) for representing a signal as sufficiently sparse, we introduce a hierarchical joint sparsity model in the CS image recovery process. Our experiments show that the use of a self-correlation significantly improves the performance of multi-spectral image reconstruction.

Compressive sensing and adaptive direct sampling in hyperspectral imaging

The compression of hyperspectral images becomes recently very attractive issue for remote sensing applications because of the volumetric data. In this paper, an efficient method for hyperspectral image compression is presented based on Tucker Decomposition (TD) and Discrete Wavelet Transform (DWT). The core idea behind our proposed technique is to apply TD on the DWT coefficients of spectral bands of hyperspectral images. Our method not only exploits redundancies between bands but also uses spatial correlation of every image band. Simulation results applied on the real hyperspectral images show a remarkable compression ratio and quality.

Abstract. Over the past decade hyper spectral (HS) image analysis has turned into one of the most powerful and growing technologies in the field of remote sensing. While HS images cover large area at fine spectral resolution, their spatial resolutions are often too coarse for the use in various applications. Hence improving their resolution has a high payoff. This paper presents a novel approach for super-resolution (SR) of HS images using compressive sensing (CS). Besides ill-posedness of SR problem, the main challenge in HS super-resolution is to preserve spectral contents among all bands while increasing their spatial resolutions. In this work, we first obtain an initial estimate of the super-resolution on a reduced dimension HS data. The HS observations of different wavelengths are represented as linear combination of smaller number of basis image planes (BIPs) using principal component analysis (PCA). The novelty of our approach lies in using CS based approach to super-resolve the most informative PCA transformed image representing highest spectral variance (i.e. the first principal component). Our approach uses low and high spatial resolution dictionaries of patches generated by random sampling of raw patches of PCA transformed images that are generated using the training images having similar statistical properties. Using the sparsity constraint, low resolution test patch is represented as a sparse linear combination of relevant dictionary elements adaptively, that leads to initial estimate of super-resolved PCA image having maximum spectral variability. Since SR is an ill-posed problem, we obtain the final solution using a regularization framework considering the sparse coefficients obtained by the CS approach and the autoregressive (AR) parameters obtained from the initial estimate. The remaining PCA images are up-scaled using regularization, considering the same AR parameters which were obtained from super-resolved PCA image having maximum spectral variability. Experiments are conducted on real HS images collected by Airborne Visible/Infrared Imaging Spectrometer (AVIRIS). Visual inspections and quantitative comparison confirm that our method enhances spatial information without introducing significant spectral distortion.

Hyperspectral data compression has received considerable interest in recent years. Contrarily to the conventional compression schemes, which first acquire the full data set and then implement some compressing technique, compressive sensing (CS) acquires directly the compressed signal which will be later recovered on the ground station. The CS paradigm fits perfectly the requirements of onborad hyperspectral imaging systems in terms of energy, computing power, and bandwidth. By using CS in these systems, the amount of data acquired and transmitted to the ground stations is reduced and the bulk of the computation to infer the original data is carried out in the ground stations. In this paper, we present a new technique to perform CS of hyperspectral images (HSIs), which exploit the fact that HSIs admits a low dimensional linear representation. The proposed method is blind in the sense that linear representation is learned with low computational cost from the compressed measurements. Furthermore the proposed method is very light from the computational point of view and it can recover perfectly the original image in noise-free scenarios. The effectiveness of the proposed method is illustrated in both synthetic and real scenarios.

To reduce huge consumption of processing hyperspectral images(HSI), a novel Bayesian unmixing compressive sensing framework is proposed to compress and reconstruct HSI effectively, called structured sparse Bayesian umixing compressive sensing(SSBUCS). SSBUCS unites compressive sensing and hyperspectral linear mixed model in Bayesian framework. An HSI is decomposed as a linear combination of endmembers and abundance matrix. The abundance matrix is transformed to a structured sparse signal in the wavelet domain. Then, compressive sensing is employed on this sparse signal to produce a more compact result. To recover the HSI, a Markov chain Monte Carlo(MCMC) method based on Gibbs sampling is proposed, imposing structured sparse prior on abundance matrix. Experimental results verify the superiority of the proposed method over several state-of-art methods.