Sparse Bayesian learning using correlated hyperparameters for recovery of block sparse signals

In this paper, we develop a new sparse Bayesian learning method for recovery of block-sparse signals with un- known cluster patterns. A pattern-coupled hierarchical Gaussian prior model is introduced to characterize the statistical depen- dencies among coefficients, where a set of hyperparameters are employed to control the sparsity of signal coefficients. Unlike the conventional sparse Bayesian learning framework in which each individual hyperparameter is associated independently with each coefficient, in this paper, the prior for each coefficient not only involves its own hyperparameter, but also the hyperparameters of its immediate neighbors. In doing this way, the sparsity patterns of neighboring coefficients are related to each other and the hierarchical model has the potential to encourage structured- sparse solutions. The hyperparameters, along with the sparse signal, are learned by maximizing their posterior probability via an expectation-maximization (EM) algorithm. Index Terms— Sparse Bayesian learning, pattern-coupled hi- erarchical model, block-sparse signal recovery.

Compressive sensing is a sub-Nyquist sampling technique for efficient signal acquisition and reconstruction of sparse or compressible signals. In order to account for the sparsity of the underlying signal of interest, it is common to use sparsifying priors such as Bernoulli–Gaussian-inverse Gamma (BGiG) and Gaussian-inverse Gamma (GiG) priors on the components of the signal. With the introduction of variational Bayesian inference, the sparse Bayesian learning (SBL) methods for solving the inverse problem of compressive sensing have received significant interest as the SBL methods become more efficient in terms of execution time. In this paper, we consider the sparse signal recovery problem using compressive sensing and the variational Bayesian (VB) inference framework. More specifically, we consider two widely used Bayesian models of BGiG and GiG for modeling the underlying sparse signal for this problem. Although these two models have been widely used for sparse recovery problems under various signal structures, the question of which model can outperform the other for sparse signal recovery under no specific structure has yet to be fully addressed under the VB inference setting. Here, we study these two models specifically under VB inference in detail, provide some motivating examples regarding the issues in signal reconstruction that may occur under each model, perform comparisons and provide suggestions on how to improve the performance of each model.

Cauchy greedy algorithm for robust sparse recovery and multiclass classification

Robust Bayesian compressed sensing with outliers

This study concerns the issue of jointly enhancing noise robustness and promoting signal sparsity in Sparse Bayesian Learning (SBL), which aims at addressing the performance deficiency of sparse signal recovery due to uninformative data with low signal-to-noise ratios. In particular, the authors propose a hierarchical prior noise model with a signal-dependent parametrisation and incorporate it into developing the robust SBL algorithms for sparse signal recovery. The main contribution of the proposed approach is twofold. The first is the new consideration of noise-robustness enhancement in building SBL algorithms, which devotes to noise awareness in counteracting outliers in measurements. Specifically, the idea of signal-sparsity enforcing is extended to build a Least Absolute Deviation like loss criterion with the proposed hierarchical prior model of measurement noise. The second is the novelty of using the signal-dependent parametrisation in the proposed noise model. Indeed, the signal-dependent mechanism plays an indispensable role in producing the reliable noise parameter estimation jointly with updating signal model parameters under the fast SBL framework. In addition to numerical simulation studies, the real-life application of radio tomographic imaging is presented to validate the proposed approach.

Recovery of block sparse signals with partially-known block support information is of particular importance in compressed sensing. A uniform sufficient condition guaranteeing stable recovery of non-strictly block $k$-sparse signals is established via the weighted $ℓ_{2,p}−\alpha ℓ_{2,q}$ nonconvex minimization method, and the reconstruction error is precisely bounded in terms of the residual of block-sparsity and the measurement error. Furthermore, a series of contrastive numerical experiments reveal that exploiting the approximate block-sparsity characteristic and the nonuniform prior block support estimate substantially promotes the performance of reconstruction for block-structural signals.

In this article we study the sparse signal recovery problem in a Bayesian framework using a novel Bootstrapped Sparse Bayesian Learning method. Sparse Bayesian Learning (SBL) framework is an effective tool for pruning out the irrelevant features and ending up with a sparse representation. In SBL the choice of prior over the variances of the Gaussian Scale mixture has been an interesting area of research for some time now. This motivates us to use a more generalized maximum entropy density as the prior which results in a new variant of SBL. It has been shown to perform better than traditional SBL empirically and it also accelerates the pruning procedure. Because of this advantage, this variant of SBL can be claimed as more robust choice as it is less sensitive to the threshold for pruning. Theoretical justifications have also been provided to show that the proposed model actually promotes sparse point estimates.

The compressive sensing(CS) and sparse representation(SR) technique provide new way to improve the ISAR image resolution. At present, in most traditional CS and SR based ISAR imaging methods, the target is regarded as a set of isolated scattering centers. As a matter of fact, adjacent scattering centers compose a lot of small sets which can reflect the structure of the target. It is no doubt that these small sets can be exploited to improve the ISAR image quality, but the traditional CS and SR ISAR imaging methods ignore this. So in this paper, a block sparse signal recovery algorithm-Block Sparse Bayesian Learning(BSBL) method is introduced to modify the traditional method, and the simulate experiment show that this method can get better ISAR image than the other methods.

In this letter, the authors propose block normalised iterative hard thresholding (BNIHT) algorithm for the recovery of block sparse signal, in which the non-zero elements are presented in clusters. Based on block restricted isometry property, the sufficient conditions to guarantee the convergence of BNIHT are derived. In addition, the number of required iterations is obtained. The simulation experiment shows that BNIHT algorithm is superior to the block IHT (BIHT) algorithm when the step size satisfies μ < 1 .

We propose a pattern-coupled sparse Bayesian learning method for inverse synthetic aperture radar (ISAR) imaging by exploiting a block-sparse structure inherent in ISAR target images. A two-dimensional pattern-coupled hierarchical Gaussian prior is proposed to model the pattern dependencies among neighboring scatterers on the target scene. An expectation-maximization (EM) algorithm is developed to infer the maximum a posterior (MAP) estimate of the hyperparameters, along with the posterior distribution of the sparse signal. Numerical results are provided to illustrate the effectiveness of the proposed algorithm.

ABSTRACTSparse Bayesian learning (SBL) is widely applied in direction‐of‐arrival (DOA) estimation. However, it is limited by complexity, grid mismatch and inappropriate initial values of noise. To address these problems, a DOA estimation algorithm using grid pruning and adaptation based on noise integral‐based sparse Bayesian learning (AGNISBL) method is proposed in this letter. To reduce complexity, grid pruning is introduced for expectation maximization (EM) framework. Furthermore, a novel adaptive‐grid method is proposed for solving grid mismatch. A noise integral‐based inference framework is used to improve the robustness of the sparse Bayesian method. Simulation results show that the performance of the proposed AGNISBL approaches CRB at high signal‐to‐noise ratios (SNR) and with lower time complexity compared to other methods.

We consider the recovery of sparse signals, f ∈ ℝN, containing at most k ≪ N nonzero entries using linear measurements contaminated with i.i.d. Gaussian background noise. Given this measurement model, we present and analyze a computationally efficient group testing strategy for recovering the support of f and approximating its nonzero entries. In particular, we demonstrate that group testing measurement matrix constructions may be combined with statistical binary detection and estimation methods to produce efficient adaptive sequential algorithms for sparse signal support recovery. Furthermore, when f exhibits sufficient sparsity, we show that these adaptive group testing methods allow the recovery of sparse signals using fewer noisy linear measurements than possible with non-adaptive methods based on Gaussian measurement ensembles. As a result we improve on previous sufficient conditions for sparsity pattern recovery in the noisy sublinear-sparsity regime.

Parsimony-Enhanced Sparse Bayesian Learning for Robust Discovery of Partial Differential Equations

This paper concerns direction of arrival (DOA) estimation based on a sparse Bayesian learning (SBL) approach. We address two inherent problems of this class of DOA estimation methods: (i) a predefined dictionary can generate off-grid problems to a SBL DOA estimator; (ii) a parametric prior generally enforces the solution to be sparse, but the existence of noise can greatly affect the sparsity of the solution. Both of these issues may have a negative impact on the estimation accuracy. In this paper, we propose an improved root SBL (IRSBL) method for off-grid DOA estimation that adopts a coarse grid to generate an initial dictionary. To reduce the bias caused by dictionary mismatch, we integrate the polynomial rooting approach into the SBL method to refine the spatial angle grid. Then, we integrate a constant false alarm rate rule in the SBL framework to enforce sparsity and improve computational efficiency. Finally, we generalize the IRSBL method to the case of non-uniform linear arrays. Numerical analysis demonstrates that the proposed IRSBL method provides improved performance in terms of both estimation accuracy and computational complexity over the most relevant existing method.

This letter addresses the recovery of hierarchical sparse signals in a Bayesian framework. Hierarchical sparse signals exhibit two levels of sparsity, i.e., block-sparsity among different blocks and internal sparsity within each individual block. As in sparse Bayesian learning, each component of the coefficient vector is firstly modeled as a Gaussian distributed variable with zero mean. To enforce the two-level hierarchical sparsity, the variance is further modeled by two classes of hidden variables controlling the block-sparsity and the internal sparsity, respectively. Finally, variational Bayesian inference is used to recover the coefficient vector from the noise corrupted data. Numerical simulation and experimental results show that the proposed method outperforms those recently reported recovery methods.