Toeplitz-structured Chaotic Sensing Matrix for Compressive Sensing

In compressive sensing (CS), the restricted isometry property (RIP) is an important condition on measurement matrices which guarantees the recovery of sparse signals with undersampled measurements. It has been proved in the prior works that both random (e.g., i.i.d. Gaussian, Bernoulli, $\ldots$ ) and Toeplitz matrices satisfy the RIP with high probability. However, structured matrices, such as banded Toeplitz matrices have drawn more attention since their structures have the advantage of fast matrix multiplication which may decrease the computational complexity of recovery algorithms. In this paper, we show that banded block Toeplitz matrices satisfy the RIP condition with high probability. Banded block Toeplitz matrices can be used in the sparse multi-channel source separation. The banded block Toeplitz matrices decrease the computational complexity while they have fewer number of non-zero entries in comparison to the same dimensional banded Toeplitz matrices. Furthermore, our simulation results show that banded block Toeplitz matrices outperform banded Toeplitz matrices in signal estimation. The analytical RIP bound for banded block Toeplitz matrices is provided in this paper and the RIP bound of sparse Gaussian matrices is also obtained as an upper bound for banded block Toeplitz matrices. Our simulation and analytical results show that sparse Gaussian random matrices do satisfy the RIP condition with high probability. The probability of satisfying the RIP depends on the probability of zero entries.

Sub-Nyquist Sampling of Acoustic Signals Based on Chaotic Compressed Sensing

In the theory of compressed sensing, restricted isometry property (RIP) decides the universality and reconstruction robustness of an observation matrix. At present, an observation matrix based on RD-AIC (RD-AIC-based observation matrix) can compress sparse continuous signals with a simple structure, but RIP analysis of this matrix is lack and challenging to prove. In this paper, this problem is relaxed. Instead, we demonstrate the incoherence analysis process, derive the orthogonality and nonsingularity of the matrix, propose the generalized relevance calculation steps of the matrix, and propose the hardware parameter design principles to improve the incoherence of the matrix. Moreover, compression and reconstruction experiments used in power quality disturbance signals are developed for testing the incoherence. The results show that the RD-AIC-based observation matrix has substantial incoherence under suitable hardware parameters, equivalent to the Gaussian random matrix and the Bernoulli random matrix.

Sparse recovery in bounded Riesz systems with applications to numerical methods for PDEs

The conditions under which Compressed sensing (CS) succeeds depend on the structure of the measurement matrix. Researches indicated that matrices whose entries are drawn independently from certain probability distributions satisfy the restricted isometry property (RIP) and guarantee exact recovery of a sparse signal with high probability. Motivated by signal processing applications, random filtering with Toeplitz sensing matrices whose elements are drawn from the same distributions were considered and shown to also be sufficient to recover a sparse signal from reduced samples exactly with high probability. In order to achieve reduction of sampling rate in impulse radio Ultra-Wideband (IR-UWB) communication systems, the output streams of UWB channel were periodically down-sampled. Sub-sampling at the receiver leads to quasi-Toeplitz-structured measurement matrices, whose entries are UWB channel coefficients. In this paper, the feasibility of this kind of quasi-Toeplitz matrices as measurement matrices is discussed. It is shown that the quasi-Toeplitz matrices with entries drawn from logarithm normal distribution satisfy RIP with high probability and also ensures the exact reconstruction of the sparse signals. Simulation results validate their performance.

Time delay estimation (TDE) is a hot research topic in wireless location technology. Compressed sensing (CS) theory has been widely applied to image reconstruction and direction of arrival estimation since it was proposed in 2004. The sparse model can be constructed in time domain for estimating the time delay by using the CS theory. The measurement matrix plays a crucial role in the processing of signal reconstruction which is the core problem of CS theory. Therefore the research in the measurement matrix has becomes a hotspot in recent years. The existing measurement matrix is mainly divided into two categories, i.e., random measurement matrix and deterministic measurement matrix. The performance of random measurement matrix has bottlenecks. Firstly, because of the redundant measurement matrix data, the generation and storage of the random number put forward a high requirement for hardware. Secondly the random matrix can only satisfy the restricted isometry property in a statistical sense. The research of the deterministic measurement matrix is of great value under this background. The parity check matrix of low density parity check (LDPC) code has good performance in CS theory. However, the method of randomly selecting non-zero element position has a certain probability to generate a measurement matrix with a short loop structure during generating LDPC code measurement matrix. The robustness of the reconstruction performance decreases with the increase of iteration times. A novel quasi-cyclic CS algorithm based on progressive edge-growth is constructed to estimate the time delay. The purpose of this article is to deal with the need to store a large number of data in existing measurement matrix during time delay, by using the CS theory. The algorithm presented here can achieve TDE in a high precision. First, the theoretical bridge between CS and the maximum likelihood decoding is established. And the design criterion of measurement matrix based on the LDPC code is derived. The sparse measurement matrix with quasi-cyclic structure is constructed by introducing the idea of progressive edge-growth. Finally, the orthogonal matching pursuit algorithm is used to estimate the time delay. Furthermore, the computational complexity of the algorithm and the data storage of the measurement matrix are analyzed theoretically. Simulations show that the correct reconstruction probability of the proposed approach is higher than those of the Gauss random matrix and random LDPC matrix under the same dimension. Compared with the random LDPC matrix, the proposed method can improve performance at the expense of less complexity under the condition of the same data storage.

Signal acquisition in ultra-high frequency is a challenging problem due to high cost of analog-digital converter. While compressed sensing (CS) provides an alternative way to sample signal with low sampling rate, the construction of measurement matrix is still challenging due to hardware complexity and random generation. To address this challenge, a variable dimension deterministic measurement matrix construction method is proposed in this paper based on cross-correlation characteristics of m sequences. Specifically, a lower bound of the spark of measurement matrix is derived theoretically. The proposed measurement matrix construction method is applicable to compressive sampling system to improve the quality of signal reconstruction, especially for modulated wideband converter (MWC) architecture. Simulation results demonstrate that the proposed measurement matrix is superior to random Gauss matrix and random Bernoulli matrix.

Random measurement matrices play a critical role in successful recovery with the compressive sensing (CS) framework. However, due to its randomly generated elements, these matrices require massive amounts of storage space to implement a random matrix in CS applications. To effectively reduce the storage space of the random measurement matrix for CS, we propose a random sampling approach for the CS framework based on the semi-tensor product (STP). The proposed approach generates a random measurement matrix, where the dimensions of the random measurement matrix are reduced to a quarter (or 1/16, 1/64, and even 1/256) of the number of dimensions, which are used for conventional CS. We then estimate the values of the sparse vector with a modified iteratively re-weighted least-squares (IRLS) algorithm. The results of numerical simulations showed that the proposed approach can reduce the storage space of a random matrix to at least a quarter while maintaining quality of reconstruction. All results confirmed that the proposed approach significantly influences the physical implementation of the CS in images, especially on embedded system and field programmable gate array (FPGA), where storage is limited.

A robust image encryption algorithm based on Chua's circuit and compressive sensing

The importance of sparse signal structures has been recognized in a plethora of applications ranging from medical imaging to group disease testing to radar technology. It has been shown in practice that various signals of interest may be (approximately) sparsely modeled, and that sparse modeling is often beneficial, or even indispensable to signal recovery. Alongside an increase in applications, a rich theory of sparse and compressible signal recovery has recently been developed under the names compressed sensing (CS) and sparse approximation (SA). This revolutionary research has demonstrated that many signals can be recovered from severely undersampled measurements by taking advantage of their inherent low-dimensional structure. More recently, an offshoot of CS and SA has been a focus of research on other low-dimensional signal structures such as matrices of low rank. Low-rank matrix recovery (LRMR) is demonstrating a rapidly growing array of important applications such as quantum state tomography, triangulation from incomplete distance measurements, recommender systems (e.g., the Netflix problem), and system identification and control. In this dissertation, we examine CS, SA, and LRMR from a theoretical perspective. We consider a variety of different measurement and signal models, both random and deterministic, and mainly ask two questions. How many measurements are necessary? How large is the recovery error? We give theoretical lower bounds for both of these questions, including oracle and minimax lower bounds for the error. However, the main emphasis of the thesis is to demonstrate the efficacy of convex optimization---in particular l1 and nuclear-norm minimization based programs---in CS, SA, and LRMR. We derive upper bounds for the number of measurements required and the error derived by convex optimization, which in many cases match the lower bounds up to constant or logarithmic factors. The majority of these results do not require the restricted isometry property (RIP), a ubiquitous condition in the literature.

Shannon’s Nyquist theorem has always dictated the conventional signal acquisition policies. Power system is not an exception to this. As per this theory, the sampling rate must be at least twice the maximum frequency present in the signal. Recently, compressive sampling (CS) theory has shown that the signals can be reconstructed from samples obtained at sub-Nyquist rate. Signal reconstruction in this theory is exact for “sparse signals” and is near exact for compressible signals provided certain conditions are satisfied. CS theory has already been applied in communication, medical imaging, MRI, radar imaging, remote sensing, computational biology, machine learning, geophysical data analysis, and so forth. CS is comparatively new in the area of computer based power system monitoring. In this paper, subareas of computer based power system monitoring where compressive sampling theory has been applied are reviewed. At first, an overview of CS is presented and then the relevant literature specific to power systems is discussed.

At present, by establishing complex mathematical model to simulate the ironmaking process in Blast Furnace (BF), the real-time and applicability are not strong in actual production. To solve this problem, an image reconstruction algorithm for BF Burden surface based on Compressive Sensing is proposed. Sparse matrix is constructed by Discrete Cosine Transform (DCT) and random Gaussian matrix is constructed to obtain part of the image information of BF Burden surface directly. Then the original image information is reconstructed by orthogonal matching pursuit algorithm. The final simulation results show that the image reconstruction algorithm proposed in this study works well.

In traditional image encryption system, decryption is extremely sensitive to packet loss. However, in wireless networks, packet loss is inevitable. Compressed sensing (CS) theory shows that sparse signal can be recovered from few incomplete measurements of it. Strong randomness of measurement matrix and irrelevance among the elements of the measurement vector imply that measurement process can be regarded as encryption process. So, this paper, based on CS theory, presents a new image encryption scheme with robustness to packet loss. In the scheme, we design a Gaussian random measurement matrix as the key to realize data encryption. Moreover, to enhance the incoherence between the plain-image and the cipher-image, we add a random disturbance term to the measurements (cipher-image) and thus improve the security level of the cipher-image. Numerical experiments show that the proposed method not only has well anti-attack ability but also is robust to packet loss, which can still decrypt plain-image even when the packet loss ratio is up to 50%.

Wearable ECG monitoring devices, often limited by power constraints, require efficient methods to reduce energy consumption and extend battery life for continuous health tracking. This work proposes a digital compressed sensing approach for ECG (DCS-ECG), featuring a suitable sensing matrix, effective sparse signal recovery algorithms, and an optimized number of bits for quantization (BM). The framework is designed to achieve high compression ratios (CR) with minimal signal distortion and parameter extraction without the reconstruction of the original signal. The following five sensing matrices are examined: deterministic block binary diagonal (DBBD) matrix, random binary (RBin) matrix, random Bernoulli (RBen) matrix, random Gaussian (RG) matrix, and random sparse fixed binary (RSB) matrix. These are paired with a sparsifying matrix (ψ), a hybrid of identity matrix (I), discrete sine transform matrix (S), and discrete cosine transform matrix (C) (i.e. ψ = [I S C]). The following five sparse reconstruction algorithms are evaluated: iterative hard thresholding (IHT) algorithm, orthogonal matching pursuit (OMP) algorithm, smoothed ℓ0 (SL0) algorithm, ℓ1 least square (L1LS) algorithm, and subspace matching pursuit (SMP) algorithm. The proposed DCS-ECG system was tested on ECG signals from the MIT-BIH arrhythmia database. The configuration using the DBBD sensing matrix and OMP recovery algorithm with the sparsifying matrix achieved a low average percentage of root mean square difference (PRD) of 3.75 ± 1.43% at CR = 12.5%, which also offers fast reconstruction. For CR = 12.5% and BM = 8, the CS measurement generation on the Arduino Due consumes 2.02 mJ, while reconstruction on the Raspberry Pi requires 1.13 J. The wireless transmission energy is 1.2973 J. Overall, the proposed CS-based system achieves an 86.24% total energy saving compared to the without CS approach, demonstrating its suitability for low-power IoT-enabled wearable edge ECG health monitoring applications.

Conventional spatial-based array processing technique requires a lot of large storage space and costly hardware implementations in an antenna array-based global navigation satellite system (GNSS) receivers. In this paper, the compressive sensing (CS)-based antenna array processing scheme is proposed to apply in anti-jamming GNSS receivers. The design criteria of CS matrix is to meet the restricted isometry property (RIP) conditions, and it is combined with discrete wavelet transform and Gaussian measurement matrix. The minimum variance distortionless response (MVDR) beamformer is used to null the interference and maintain the gain direction of desired signal and the proposed scheme reduces a large computation load in MVDR. Under the use of 3×3 antennas with uniform rectangular array under 1/2 wavelength spacing, the anti-jam performance is achieved to 40 dB under two present interferences. The overall computation performance can enhance by 1.2∼1.4 times.