Image restoration with triangular orthogonal wavelets

This article presents some comments on the article recently published by Prazenica and Kurdila under the title “Volterra Kernel Identification Using Triangular Wavelets”. First some common misconceptions in the literature in using wavelets for modeling and identifications are addressed. Then, misconceptions and demonstrational errors regarding the definitions and applications of Haar wavelets and Haar scaling functions are highlighted within the article by Prazenica and Kurdila, and their consequences are investigated. Practical comments and some modifications are also provided.

Compressive sensing (CS) is a technique that enables the recovery of sparse signals using fewer measurements than traditional sampling methods. To address the computational challenges of CS reconstruction, our objective is to develop an interpretable and concise neural network model for reconstructing natural images using CS. We achieve this by mapping one step of the iterative shrinkage thresholding algorithm (ISTA) to a deep network block, representing one iteration of ISTA. To enhance learning ability and incorporate structural diversity, we integrate aggregated residual transformations (ResNeXt) and squeeze‐and‐excitation mechanisms into the ISTA block. This block serves as a deep equilibrium layer connected to a semi‐tensor product network for convenient sampling and providing an initial reconstruction. The resulting model, called MsDC‐DEQ‐Net, exhibits competitive performance compared to state‐of‐the‐art network‐based methods. It significantly reduces storage requirements compared to deep unrolling methods, using only one iteration block instead of multiple iterations. Unlike deep unrolling models, MsDC‐DEQ‐Net can be iteratively used, gradually improving reconstruction accuracy while considering computation tradeoffs. Additionally, the model benefits from multiscale dilated convolutions, further enhancing performance.

In this paper, the method of orthogonal wavelet transform was used to decompose monolayer from fabric image. And the sub-images of horizontal and vertical direction are extracted to represent respectively the textures of fabric in warp and weft. Then, energy in warp and weft; variance, entropy and range of eigenvalue is calculated And they were also compared to the normal control to determine whether there is any defect exists. Meanwhile, some typical defect forms of plain weave white cotton fabric has been detection in this paper. The experiment results show that the method is effective and feasible.

Iterative shrinkage/thresholding algorithm (ISTA) is a well-studied method for finding sparse solutions to ill-posed inverse problems. In this letter, we present a data-driven scheme for learning optimal thresholding functions for ISTA. The proposed scheme is obtained by relating iterations of ISTA to layers of a simple deep neural network (DNN) and developing a corresponding error backpropagation algorithm that allows to fine-tune the thresholding functions. Simulations on sparse statistical signals illustrate potential gains in estimation quality due to the proposed data adaptive ISTA.

Synthetic aperture radar tomography (TomoSAR) has been widely employed in 3-D urban mapping. However, state-of-the-art super-resolving TomoSAR algorithms are computationally expensive, because conventional numerical solvers need to solve the <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$l_{2^{-}}l_{1}$</tex> mix norm minimization. This paper proposes a computationally efficient super-resolving To-moSAR inversion algorithm based on deep learning. We studied the potential of deep learning to mimic a conventional <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$l_{2}-l_{1}$</tex> mix norm solver, i.e. iterative shrinkage thresholding algorithm (ISTA), and proposed several improvements of the complex-valued learned ISTA for TomoSAR inversion. Investigation on the super-resolution ability and estimator efficiency of the proposed algorithm shows that the proposed algorithm approaches the Cramer Rao lower bound (CRLB) with a computational efficiency more than 100 times better than the conventional solver.

Compressed sensing (CS) reconstruction of nonsparse scenes is one of the difficulties in synthetic aperture radar (SAR) imaging technology. Although the conventional CS method with sparse representation has proven applicable for nonsparse SAR reconstruction, its disadvantages are unsatisfactory imaging quality and high computational complexity under downsampling. In this paper, a novel deep learning approach for nonsparse SAR scene reconstruction is proposed based on sparse representation and the iterative shrinkage threshold algorithm (ISTA). Specifically, we first develop a sparse representation-based imaging model associated with the &#x2113;₁ sparse regularizer in nonlinear transform domains. Then, the advantages of the recurrent neural network (RNN) and convolutional neural network (CNN) are incorporated into an ISTA-inspired deep unfolded network (DUN) called SR-ISTA-Net, in which all the parameters are layer-varied rather than handcrafted. The experiments verify that the proposed SR-ISTA-Net can provide high-quality reconstruction results under nonsparse scenes while substantially reducing imaging time.

We present two model-based neural network architectures purposed for sporadic user detection and channel estimation in massive machine-type communications. In the scenario under consideration, a base station assigns the users a set of pilot sequences that is linearly dependent, but because user activity is sporadic the detection/estimation problem is amenable to sparse recovery algorithms. Further, we consider a millimeter-wave wireless channel, so that the channel vectors are sparse in a known dictionary. We apply the deep unfolding framework to design custom neural network layers by unrolling two iterative optimization algorithms: (1) linearized alternating direction method of multipliers, which we apply to a constrained convex problem, and (2) vector approximate message passing featuring a novel denoiser based on the iterative shrinkage thresholding algorithm. The networks thus inherit domain knowledge as encapsulated by the signal model, and suitable operations as informed by the algorithms—in the same spirit as convolutional networks that exploit structure inherent in images and audio, except grounded in optimization and statistics. The networks, trained on synthetic data generated from the block-fading millimeter-wave multiple access channel model, offer improved complexity and accuracy relative to their iterative counterparts, and are potentially a boon to cell-free MIMO systems.

The fast compressed sensing (CS) reconstruction for natural image processing aims to infer the original pixel vector from randomized measurements as correctly as possible. Current first-order proximal mainstream schemes, including alternating direction methods of multipliers (ADMM) and the iterative shrinkage thresholding algorithm (ISTA), have advantages in convergence and stability at the expense of computing speed and complex tuning strategy. This paper proposes the deep iterative shrinkage network for real-time applications, where network layers replace the iterative optimization steps. The hyperparameters associated with shrinkage thresholds and step sizes are adjusted by standard deep learning updates. Numerical results suggest that the proposed method has flexibility and effectiveness in image reconstruction with different compression ratios while preserving the computational simplicity of end-to-end methods.

This paper focuses on processing low oversampling echo data of staggered synthetic aperture radar (SAR). In staggered mode, the non-uniformly sampling and echo data loss cause severe azimuth ambiguity. To solve this problem, we propose a method combining the compressed sensing (CS) tool and the conformal Fourier transform (CFT) algorithm. First, the 2-D-fast iterative shrinkage thresholding algorithm (FISTA) is used to efficiently solve the optimization problem based on CS theory to recovery the missing data. Second, the CFT algorithm is used to accurately compute the spectrum of the non-uniformly sampled echo data. Unlike other methods suiting fast pulse repetition interval (PRI) change only, this method performs well for both fast and slow PRI change. Plus, the proposed method can be well applied to both point and distributed targets. Simulation results demonstrate that the proposed method can effectively and robustly suppress the azimuth ambiguity for staggered SAR data.

A new restoration algorithm based on Huber function for astronomy image compression was proposed in this paper. A combinatorial sensing matrix based on noiselet transform and subsample matrix was built for image acquisition. A restoration algorithm based on Huber function was introduced to reconstruct the signal. Peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) were used to evaluate the performance of the proposed algorithm. Compared with the standard compression algorithms, including JPEG and iterative shrinkage thresholding algorithm (ISTA) based reconstruction algorithm, the results obtained by the proposed algorithm are of higher structural similarity and PSNR. The proposed algorithm is suitable for the application scenarios of astronomy images with large data volume and high redundancy.

Sparse-representation-based synthetic aperture radar (SAR) imaging technology has shown superior potential in the reconstruction of nonsparse scenes. However, many existing compressed sensing (CS) methods with sparse representation cannot obtain an optimal sparse basis and only apply to the sensing matrix obtained by exact observation, resulting in a low image quality occupying more storage space. To reduce the computational cost and improve the imaging performance of nonsparse scenes, we formulate a deep learning SAR imaging method based on sparse representation and approximated observation deduced from the chirp-scaling algorithm (CSA). First, we incorporate the CSA-derived approximated observation model and a nonlinear transform function within a sparse reconstruction framework. Second, an iterative shrinkage threshold algorithm is adopted to solve this framework, and the solving process is unfolded as a deep SAR imaging network. Third, a dual-path convolutional neural network (CNN) block is designed in the network to achieve the nonlinear transform, dramatically improving the sparse representation capability over conventional transform-domain-based CS methods. Last, we improve the CNN block to develop an enhanced version of the deep SAR imaging network, in which all the parameters are layer-varied and trained by supervised learning. The experiments demonstrate that our proposed two imaging networks outperform conventional CS-driven and deep-learning-based methods in terms of computing efficiency and reconstruction performance of nonsparse scenes.

In recent years, extensive research has shown that deep learning-based compressed image reconstruction algorithms can achieve faster and better high-quality reconstruction for single-pixel imaging, and that reconstruction quality can be further improved by joint optimization of sampling and reconstruction. However, these network-based models mostly adopt end-to-end learning, and their structures are not interpretable. In this paper, we propose SRMU-Net, a sampling and reconstruction jointly optimized model unfolding network. A fully connected layer or a large convolutional layer that simulates compressed reconstruction is added to the compressed reconstruction network, which is composed of multiple cascaded iterative shrinkage thresholding algorithm (ISTA) unfolding iteration blocks. To achieve joint optimization of sampling and reconstruction, a specially designed network structure is proposed so that the sampling matrix can be input into ISTA unfolding iteration blocks as a learnable parameter. We have shown that the proposed network outperforms the existing algorithms by extensive simulations and experiments.

The most common technique for generating B-mode ultrasound (US) images is delay-and-sum (DAS) beamforming, where the signals received at the transducer array are sampled before an appropriate delay is applied. This necessitates sampling rates exceeding the Nyquist rate and the use of a large number of antenna elements to ensure sufficient image quality. Recently, we proposed methods to reduce the sampling rate and the array size relying on image recovery using iterative algorithms based on compressed sensing (CS) and the finite rate of innovation (FRI) frameworks. Iterative algorithms typically require a large number of iterations, making them difficult to use in real time. In this article, we propose a reconstruction method from sub-Nyquist samples in the time and spatial domain, which is based on unfolding the iterative shrinkage thresholding algorithm (ISTA), resulting in an efficient and interpretable deep network. The inputs to our network are the subsampled beamformed signals after summation and delay in the frequency domain, requiring only a subset of the US signal to be stored for recovery. Our method allows reducing the number of array elements, sampling rate, and computational time while ensuring high-quality imaging performance. Using in vivo data, we demonstrate that the proposed method yields high-quality images while reducing the data volume traditionally used up to 36 times. In terms of image resolution and contrast, our technique outperforms previously suggested methods as well as DAS and minimum-variance (MV) beamforming, paving the way to real-time applicable recovery methods.

A critical challenge in image restoration is the presence of various types of noise. Meanwhile, noise detection is a crucial step in mixed noise removal. This paper tackles the challenge of restoring images corrupted by a mixture of additive Gaussian and multiplicative Gamma noise. In the proposed method, we integrate the noise detection process into a variational model using a dual formulation of a maximum a posteriori (MAP) estimator. The variational model consists of a novel adaptive fidelity term and a plugin-and-play regularization term. The fidelity term contains an adaptive weight that can automatically detect the noise types, levels, and pollution ways for each pixel. There is flexibility in choosing a plugin-and-play regularization term. For example, we can use a model-based regularizer or a deep learning-based regularizer. In addition, we present a splitting algorithm to minimize the proposed cost functional. This splitting technique enables us to transfer a mixed noise removing problem to several subproblems, including noise removal and detection. The noise detection process can be iteratively estimated by the proposed algorithm itself. Therefore, in the numerical experiments, the proposed model outperforms the existing Rudin-Osher-Fatemi (ROF), Aubert-Aujol (AA), BM3D, and deep learning-based single type denoiser. Experimental results show that the proposed model can remove noise more efficiently and better preserve details in images. Compared to the existing best-performing single type denoiser, on average, the improvements of PSNR values range from 0.33 dB to 0.81 dB under noise mixture ratios α = 0.4, 0.6.

Iterative shrinkage-thresholding algorithms provide simple methods to recover sparse signals from compressed measurements. In this paper, we propose a new class of iterative shrinkage-thresholding algorithms which preserve the computational simplicity and improve iterative estimation by incorporating a soft support detection. Indeed, at each iteration, by learning the components that are likely to be nonzero from the current signal estimation using Bayesian techniques, the shrinkage-thresholding step is adaptively tuned and optimized. Unlike other adaptive methods, we are able to prove, under suitable conditions, the convergence of the proposed methods. Moreover, we show through numerical experiments that the proposed methods outperform classical shrinkage-thresholding in terms of rate of convergence and of sparsity-undersampling tradeoff.