Compressed sensing based on dictionary learning for extracting impulse components

[1] Sparse geologic dictionaries provide a novel approach for subsurface flow model representation and calibration. Learning sparse dictionaries from prior training data sets is an effective approach to describe complex geologic connectivity patterns in subsurface imaging applications. However, the computational cost of sparse learning algorithms becomes prohibitive for large models. Performing the sparse dictionary learning process on smaller image patches (segments) provides a simple approach to address this problem in image processing applications. However, in underdetermined subsurface flow model calibration inverse problems, reconstruction of a segmented image can introduce significant structural distortion and discontinuity at the boundaries of the segments. This paper proposes an alternative sparse learning approach where the sparse dictionaries are learned from low-rank representations of the large-scale training data set in spectral domains (e.g., frequency domain). The objective is to develop a computationally efficient dictionary learning approach that emphasizes large-scale spatial connectivity patterns. This is achieved by removing the strong spatial correlations in the training data, thereby eliminating a large number of insignificant components from the sparse learning computation. In addition to improving the computational complexity, sparse learning from low-rank training data sets suppresses the small-scale details from entering the reconstruction of large-scale connectivity patterns, thereby providing a regularization effect in solving the resulting ill-posed inverse problems. We apply the proposed approach to travel-time tomography inversion and nonlinear subsurface flow model calibration inverse problems to demonstrate its effectiveness and practicality.

This paper describes how to construct a probability map using sparse representation and dictionary learning to indicate the probability of each optic disk pixel of belonging to the optic cup. This probability map will be used in the future as input to a method for automatically detecting glaucoma from color fundus images. The probability map was obtained constructing a model (using the Bayes classifier) which takes into account texture information, by means of sparse representation and RLS-DLA dictionary learning technique, and intensity information. Several experiments on a private database are presented in this work. The results are compared with the segmentation made by specialists, highlighting the promising performance of this technique in difficult cases where the optic cup is barely visible.

Synthetic aperture radar (SAR) images are corrupted by speckle noise due to random interference of electromagnetic waves. In this paper, we proposed a speckle reduction technique based on sparse representation and dictionary learning. Firstly, an adaptive dictionary was learned by performing KSVD algorithm through a large amount of training patches extracted from the noisy SAR image. Considering the inaccurate recovery of point targets which is brought by the inadequate number of training samples, we employed a point target enhancing scheme to highlight the important point targets in the SAR image. Some experiments were conducted on real SAR images, and the results shows that our proposed algorithm can effectively reduce the speckle noise as well as preserve details. Some comparisons are made to prove its superiority to the available algorithms.

An automatic segmentation method of hippo-campus for volume measurement in MR brain images by using sparse patch representation and discriminative dictionary learning is proposed in this paper, which can overcome the limitation of multi-atlas approaches that mostly rely on similarity between target image and atlases for more accurate segmentation. In the proposed method, atlases are registered to a target image, then patch-based features including intensity and gradient are extracted from registered atlases for a dictionary learning model, from which dictionaries and classifiers are learned simultaneously. The label for voxels in the target image is determined via solving sparse representation of target patch over learned dictionary. Performance of the proposed method is evaluated on 30 subjects from the public dataset CIND by cross validation. Qualitative and quantitative comparisons illustrate that the proposed method is competitive compared with state-of-the-art approaches based on multi-atlas.

In this paper, we present an automated system for robust biometric recognition based upon sparse representation and dictionary learning. In sparse representation, extracted features from the training data are used to develop a dictionary. Training data of real world applications are likely to be exposed to geometric transformations, which is a big challenge for designing of discriminative dictionaries. Classification is achieved by representing the extracted features of the test data as a linear combination of entries in the dictionary. We propose joint weighted dictionary learning and classifier training (JWDL-CT) approach which simultaneously learns from a set of training samples along with weight vectors that correspond to the atoms in the learnt dictionary. The components of the weight vector associated with an atom represent the relationship between the atom and each of the classes. The weight vectors and atoms are jointly obtained during the dictionary learning. In the proposed method, a constraint is imposed on the correlation between the atoms to decrease the similarity between these atoms. The proposed dictionary learning objective function enhances the class-discrimination capabilities of individual atoms that renders the designed dictionaries especially suitable for classification of query images with very sparse representation. Experiments conducted on the West Virginia University (WVU) and the University of Notre Dame (UND) datasets for ear recognition show that the proposed method outperforms other state-of-the-art classifiers.

Automatic prostate segmentation from MR images is an important task in various clinical applications such as prostate cancer staging and MR-guided radiotherapy planning. However, the large appearance and shape variations of the prostate in MR images make the segmentation problem difficult to solve. Traditional Active Shape/Appearance Model (ASM/AAM) has limited accuracy on this problem, since its basic assumption, i.e., both shape and appearance of the targeted organ follow Gaussian distributions, is invalid in prostate MR images. To this end, the authors propose a sparse dictionary learning method to model the image appearance in a nonparametric fashion and further integrate the appearance model into a deformable segmentation framework for prostate MR segmentation. To drive the deformable model for prostate segmentation, the authors propose nonparametric appearance and shape models. The nonparametric appearance model is based on a novel dictionary learning method, namely distributed discriminative dictionary (DDD) learning, which is able to capture fine distinctions in image appearance. To increase the differential power of traditional dictionary-based classification methods, the authors' DDD learning approach takes three strategies. First, two dictionaries for prostate and nonprostate tissues are built, respectively, using the discriminative features obtained from minimum redundancy maximum relevance feature selection. Second, linear discriminant analysis is employed as a linear classifier to boost the optimal separation between prostate and nonprostate tissues, based on the representation residuals from sparse representation. Third, to enhance the robustness of the authors' classification method, multiple local dictionaries are learned for local regions along the prostate boundary (each with small appearance variations), instead of learning one global classifier for the entire prostate. These discriminative dictionaries are located on different patches of the prostate surface and trained to adaptively capture the appearance in different prostate zones, thus achieving better local tissue differentiation. For each local region, multiple classifiers are trained based on the randomly selected samples and finally assembled by a specific fusion method. In addition to this nonparametric appearance model, a prostate shape model is learned from the shape statistics using a novel approach, sparse shape composition, which can model nonGaussian distributions of shape variation and regularize the 3D mesh deformation by constraining it within the observed shape subspace. The proposed method has been evaluated on two datasets consisting of T2-weighted MR prostate images. For the first (internal) dataset, the classification effectiveness of the authors' improved dictionary learning has been validated by comparing it with three other variants of traditional dictionary learning methods. The experimental results show that the authors' method yields a Dice Ratio of 89.1% compared to the manual segmentation, which is more accurate than the three state-of-the-art MR prostate segmentation methods under comparison. For the second dataset, the MICCAI 2012 challenge dataset, the authors' proposed method yields a Dice Ratio of 87.4%, which also achieves better segmentation accuracy than other methods under comparison. A new magnetic resonance image prostate segmentation method is proposed based on the combination of deformable model and dictionary learning methods, which achieves more accurate segmentation performance on prostate T2 MR images.

Retinal blood vessels are considered as being interference on the retinal images for the task of detecting significant features of the most frequent eye diseases. If these blood vessel structures could be suppressed, it might lead to a more accurate segmentation of retinal lesions as well as a better extraction of textural features to be used for pathology detection. This work proposes, as a novelty, the use of sparse representations and dictionary learning techniques for retinal vessel inpainting. The dictionary learning algorithms used in this paper were the Recursive Least Square Dictionary Learning (RLS-DL), and Online Dictionary Learning (ODL). We tested the performance of the algorithm for grayscale and RGB images from the DRIVE public database, employing different neighbourhoods and sparseness factors. An average recovery error smaller than 0.022 was achieved. The results suggest that the use of sparse representations and dictionaries learned by RLS-DLA performs very well for inpainting of retinal blood vessels.

Sparse representation is efficient to approximately recover signals by a linear composition of a few bases from an over-complete dictionary. However, in the scenario of data compression, its efficiency and popularity are hindered due to the extra overhead for encoding the sparse coefficients. Therefore, how to establish an accurate rate model in sparse coding and dictionary learning becomes meaningful, which has been not fully exploited in the context of sparse representation. According to the Shannon entropy inequality, the variance of data source can bound its entropy, thus can reflect the actual coding bits. Therefore, a Globally Variance-Constrained Sparse Representation (GVCSR) model is proposed, where a variance-constrained rate term is introduced to the conventional sparse representation. To solve the non-convex optimization problem, we employ the Alternating Direction Method of Multipliers (ADMM) for sparse coding and dictionary learning, both of which have shown state-of-the-art rate-distortion performance in image representation.

We propose a framework for automated detection of dry age-related macular degeneration (AMD) and diabetic macular edema (DME) from retina optical coherence tomography (OCT) images, based on sparse coding and dictionary learning. The study aims to improve the classification performance of state-of-the-art methods. First, our method presents a general approach to automatically align and crop retina regions; then it obtains global representations of images by using sparse coding and a spatial pyramid; finally, a multiclass linear support vector machine classifier is employed for classification. We apply two datasets for validating our algorithm: Duke spectral domain OCT (SD-OCT) dataset, consisting of volumetric scans acquired from 45 subjects—15 normal subjects, 15 AMD patients, and 15 DME patients; and clinical SD-OCT dataset, consisting of 678 OCT retina scans acquired from clinics in Beijing—168, 297, and 213 OCT images for AMD, DME, and normal retinas, respectively. For the former dataset, our classifier correctly identifies 100%, 100%, and 93.33% of the volumes with DME, AMD, and normal subjects, respectively, and thus performs much better than the conventional method; for the latter dataset, our classifier leads to a correct classification rate of 99.67%, 99.67%, and 100.00% for DME, AMD, and normal images, respectively.

For face recognition, conventional dictionary learning (DL) methods have disadvantages. In the paper, we propose a novel robust, discriminative and comprehensive DL (RDCDL) model. The proposed model uses sample diversities of the same face image to make the dictionary robust. The model includes class-specific dictionary atoms and disturbance dictionary atoms, which can well represent the data from different classes. Both the dictionary and the representation coefficients of data on the dictionary introduce discriminative information, which improves effectively the discrimination capability of the dictionary. The proposed RDCDL is extensively evaluated on benchmark face image databases, and it shows superior performance to many state-of-the-art sparse representation and dictionary learning methods for face recognition.

This work presents a video compression method based on sparse representation and dictionary learning algorithms. The proposed scheme achieves superb rate-distortion performance and decent subjective quality, compared to modern standards, especially at low bit-rates. Different from similar works, sparse representation is employed here for both intra-frame and block matching inter-frame motion information. Dividing video frames to reference and current frames, motion vectors and motion compensation residuals of current frames are estimated in regard to reference frames. The sparse codes of reference frames and motion compensation residuals are obtained using learned dictionaries, entropy-coded, and stored or sent to the receiver along with the coded motion field. In the receiver, after decoding the sparse codes and motion vectors, the reference frames and residuals are reconstructed employing the same learned dictionary and the current frames are recovered using the reference frames and motion fields. In the proposed scheme, the Iterative Least Square Dictionary Learning Algorithm (ILS-DLA) and K-SVD dictionary building methods are employed in the DCT domain. The compression rate and quality of the method based on the two dictionary learning algorithms are compared to each other and to H.264/AVC and HEVC modern standards. The results based on PSNR and SSIM criteria show that the proposed approach presents superior performance respect to H.264/AVC and even HEVC for higher bit-rates of QCIF video format, and the K-SVD learning algorithm performs slightly better than the ILS-DLA for the purpose.

Facial Expression (FE) detection is a popular research area, particularly in the field of Image Classification, Pattern Recognition and Computer Vision. Sparse Representation (SR) and Dictionary Learning (DL) have significantly enhanced the classification performance of image recognition and also resolved the problem of the nonlinear distribution of face images and its implementation with DL. However, the locality structure of face image data containing more discriminative information, which is very critical for classification has not been fully explored by state-of-the-art existing SR-based approaches. Furthermore, similar coding results between test samples and neighboring training data, contained in the feature space are not being fully realized from the image features with similar image categorizations, to effectively capture the embedded discriminative information. In an attempt to resolve the forgoing issues, we propose a novel DL method, Convolutional locality-sensitive Dictionary Learning (CLSDL) for Facial Expression detection.

Magnetic Resonance Imaging (MRI) provides a non-invasive manner to aid clinical diagnosis, while its limitation is the slow scanning speed. Recently, due to the high costs of health care and taking account of patient comfort, some methods such as Parallel MRI (pMRI) and compressed sensing MRI have been developed to reduce the MR scanning duration under the sampling process. It is almost unavoidable to accept some doses of X-rays in computed tomography (CT scans). If one could find a more efficient way to represent the required visual information, the tasks of image processing and medical imaging would become easier and less troublesome. In this paper, first, we used pMRI on complex double data of brain magnetic resonance image. pMRI significantly reduces the number of measurements in the Fourier domain because each coil only acquires a small fraction of the whole measurements. It is important to reconstruct the original MR image efficiently and precisely for better diagnosis. In this research, we proposed a new super resolution and deblurring algorithm with dictionary learning, based on assuming a local Sparse-Land model on image patches, serving as regularization, then we validated the proposed method by using another one called the adaptive selection of sub dictionaries- adaptive reweighted sparsity regularization. Visual comparison and significant difference in psnr calculation (0.8111db) and time complexity showed that the proposed method had much better results.

Sparse dictionary learning by block proximal gradient with global convergence

This paper presents a Joint Graph Learning and Signal Representation algorithm, called JGLSR, for simultaneous topology learning and graph signal representation via a learned over-complete dictionary. The proposed algorithm alternates between three main steps: sparse coding, dictionary learning, and graph topology inference. We introduce the “transformed graph” which can be considered as a projected graph in the transform domain spanned by the dictionary atoms. Simulation results via synthetic and real data show that the proposed approach has a higher performance when compared to the well-known algorithms for joint undirected graph topology inference and signal representation, when there is no information about the transform domain. Five performance measures are used to compare JGLSR with two conventional algorithms and show its higher performance.