An adaptive image representation learned from data for cervix cancer tumor detection

Sparse representation is efficient to approximately recover signals by a linear composition of a few bases from an over-complete dictionary. However, in the scenario of data compression, its efficiency and popularity are hindered due to the extra overhead for encoding the sparse coefficients. Therefore, how to establish an accurate rate model in sparse coding and dictionary learning becomes meaningful, which has been not fully exploited in the context of sparse representation. According to the Shannon entropy inequality, the variance of data source can bound its entropy, thus can reflect the actual coding bits. Therefore, a Globally Variance-Constrained Sparse Representation (GVCSR) model is proposed, where a variance-constrained rate term is introduced to the conventional sparse representation. To solve the non-convex optimization problem, we employ the Alternating Direction Method of Multipliers (ADMM) for sparse coding and dictionary learning, both of which have shown state-of-the-art rate-distortion performance in image representation.

Content-based 3D shape retrieval (CBR) become a central research topic in the field of pattern recognition. The primary challenge for CBR methods is to extract proper features for discriminating diverse shapes of 3D models with non-rigid deformations. The bag-of-features (BoF) paradigm and Local Feature Descriptors (LFDs) have demonstrated impressive levels of performance. The success of this approach prompted several extensions to BoF, such as sparse coding approach. In this study, state-of-the-art content-based 3D shape retrieval methods based on local features and sparse coding are investigated in detail. Performance of the well-known local spectral descriptors (GPS, HKS, SIHKS, WKS and meshSIFT) is tested with several algorithms for dictionaries learning and coefficient learning. Experiments are performed on the standard dataset Shrec11 with different scenarios.

Bag of Features (BoF) has been successfully exploited in content-based image retrieval for several years. Due to its performance and popularity, several extensions have been proposed that involve feature description, dictionary building, feature encoding and post-query process, etc. This paper proposes a dynamically weighting scheme for BoF-based image retrieval based on feedback. It involves two contributions: (i) analyzing the statistical distribution characteristic of similar BoF representations and (ii) computing weights dynamically based on the feedback obtained from different initial query results. We quantitatively evaluate the proposed method on two different databases. Experiments confirm that the proposed weighting scheme has better performance than the baseline of BoF-based image retrieval systems. Meanwhile, the results demonstrate the effectiveness of the weighting scheme in terms of the precision of top-N returned images.

Automatic prostate segmentation from MR images is an important task in various clinical applications such as prostate cancer staging and MR-guided radiotherapy planning. However, the large appearance and shape variations of the prostate in MR images make the segmentation problem difficult to solve. Traditional Active Shape/Appearance Model (ASM/AAM) has limited accuracy on this problem, since its basic assumption, i.e., both shape and appearance of the targeted organ follow Gaussian distributions, is invalid in prostate MR images. To this end, the authors propose a sparse dictionary learning method to model the image appearance in a nonparametric fashion and further integrate the appearance model into a deformable segmentation framework for prostate MR segmentation. To drive the deformable model for prostate segmentation, the authors propose nonparametric appearance and shape models. The nonparametric appearance model is based on a novel dictionary learning method, namely distributed discriminative dictionary (DDD) learning, which is able to capture fine distinctions in image appearance. To increase the differential power of traditional dictionary-based classification methods, the authors' DDD learning approach takes three strategies. First, two dictionaries for prostate and nonprostate tissues are built, respectively, using the discriminative features obtained from minimum redundancy maximum relevance feature selection. Second, linear discriminant analysis is employed as a linear classifier to boost the optimal separation between prostate and nonprostate tissues, based on the representation residuals from sparse representation. Third, to enhance the robustness of the authors' classification method, multiple local dictionaries are learned for local regions along the prostate boundary (each with small appearance variations), instead of learning one global classifier for the entire prostate. These discriminative dictionaries are located on different patches of the prostate surface and trained to adaptively capture the appearance in different prostate zones, thus achieving better local tissue differentiation. For each local region, multiple classifiers are trained based on the randomly selected samples and finally assembled by a specific fusion method. In addition to this nonparametric appearance model, a prostate shape model is learned from the shape statistics using a novel approach, sparse shape composition, which can model nonGaussian distributions of shape variation and regularize the 3D mesh deformation by constraining it within the observed shape subspace. The proposed method has been evaluated on two datasets consisting of T2-weighted MR prostate images. For the first (internal) dataset, the classification effectiveness of the authors' improved dictionary learning has been validated by comparing it with three other variants of traditional dictionary learning methods. The experimental results show that the authors' method yields a Dice Ratio of 89.1% compared to the manual segmentation, which is more accurate than the three state-of-the-art MR prostate segmentation methods under comparison. For the second dataset, the MICCAI 2012 challenge dataset, the authors' proposed method yields a Dice Ratio of 87.4%, which also achieves better segmentation accuracy than other methods under comparison. A new magnetic resonance image prostate segmentation method is proposed based on the combination of deformable model and dictionary learning methods, which achieves more accurate segmentation performance on prostate T2 MR images.

This paper describes how to construct a probability map using sparse representation and dictionary learning to indicate the probability of each optic disk pixel of belonging to the optic cup. This probability map will be used in the future as input to a method for automatically detecting glaucoma from color fundus images. The probability map was obtained constructing a model (using the Bayes classifier) which takes into account texture information, by means of sparse representation and RLS-DLA dictionary learning technique, and intensity information. Several experiments on a private database are presented in this work. The results are compared with the segmentation made by specialists, highlighting the promising performance of this technique in difficult cases where the optic cup is barely visible.

In this paper, we present an automated system for robust biometric recognition based upon sparse representation and dictionary learning. In sparse representation, extracted features from the training data are used to develop a dictionary. Training data of real world applications are likely to be exposed to geometric transformations, which is a big challenge for designing of discriminative dictionaries. Classification is achieved by representing the extracted features of the test data as a linear combination of entries in the dictionary. We propose joint weighted dictionary learning and classifier training (JWDL-CT) approach which simultaneously learns from a set of training samples along with weight vectors that correspond to the atoms in the learnt dictionary. The components of the weight vector associated with an atom represent the relationship between the atom and each of the classes. The weight vectors and atoms are jointly obtained during the dictionary learning. In the proposed method, a constraint is imposed on the correlation between the atoms to decrease the similarity between these atoms. The proposed dictionary learning objective function enhances the class-discrimination capabilities of individual atoms that renders the designed dictionaries especially suitable for classification of query images with very sparse representation. Experiments conducted on the West Virginia University (WVU) and the University of Notre Dame (UND) datasets for ear recognition show that the proposed method outperforms other state-of-the-art classifiers.

The sparsity is an attractive property that has been widely and intensively utilized in various image processing fields (e.g., robust image representation, image compression, image analysis, etc.). Its actual success owes to the exhaustive mining of the intrinsic (or homogenous) information from the whole data carrying redundant information. From the perspective of image representation, the sparsity can successfully find an underlying homogenous subspace from a collection of training data to represent a given test sample. The famous sparse representation (SR) and its variants embed the sparsity by representing the test sample using a linear combination of training samples with L0-norm regularization and L1-norm regularization. However, although these state-of-the-art methods achieve powerful and robust performances, the sparsity is not fully exploited on the image representation in the following three aspects: 1) the within-sample sparsity, 2) the between-sample sparsity, and 3) the image structural sparsity. In this paper, to make the above-mentioned multi-context sparsity properties agree and simultaneously learned in one model, we propose the concept of consensus sparsity (Con-sparsity) and correspondingly build a multi-context sparse image representation (MCSIR) framework to realize this. We theoretically prove that the consensus sparsity can be achieved by the L∞-induced matrix variate based on the Bayesian inference. Extensive experiments and comparisons with the state-of-the-art methods (including deep learning) are performed to demonstrate the promising performance and property of the proposed consensus sparsity.

Breakthrough results in compressive sensing (CS) have shown that high dimensional signals (vectors) can often be accurately recovered from a relatively small number of non-adaptive linear projection observations, provided that they possess a sparse representation in some basis. Subsequent efforts have established that the reconstruction performance of CS can be improved by employing additional prior signal knowledge, such as dependency in the location of the non-zero signal coefficients (structured sparsity) or by collecting measurements sequentially and adaptively, in order to focus measurements into the proper subspace where the unknown signal resides. In this paper, we examine a powerful hybrid of adaptivity and structure. We identify a particular form of structured sparsity that is amenable to adaptive sensing, and using concepts from sparse hierarchical dictionary learning we demonstrate that sparsifying dictionaries exhibiting the appropriate form of structured sparsity can be learned from a collection of training data. The combination of these techniques (structured dictionary learning and adaptive sensing) results in an effective and efficient adaptive compressive acquisition approach which we refer to as LASeR (Learning Adaptive Sensing Representations).

An automatic segmentation method of hippo-campus for volume measurement in MR brain images by using sparse patch representation and discriminative dictionary learning is proposed in this paper, which can overcome the limitation of multi-atlas approaches that mostly rely on similarity between target image and atlases for more accurate segmentation. In the proposed method, atlases are registered to a target image, then patch-based features including intensity and gradient are extracted from registered atlases for a dictionary learning model, from which dictionaries and classifiers are learned simultaneously. The label for voxels in the target image is determined via solving sparse representation of target patch over learned dictionary. Performance of the proposed method is evaluated on 30 subjects from the public dataset CIND by cross validation. Qualitative and quantitative comparisons illustrate that the proposed method is competitive compared with state-of-the-art approaches based on multi-atlas.

[1] Sparse geologic dictionaries provide a novel approach for subsurface flow model representation and calibration. Learning sparse dictionaries from prior training data sets is an effective approach to describe complex geologic connectivity patterns in subsurface imaging applications. However, the computational cost of sparse learning algorithms becomes prohibitive for large models. Performing the sparse dictionary learning process on smaller image patches (segments) provides a simple approach to address this problem in image processing applications. However, in underdetermined subsurface flow model calibration inverse problems, reconstruction of a segmented image can introduce significant structural distortion and discontinuity at the boundaries of the segments. This paper proposes an alternative sparse learning approach where the sparse dictionaries are learned from low-rank representations of the large-scale training data set in spectral domains (e.g., frequency domain). The objective is to develop a computationally efficient dictionary learning approach that emphasizes large-scale spatial connectivity patterns. This is achieved by removing the strong spatial correlations in the training data, thereby eliminating a large number of insignificant components from the sparse learning computation. In addition to improving the computational complexity, sparse learning from low-rank training data sets suppresses the small-scale details from entering the reconstruction of large-scale connectivity patterns, thereby providing a regularization effect in solving the resulting ill-posed inverse problems. We apply the proposed approach to travel-time tomography inversion and nonlinear subsurface flow model calibration inverse problems to demonstrate its effectiveness and practicality.

K-Singular Value Decomposition (K-SVD) is an excellent feature analysis method, but it has a large amount of calculation and low algorithm efficiency. To solve the above problems, a dictionary learning method for image block classification training is proposed. This method uses image entropy as the classification index of image samples, selects more complex texture image blocks with more analytical value, and uses Discrete Cosine Transform- Discrete Wavelet Transformation (DCT-DWT) dictionary to train them in K-Singular Value Decomposition. Through the feedback of sparse coefficients, the threshold value is dynamically changed and the precision of sparse coding is controlled. In the sparse solution, a variable-step Orthogonal Matching Pursuit (OMP) algorithm is used. The experimental comparison shows that the classification K-Singular Value Decomposition dictionary learning algorithm runs faster, and the Peak signal-to-noise Ratio (PSNR) and Structural Similarity (SSIM) value of the reconstructed image are higher.

This work presents a video compression method based on sparse representation and dictionary learning algorithms. The proposed scheme achieves superb rate-distortion performance and decent subjective quality, compared to modern standards, especially at low bit-rates. Different from similar works, sparse representation is employed here for both intra-frame and block matching inter-frame motion information. Dividing video frames to reference and current frames, motion vectors and motion compensation residuals of current frames are estimated in regard to reference frames. The sparse codes of reference frames and motion compensation residuals are obtained using learned dictionaries, entropy-coded, and stored or sent to the receiver along with the coded motion field. In the receiver, after decoding the sparse codes and motion vectors, the reference frames and residuals are reconstructed employing the same learned dictionary and the current frames are recovered using the reference frames and motion fields. In the proposed scheme, the Iterative Least Square Dictionary Learning Algorithm (ILS-DLA) and K-SVD dictionary building methods are employed in the DCT domain. The compression rate and quality of the method based on the two dictionary learning algorithms are compared to each other and to H.264/AVC and HEVC modern standards. The results based on PSNR and SSIM criteria show that the proposed approach presents superior performance respect to H.264/AVC and even HEVC for higher bit-rates of QCIF video format, and the K-SVD learning algorithm performs slightly better than the ILS-DLA for the purpose.

Dictionary learning with the cosparse analysis model based on summation of blocked determinants as the sparseness measure

In this paper, we introduce shift-invariant sparse image representations using tree-structured dictionaries. Sparse coding is a generative signal model that approximates signals by the linear combinations of atoms in a dictionary. Since a sparsity penalty is introduced during signal approximation and dictionary learning, the dictionary represents the primal structures of the signals. Under the shift-invariance constraint, the dictionary comprises translated structuring elements (SEs). The computational cost and number of atoms in the dictionary increase along with the increasing number of SEs. In this paper, we propose an algorithm for shift-invariant sparse image representation, in which SEs are learnt with a tree-structured approach. By using a tree-structured dictionary, we can reduce the computational cost of the image decomposition to the logarithmic order of the number of SEs. We also present the results of our experiments on SE learning and the use of our algorithm in an image recovery application.

Image reconstruction based on sparse and redundant representation model: Local vs nonlocal