Convolutional Locality-Sensitive Dictionary Learning for Facial Expressions Detection

Kernel-based Sparse Representation (SR) has impacted positively on the classification performance in image recognition and has eradicated the problems attributed to the nonlinear distribution of face images and its implementation with Dictionary Learning (DL). However, the locality construction of image data containing more discriminative information, which is crucial for classification has not been fully examined by the current Kernel Sparse representation-based approaches. Furthermore, similar coding outcomes between test samples and neighbouring training data, restrained in the kernel space are not being fully realized from the image features with similar image groupings to effectively capture the embedded discriminative information. To handle these issues, we propose a novel DL method, Kernel Locality-Sensitive Discriminative SR (K-LSDSR) for face recognition. In the proposed K-LSDSR, a discriminative loss function for the groupings based on sparse coefficients is introduced into a locality-sensitive DL (LSDL). After solving the optimized dictionary, the sparse coefficients for the testing image feature samples are obtained, and then the classification results for face recognition is realized by reducing the error between the original and reassembled samples. Experimental results have shown that the proposed K-LSDSR significantly improves the performance of face recognition accuracies compared with competing methods and is robust to various diverse environments in image recognition.

Automatic prostate segmentation from MR images is an important task in various clinical applications such as prostate cancer staging and MR-guided radiotherapy planning. However, the large appearance and shape variations of the prostate in MR images make the segmentation problem difficult to solve. Traditional Active Shape/Appearance Model (ASM/AAM) has limited accuracy on this problem, since its basic assumption, i.e., both shape and appearance of the targeted organ follow Gaussian distributions, is invalid in prostate MR images. To this end, the authors propose a sparse dictionary learning method to model the image appearance in a nonparametric fashion and further integrate the appearance model into a deformable segmentation framework for prostate MR segmentation. To drive the deformable model for prostate segmentation, the authors propose nonparametric appearance and shape models. The nonparametric appearance model is based on a novel dictionary learning method, namely distributed discriminative dictionary (DDD) learning, which is able to capture fine distinctions in image appearance. To increase the differential power of traditional dictionary-based classification methods, the authors' DDD learning approach takes three strategies. First, two dictionaries for prostate and nonprostate tissues are built, respectively, using the discriminative features obtained from minimum redundancy maximum relevance feature selection. Second, linear discriminant analysis is employed as a linear classifier to boost the optimal separation between prostate and nonprostate tissues, based on the representation residuals from sparse representation. Third, to enhance the robustness of the authors' classification method, multiple local dictionaries are learned for local regions along the prostate boundary (each with small appearance variations), instead of learning one global classifier for the entire prostate. These discriminative dictionaries are located on different patches of the prostate surface and trained to adaptively capture the appearance in different prostate zones, thus achieving better local tissue differentiation. For each local region, multiple classifiers are trained based on the randomly selected samples and finally assembled by a specific fusion method. In addition to this nonparametric appearance model, a prostate shape model is learned from the shape statistics using a novel approach, sparse shape composition, which can model nonGaussian distributions of shape variation and regularize the 3D mesh deformation by constraining it within the observed shape subspace. The proposed method has been evaluated on two datasets consisting of T2-weighted MR prostate images. For the first (internal) dataset, the classification effectiveness of the authors' improved dictionary learning has been validated by comparing it with three other variants of traditional dictionary learning methods. The experimental results show that the authors' method yields a Dice Ratio of 89.1% compared to the manual segmentation, which is more accurate than the three state-of-the-art MR prostate segmentation methods under comparison. For the second dataset, the MICCAI 2012 challenge dataset, the authors' proposed method yields a Dice Ratio of 87.4%, which also achieves better segmentation accuracy than other methods under comparison. A new magnetic resonance image prostate segmentation method is proposed based on the combination of deformable model and dictionary learning methods, which achieves more accurate segmentation performance on prostate T2 MR images.

This work presents the use of Dictionary Learning methods for a sparse representation of 4D seismic data in history matching. We consider a trade-off between the number of coefficients retained in the sparse data representation, the computational cost, and how well we can capture the main features of the 4D seismic signal. K-SVD is an iterative algorithm used in Dictionary Learning problems that alternates between the calculation of the sparse representation vector and dictionary update. For the definition of the sparse representation vector, one can constrain the problem into two distinct approaches: (1) sparsity-constrained; and (2) error-constrained. We evaluated the two methods and the influence of critical parameters of the algorithm (dictionary size, number of iterations, patch size, and training dataset size) using a synthetic reservoir model. Results showed that regardless of which of the constrained approaches we used, the dictionary learning method can capture the main features of the 4D seismic signal with a sparse representation. However, the number of nonzero coefficients is highly dependent on the approach. Besides, dictionary size, number of iterations, patch size, and training dataset size, also have a significant impact on the number of coefficients and the computational cost. Consequently, the selection of these variables is crucial as it might affect the history-matching process. In a permanent-reservoir-monitoring (big data) scenario, the use of sparse representation allows us to retain the main features of the reservoir in a reasonably sized data representation that can be directly used in a history matching method, leading to improved reservoir characterization and a better understanding of the reservoir properties. This paper gives a practical implementation of a technique already used in other areas (image denoising, processing of raw seismic data, and facies representation) applied to 4D seismic data.

In this paper, we propose a simultaneous feature and dictionary learning (SFDL) method for image set based face recognition, where each training and testing example contains a face image set captured from different poses, illuminations, expressions and resolutions. While several feature learning and dictionary learning methods have been proposed for image set based face recognition in recent years, most of them learn the features and dictionaries separately, which may not be powerful enough because some discriminative information for dictionary learning may be compromised in the feature learning stage if they are applied sequentially, and vice versa. To address this, we propose a SFDL method to learn discriminative features and dictionaries simultaneously from raw face images so that discriminative information can be jointly exploited. Extensive experimental results on four widely used face datasets show that our method achieves better performance than state-of-the-art image set based face recognition methods.KeywordsFace recognitionimage setfeature learningdictionary learningsimultaneous learning

Sparse representation and dictionary learning have been successfully applied to encode dense data and facilitate image classification. Though existing dictionary learning methods achieve better performance than their counterparts, the class discriminative ability of learned dictionary is still limited. This paper proposes a novel supervised dictionary learning method based on the prior of the block diagonal phenomenon, i.e., each sample should be well reconstructed by the samples in the same class while poorly reconstructed by the samples in other class. Specifically, a block diagonal regularizer is imposed on the affinity matrix to enforce the sparse representation matrix to have an approximately block diagonal structure, which makes the learned dictionary more discriminative and suitable for classification tasks. Furthermore, we present an effective optimization strategy by combining the alternating minimization with the alternating direction method of multipliers (ADMM) for the proposed framework. Experimental results on six real-world datasets show that the proposed method is more effective than state-of-the-art dictionary learning methods.

Sparse representation based classification has led to interesting image recognition results, while the dictionary used for sparse coding plays a key role in it. This paper presents a novel dictionary learning (DL) method to improve the pattern classification performance. Based on the Fisher discrimination criterion, a structured dictionary, whose dictionary atoms have correspondence to the class labels, is learned so that the reconstruction error after sparse coding can be used for pattern classification. Meanwhile, the Fisher discrimination criterion is imposed on the coding coefficients so that they have small within-class scatter but big between-class scatter. A new classification scheme associated with the proposed Fisher discrimination DL (FDDL) method is then presented by using both the discriminative information in the reconstruction error and sparse coding coefficients. The proposed FDDL is extensively evaluated on benchmark image databases in comparison with existing sparse representation and DL based classification methods.

Low-rank double dictionary learning from corrupted data for robust image classification

For face recognition, conventional dictionary learning (DL) methods have disadvantages. In the paper, we propose a novel robust, discriminative and comprehensive DL (RDCDL) model. The proposed model uses sample diversities of the same face image to make the dictionary robust. The model includes class-specific dictionary atoms and disturbance dictionary atoms, which can well represent the data from different classes. Both the dictionary and the representation coefficients of data on the dictionary introduce discriminative information, which improves effectively the discrimination capability of the dictionary. The proposed RDCDL is extensively evaluated on benchmark face image databases, and it shows superior performance to many state-of-the-art sparse representation and dictionary learning methods for face recognition.

We address the problem of sparse channel representation for downlink channel estimation in multi-user frequency division duplexing (FDD) massive multiple-input multiple-output (MIMO) systems. Existing methods typically adopt discrete Fourier transform (DFT) matrix as a sparse basis to represent sparse channels. However, a sparse basis constructed through dictionary learning method has proven to have strong sparse channel representation. In this work, we develop a discriminative dictionary learning-based sparse channel representation for downlink channel estimation in a multi-user FDD massive MIMO systems. Considering partially shared support between near users, we present a new discriminative dictionary learning (DDL) method for sparse channel representation, based on which the channel estimation scheme is developed. Compared with learning a shared dictionary for all users, it can provide a better representation, thus improving the performance of recovery in the compressive sensing process. Numerical results demonstrate the superior performance of discriminative dictionary as compared to the shared dictionary in terms of normalized mean square error (NMSE) and symbol error rate (SER).

Slip/antiblocking agents

Mutually exclusive-KSVD: Learning a discriminative dictionary for hyperspectral image classification

Discriminative dictionary learning, playing a critical role in sparse representation based classification, has led to state-of-the-art classification results. Among the existing discriminative dictionary learning methods, two different approaches, shared dictionary and class-specific dictionary, which associate each dictionary atom to all classes or a single class, have been studied. The shared dictionary is a compact method but with lack of discriminative information; the class-specific dictionary contains discriminative information but consists of redundant atoms among different class dictionaries. To combine the advantages of both methods, we propose a new weighted block dictionary learning method. This method introduces proto dictionary and class dictionary. The proto dictionary is a base dictionary without label information. The class dictionary is a class-specific dictionary, which is a weighted proto dictionary. The weight value indicates the contribution of each proto dictionary block when constructing a class dictionary. These weight values can be computed conveniently as they are designed to adapt sparse coefficients. Different class dictionaries have different weight vectors but share the same proto dictionary, which results in higher discriminative power and lower redundancy. Experimental results demonstrate that the proposed algorithm has better classification results compared with several dictionary learning algorithms.

Although the object detection and recognition has received growing attention for decades, a robust fire and flame detection method is rarely explored. This paper presents a novel solid solution based on sparse representation with spatial pyramid pooling. Traditional sparse representation, as one of prevalent feature learning methods, is successfully applied for object detection. But it has some intrinsic defects. Firstly, it requires fixed input image size. Secondly, the accuracy of detection heavily depends on discriminative dictionary learning and feature coding. At last, it is usually very time-consuming. In this paper, we have proposed a novel dictionary learning method with the structure sparsity constraint to train a discriminative dictionary. In feature coding stage, we compute sparse codes of each patch with dictionaries learned from data and pool them to form local histogram in spatial pyramid manner. At lat, the feature vector is pipelined into a linear SVM classifier to train the model. For improving the efficiency, we also adopt the selective search approach to generate the candidate region proposals in the preprocessing stage. In processing test images, our method achieved better or comparable accuracy to the state-of-the-art on FlameDetection2010 Dataset.

Dictionary learning (DL) techniques aim to find sparse signal representations that capture prominent characteristics in a given data. Such methods operate on a data matrix $Y\in \mathbb {R}^{N\times M}$ , where each of its columns $y_i\in \mathbb {R}^N$ constitutes a training sample, and these columns together represent a sampling from the data manifold. For signals $y\in \mathbb {R}^N$ residing on weighted graphs, an additional challenge is incorporating the underlying geometric structure of the data domain into the learning process. In such cases, the topological graph structure may provide a crucial interpretation for the columns, while the data manifold itself may also possess a low-dimensional intrinsic structure that should be taken into account. In this work, we propose a novel dictionary learning algorithm for graph signals that simultaneously takes into account the underlying structure in both the signal and the manifold domains. Specifically, we require that the dictionary atoms are smooth with respect to the graph topology, as encapsulated by the graph Laplacian matrix. Furthermore, we propose to learn this graph Laplacian within the dictionary learning process, adapting it to promote the desired smoothness. Utilizing the manifold structure, we propose to encourage the smoothness of the sparse representations on the data manifold in a similar manner. Both these smoothness forces implicitly enhance the learned dictionary. The efficiency of the proposed approach is demonstrated on synthetic examples as well as on real data, showing that it outperforms other dictionary learning methods in typical problems such as resistance to noise and data completion.

Recently, the projective dictionary pair learning (DPL) method has obtained better classification representation accuracy which learned a synthesis dictionary and an analysis dictionary to achieve the goal of signal representation. In order to obtain more discriminative ability of the dictionary pair, a new method based on DPL, called discrimination projective dictionary pair learning based dictionary learning method (DPDPL), will be proposed. In DPDPL, we will consider both the inter-class and intra-class incoherence constraints of the synthesis dictionary, and the analysis dictionary should be used to simultaneously maximize the total scatter and the between-class scatter of the signal after coding. Thus, the method ensures that the dictionary has better discriminative ability and the signals are more separable after coding. Experiments of sparse representation-based classification on several face databases show the good performances of the proposed dictionary learning method.