Multimodal sparse representation classification with Fisher discriminative sample reduction

In this paper, we present a facial expression recognition method based on Gabor feature and sparse representation. Sparse Representation based Classification (SRC) has been widely used in computer vision and pattern recognition. And Gabor filter banks can be used to approximately model the signal processing in visual primary cortex. We believe that the nature of the attractive performance of SRC and Gabor feature lies in that they both followed the natures of signal perception of retina and information processing of cortex in human vision. Therefore, we combined the Gabor feature and SRC for facial expression recognition. The comparison experiments of proposed Gabor+SRC algorithm and straightforward SRC application are conducted on JAFFE database. And the experimental results showed the attractive performance of the proposed Gabor+SRC method.

Robust automatic facial expression detection method based on sparse representation plus LBP map

Sparse representation based classification (SRC) has gained great success in image recognition. In this paper, we propose a generalized CRC method, essentially a SRC using Euler sparse representation, for image classification. To be specific, our CRC first maps the image into a complex space by Euler representation with a negligible effect for outliers and illumination, and then performs a complex SRC method. We also present a fast and efficient algorithm to solve Euler SRC subproblems. Extensive experimental results illustrate that our method outperforms traditional SRC methods and achieves better performance for image classification.

Sparse representation based classification (SRC) and collaborative representation based classification (CRC) are two well-known methods in representation-based classification for face recognition. SRC emphasizes on the role of sparsity in coding, while CRC obtains an enhanced sparse representation with collaborative contributions from all classes. Previous studies show that sparsity of representation coefficients of SRC and CRC is significant for robust classification that may amplify the nonlocal contribution from other classes. However, the parameters are closely associated with the sparsity and it is very difficult to solve the optimal solutions. This paper proposed a novel representation-based image classification method that integrates SRC with CRC by a multiplication operation on the solutions to obtain enhanced sparse representation. We conducted experiments on several benchmark face databases and the experimental results showed that our algorithm produces higher accuracy on classification than both SRC and CRC.

We propose a fast kernel sparse representation based classification (SRC) for undersampling problem, i.e., each class has very few training samples, in face recognition. The proposed algorithm exploits a nonlinear mapping to map the data from the original input space into a high-dimensional feature space. Then, it performs very fast sparse representation and classification of samples in this space. Similar to the typical SRC methods, the proposed approach is based on the L1 norm minimization, whose direct solution can be very time-consuming. In order to improve the computational efficiency, our method uses the coordinate descent method in the feature space, which can avoid directly solving the L1 norm minimization problem, and significantly expedites the computational procedure. Compared with other SRC methods based on the L1 norm minimization, our proposed method achieves very high computational efficiency, without significantly degrading the classification performance. Several experiments on popular face databases demonstrate that our method is a promising efficient kernel SRC based method.

Aiming at the limitation of single feature classification, this paper proposes a facial expression recognition algorithm based on feature fusion and sparse representation residual fusion. The proposed method is composed of three components. Firstly, a feature fusion method based on local binary quantization (LBP) and local phase quantization (LPQ) is proposed. The LBP/LPQ features are an expression feature with image space and frequency domain. Second, Curvelet transform is used to extract the global features of facial expression, which is a very effective multi-scale, band-pass and direction analysis tool. Finally, the LBP/LPQ features and the Curvelet feature are classified by the sparse representation based classification (SRC) with stronger discrimination and robustness respectively. According to the sparse residuals of LBP/LPQ+SRC and Curvelet+SRC, a classification method of residual fusion is proposed. Experiments on JAFFE database and Cohn-Kanade database show that the proposed method effectively improves the ability of facial expression recognition and achieves a high recognition rate.

The sparse representation based classification (SRC) can effectively improve the face recognition rate. Smoothed l 0 algorithm has much faster calculation speed and requires fewer measured values than the other sparse representation method. In this paper, the sparse representation and smoothed l 0 algorithm for face recognition are presented to improve the face recognition under various conditions such as face disguise, illumination and pose changes, etc. The experiments on the AR, Extended Yale B and FERET face database verify the effectiveness of the presented method. The experimental results show that the face recognition algorithm increases to a certain extent in terms of recognition robustness and time than the original SRC.

A novel SRC fusion method using hierarchical multi-scale LBP and greedy search strategy

The theory of compressive sensing applies the sparse representation to the extraction of useful information from signals and brings a breakthrough to the theory of signal sampling. Based on compressive sensing, sparse representation-based classification (SRC) is proposed. SRC uses the compressibility of the image data to represent the facial image sparsely and could solve the problems of both massive calculation and information loss in dealing with signals. SRC does not, however, deal with the effects of variable illumination, posture and incomplete face image, which could result in severe performance degradation. This paper studies the differences between SRC recognition and human recognition. We find that there is an obvious disadvantage in the SRC algorithm, and it will significantly affect the face recognition performance in actual environment, especially for the variable illumination, posture and incomplete face image. To overcome the disadvantage of SRC algorithm, we propose an SRC-based twice face recognition algorithm named T_SRC. T_SRC uses bidirectional PCA, linear discriminant analysis and GradientFace to execute multichannel analysis, which could extract more "holistic/configural" face features in actual environment than by using SRC algorithm directly. Based on the multichannel analysis, we identify the test image by SRC firstly. Then, by analyzing the residual, this algorithm could decide whether the twice recognition is needed. If the twice recognition is needed, T_SRC extracts the facial details ("featural" face features) by the improved Harris point and Gabor filter detector. We suppose that the facial details are more stable than the whole face in actual environment, and later experiments verify our assumption. At last, this algorithm identifies the class of the test image by SRC again. The results of the experiments prove that the T_SRC algorithm has better recognition rate than SRC.

Face recognition via Weighted Sparse Representation

We develop a new method to recognize facial expressions. Sparse representation based classification (SRC) is used as the classifier in this method, because of its robustness to occlusion. Histograms of Oriented Gradient (HOG) descriptors and Local Binary Patterns are used to extract features. Since the results of HOG+SRC and LBP+SRC are complimentary, we use a classifier combination strategy to fuse these two results. Experiments on Cohn-Kanade database show that the proposed method gives better performance than existing methods such as Eigen+SRC, LBP+SRC and so on. Furthermore, the proposed method is robust to assigned occlusion.Keywords Terms-facial expression recognitionHOG descriptorsLocal binary patternClassifiers combinationSparse representation based classification (SRC)assigned occlusion

Recently the sparse representation based classification (SRC) has been successfully used in face recognition(FR). Using this Algorithm firstly we should code a query sample as a sparse linear combination of all the training samples. Secondly we need to classify it by evaluating which class leads to the minimum representation error. The dimension of imagery data is typically very high and that makes it computationally costly to process high-resolution images. It is widely believed that the - norm sparsity[4] constraint on coding coefficients plays a key role in the success of SRC. The theory of compressed sensing(CS) offers an useful method to reduce the face dimension. The basic principles of CS can reduce much lower-dimensional measurements of the images, without significantly compromising recognition performance. In order to get the Optimal sparse solution, we need to improve the sparse representation Algorithm.

The sparse representation-based classifier (SRC) has been developed and verified as having great potential for real-world face recognition. In this paper, we propose a discriminative projection and representation-based classification (DPRC) method to enhance the discriminant ability of the SRC. The proposed method first obtains a discriminative projection matrix not only maximizing the ratio of the distance within interclass over the distance within intraclass, but also minimizing the linear approximation error within intraclass. Then it maps the original data onto the discriminative space, and adopts an SRC method to obtain the final solution. An inexact augmented Lagrangian method of multiplier is proposed for finding the optimal representation vector in our framework, and a proximal alternating minimization method is adopted to the iteration subproblems of the proposed method. The proposed method is proven to have the subsequence convergence property. Experimental results on Yale, ORL, and AR face image databases demonstrate that, compared with some existing feature extraction methods based on the SRC, the proposed DPRC method is more efficient.

In recent years, sparse representation and dictionary learning methods have produced state-of-the-art results in many biometric recognition problems such as face, gait and iris recognition. However, when sparse representation-based classification methods are confronted with situations where the training data has different distribution than the test data, their performance degrades significantly. In this paper, we propose a general sparse representation-based classification method that learns projections of data in a space where the sparsity of data is maintained. We propose an efficient iterative procedure for solving the proposed optimization problem. One of the key features of the proposed method is that it is computationally efficient as the learning is done in the lower-dimensional space. Various experiments on mobile active authentication datasets consisting of face and screen touch gestures show that our method is able to capture the meaningful structure of data and can perform significantly better than many competitive domain adaptation algorithms.

Face recognition is one of the most important tools of identification in biometrics. Face recognition has attracted great attention in the last decades and numerous algorithms have been proposed. Different researches have shown that face recognition with Sparse Representation based Classification (SRC) has great classification performance. In some applications such as face recognition, it is appropriate to limit the search space of sparse solver because of local minima problem. In this paper, we apply this limitation via two methods. In the first, we apply the nonnegative constraint of sparse coefficients. As finding the sparse representation is a problem with very local minima, at first we use a simple classifier such as nearest subspace and then add the obtained information of this classifier to the sparse representation problem with some weights. Based on this view, we propose Weighted Non-negative Sparse Representation WNNSR for the face recognition problem. A quick and effective way to identify faces based on the sparse representation (SR) is smoothed $L_0$-norm $(SL_0)$ approach. In this paper, we solve the WNNSR problem based on the $SL_0$ idea. This approach is called Weighted Non-Negative Smoothed $L_0$ norm $(WNNSL_0)$. The simulation results on the Extended Yale B database demonstrate that the proposed method has high accuracy in face recognition better than the ultramodern sparse solvers approach.