A New Solution Scheme of Unsupervised Locality Preserving Projection Method for the SSS Problem

LPP solution schemes for use with face recognition

Locality-preserving projection (LPP) is a promising manifold-based dimensionality reduction and linear feature extraction method for face recognition. However, there exist two main issues in traditional LPP algorithm. LPP does not utilize the class label information at the training stage and its performance will be affected for classification tasks. In addition, LPP often suffers from small sample size (3S) problem, which occurs when the dimension of input pattern space is greater than the number of training samples. Under this situation, LPP fails to work. To overcome these two limitations, this paper presents a novel supervised regularization LPP (SRLPP) approach based on a supervised graph and a new regularization strategy. It theoretically proves that regularization matrix [Formula: see text] approaches to the original one as the regularized parameter tends to zero. The proposed SRLPP method is subsequently applied to face recognition. The experiments are conducted on two publicly available face databases, namely ORL database and FERET database. Compared with some existing LDA-based and LPP-based linear feature extraction approaches, experimental results show that our SRLPP approach gives superior performance.

Quaternion-based improved LPP method for color face recognition

A new image feature extraction method for face recognition called Tri-direction 2D-Fisher Discriminant Analysis (T2D-FDA) is proposed to deal with the Small Sample Size (SSS) problem in conventional 1D-Fisher Discriminant Analysis (1D-FDA). Moreover, the essence of T2D-FDA is investigated, and the equivalence of the left-multiplying 2D-FDA of the original image matrices and the left-multiplying D2D-FDA of diagonal image matrices is verified if each column is viewed as a computational unit. Different from the 1D-LDA based approaches, the T2D-FDA is based on 2D image matrices rather than column vectors, so the image matrix does not need to be transformed into a long vector before feature extraction. The advantage arising in this way is that the SSS problem does not exist anymore because within-class scatter matrices constructed is full-rank in T2D-FDA. The proposed method is applied to face recognition where only few training images exist for each subject. Experiment results show T2D-FDA outperforms the current linear subspace methods in SSS problem on four public databases: ORL, Yale, AR and FERET face databases.

Linear Discriminant Analysis (LDA) has been one of the popular subspace methods for face recognition. But this method suffers from the small sample size (SSS) problem, also known as 'curse of dimensionality'. Various techniques have been proposed in literature to overcome this limitation. But it is still unclear which method provides the best solution to SSS problem. In this paper, we have investigated the performance of some popular subspace methods such as principal component analysis (PCA), PCA + LDA, LDA via QR decomposition, Null-space LDA, Exponential Discriminant Analysis (EDA), PCA+EDA etc. Extensive experiments have been performed on five publically available face datasets viz. AR, CMU-PIE, PIX, Yale and YaleB. The performance is measured in terms of average classification accuracy. Experimental results show that the performance increases with the increase in the number of images per person in training set irrespective of the datasets. There is no clear winner among the subspace methods under investigation. But, the performance of PCA+LDA and PCA+EDA is consistent in tackling SSS problem irrespective of the dataset and can also handle the illumination variation in face recognition.

We made two contributions in this paper. First, a new method called two-dimensional fisher discriminant analysis (2D-FDA) is proposed to deal with the small sample size (SSS) problem in LDA based face recognition. Second, appearance and depth information are combined to improve face recognition rate. Different from the conventional 1D-FDA (PCA plus LDA) approaches, 2D-FDA is based on 2D image matrices rather than column vectors so the image matrix does not need to be transformed into a long vector before feature extraction. The advantage arising in this way is that the SSS problem does not exist any more because the between-class and within-class scatter matrices constructed in 2D-FDA are both of full-rank. 2D FDA and 1D FDA (PCA plus LDA) are evaluated respectively with a problem that combines appearance and depth information for face recognition. We investigate the complete range of linear combinations to reveal the interplay between these two paradigms. The recognition rate by the combination is better than either appearance alone or depth alone. It is verified that 2D-FDA outperforms 1D FDA

Due to its wide applications in practice, face recognition has been an active research topic. With the availability of adequate training samples, many machine learning methods could yield high face recognition accuracy. However, under the circumstance of inadequate training samples, especially the extreme case of having only a single training sample, face recognition becomes challenging. How to deal with conflicting concerns of the small sample size and high dimensionality in one-sample face recognition is critical for its achievable recognition accuracy and feasibility in practice. Being different from the conventional methods for global face recognition based on generalization ability promotion and local face recognition depending on image segmentation, a single-sample face recognition algorithm based on locality preserving projection (LPP) feature transfer is proposed here. First, transfer sources are screened to obtain the selective sample source using the whitened cosine similarity metric. Second, we project the vectors of source faces and target faces into feature subspace by LPP, respectively, and calculate the feature transfer matrix to approximate the mapping relationship on source faces and target faces in subspace. Then, the feature transfer matrix is used on training samples to transfer the original macro characteristics to target macro characteristics. Finally, the nearest neighbor classifier is used for face recognition. Our results based on popular databases FERET, ORL, and Yale demonstrate the superiority of the proposed LPP feature transfer-based one-sample face recognition algorithm when compared with popular single-sample face recognition algorithms, such as (PC) $^{2}\text{A}$ and Block FLDA.

Face recognition technology has evolved as an enchanting solution to address the contemporary needs in order to perform identification and verification of identity claims. By advancing the feature extraction methods and dimensionality reduction techniques in the application of pattern recognition, a number of face recognition systems has been developed with distinct degrees of success. Locality preserving projection (LPP) is a recently proposed method for unsupervised linear dimensionality reduction. LPP preserve the local structure of face image space which is usually more significant than the global structure preserved by principal component analysis (PCA) and linear discriminant analysis (LDA). This paper focuses on a systematic analysis of locality-preserving projections and the application of LPP in combination with an existing technique This combined approach of LPP through MPCA can preserve the global and the local structure of the face image which is proved very effective. Proposed approach is tested using the AT & T face database. Experimental results show the significant improvements in the face recognition performance in comparison with some previous methods.

Graph regularized non-negative matrix factorization (GNMF) is widely used in feature extraction. In the process of dimensionality reduction, GNMF can retain the internal manifold structure of data by adding a regularizer to non-negative matrix factorization (NMF). Because Ga NMF regularizer is implemented by local preserving projections (LPP), there are small sample size problems (SSS). In view of the above problems, a new algorithm named robust exponential graph regularized non-negative matrix factorization (REGNMF) is proposed in this paper. By adding a matrix exponent to the regularizer of GNMF, the possible existing singular matrix will change into a non-singular matrix. This model successfully solves the problems in the above algorithm. For the optimization problem of the REGNMF algorithm, we use a multiplicative non-negative updating rule to iteratively solve the REGNMF method. Finally, this method is applied to AR, COIL database, Yale noise set, and AR occlusion dataset for performance test, and the experimental results are compared with some existing methods. The results indicate that the proposed method is more significant.

Dimensionality reduction technologies are very important for pattern representation and recognition. Among them, locality preserving projection (LPP) is a manifold dimensionality reduction scheme and has been successfully applied to face recognition. However, LPP is an unsupervised linear approach, its performance will degrade for classification tasks. Especially, when the dimension of input space is greater than the number of training data, singularity problem will occur and LPP cannot be implemented directly. To tackle the draw backs of LPP algorithm, this paper proposes a novel regularized LPP(RLPP) approach using supervised graph and regularization technique. The proposed RLPP method has been tested and evaluated with two public available databases, namely ORL and FERET databases. Experimental results show that the proposed RLPP approach surpasses Laplacianface and Direct-LPP (DLPP) methods.

In the present work, appearance-based face recognition method called the Laplacianface approach is used. The face images are mapped into a face subspace for analysis by using Locality Preserving Projections(LPP). The technique is different from Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA) which effectively see only the Euclidean structure of face space. The main goal of LPP is to preserve neighbourhood structure of the data set optimally and hence obtain a face subspace that best detects the essential face manifold structure. The Laplacianfaces are the optimal linear approximations to the Eigen functions of the Laplace Beltrami operator on the face manifold. Hence, by using this approach undesired variations because of facial expression, changes in lighting conditions, and pose may be eliminated or reduced. Performance analysis of face recognition is carried out on standard databases using both LPP technique and PCA technique. For comparison purpose, PCA with ANN classifier based on Back Propagation Feed Forward Neural Network is also developed and being used for training the input face images and then testing. LPP approach outperforms PCA with ANN, and provides better face representation and also achieves lower error rate.

This doctoral thesis presents a framework for machine based interpretation of Malaysian Sign Language (MSL). The goal is to explore and develop necessary core algorithms that are capable of recognizing hand signs, based on the monocular/2D visual input of a low-cost hardware (Digital Webcam), without the assistance of visual-markers on hands. Successful hand sign interpretation with the aforementioned constrained visual system is challenging. Economical hardware devices often provide noisy/cluttered raw data with limited useful information. Non-involvement of visual markers imposes the requirement of additional strategies to disambiguate occlusions and background complexities. Natural variations in hand posture/gesture performances further convolute the recognition task. Addressing these challenges require computationally heavy algorithms in image processing, machine learning and pattern recognition. Thus vision-based sign language translator frameworks have to be multifaceted and versatile, in order to address innumerable practical concerns. In this research, hand postures interpretation is achieved by statistical projection methods. Analysis of high dimensional hand shape data is a complex task. Thus reducing dimensions via known projection methods aids in alleviating some of these complexities. Locality Preserving Projection (LPP) has been employed to accomplish this goal, while Principal Component Analysis (PCA) has been used as the benchmark method. Both methods were extensively tested against a hand posture database of 24 alphabet signs from MSL. As for the hand gesture interpretation, parameter-less Gaussian process based machine learning methods are proposed, as an alternative to current status quo. A variation of the Gaussian latent variable model – Gaussian Process Dynamic Model (GPDM) – has been employed for hand gesture interpretation. This has been comparatively studied against the established Hidden Markov Model (HMM). These machine learning methods were thoroughly tested against a hand gesture database of 64 signs from MSL. Grammatical sentence construction offers both intelligible sentences, and a mean of identifying erroneous sign classifications. In this thesis, a proof-of-concept on: use of Context Free Grammar (CFG) in successful parsing of meaningful sentences based on recognised gesture words, and how it can be extended in identifying (and correcting) erroneous sign classifications, is demonstrated with 92 sentences and the output of GPDM gesture classification. The novelty and contribution of this research: this is the first undertaking of markerless vision-based translation for MSL. Both LPP and GPDM are introduced to the sign language research field as an outcome of this investigation. The preliminary study and demonstration of grammatical sentence construction for translated gesture signs, is the first of its kind to the best of author's knowledge.

In order to search for an efficient feature extraction approach for face recognition,a method based on feature level fusion was presented.This method integrated Locality Preserving Projection(LPP) with Maximum Margin Criterion(MMC).Firstly,LPP was performed on training samples set,so the projection of each training sample on LPP subspace could be got.Further,MMC algorithm was performed on all the obtained projections to get more efficient discriminant features for recognition.Nearest Neighborhood(NN) algorithm was used to construct classifiers.The experiments on the ORL face database show that the recognition rate of the proposed method is high when pose,illumination condition,face expression and training sample number change.

Compared to vector based manifold learning methods, image based methods can reduce the complexity of algorithm, avoid the small sample size problem and give more spatial structural information of image. Two-dimensionality Locality Discriminat Projections (2D-LDP) is proposed, which an effective dimensionality reduction method and benefits from three parts, i.e., Locality Preserving Projections (LPP) algorithm, image based projection and discriminant analysis. In this paper, we apply 2DLPP to plant leaf classification. 2D-LDP can detect the intrinsic class-relationships between the leaf images by incorporating both class label information and neighborhood information. The Experimental results show that 2D-DLPP has better classifying performance than other methods.KeywordsLocality Preserving Projections (LPP)Two-dimensionality Locality Discriminat Projections (2D-LDP)Plant leaf Classification

Enhanced locality preserving projections using robust path based similarity