- Research Article
48
- 10.1016/j.patcog.2006.11.020
Shadow compensation in 2D images for face recognition
- Jan 17, 2007
- Pattern Recognition
- Sang-Il Choi + 2 more +2
Shadow compensation in 2D images for face recognition
Robust face recognition under variant illumination conditions is a challenging research problem. In this paper, a new shadow compensation method, called adaptive shadow compensation (ASC), will be proposed to eliminate shadows in the face image due to non-frontal lighting directions. ASC performs shadow compensation in each local region, based on Fourier analysis on each local image block, to remove as much shadows as possible. Null-space linear discriminant analysis is then employed to extract discriminant features from ASC compensated images. Experimental results on the Yale B face database show that the proposed ASC method can achieve high face recognition accuracy under illumination variations.
Loading PDF
Shadow compensation in 2D images for face recognition
Shadow compensation in 2D images for face recognition
Performance evaluation of subspace methods to tackle small sample size problem in face recognition
Linear Discriminant Analysis (LDA) has been one of the popular subspace methods for face recognition. But this method suffers from the small sample size (SSS) problem, also known as 'curse of dimensionality'. Various techniques have been proposed in literature to overcome this limitation. But it is still unclear which method provides the best solution to SSS problem. In this paper, we have investigated the performance of some popular subspace methods such as principal component analysis (PCA), PCA + LDA, LDA via QR decomposition, Null-space LDA, Exponential Discriminant Analysis (EDA), PCA+EDA etc. Extensive experiments have been performed on five publically available face datasets viz. AR, CMU-PIE, PIX, Yale and YaleB. The performance is measured in terms of average classification accuracy. Experimental results show that the performance increases with the increase in the number of images per person in training set irrespective of the datasets. There is no clear winner among the subspace methods under investigation. But, the performance of PCA+LDA and PCA+EDA is consistent in tackling SSS problem irrespective of the dataset and can also handle the illumination variation in face recognition.
Read moreAn automatic remote sensing image shadow compensation method utilizing reflectance differences and transfer learning
Shadows inevitably exist in remote sensing images (RSIs) and are characterized by lower resolution, mixed-pixel, and diverse background information. These characteristics pose a great challenge to the automatic compensation of shadows in RSIs. To address these issues, this paper proposes a training method using automatically simulated data to achieve real shadow compensation. In the process of data simulation, we take into comprehensive account the distribution, spatial extent, morphology, and other properties of shadows in RSIs, along with the reflectivity differences of ground features. And a lightweight shadow compensation framework is proposed to compensate shadows. Specifically, a Stair-step Hierarchical Context Aggregation Module is employed in the primary stage to integrate global and local texture information that is more important for shadow compensation. After that, a U-shaped end-to-end structure is used to perceive shadows and image features. Then, a Buffer-based mask attention Module is proposed to enhance the network’s attentiveness to both shadows and shadow boundaries. Finally, an additional high-resolution residual connection is utilized to get the final output. This connection effectively maintains the continuity of the image. This method was validated by two remote sensing image datasets with different resolutions and achieved favorable results.
Read moreFace recognition using elastic local reconstruction based on a single face image
Face recognition using elastic local reconstruction based on a single face image
Contourlet transform based algorithm of shadow compensation for face recognition
This paper researches of the new multi-scale geometric analysis tool-Contourlet and proposes a new Contourlet multi-threshold method of shadow compensation for uneven illumination face images. The proposed algorithm combines hard threshold with 2D shadow compensation method and selects proper thresholds depending on the sub-band layers of Contourlet transform. It takes full advantage of the shadow elimination with Contourlet multi-threshold method and the 2D shadow compensation method, so that it could obtain the information of the shadow field and non-shadow field. Experiments are carried out using the Yale B database and the results demonstrate that the face images dealt with the proposed method have good subjective vision and impersonal identify ratio. For images under different illumination angles, compared with 2D shadow compensation algorithm, the proposed method has an average recognition ratio increase of 21.20% to 55.84% in extreme condition.
Read moreLocal Directional Amplitude Feature for Illumination Normalization with Application to Face Recognition
Face recognition under variant illumination conditions has been one of the major research topics in the development of face recognition systems. In this paper we analyze the strength and the weakness of different types of approaches, and design an illumination robust feature by combining the directional and amplitude information as an optimal solution to the problem. We first extract and process the direction and amplitude information of the pixel changes, and then fuse them into a comprehensive feature. We conducted our experiments on CMU-PIE database and Extended Yale B database, and all the results have shown the effectiveness of our approach.
Read moreBiview face recognition in the shape–texture domain
Face recognition is one of the biometric identification methods with the highest potential. The existing face recognition algorithms relying on the texture information of face images are affected greatly by the variation of expression, scale and illumination. Whereas the algorithms based on the shape topology weaken the influence of illumination to some extent, but the impact of expression, scale and illumination on face recognition is still unsolved. To this end, we propose a new method for face recognition by integrating texture information with shape information, called biview face recognition algorithm. The texture models are constructed by using subspace learning methods and shape topologies are formed by building graphs for face images. The proposed biview face recognition method is compared with recognition algorithms merely based on texture or shape information. Experimental results of recognizing faces under the variation of illumination, expression and scale demonstrate that the performance of the proposed biview face recognition outperforms texture-based and shape-based algorithms.
Read moreFusion of Visual and Thermal Signatures with Eyeglass Removal for Robust Face Recognition
This paper describes a fusion of visual and thermal infrared (IR) images for robust face recognition. Two types of fusion methods are discussed: data fusion and decision fusion. Data fusion produces an illumination-invariant face image by adaptively integrating registered visual and thermal face images. Decision fusion combines matching scores of individual face recognition modules. In the data fusion process, eyeglasses, which block thermal energy, are detected from thermal images and replaced with an eye template. Three fusion-based face recognition techniques are implemented and tested: Data fusion of visual and thermal images (Df), Decision fusion with highest matching score (Fh), and Decision fusion with average matching score (Fa). A commercial face recognition software FaceIt® is used as an individual recognition module. Comparison results show that fusion-based face recognition techniques outperformed individual visual and thermal face recognizers under illumination variations and facial expressions.
Read moreNuclear Norm Based Superposed Collaborative Representation Classifier for Robust Face Recognition
In this paper, we propose a novel robust face recognition framework named nuclear norm based superposed collaborative representation classifier (NNSCRC) to handle illumination variations, occlusion and undersampled problems in face recognition. Specifically, we develop a superposed linear collaborative representation classifier for robust face recognition by representing the query image in terms of a superposition of the class centroid, the shared intra-class difference, and the low rank error. By representing a face image as the class centroid and the shared intra-class difference, our model can effectively enhance the face recognition performance on undersampled databases. In addition, since the occlusion and illumination variations generally lead to a low-rank error image, we use nuclear norm matrix regression to obtain these low-rank errors, which makes our model able to reconstruct the test image better. Extensive experiments are performed on Extended Yale-B and AR databases, which show the effectiveness of NNSCRC in robust face recognition.
Read moreRandom sampling LDA incorporating feature selection for face recognition
Classical Linear Discriminant Analysis (LDA) is usually suffers from the small sample size (SSS) problem when dealing with the high dimensional face data. Many methods have been proposed for solving this problem such as Fisherface and Null Space LDA (N-LDA), but these methods are overfitted to the training set and inevitably lose some useful discriminative information in many cases. To effectively utilize nearly all useful discriminative information, a not completely random sampling framework for the integration of multiple features is developed. However, this method has the following main disadvantage: By directly employing feature extraction, the newly constructed variables may contain lots of information originated from those redundant features in the original space. So, in this paper, we introduce a new random sampling LDA by incorporating feature selection for face recognition, that is, some redundant features are removed using the given feature selection methods at first, and then PCA is employed, finally we use random sampling to generate multiple feature subsets. Along this, corresponding weak LDA classifiers are naturally generated and an integrated classifier is developed using a fusion rule. Experiments on 4 face datasets (AR, ORL, Yale, YaleB) show the effectiveness of our algorithm.
Read moreEmbedded Face Recognition System Based on Multi-task Convolutional Neural Network and LBP Features
Based on neural network and local binary pattern algorithm, this paper builds a lightweight artificial face recognition system on chip Firefly-RK3399, with high speed, strong robustness and high recognition accuracy. Our embedded artificial intelligent face recognition system mainly consists of face detection, feature extraction and recognition. Multi-task convolutional neural network (MTCNN) under the CaffeOnACL framework is utilized for face detection, and the local binary pattern (LBP) is applied as face recognition algorithm. Experiments illustrate that our artificial intelligent embedded face recognition system has high speed and accuracy, which is easy-carrying and of high commercial value as well.
Read moreAdaptive Context-Aware Filter Fusion for Face Recognition on Bad Illumination
At present, the performance of face recognition system depends much on the variations in illumination. To solve this problem, this paper presents an adaptable face recognition approach that uses filter fusion representation. The key idea is to use context-aware filter fusion to get better image from a bad illumination one. Genetic algorithm is the tool for adaptation for individual context category. These can provide robust face recognition on illumination context-awareness under uneven environments. Gabor wavelet representation can also provide a robust feature for image enhancement. Using these approaches, we have developed a robust face recognition technique that can recognize with a notable success and it has been tested on Inha DB and FERET face images.
Read moreAttentional Feature-Pair Relation Networks for Accurate Face Recognition
Human face recognition is one of the most important research areas in biometrics. However, the robust face recognition under a drastic change of the facial pose, expression, and illumination is a big challenging problem for its practical application. Such variations make face recognition more difficult. In this paper, we propose a novel face recognition method, called Attentional Feature-pair Relation Network (AFRN), which represents the face by the relevant pairs of local appearance block features with their attention scores. The AFRN represents the face by all possible pairs of the 9x9 local appearance block features, the importance of each pair is considered by the attention map that is obtained from the low-rank bilinear pooling, and each pair is weighted by its corresponding attention score. To increase the accuracy, we select top-K pairs of local appearance block features as relevant facial information and drop the remaining irrelevant. The weighted top-K pairs are propagated to extract the joint feature-pair relation by using bilinear attention network. In experiments, we show the effectiveness of the proposed AFRN and achieve the outstanding performance in the 1:1 face verification and 1:N face identification tasks compared to existing state-of-the-art methods on the challenging LFW, YTF, CALFW, CPLFW, CFP, AgeDB, IJB-A, IJB-B, and IJB-C datasets.
Read moreCombined features for face recognition under illumination variation
A robust face recognition method that utilises a set of combined features is proposed to effectively conduct face recognition with images taken under diverse illumination variations. This method extracts discriminant features from different methods, both of which have different characteristics. To exploit the respective advantage of each method, the respective discriminability of the features extracted by each method is measured based on the discriminant distance criterion of each method. The experimental results show that the proposed features result in improved recognition performance under illumination variation.
Read moreIllumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain
This paper presents a novel illumination normalization approach for face recognition under varying lighting conditions. In the proposed approach, a discrete cosine transform (DCT) is employed to compensate for illumination variations in the logarithm domain. Since illumination variations mainly lie in the low-frequency band, an appropriate number of DCT coefficients are truncated to minimize variations under different lighting conditions. Experimental results on the Yale B database and CMU PIE database show that the proposed approach improves the performance significantly for the face images with large illumination variations. Moreover, the advantage of our approach is that it does not require any modeling steps and can be easily implemented in a real-time face recognition system.
Read more