Face recognition: A study in information fusion using fuzzy integral

This research aims to develop artificial intelligence (AI) algorithms in the context of facial recognition with a focus on increasing accuracy in difficult environmental conditions. Although facial recognition technology has made great progress, challenges such as poor lighting, variations in facial expressions, and head rotation are still problems that must be overcome. The research methodology involved collecting a wide dataset covering a wide variety of faces under various environmental conditions. This data is then processed and its features are extracted using computer image processing techniques. Furthermore, several deep neural network architectures, such as Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs), were developed, trained, and evaluated for face recognition tasks. The expected result is the development of an AI algorithm that is able to overcome challenges in facial recognition with higher accuracy than existing methods. In particular, significant improvements in facial recognition accuracy are expected especially under low lighting conditions and variations in facial expressions. This research has a major impact in a variety of security applications, such as border surveillance, building access control, and corporate security. With higher facial recognition accuracy, security risks can be significantly reduced, resulting in safer and more efficient security solutions. In conclusion, this research aims to bring innovation in facial recognition technology through advanced AI approaches, with the potential to improve security in various contexts.

We develop a face recognition algorithm which is insensitive to large variation in lighting direction and facial expression. Taking a pattern classification approach, we consider each pixel in an image as a coordinate in a high-dimensional space. We take advantage of the observation that the images of a particular face, under varying illumination but fixed pose, lie in a 3D linear subspace of the high dimensional image space-if the face is a Lambertian surface without shadowing. However, since faces are not truly Lambertian surfaces and do indeed produce self-shadowing, images will deviate from this linear subspace. Rather than explicitly modeling this deviation, we linearly project the image into a subspace in a manner which discounts those regions of the face with large deviation. Our projection method is based on Fisher's linear discriminant and produces well separated classes in a low-dimensional subspace, even under severe variation in lighting and facial expressions. The eigenface technique, another method based on linearly projecting the image space to a low dimensional subspace, has similar computational requirements. Yet, extensive experimental results demonstrate that the proposed "Fisherface" method has error rates that are lower than those of the eigenface technique for tests on the Harvard and Yale face databases.

We develop a face recognition algorithm which is insensitive to gross variation in lighting direction and facial expression. Taking a pattern classification approach, we consider each pixel in an image as a coordinate in a high-dimensional space. We take advantage of the observation that the images of a particular face under varying illumination direction lie in a 3-D linear subspace of the high dimensional feature space — if the face is a Lambertian surface without self-shadowing. However, since faces are not truly Lambertian surfaces and do indeed produce self-shadowing, images will deviate from this linear subspace. Rather than explicitly modeling this deviation, we project the image into a subspace in a manner which discounts those regions of the face with large deviation. Our projection method is based on Fisher's Linear Discriminant and produces well separated classes in a low-dimensional subspace even under severe variation in lighting and facial expressions. The Eigenface technique, another method based on linearly projecting the image space to a low dimensional subspace, has similar computational requirements. Yet, extensive experimental results demonstrate that the proposed “Fisherface” method has error rates that are significantly lower than those of the Eigenface technique when tested on the same database.

The technology of face recognition has been widely applied to many fields such as identity authentication. A New Improvement for Face Recognition Using MMPCA is presented in this paper. The proposed algorithm when compared with conventional modular PCA algorithm is different in the computation of image mean value and the recognition process. Comparison of the two algorithms in different face databases proves that the proposed algorithm is more effective and robust than conventional modular PCA algorithm under the large variations in lighting direction and facial expression. The authors also point out that 2DPCA is a special case of improved algorithm, no matter in the process of dimension reduction or recognition.

The human face has a great accumulation and a diversity of facial expressions. It explores the feelings of a person and can be used to judge the emotional intents of the person to a certain level. By using facial detection and recognition systems, varieties of applications are working in computer vision, surveillance system, security, authentication, or verification of a person and home automation system based on digital image processing with the help of the Internet of Things. The state of the art in these applications is to detect expressions with their intensity level. It is an attention-grabbing problem due to the complex nature of facial features, which is associated with emotions. For that purpose, it is essential to develop an innovative deep learning model to detect and estimate the facial expression intensity level. To do this, a multi-level deep convolutional neural network is proposed to recognize facial expression and their intensity level. At the first level, Expression-Net classifies face expressions, and at the second level, Intensity-Net estimates the intensity of the facial expression. Evaluation of the proposed model for facial expression recognition and intensity estimation is carried out by using the extended Cohn–Kanade and Japanese Female Facial Expression datasets. The proposed method shows an outstanding performance in terms of accuracy of 98.8% and 97.7% for both the datasets as compared to state-of-the-art techniques.

We proposed a facial motion tracking and expression recognition system based on video data. By a 3D deformable facial model, the online statistical model (OSM) and cylinder head model (CHM) were combined to track 3D facial motion in the framework of particle filtering. For facial expression recognition, a fast and efficient algorithm and a robust and precise algorithm were developed. With the first, facial animation and facial expression were retrieved sequentially. After that facial animation was obtained, facial expression was recognized by static facial expression knowledge learned from anatomical analysis. With the second, facial animation and facial expression were simultaneously retrieved to increase the reliability and robustness with noisy input data. Facial expression was recognized by fusing static and dynamic facial expression knowledge, the latter of which was learned by training a multi-class expressional Markov process using a video database. The experiments showed that facial motion tracking by OSM+CHM is more pose robust than that by OSM, and the facial expression score of the robust and precise algorithm is higher than those of other state-of-the-art facial expression recognition methods.

Characterizing abrupt changes in the stock prices using a wavelet decomposition method

Facial expressions recognition and synthesis are important research fields to study how human beings reflect to environments in affective computing. With the rapid development of mathematical theory on multivariate statistics and multi-media technology especially image processing, facial expressions recognition researchers have achieved many useful results. Recently studies show that approaches to facial modeling and expressions recognition and synthesis analysis could be adapted to control security or even real-time health monitoring in the real world. Similarity, how to achieve facial expressions recognition and synthesis for independent-free mechanism is a central design in general. Based on the cognitive analysis of independent user's affective facial recognition researches we proposed an emotions composition model to dope out what are the user's new affective facial expressions. At this point, principal component, cluster and discriminate analysis were applied to show and verify independent user's affective expressions can be composited for synthesis by basic facial expressions such as happy, neutral and unhappy. Experiments were conducted to prove our models to be very significant.

The aim of this study was to determine how the depressor supercilii (DS) connects to the levator labii superioris alaeque nasi (LLSAN) and inferior fibers of the orbicularis oculi (OOc INF) in the human midface. While grimacing, contraction of the DS with fibers connecting to the LLSAN and OOc INF can assist in pulling the medial eyebrow downward more than when these connecting fibers are not present. Contraction of these distinct connecting fibers between the DS and the LLSAN can also slightly elevate the nasal ala and upper lip. The DS was examined in 44 specimens of embalmed adult Korean cadavers. We found that the DS connected to the LLSAN or the OOc INF by muscle fibers or thin aponeuroses in 33 (75.0%) of the 44 specimens. The DS was connected to both the LLSAN and OOc INF by muscle fibers or aponeuroses and had no connection to either in 5 (11.4%) and 11 (25.0%) specimens, respectively. The DS was connected to the LLSAN by the muscle fibers and thin aponeuroses in 6 (13.6%) and 4 (9.1%) specimens, respectively. The DS was connected to the OOc INF by the muscle fibers and thin aponeuroses in 5 (11.4%) and 23 (52.3%) specimens, respectively. Our findings regarding the anatomical connections of the glabellar region DS to the midface LLSAN and OOc INF provide insights on the dynamic balance between the brow depressors such as the DS and brow-elevating muscle and contribute to understanding the anatomical origins of individual variation in facial expressions. These results can also improve the safety, predictability, and aesthetics of treatments for the glabellar region with botulinum toxin type A and can be helpful when performing electromyography.

An efficient face recognition system should recognize faces in different views and poses. The efficiency of a human face recognition system depends on the capability of face recognition in presence of changes in the appearance of face due to expression, pose and illumination. A novel algorithm which utilizes the combination of texture and depth information based on Modular PCA to overcome the problem of pose variation and illumination change for face recognition is proposed. The system has combined 2D and 3D systems in the feature level which presents higher performance in contrast with methods which utilizes either 2D or 3D system separately. A multimodal face recognition based on Modular PCA when compared with conventional PCA algorithm has an improved recognition rate for face images with large variations in illumination and facial expression. The proposed algorithm is tested with FRAV3D database that has faces with pose variation and illumination changes. Recognition rates from experimental results show the superiority of Modular PCA over conventional PCA methods in tackling face images with different pose variations and changes in illuminations. The proposed algorithm shows a recognition rate of 86% that is achieved in fusion experiment.

Face recognition (FR) is a practical application of pattern recognition (PR) and remains a compelling topic in the study of computer vision. However, in real-world FR systems, interferences in images, including illumination condition, occlusion, facial expression and pose variation, make the recognition task challenging. This study explored the impact of those interferences on FR performance and attempted to alleviate it by taking face symmetry into account. A novel and robust FR method was proposed by combining multi-mirror symmetry with local binary pattern (LBP), namely multi-mirror local binary pattern (MMLBP). To enhance FR performance with various interferences, the MMLBP can 1) adaptively compensate lighting under heterogeneous lighting conditions, and 2) generate extracted image features that are much closer to those under well-controlled conditions (i.e., frontal facial images without expression). Therefore, in contrast with the later variations of LBP, the symmetrical singular value decomposition representation (SSVDR) algorithm utilizing the facial symmetry and a state-of-art non-LBP method, the MMLBP method is shown to successfully handle various image interferences that are common in FR applications without preprocessing operation and a large number of training images. The proposed method was validated with four public data sets. According to our analysis, the MMLBP method was demonstrated to achieve robust performance regardless of image interferences.

Face recognition algorithm is a very promising technique in biometric authentication. However, the recognition precision can be affected by many factors, such as feature extraction method and classifier selection. In this paper, a novel algorithm for face recognition is presented according to the advances of the wavelet decomposition technique and the Support Vector Machines (SVM) model. The extracted features from human images by wavelet decomposition are less sensitive to facial expression variation. As a classifier, SVM provides high generation performance without transcendental knowledge. First, we detect the face region using an improved AdaBoost algorithm. Second, we extract the appropriate features of the face by wavelet decomposition, and compose the face feature vectors as input to SVM. Third, we train the SVM model by the face feature vectors, and then use the trained SVM model to classify the human face. In the training process, three different kernel functions are adopted: Radial basis function, Polynomial and Linear kernel function. Finally, we present a face recognition system that can achieve high recognition precision and fast recognition speed in practice. Experimental results indicate that the proposed method can achieve recognition precision of 96.78 percent based on 96 persons in Ren-FEdb database that is higher than other approaches.

Emotion recognition through facial expression analysis is an emerging research in Artificial Intelligence which faces many challenges. The problem is the variation of facial expressions that displays human emotions. Humans can subjectively express the same emotions in various ways. To overcome the problem of ambiguity in emotion expression, a fuzzy approach is developed to analyze the facial components in determining the type of emotion. In this study, we proposed a framework for fuzzy emotion recognition as a representation of the psychologist knowledge. Three stages in the fuzzy emotion recognition were facial feature extraction with Active Appearance Model; Semantic-linguistic facial features extraction; fuzzy emotion recognition with Fuzzy Emotion Classification. System performance testing provided the best results on extended Cohn Kanade (CK+) facial expression dataset, with the accuracy of linguistic facial component recognition 0.98, and accuracy of fuzzy emotion recognition 0.90. Testing was also performed on custom-made Indonesian Mixed Emotion Dataset (IMED) which resulted in accuracy of 0.87. The fuzzy emotion recognition has a potential to be applied in various real problems such as virtual counseling, stress detection, lie detection, and e-commerce.

In this paper performance of elastic bunch graph matching (EBGM) for face recognition under variation in facial expression, variation in lighting condition and variation in poses are given. In this approach faces are represented by labelled graphs. Experimental results of EBGM on ORL, Yale B and FERET datasets are provided. Strong and weak features of EBGM algorithm are discussed.

In this paper a face recognition system based on multi resolution hybrid wavelet approach has been presented. The multi resolution hybrid wavelet transform matrix is generated using Kronecker product of Walsh and DCT transform matrices. This wavelet is used to extract features from face images with different expressions of subjects' faces. A feature map is generated using energy compaction technique which is used as a template to extract features of enrolled and test images. The experiments are performed on faces94 database with different variations in facial expression, change in face position and occlusion. The recognition rates achieved are 99.24%.