Plastic Surgery: An Obstacle for Deep Face Recognition?

The Enhanced Border Security and Visa Entry Reform Act of 2002 requires that the Visa Waiver Program be available only to countries that have a program to issue to their nationals machine-readable passports incorporating biometric identifiers complying with applicable standards established by the International Civil Aviation Organization (ICAO). In June 2002, the New Technologies Working Group of ICAO unanimously endorsed the use of face recognition (FR) as the globally interoperable biometric for machine-assisted identity confirmation with machine-readable travel documents (MRTDs), although Member States may elect to use fingerprint and/or iris recognition as additional biometric technologies. The means and formats are still being developed through which biometric information might be stored in the constrained space of integrated circuit chips embedded within travel documents. Such information will be stored in an open, yet unalterable and very compact format, probably as digitally signed and efficiently compressed images. The objective of this research is to characterize the many factors that affect FR system performance with respect to the legislated mandates concerning FR. A photograph acquisition environment and a commercial face recognition system have been installed at Mitretek, and over 1,400 images have been collected of volunteers. The image database and FR system are being used to analyze the effects of lossy image compression, individual differences, such as eyeglasses and facial hair, and the acquisition environment on FR system performance. Images are compressed by varying ratios using JPEG2000 to determine the trade-off points between recognition accuracy and compression ratio. The various acquisition factors that contribute to differences in FR system performance among individuals are also being measured. The results of this study will be used to refine and test efficient face image interchange standards that ensure highly accurate recognition, both for automated FR systems and human inspectors. Working within the M1-Biometrics Technical Committee of the InterNational Committee for Information Technology Standards (INCITS) organization, a standard face image format will be tested and submitted to organizations such as ICAO.

Chapter 10 - Local plastic surgery-based face recognition using convolutional neural networks

Illumination variation significantly affects the performance of face recognition algorithms. However, it is difficult to construct a database that meets the demand of illumination analysis with current face image database construction technology. The influence of illumination variation on deep face recognition based on 3D face models is investigated. First a new method is presented to produce face images under arbitrary illuminations by using a 3D face model based on face basis image representation theory proposed. Then the database used for illumination analysis is constructed. Afterwards, an optimal way is explored to select illuminations used for constructing a high quality face image database by analyzing the impacts of different illumination sampling strategies on the performances of face recognition models. With the advantage of accurate illumination labeling of virtual data, the performances of different illumination labeling methods on the training of face recognition network are tested on a multi-task learning framework. Through experiments on the effects of different lighting sampling schemes and labeling methods on the performances of face recognition models carried out on virtual data and real data, it is concluded that using an appropriate amount of lightings of basis images to build a database is an effective lighting sampling scheme, and accurate lighting annotation can help further improve the face recognition rate, the corresponding recognition models have face recognition accuracy rates of more than 98% on virtual and real monitoring datasets which contain face images captured under very challenging lighting conditions. Proposed work improve the performance of deep face recognition models, and facilitate the construction of high quality face image databases with various illuminations.

To improve the efficiency of traditional face recognition techniques, this paper proposes a novel face recognition algorithm called Image Gradient Feature Compensation (IGFC). Based on the gradients along four directions in an image, a fusion algorithm and a compensation method are implemented to obtain features of the original image. In this study, gradient magnitude maps of a face image are calculated along four directions. Fusion gradients and differential fusion gradients are produced by fusing the four gradient magnitude maps of a face image in multiple ways, and they are used as compensation variables to compensate the appropriate coefficients on the original image and build IGFC feature maps of the original face image. Subsequently, IGFC feature maps are divided into several blocks to calculate the concatenated histogram over all blocks, which is in turn utilized as the feature descriptor for face recognition. Principal component analysis (PCA) is used to cut down the number of dimensions in high-dimensional features, which are recognized by the Support Vector Machine (SVM) classifier. Finally, the proposed IGFC method is superior to traditional methods as suggested by verification studies on YALE, ORL, CMU_PIE, and FERET face databases. When the LibSVM parameter was set to ‘-s 0 -t 2 -c 16 -g 0.0009765625’, the algorithm achieved 100% recognition on Yale and ORL data sets, 92.16% on CMU_PIE data sets, and 74.3% on FERET data sets. The average time for simultaneous completion of the data sets examined was 1.93 s, and the algorithm demonstrated a 70.71% higher running efficiency than the CLBP algorithm. Therefore, the proposed algorithm is highly efficient in feature recognition with excellent computational efficiency.

The objective of this project was to assess the performance of the leading commercial-off-the-shelf (COTS) facial recognition software package when used as a laptop application. We performed the assessment to determine the system's usefulness for enrolling facial images in a database from remote locations and conducting real-time searches against a database of previously enrolled images. The assessment involved creating a database of 40 images and conducting 2 series of tests to determine the product's ability to recognize and match subject faces under varying conditions. This report describes the test results and includes a description of the factors affecting the results. After an extensive market survey, we selected Visionics' FaceIt{reg_sign} software package for evaluation and a review of the Facial Recognition Vendor Test 2000 (FRVT 2000). This test was co-sponsored by the US Department of Defense (DOD) Counterdrug Technology Development Program Office, the National Institute of Justice, and the Defense Advanced Research Projects Agency (DARPA). Administered in May-June 2000, the FRVT 2000 assessed the capabilities of facial recognition systems that were currently available for purchase on the US market. Our selection of this Visionics product does not indicate that it is the ''best'' facial recognition software package for all uses. It was the most appropriate package based on the specific applications and requirements for this specific application. In this assessment, the system configuration was evaluated for effectiveness in identifying individuals by searching for facial images captured from video displays against those stored in a facial image database. An additional criterion was that the system be capable of operating discretely. For this application, an operational facial recognition system would consist of one central computer hosting the master image database with multiple standalone systems configured with duplicates of the master operating in remote locations. Remote users could perform real-time searches where network connectivity is not available. As images are enrolled at the remote locations, periodic database synchronization is necessary.

Yüz tanıma çok sayıda uygulama alanı olan popüler bir bilgisayarla görü problemidir. Farklı ışık koşulları ve değişen yüz ifadeleri yüz tanıma problemini zorlaştıran etkenlerdir. Yüz tanıma işlemi için çeşitli yöntemlerle elde edilen öznitelikler yüze ait farklı karakteristik özellikleri yansıtır. Bu karakteristik özelliklerden faydalanılarak yüz tanıma işlemi gerçekleştirilir. Bu çalışmada, örüntü ve doku tanımada sıklıkla kullanılan Yerel İkili Örüntü ve Felzenszwalb Yönelimli Gradyan Histogram özniteliklerinin birleştirilmesi ile yüz tanıma problemine çok kipli bir çözüm sunulmuştur. Yüz imgesi bölgelere ayrılarak, her iki yöntem ile bölgelerden öznitelik vektörleri elde edilmiştir. Bununla birlikte elde edilen vektörlere öznitelik seçim yöntemleri uygulanarak hem vektör boyutu azaltılmış hem de başarım arttırılmıştır. Öznitelik seçimi sonucu her iki yöntem için seçilen öznitelik alt kümeleri birleştirilerek uzamsal ve spektral öznitelikleri içeren tek bir öznitelik vektörü haline getirilmiştir. Seçilen öznitelikler Ki-kare sınıflandırıcısı kullanılarak sınıflandırılmıştır. Önerilen yöntemin başarımı FERET veri setinde ölçülmüş, %89.45 yüz doğrulama ve %94.55 yüz tanıma başarımı elde edilmiştir.

Many beginning writers, especially medical residents, feel difficulties in writing journal articles. However, illogical and unscientific papers are not accepted for publication even if their topics are creative and interesting. The authors should do their best to convince reviewers and readers of their opinions using evidence through reasoning, explanation, and data interpretation.

In recent years, much advancement have been made in face recognition techniques which leads to the popularity of plastic surgery procedures. Pose, illumination and expressions are some of the problems that have been already recognized and studied in the domain of face recognition. In this paper, we have proposed an approach based on near set theory to develop a classifier for facial images that have previously undergone some feature modifications through plastic surgery. Our work concerns only geometrically obtained feature values and their approximation using near sets. Near set theory provides a method to establish resemblance between objects contained in a disjoint set, that is, it provides a formal basis for observation, comparison and classification of the objects. The experimental results indicate the performance and accuracy of the plastic surgery based face recognition.

Facial images are of critical importance in many real-world applications from gaming to surveillance. The current literature on facial image analysis, from face detection to face and facial expression recognition, are mainly performed in either RGB, Depth (D), or both of these modalities. But, such analyzes have rarely included Thermal (T) modality. This paper paves the way for performing such facial analyzes using synchronized RGB-D-T facial images by introducing a database of 51 persons including facial images of different rotations, illuminations, and expressions. Furthermore, a face recognition algorithm has been developed to use these images. The experimental results show that face recognition using such three modalities provides better results compared to face recognition in any of such modalities in most of the cases.

This paper presents a novel Gabor-based kernel Principal Component Analysis (PCA) method by integrating the Gabor wavelet representation of face images and the kernel PCA method for face recognition. Gabor wavelets first derive desirable facial features characterized by spatial frequency, spatial locality, and orientation selectivity to cope with the variations due to illumination and facial expression changes. The kernel PCA method is then extended to include fractional power polynomial models for enhanced face recognition performance. A fractional power polynomial, however, does not necessarily define a kernel function, as it might not define a positive semidefinite Gram matrix. Note that the sigmoid kernels, one of the three classes of widely used kernel functions (polynomial kernels, Gaussian kernels, and sigmoid kernels), do not actually define a positive semidefinite Gram matrix either. Nevertheless, the sigmoid kernels have been successfully used in practice, such as in building support vector machines. In order to derive real kernel PCA features, we apply only those kernel PCA eigenvectors that are associated with positive eigenvalues. The feasibility of the Gabor-based kernel PCA method with fractional power polynomial models has been successfully tested on both frontal and pose-angled face recognition, using two data sets from the FERET database and the CMU PIE database, respectively. The FERET data set contains 600 frontal face images of 200 subjects, while the PIE data set consists of 680 images across five poses (left and right profiles, left and right half profiles, and frontal view) with two different facial expressions (neutral and smiling) of 68 subjects. The effectiveness of the Gabor-based kernel PCA method with fractional power polynomial models is shown in terms of both absolute performance indices and comparative performance against the PCA method, the kernel PCA method with polynomial kernels, the kernel PCA method with fractional power polynomial models, the Gabor wavelet-based PCA method, and the Gabor wavelet-based kernel PCA method with polynomial kernels.

Face recognition has received more attention in the recent past. It refers to using biometric technology to identify individuals from a captured image by comparing it to the images in the database. There are three face recognition techniques: 2D, 2D-3D and 3D. Face recognition occurs in three processes. Firstly, face recognition begins with face detection, where an image is identified as having a face. That is followed by face extraction, which involves identifying the various faces within an image. The final stage is face classification which entails face verification or face identification. Depending on the type of system, face recognition can either occur in verification or identification mode. Additionally, face recognition has various applications in the current global environment. Face recognition can be used in security systems, hospitals, schools, and retail industries. It allows easier verification and identification of individuals. However, despite the development of the technology, there are still some challenges, such as plastic surgery, illumination, aging, occlusion and pose variation.

In video based face recognition, face images are typically captured over multiple frames in uncontrolled conditions, where head pose, illumination, shadowing, motion blur and focus change over the sequence. Additionally, inaccuracies in face localisation can also introduce scale and alignment variations. Using all face images, including images of poor quality, can actually degrade face recognition performance. While one solution it to use only the "best" subset of images, current face selection techniques are incapable of simultaneously handling all of the abovementioned issues. We propose an efficient patch-based face image quality assessment algorithm which quantifies the similarity of a face image to a probabilistic face model, representing an "ideal" face. Image characteristics that affect recognition are taken into account, including variations in geometric alignment (shift, rotation and scale), sharpness, head pose and cast shadows. Experiments on FERET and PIE datasets show that the proposed algorithm is able to identify images which are simultaneously the most frontal, aligned, sharp and well illuminated. Further experiments on a new video surveillance dataset (termed ChokePoint) show that the proposed method provides better face subsets than existing face selection techniques, leading to significant improvements in recognition accuracy.

Biometrics has become an integral part for person identification. Out of all biometrics, face is used more often as it can be captured easily. Face recognition plays an important role in digital world and hence has gained a lot of attention. In this paper, focus is laid on the face recognition with permanent changes. Permanent changes in face can be naturally or artificially induced. In natural change, changes in face happen due to change in age while artificially face can be changed by plastic surgery, both these changes are permanent. Innovation of this paper is that survey for age and plastic surgery exist separately in literature but here, survey exists in the direction of those techniques which leave a permanent mark/change in face. In this paper, the comparison is made among various techniques for face recognition dealing with age and plastic surgery. This paper also provides future directions for further research.

Two of the most critical requirements in support of producing reliable face-recognition systems are a large database of facial images and a testing procedure to evaluate systems. The Face Recognition Technology (FERET) program has addressed both issues through the FERET database of facial images and the establishment of the FERET tests. To date, 14,126 images from 1199 individuals are included in the FERET database, which is divided into development and sequestered portions of the database. In September 1996, the FERET program administered the third in a series of FERET face-recognition tests. The primary objectives of the third test were to (1) assess the state of the art, (2) identify future areas of research, and (3) measure algorithm performance. 1

To review the application of machine learning (ML) in the facial cosmetic surgeries and procedures METHODS AND MATERIALS: Electronic search was conducted in PubMed, Scopus, Embase, Web of Science, ArXiv and Cochrane databases for the studies published until August 2022. Studies that reported the application of ML in various fields of facial cosmetic surgeries were included. The studies' risk of bias (ROB) was assessed using the QUADAS-2 tool and NIH tool for before and after studies. From 848 studies, a total of 29 studies were included and categorized in five groups based on the aim of the studies: outcome evaluation (n = 8), face recognition (n = 7), outcome prediction (n = 7), patient concern evaluation (n = 4) and diagnosis (n = 3). Total of 16 studies used public data sets. ROB assessment using QUADAS-2 tool revealed that six studies were at low ROB, five studies were at high ROB, and others had moderate ROB. All studies assessed with NIH tool showed fair quality. In general, all studies showed that using ML in the facial cosmetic surgeries is accurate enough to benefit both surgeons and patients. Using ML in the field of facial cosmetic surgery is a novel method and needs further studies, especially in the fields of diagnosis and treatment planning. Due to the small number of articles and the qualitative analysis conducted, we cannot draw a general conclusion about the impact of ML in the sphere of facial cosmetic surgery. This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .