A review on presentation attack detection system for fake fingerprint

Presentation attacks such as printed iris images or patterned contact lenses can be used to circumvent an iris recognition system. Different solutions have been proposed to counteract this vulnerability with Presentation Attack Detection (commonly called liveness detection) being used to detect the presence of an attack, yet independent evaluations and comparisons are rare. To fill this gap we have launched the first international iris liveness competition in 2013. This paper presents detailed results of its second edition, organized in 2015 (LivDet-Iris 2015). Four software-based approaches to Presentation Attack Detection were submitted. Results were tallied across three different iris datasets using a standardized testing protocol and large quantities of live and spoof iris images. The Federico Algorithm received the best results with a rate of rejected live samples of 1.68% and rate of accepted spoof samples of 5.48%. This shows that simple static attacks based on paper printouts and printed contact lenses are still challenging to be recognized purely by software-based approaches. Similar to the 2013 edition, printed iris images were easier to be differentiated from live images in comparison to patterned contact lenses.

Although face recognition systems have wide application, they are vulnerable to presentation attack samples (fake samples). Therefore, a presentation attack detection (PAD) method is required to enhance the security level of face recognition systems. Most of the previously proposed PAD methods for face recognition systems have focused on using handcrafted image features, which are designed by expert knowledge of designers, such as Gabor filter, local binary pattern (LBP), local ternary pattern (LTP), and histogram of oriented gradients (HOG). As a result, the extracted features reflect limited aspects of the problem, yielding a detection accuracy that is low and varies with the characteristics of presentation attack face images. The deep learning method has been developed in the computer vision research community, which is proven to be suitable for automatically training a feature extractor that can be used to enhance the ability of handcrafted features. To overcome the limitations of previously proposed PAD methods, we propose a new PAD method that uses a combination of deep and handcrafted features extracted from the images by visible-light camera sensor. Our proposed method uses the convolutional neural network (CNN) method to extract deep image features and the multi-level local binary pattern (MLBP) method to extract skin detail features from face images to discriminate the real and presentation attack face images. By combining the two types of image features, we form a new type of image features, called hybrid features, which has stronger discrimination ability than single image features. Finally, we use the support vector machine (SVM) method to classify the image features into real or presentation attack class. Our experimental results indicate that our proposed method outperforms previous PAD methods by yielding the smallest error rates on the same image databases.

Fingerprint recognition systems have been widely deployed in authentication and verification applications, ranging from personal smartphones to border control systems. Recently, the biometric society has raised concerns about presentation attacks that aim to manipulate the biometric system’s final decision by presenting artificial fingerprint traits to the sensor. In this paper, we propose a presentation attack detection scheme that exploits the natural fingerprint phenomena, and analyzes the dynamic variation of a fingerprint’s impression when the user applies additional pressure during the presentation. For that purpose, we collected a novel dynamic dataset with an instructed acquisition scenario. Two sensing technologies are used in the data collection, thermal and optical. Additionally, we collected attack presentations using seven presentation attack instrument species considering the same acquisition circumstances. The proposed mechanism is evaluated following the directives of the standard ISO/IEC 30107. The comparison between ordinary and pressure presentations shows higher accuracy and generalizability for the latter. The proposed approach demonstrates efficient capability of detecting presentation attacks with low bona fide presentation classification error rate (BPCER) where BPCER is 0% for an optical sensor and 1.66% for a thermal sensor at 5% attack presentation classification error rate (APCER) for both.

Presentation attacks such as using a contact lens with a printed pattern or printouts of an iris can be utilized to bypass a biometric security system. The first international iris liveness competition was launched in 2013 in order to assess the performance of presentation attack detection (PAD) algorithms, with a second competition in 2015. This paper presents results of the third competition, LivDet-Iris 2017. Three software-based approaches to Presentation Attack Detection were submitted. Four datasets of live and spoof images were tested with an additional cross-sensor test. New datasets and novel situations of data have resulted in this competition being of a higher difficulty than previous competitions. Anonymous received the best results with a rate of rejected live samples of 3.36% and rate of accepted spoof samples of 14.71%. The results show that even with advances, printed iris attacks as well as patterned contacts lenses are still difficult for software-based systems to detect. Printed iris images were easier to be differentiated from live images in comparison to patterned contact lenses as was also seen in previous competitions.

Fingerprint recognition is very stable, reliable, and oldest biometric authentication technology that has been widely used in various civilian and government applications. Like other authentication technologies, fingerprint recognition is not totally free from spoofing. A fingerprint recognition system can be spoofed by placing artificially generated fingerprints of enrolled user at the sensor that are made up of materials like gelatine, silicon, wax or play-doh etc. Liveness detection is a technique to enhance the security of such systems by detecting physiological life signs in fingerprint samples to differentiate a real fingerprint from an artificial one. A live fingerprint image has the property to produce gray level variations along ridges due to presence of sweat pores, perspiration and skin quality (dry, wet) whereas a fake fingerprint has uniform gray levels that can give a fair idea about the liveness in input sample. In the proposed work, two fingerprints are captured by scanner at different time points (0 sec and 2 sec). In order to find their gray level variations, a gray level co-occurrence matrix of each fingerprint image is determined. After that, contrast value is computed from each matrix. If the difference in their contrast value is greater than threshold, then the input fingerprint sample is considered as live otherwise it is considered as fake. Liveness detection solution presented in this work helps to avoid direct attacks at fingerprint sensor that result in very secure and precise fingerprint detection. Keywords: Biometrics, Fingerprint detection, Liveness Detection, Spoofing

Automated Fingerprint Recognition Systems (AFRSs) have been threatened by Presentation Attack (PA) since its existence. It is thus desirable to develop effective presentation attack detection (PAD) methods. However, the unpredictable PAs make PAD be a challenging problem. This paper proposes a novel One-Class PAD (OCPAD) method for Optical Coherence Technology (OCT) images based fingerprint PA detection. The proposed OCPAD model is learned from a training set only consists of Bonafides (i.e. real fingerprints). The reconstruction error and latent code obtained from the trained auto-encoder network in the proposed model is taken as the basis for the following spoofness score calculation. To get more accurate reconstruction error, we propose an activation map based weighting model to further refine the accuracy of reconstruction error. We test different statistics and distance measures and finally use a decision level fusion to make the final prediction. Our experiments are performed using a dataset with 93200 bonafide scans and 48400 PA scans. The results show that the proposed OCPAD can achieve a True Positive Rate (TPR) of 99.43% when the False Positive Rate (FPR) equals to 10% and a TPR of 96.59% when FPR=5%, which significantly outperformed a feature based approach and a supervised learning based model requiring PAs for training.

Fingerprint is the most hopeful biometric authentication that can specifically identify a person from their exclusive features. In the proposed approach, a novel software-based classification method is presented to classify between fake and real fingerprint. The intention of the proposed system is to improve the security of biometric identification system. The statistical techniques are good for micro features but not well for macro. In this paper, we present a novel combination of local Haralick micro texture features with macro features derived from neighbourhood gray-tone difference matrix (NGTDM) to generate an effective feature vector. Combined extracted features of training and testing images are passed to support vector machine for discriminating live and fake fingerprints. The proposed approach is experimented and validated on ATVS dataset and LivDet2011 dataset. The proposed approach has achieved good accuracy and less error rate in comparison with previously studied techniques.

Face recognition systems face real challenges from various presentation attacks. New, more sophisticated methods of presentation attacks are becoming more difficult to detect using traditional face recognition systems. Thermal infrared imaging offers specific physical properties that may boost presentation attack detection capabilities. The aim of this paper is to present outcomes of investigations on the detection of various face presentation attacks in thermal infrared in various conditions including thermal heating of masks and various states of subjects. A thorough analysis of presentation attacks using printed and displayed facial photographs, 3D-printed, custom flexible 3D-latex and silicone masks is provided. The paper presents the intensity analysis of thermal energy distribution for specific facial landmarks during long-lasting experiments. Thermalization impact, as well as varying the subject’s state due to physical effort on presentation attack detection are investigated. A new thermal face spoofing dataset is introduced. Finally, a two-step deep learning-based method for the detection of presentation attacks is presented. Validation results of a set of deep learning methods across various presentation attack instruments are presented.

Fingerprint identification system is widely used in various areas. However, a fake fingerprint made from a mold can cheat the identification systems easily. It reduces the reliability of the identification system. Recently, fingerprint liveness detection methods are proposed to filter fake fingerprints before the verification process. Although some liveness detection methods have satisfying performance, to best our knowledge, there is no investigation on the fingerprint images with out-of-focus blur which is a common scenario, especially for the touchless sensors. In this paper, we simulate out-of-focus blur on the fingerprint images and study their influence on the performance of state-of-art liveness detection methods. The resultindicates that the accuracy on classifying the fake fingerprint images with out-of-focus blur drops significantly, which may lead to secure problems.

With the rapid increase in fingerprint-based identification systems, there are growing concerns related to spoofs or artificially created fingerprint substantiations that can breach the security of these systems. Several issues associated with the susceptibility of fingerprint authentication systems to spoofing attacks are being underlined in recent research works. To produce spoof artefacts, easily accessible materials like Play-Doh, Gelatin, Wood glue and Ecoflex are etched with ridges of fingerprint modality and presented to the biometric device to circumvent the sensor module. A number of anti-spoofing techniques that incorporate the potent fingerprint features are being developed to countermeasure the fingerprint presentation attacks (PAs). These strategies are intended to thwart an adversary from obtaining unauthorized access to the sensitive information that the fingerprint recognition system is supposed to protect. This paper examines fingerprint presentation attack detection (PAD) mechanisms in depth, with an emphasis on deep learning-based solutions. The review clearly reveals that software-based PAD techniques are more efficient as compared to their hardware counterparts in terms of performance metrics. However, designing fingerprint PAD techniques which provide better performance in cross-datasets and cross-sensor environment still remains an open research problem. Besides, requirement of large data volumes for training and the emergence of novel and easily accessible materials for creating spoof artefacts is still an open research challenge.

Today, face biometric systems are becoming widely accepted as a standard method for identity authentication in many security settings. For example, their deployment in automated border control gates plays a crucial role in accurate document authentication and reduced traveler flow rates in congested border zones. The proliferation of such systems is further spurred by the advent of portable devices. On the one hand, modern smartphone and tablet cameras have in-built user authentication applications while on the other hand, their displays are being consistently exploited for face spoofing. Similar to biometric systems of other physiological biometric identifiers, face biometric systems have their own unique set of potential vulnerabilities. In this work, these vulnerabilities (presentation attacks) are being explored via a biologically-inspired presentation attack detection model which is termed “BIOPAD.” Our model employs Gabor features in a feedforward hierarchical structure of layers that progressively process and train from visual information of people's faces, along with their presentation attacks, in the visible and near-infrared spectral regions. BIOPAD's performance is directly compared with other popular biologically-inspired layered models such as the “Hierarchical Model And X” (HMAX) that applies similar handcrafted features, and Convolutional Neural Networks (CNN) that discover low-level features through stochastic descent training. BIOPAD shows superior performance to both HMAX and CNN in all of the three presentation attack databases examined and these results were consistent in two different classifiers (Support Vector Machine and k-nearest neighbor). In certain cases, our findings have shown that BIOPAD can produce authentication rates with 99% accuracy. Finally, we further introduce a new presentation attack database with visible and near-infrared information for direct comparisons. Overall, BIOPAD's operation, which is to fuse information from different spectral bands at both feature and score levels for the purpose of face presentation attack detection, has never been attempted before with a biologically-inspired algorithm. Obtained detection rates are promising and confirm that near-infrared visual information significantly assists in overcoming presentation attacks.

The main scope of this chapter is to serve as an introduction to face presentation attack detection, including key resources and advances in the field in the last few years. The next pages present the different presentation attacks that a face recognition system can confront, in which an attacker presents to the sensor, mainly a camera, a Presentation Attack Instrument (PAI), that is generally a photograph, a video, or a mask, with the target to impersonate a genuine user or to hide the actual identity of the attacker via obfuscation. First, we make an introduction of the current status of face recognition, its level of deployment, and its challenges. In addition, we present the vulnerabilities and the possible attacks that a face recognition system may be exposed to, showing that way the high importance of presentation attack detection methods. We review different types of presentation attack methods, from simpler to more complex ones, and in which cases they could be effective. Then, we summarize the most popular presentation attack detection methods to deal with these attacks. Finally, we introduce public datasets used by the research community for exploring vulnerabilities of face biometrics to presentation attacks and developing effective countermeasures against known PAIs.

The rapid advancement of premium smartphones with sophisticated high resolution cameras has enabled reliable and convenient contactless acquisition of fingerprint biometrics, making them suitable for verification at scale. However, as with other biometric systems, contactless fingerprint verification remains vulnerable to presentation attacks. Many Presentation Attack Detection (PAD) methods rely on supervised learning that requires labelled attack data, which limits generalisation. We propose an unsupervised PAD approach based on the Denoising Diffusion Probabilistic Model (DDPM). The system is trained only on bona fide samples and makes decisions via score level fusion of two deep similarity measures, yielding robustness to unseen attacks without access to attack labels. We further provide a Jacobian based theoretical analysis that explains why diffusion reconstructions are well suited to PAD. Using Frobenius and spectral norms together with a log determinant surrogate, we show that the iterative refinement in diffusion models preserves ridge aligned structure while contracting off manifold artifacts, thereby accounting for the observed empirical gains over single shot alternatives. In addition, we introduce a new fingerphoto presentation attack dataset comprising 101 subjects with 6,060 bona fide and 1,818 attack images captured on recent smartphones under diverse conditions. Benchmarking across four datasets shows that the proposed method is effective in practice, improving PAD performance and outperforming strong supervised baselines and recent state of the art methods in unseen attack scenarios. We report uncertainty estimates and non parametric statistical summaries across datasets and PAIs (Presentation Attack Instruments), which indicate consistent advantages without significant regressions, supporting the suitability of diffusion based PAD for deployment.

Presentations and attacks, and spoofs, oh my

Anti-spoofing ability is vital for fingerprint identification systems. Conventional fingerprint scanning devices can only obtain information from the fingertip surfaces, and their performance is susceptible to skin conditions and presentation attacks (PAs). However, optical coherence tomography (OCT) can scan subcutaneous tissue and obtain 3D fingerprint structures, naturally enhancing its PA detection (PAD) ability from the perspective of hardware. Existing unsupervised PAD methods are based on image reconstruction. However, the reconstruction error is easily affected by OCT noise and the rich details of OCT images. Therefore we propose feature-based reconstruction to alleviate this problem, called the prototype-guided autoencoder. The model consists of a memory module and a denoising autoencoder without the requirement of PA fingerprints. As only bona fide fingerprints are available during the training phase, the memory module contains the prototype features of the bona fide fingerprints. During the inference phase, as the prototype memory module is frozen, the reconstructed representation of the bona fide input is close to the bona fide fingerprint features. Calculating the distance between the original features and the prototype reconstructed representation of the sample can achieve PAD. To obtain a better decision making boundary, we propose a representation consistency constraint, which reduces the bona fide representation reconstruction distance closer, so that it is easier to differentiate between fingerprints and PAs.