An Efficient Multimodal Biometric System Integrated with Liveness Detection Technique

The vulnerability of the face recognition system to spoofing attacks has piqued the biometric community's interest, motivating them to develop anti-spoofing techniques to secure it. Photo, video, or mask attacks can compromise face biometric systems (types of presentation attacks). Spoofing attacks are detected using liveness detection techniques, which determine whether the facial image presented at a biometric system is a live face or a fake version of it. We discuss the classification of face anti-spoofing techniques in this paper. Anti-spoofing techniques are divided into two categories: hardware and software methods. Hardware-based techniques are summarized briefly. A comprehensive study on software-based countermeasures for presentation attacks is discussed, which are further divided into static and dynamic methods. We cited a few publicly available presentation attack datasets and calculated a few metrics to demonstrate the value of anti-spoofing techniques.

Traditional identity verification of students based on the human proctoring approach can cause a scam identity verification and ineffective processing time, particularly among vast groups of students. Most student identification cards outdated personal information. Several biometric recognition approaches have been proposed to strengthen students’ identity verification. Most educational adoption technologies struggle with evaluation and validation techniques to ensure that biometric recognition systems are unsuitable for utilization and implementation for student identity verification. This study presents the internet of things to develop flexible biometric recognition systems and an approach to assess the quality of biometric systems for educational use by investigating the effectiveness of identity verification of various biometric recognition technologies compared to the traditional verification method. The unimodal, multimodal, and semi-multimodal biometric technologies were tested using the developed internet of things-base biometric recognition systems examined by applying the proposed quality metrics of scoring factors based on accuracy, error rate, processing time, and cost. Hundreds of undergraduate exam takers were a sample group. Key findings indicate that the designed and presented systems suitably attain identity verification of exam students using a unimodal biometric. The unimodal facial biometric system promises excellent support. A unimodal fingerprint biometric system ensures second excellent aid for student identity verification. However, multimodal and semi-multimodal biometric systems provide better accuracy with fewer handling times and higher costs. This study contributes significantly to the knowledge of utilizing biometric recognition for identity verification in smart educational applications.

Biometrics using biological or behavioral features to authenticate a person has attracted much attention as a new authentication approach against traditional ones such as key, password, etc. Biometrics technologies provide us better security and greater convenience than traditional person authentication technologies such as key, password and card. Biometric systems with cameras involve the risk of spoofing. For example in face recognition systems, when a malicious person turns a printed face photo of an authenticated user to a camera, a face recognition system may accept the malicious person as the authenticated user. To address the above problem, liveness detection is important to develop secure biometric recognition systems. This paper presents a liveness detection method using deep learning for face recognition systems.

In the field of data security, biometric security is a significant emerging concern. The multimodal biometrics system with enhanced accuracy and detection rate for smart environments is still a significant challenge. The fusion of an electrocardiogram (ECG) signal with a fingerprint is an effective multimodal recognition system. In this work, unimodal and multimodal biometric systems using Convolutional Neural Network (CNN) are conducted and compared with traditional methods using different levels of fusion of fingerprint and ECG signal. This study is concerned with the evaluation of the effectiveness of proposed parallel and sequential multimodal biometric systems with various feature extraction and classification methods. Additionally, the performance of unimodal biometrics of ECG and fingerprint utilizing deep learning and traditional classification technique is examined. The suggested biometric systems were evaluated utilizing ECG (MIT-BIH) and fingerprint (FVC2004) databases. Additional tests are conducted to examine the suggested models with:1) virtual dataset without augmentation (ODB) and 2) virtual dataset with augmentation (VDB). The findings show that the optimum performance of the parallel multimodal achieved 0.96 Area Under the ROC Curve (AUC) and sequential multimodal achieved 0.99 AUC, in comparison to unimodal biometrics which achieved 0.87 and 0.99 AUCs, for the fingerprint and ECG biometrics, respectively. The overall performance of the proposed multimodal biometrics outperformed unimodal biometrics using CNN. Moreover, the performance of the suggested CNN model for ECG signal and sequential multimodal system based on neural network outperformed other systems. Lastly, the performance of the proposed systems is compared with previously existing works.

A spoof resistant multibiometric system based on the physiological and behavioral characteristics of fingerprint

The interface of computer technologies and biology is having a huge impact on society. Human recognition technology research projects promises new life to many security consulting firms and personal identification system manufacturers. The physiological or biological features of an individual, called biometrics, are unique to each human and remain unaltered during a person's lifetime and give a promising solution for security management. This paper presents an intelligent multimodal biometric verification system for physical access control, based on fusion of iris, face and fingerprint patterns. Feature vectors are created independently for query images and are then compared with the enrolled templates of each biometric trait to compute the matching score. The final decision is made by fusion at this matching score level. The proposed system is designed to suit embedded solutions for high security access in pervasive environments using biometric features.

Background: With the growing need for information safety and security rules in every corner of the globe. The biometric innovation has been used widely all over the world in daily life. In this view, the Multimodal-based biometric technique has gained popularity and interest due to its capability to resolve various problems associated with single-model biometric identification systems Methods:: In this research, an advanced multimodal-based biometric recognition system is introduced, which depends on multilayer perceptron (MLP), and it identifies humans using biometric features of Fingerprints and IRIS. To build an efficient model, the popular model called Rest- Net50 was used, the gradient method was used and the hinge technique was used as a loss function. For the technique of fusion, different techniques are used to show the effect of fusion in our model. The recognition rate of introduced systems was assessed by experimenting with various techniques on SDUMLA-HMT datasets based on the multimodal biometric datasets. The recognition rate showed that merging two biometric features in biometric recognition systems gives the best results compared to a single biometric feature. Results: The results obtained showed the superiority of our model with other existing techniques by obtaining a recognition rate of 99.79% with a feature-based fusion method. Conclusion: The introduced system used the MLP deep learning technique. The feature level fusion was applied to recognize the user using IRIS and fingerprints. To the best of our belief, this is the first research to incorporate MLP and multimodal-based biometric systems using IRIS and fingerprints.

Traditional authentication methods such as passwords are susceptible to easy hacking, and as technology progresses, the demand is on the rise for more reliable and secure recognition systems, which can be used in surveillance and biometrics applications etc. A biometric recognition system of individuals is established on the unique features of the individual. Multi modal biometric systems represent a significant research field with widespread applications of recognition systems. Unimodal biometric systems have a variety of issues, including nonuniversality and noisy data. Certain limitations and difficulties can be partially addressed with the use of multi modal biometric systems. In this paper, a survey on multi-biometric systems is presented to highlight the challenges, strengths and weaknesses of some of the research discussed in this study which contributes to enhancing the understanding and development of robust and reliable biometric authentication solutions, essential for ensuring security in various domains as well as suggest directions for future work. Index Terms— biometric recognition, multimodal biometric, biometric system, fusion techniques, multi-biometric system.

Multimodal biometrics-based systems aim to improve the recognition accuracy of human beings using more than one physical and/or behavioral characteristics of a person. In this paper, different fusion schemes at matching score level and feature level are employed to obtain a robust recognition system using several standard feature extractors. The proposed method involves the consideration of a face–iris multimodal biometric system using score level and feature level fusion. Principal Component Analysis (PCA), subspace Linear Discriminant Analysis (LDA), subpattern-based PCA, modular PCA and Local Binary Patterns (LBP) are global and local feature extraction methods applied on face and iris images. In fact, different feature sets obtained from five local and global feature extraction methods for unimodal iris biometric system are concatenated at feature level fusion called iris feature vector fusion (iris-FVF), while for unimodal face biometric system, LBP is used to achieve efficient texture descriptors. Feature selection is performed using Particle Swarm Optimization (PSO) at feature level fusion step to reduce the dimension of feature vectors for improving the recognition performance. Our proposed method is validated by forming three datasets using ORL, BANCA, FERET face databases and CASIA, UBIRIS iris databases. The results based on recognition performance and ROC analysis demonstrate that the proposed matching score level fusion scheme using Weighted Sum rule, tanh normalization, iris-FVF and facial features extracted by LBP achieves a significant improvement over unimodal and multimodal methods. Support Vector Machine (SVM) and t-norm normalization are also used to improve the recognition performance of the proposed method.

Biometric systems have been actively emerging in various industries in the past few years and continue to provide higher-security features for access control systems. Many types of unimodal biometric systems have been developed. However, these systems are only capable of providing low- to mid-range security features. Thus, for higher-security features, the combination of two or more unimodal biometrics (multiple modalities) is required. In this paper, we propose a multimodal biometric system for person recognition using face, fingerprint, and finger vein images. Addressing this problem, we propose an efficient matching algorithm that is based on secondary calculation of the Fisher vector and uses three biometric modalities: face, fingerprint, and finger vein. The three modalities are combined and fusion is performed at the feature level. Furthermore, based on the method of feature fusion, the paper studies the fake feature which appears in the practical scene. The liveness detection is append to the system, detect the picture is real or fake based on DCT, then remove the fake picture to reduce the influence of accuracy rate, and increase the robust of system. The experimental results showed that the designed framework can achieve an excellent recognition rate and provide higher security than a unimodal biometric-based system, which are very important for a IoMT platform.

With the widespread deployment of biometric recognition systems, the interest in attacking these systems is increasing. One of the easiest ways to circumvent a biometric recognition system are so-called presentation attacks, in which artefacts are presented to the sensor to either impersonate another subject or avoid being recognised. In the recent past, the vulnerabilities of biometric systems to so-called morphing attacks have been unveiled. In such attacks, biometric samples of multiple subjects are merged in the signal or feature domain, in order to allow a successful verification of all contributing subjects against the morphed identity. Being a recent area of research, there is to date no standardised manner to evaluate the vulnerability of biometric systems to these attacks. Hence, it is not yet possible to establish a common benchmark between different morph detection algorithms. In this paper, we tackle this issue proposing new metrics for vulnerability reporting, which build upon our joint experience in researching this challenging attack scenario. In addition, recommendations on the assessment of morphing techniques and morphing detection metrics are given.

It is an undeniable fact that biometric recognition systems are susceptible to different software-related or template attacks at different vulnerable points in the biometric authentication system. However, these attacks are frequently overlooked, implying one of two possibilities: either researchers and biometric stakeholders have forgotten or simply ignored the consequences of these attacks, or they are unaware of some of these threats. Meanwhile, if biometric systems do not have the required protection, these attacks can lead to biometric system compromise and consequently the loss of sensitive personal data, which is irreplaceable and irrevocable. Therefore, considering the significance of the implications posed by these threats, researchers and biometric stakeholders have, over the last two decades, proposed different methods to mitigate some of the attacks, while a large number of the existing attacks are left unattended to. Hence, we deemed it paramount to bring this to the attention of the research community. This article is an effort to emphasize the implications of these attacks, exploit the threat approach based on attackers’ knowledge, and consolidate them into a single, thorough, and comprehensive review together with recent state-of-the-art protection mechanisms that are put forward to mitigate these threats. Moreover, a comparative performance analysis of these protection mechanisms and other possible countermeasures to the attacks is given. It is expected that this survey will, on the one hand, be a wakeup call to the biometric template protection research community, thus drawing their attention to the task at hand. On the other hand, an awareness to the ordinary users and biometric stakeholders on the risks posed by these threats.

Single modality biometric recognition system is often not able to meet the desired system performance requirements. Several studies have shown that multimodal biometric identification systems improve the recognition accuracy and allow performances that are required for many security applications. In this paper, we have developed a multimodal biometric recognition system which combines two modalities: face and fingerprint. For face trait, we build features based on Gabor Wavelet Networks (GWNs), while Local Binary Patterns (LBP) is used for fingerprint trait. Experimental results affirm that a weighted sum based fusion achieves excellent recognition performances, which out performs both single biometric systems.

A biometric system is an amalgamation of algorithms that uses an individual’s unique biological data innate physical features (fingerprints, retina, face, ears, etc.) or behavioural features (signature, voice, keystroke dynamics, etc.) or both to authenticate the individual. This essentially makes a biometric system function as a pattern recognition system that helps an individual in any kind of adversarial environment. Hence, like any conventional authentication system, it is vulnerable to the attacks of malicious adversaries that try to manipulate the data and thus decline the security of the system by compromising its robustness. These possible attacks have not been considered while developing most biometric authentication systems. Our work describes multimodal biometrics, its feature extraction methods, research challenges and focuses on the major security issues in both unimodal and multimodal biometric systems. This paper summarizes some robust multimodal systems, their countermeasures and algorithms that have been devised to tackle these security challenges.KeywordsBiometricsMultimodal biometricsBiometric fusionSecurityAttacksCountermeasuresEncryption

This research discusses the evaluation of biometric systems that are designed to process hundreds to tens of thousands of individuals in short time spans. We propose a method for evaluating a system's performance across capture attempts for the purpose of identifying characteristics that are advantageous in these high-throughput environments. We also present a novel modification to the traditionally accepted biometric performance metrics of failure-to-acquire, and true-match rate. Namely, this paradigm shift holds that these metrics are a function of time and, as such, vary with the time available for a biometric system to interact with a user. This research demonstrates the utility of these time-based metrics in evaluating the performance of multiple, commercially available, high-throughput systems. We show that different biometric systems have notably different time-based performance curves using a corpus of data collected during the 2018 Department of Homeland Security, Science and Technology Directorate (DHS S&T) Biometric Technology Rally. These curves and the deviations between them are useful when quantifying the suitability of a technology, evaluated via scenario testing, for deployment in an operational environment where the throughput of the target population is a key performance parameter.