An intelligent multimodal biometric system for high security access

In the field of data security, biometric security is a significant emerging concern. The multimodal biometrics system with enhanced accuracy and detection rate for smart environments is still a significant challenge. The fusion of an electrocardiogram (ECG) signal with a fingerprint is an effective multimodal recognition system. In this work, unimodal and multimodal biometric systems using Convolutional Neural Network (CNN) are conducted and compared with traditional methods using different levels of fusion of fingerprint and ECG signal. This study is concerned with the evaluation of the effectiveness of proposed parallel and sequential multimodal biometric systems with various feature extraction and classification methods. Additionally, the performance of unimodal biometrics of ECG and fingerprint utilizing deep learning and traditional classification technique is examined. The suggested biometric systems were evaluated utilizing ECG (MIT-BIH) and fingerprint (FVC2004) databases. Additional tests are conducted to examine the suggested models with:1) virtual dataset without augmentation (ODB) and 2) virtual dataset with augmentation (VDB). The findings show that the optimum performance of the parallel multimodal achieved 0.96 Area Under the ROC Curve (AUC) and sequential multimodal achieved 0.99 AUC, in comparison to unimodal biometrics which achieved 0.87 and 0.99 AUCs, for the fingerprint and ECG biometrics, respectively. The overall performance of the proposed multimodal biometrics outperformed unimodal biometrics using CNN. Moreover, the performance of the suggested CNN model for ECG signal and sequential multimodal system based on neural network outperformed other systems. Lastly, the performance of the proposed systems is compared with previously existing works.

A spoof resistant multibiometric system based on the physiological and behavioral characteristics of fingerprint

Ear based identity recognition subject to uncontrolled conditions such as illumination changes, pose variation, low contrast, partial occlusion and noise, is an active research area in the field of biometrics. Meanwhile, multimodal biometrics is becoming increasingly popular and offers improved performance due to the use of multiple sources of information. In this paper, a multimodal biometrics system is proposed based on the ear and profile face that not only alleviates the short-comings of ear biometrics but also improves the overall recognition rate. The ear and profile face modalities are first represented individually using the combination of two efficient local feature descriptors namely, local phase quantization (LPQ) and local directional patterns (LDP). These histogram-based local descriptors are then combined into a high-dimensional feature vector that preserves complementary information in both frequency and spatial domains. The PCA along with the z-score normalization technique is independently applied on each feature vector and the resultant reduced feature vectors are combined at the feature level. The kernel discriminative common vector (KDCV) approach is finally exploited over the combined feature set to derive more discriminative and non-linear features for the identification of individuals using kNN classifier. The effectiveness of the proposed model has been verified with the deep features derived from three popular pre-trained CNN models such as AlexNet, VGG16 and GoogleNet. Experimental results on two benchmark databases clearly show that the proposed approach achieves better performance than individual modality and other state-of-the-art methods.

The primary factor driving the growing interest in novel biometric features is the vulnerability of traditional methods like fingerprint and facial recognition to forgery. This study focuses on a multimodal biometric identification system that integrates data from electroencephalograms (EEG) and facial features. To derive valuable insights from EEG data, we apply signal processing techniques such as filtering, segmentation, and feature extraction, alongside Daubechies-4 (DB4) wavelet analysis with five decomposition levels. The enhanced facial video features include entropy calculations and tracking of facial measurements. Six classifiers Gaussian Naïve Bayes, K-Nearest Neighbour, Random Forest, AdaBoost, Support Vector Machine, and Multilayer Perceptron were trained utilizing the combined EEG and facial data. Findings reveal that AdaBoost and Random Forest emerged as the most effective classifiers for this application, achieving accuracies of 99.87±0.13% and requiring EEG recording times of 2s and 1.5s, respectively, showcasing excellent precision.

Human identification is essential for proper functioning of society. Human identification through multimodal biometrics is becoming an emerging trend, and one of the reasons is to improve recognition accuracy. Unimodal biometric systems are affected by various problemssuch as noisy sensor data,non-universality, lack of individuality, lack of invariant representation and susceptibility to circumvention.A unimodal system has limited accuracy. Hence, Multimodal biometric systems by combining more than one biometric feature in different levels are proposed in order to enhance the performance of the system. A supervisor module combines the different opinions or decisions delivered by each subsystem and then make a final decision. In this paper, a multimodal biometrics authentication is proposed by combining face, iris and finger features. Biometric features are extracted by Local Derivative Ternary Pattern (LDTP) in Contourlet domain and an extensive evaluation of LDTP is done using Support Vector Machine and Nearest Neighborhood Classifier. The experimental evaluations are performed on a public dataset demonstrating the accuracy of the proposed system compared with the existing systems. It is observed that, the combination of face, fingerprint and iris gives better performance in terms of accuracy, False Acceptance Rate, False Rejection Rate with minimum computation time.

Multimodal biometrics-based systems aim to improve the recognition accuracy of human beings using more than one physical and/or behavioral characteristics of a person. In this paper, different fusion schemes at matching score level and feature level are employed to obtain a robust recognition system using several standard feature extractors. The proposed method involves the consideration of a face–iris multimodal biometric system using score level and feature level fusion. Principal Component Analysis (PCA), subspace Linear Discriminant Analysis (LDA), subpattern-based PCA, modular PCA and Local Binary Patterns (LBP) are global and local feature extraction methods applied on face and iris images. In fact, different feature sets obtained from five local and global feature extraction methods for unimodal iris biometric system are concatenated at feature level fusion called iris feature vector fusion (iris-FVF), while for unimodal face biometric system, LBP is used to achieve efficient texture descriptors. Feature selection is performed using Particle Swarm Optimization (PSO) at feature level fusion step to reduce the dimension of feature vectors for improving the recognition performance. Our proposed method is validated by forming three datasets using ORL, BANCA, FERET face databases and CASIA, UBIRIS iris databases. The results based on recognition performance and ROC analysis demonstrate that the proposed matching score level fusion scheme using Weighted Sum rule, tanh normalization, iris-FVF and facial features extracted by LBP achieves a significant improvement over unimodal and multimodal methods. Support Vector Machine (SVM) and t-norm normalization are also used to improve the recognition performance of the proposed method.

Biometric Authentication (BA) has been recently identified as a significant paradigm on maintaining the security level to improve individual person's authenticity. With more and more advanced technology, the BA has to be enhanced to cope up with the increased insecure environment. Several schemes employing multimodal biometric system fuses the face image with certain other traditional biometric modalities to ensure security. However changes in the facial expression significantly updates the facial geometry, thereby reduces the ranking score level. Some of the multimodal biometric research group has designed different algorithms on personal biometric feature based authentication. But, fusion multimodal biometric system did not provide robustness compromising the security level. To develop high robust multimodal biometric system, person multimodal biometric using Covariance Matrix Incremental Principal Component Analysis (CMI-PCA) method is proposed in this paper. The main goal of CMI-PCA method is to work with three principle steps and attain rank level fusion integration on the faces, ears and hand dorsal vein. First, the person's multimodal biometric features are sensed and feature extraction is performed using Gabor Filter based Incremental PCA to improve robustness level. Second step is to match the extracted features with stored test image from the database using Score Matching based on Covariance Matrix Incremental PCA. The score matching based on Covariance Matrix Incremental PCA maintain the scale of extracted features and compute the mean score value to match with test images without any Covariance Matrix range. Finally, the CMI-PCA method involves combining different biometric identification ranks for making final decision. The extended Borda Count Multimodal Ranking system is used in CMI-PCA to determine the integrated biometric outcome and ensures higher security level for individual information. Experiment is conducted on factors such as robustness level, multimodal matching score rate, rank level fusion efficiency rate.

The biometrics is an alternative for password-based recognition systems in recent days. But biometric recognition systems are venerable to spoof attacks. Hence, anti-spoofing techniques are attracting growing interest in this field. Liveness detection is the anti-spoofing technique, which has the aim to identify the dead and living modalities presented at the time of authentication. This paper presents an efficient and robust multimodal biometric system integrated with liveness detection technique. In the proposed system, face and fingerprint modalities are used at the enrolment time and only face modality is used to authenticate a person. Here, fingerprint is used to generate a fingerprint key using K-means clustering algorithm and then encrypt the face feature set with asymmetric encryption standard (AES) using fingerprint key. At the time of authentication, liveness of a person is checked using challenge--response method at the sensor level. If in any case, an intruder has passed liveness test, he/she may be detected at matching score level as template of system is secured with AES encryption. Multimodal biometric system integrated with liveness detection technique can increase the speed of the system. Matrix Laboratory (MATLAB) 2017b and multi-biometric integration (MUBI) tool are used for the experimental work, and results show that the proposed system gives better performance as compared to others.KeywordsFace recognitionEncrypted face templateLiveness detectionMultimodal biometric system

Biometric identification referes to idetifying an individual based on his or her physilogical or beavioral characteristics. The use of more than one biometric identfiers in a biometric system, called the multimodal biometric system, increases the overall system accuracy and hence increase security, as well as reduce the enrollment problems. An effective and appropriate fusion strategy is needed to integrate different biometric information in such multimodal systems. This chapter provides an in-depth overview of traditional multimodal biometric systems and current trends in multimodal biometric fusion. Various approaches of rank level fusion, which is an not heavily investigated by researchers yet, are also illustrated in details in this chapter. Pros and cons of these rank fusion approaches are discussed which can be helpful for large scale multimodal biometric system deployment.

A biometric system is an amalgamation of algorithms that uses an individual’s unique biological data innate physical features (fingerprints, retina, face, ears, etc.) or behavioural features (signature, voice, keystroke dynamics, etc.) or both to authenticate the individual. This essentially makes a biometric system function as a pattern recognition system that helps an individual in any kind of adversarial environment. Hence, like any conventional authentication system, it is vulnerable to the attacks of malicious adversaries that try to manipulate the data and thus decline the security of the system by compromising its robustness. These possible attacks have not been considered while developing most biometric authentication systems. Our work describes multimodal biometrics, its feature extraction methods, research challenges and focuses on the major security issues in both unimodal and multimodal biometric systems. This paper summarizes some robust multimodal systems, their countermeasures and algorithms that have been devised to tackle these security challenges.KeywordsBiometricsMultimodal biometricsBiometric fusionSecurityAttacksCountermeasuresEncryption

Recent works have shown that multi-modal biometric systems are not robust against spoofing attacks [12, 15, 13]. However, this conclusion has been obtained under the hypothesis of a “worst case” attack, where the attacker is able to replicate perfectly the genuine biometric traits. Aim of this paper is to analyse the robustness of some multi-modal verification systems, combining fingerprint and face biometrics, under realistic spoofing attacks, in order to investigate the validity of the results obtained under the worst-case attack assumption.

Unimodal biometric systems often face significant limitations due to sensitivity to noise intraclass variability and other factors. Multimodal biometric systems seek to alleviate some of these problems by providing multiple pieces of evidence of the same identity. However, the multimodal biometric system is limited to the time constraints due to its multiple processing stages. To overcome these limitations this paper presents a fast multimodal verification system by using the dynamic regions of the fingerprint image and enhanced iris segmentation method. The multimodal system is fused using rank level fusion at the verification stage. The performance of the biometric system shows improvement in the False Acceptance Rate (FAR) and Equal Error Rate (EER) curves. Furthermore, the time taken for the training and verification phase has a reduction of 15% when compared with the existing system tested on the slow processing mobile devices.

Biometric authentication systems operating in real world environments using a single modality are found to be insecure and unreliable due to numerous limitations. Multimodal biometric systems have better accuracy and reliability due to the use of multiple biometric traits to authenticate a claimed identity or perform identification. In this paper a novel method for person identification using multimodal biometrics with hand geometry and palmprint biometric traits is proposed. The geometrical information embedded in the user hand and palmprint images are brought out through the graph representations. The topological characterization of the image moments, represented as the virtual nodes of the palmprint image graph is a novel feature of this work. The user hand and palmprint images are represented as weighted undirected graphs and spectral characteristics of the graphs are extracted as features vectors. The feature vectors of the hand geometry and palmprint are fused at feature level to obtain a graph spectral feature vector to represent the person. User identification is performed by using a multiclass support vector machine (SVM) classifier. The experimental results demonstrate, an appreciable performance giving identification rate of 99.19% for multimodal biometric after feature level fusion of hand geometry and palmprint modalities. The performance is investigated by conducting the experiments separately for handgeometry, palmprint and fused feature vectors for person identification. Experimental results show that the proposed multimodal system achieves better performance than the unimodal cues, and can be used in high security applications. Further comparison show that it is better than similar other multimodal techniques.

In this paper, a new transform Gabor filtered Wigner transform (GFWT) has been proposed. In GFWT, Gabor filtering is performed on the Wigner transformed image. Wigner transform gives a simultaneous representation of an image in time and frequency domain which is further processed using Gabor filters. The proposed transform is then used to extract the features from the biometrics to develop different multimodal biometric systems. A detailed study has been carried out in which, different unimodal and multimodal systems such as feature level and score level fusion are analysed. In order to improve the performance of the system, an optimisation technique, particle swarm optimisation (PSO) is used to find the optimal parameters of the Gabor filter and to select the significant GFWT feature vector. The PSO technique not only improves the performance of the system but also able to reduce the dimension of the feature vectors. Numerical experiments are carried out on face and palmprint database to show the effectiveness of the proposed transform for different unimodal and multimodal systems.

Multibiometric systems fuse the evidence presented by different biometric sources in order to improve the matching accuracy of a biometric system. In such systems, information fusion can be performed at different levels; however, integration at the matching score level is the most commonly used approach due to the tradeoff between information content and accessibility. This work develops a tool in order to analyze the impact of various normalization schemes on the matching performance of score-level fusion algorithms. The tool permits the systematic evaluation of different fusion rules after employing normalizing and mapping the match scores of different modalities into a common domain. Furthermore, it provides a method to fit various parametric models to the score distribution and analyze the goodness of fit statistic based on the Chi-Squared and Kolmogorov-Smirnov tests. Experimental results on multiple datasets indicate the benefits of normalization, the role of parametric distributions and the variations in matching performance on different databases.