Evaluation and performance prediction of multimodal biometric systems

Dynamic registration selection for fingerprint verification

Multimodal biometrics-based systems aim to improve the recognition accuracy of human beings using more than one physical and/or behavioral characteristics of a person. In this paper, different fusion schemes at matching score level and feature level are employed to obtain a robust recognition system using several standard feature extractors. The proposed method involves the consideration of a face–iris multimodal biometric system using score level and feature level fusion. Principal Component Analysis (PCA), subspace Linear Discriminant Analysis (LDA), subpattern-based PCA, modular PCA and Local Binary Patterns (LBP) are global and local feature extraction methods applied on face and iris images. In fact, different feature sets obtained from five local and global feature extraction methods for unimodal iris biometric system are concatenated at feature level fusion called iris feature vector fusion (iris-FVF), while for unimodal face biometric system, LBP is used to achieve efficient texture descriptors. Feature selection is performed using Particle Swarm Optimization (PSO) at feature level fusion step to reduce the dimension of feature vectors for improving the recognition performance. Our proposed method is validated by forming three datasets using ORL, BANCA, FERET face databases and CASIA, UBIRIS iris databases. The results based on recognition performance and ROC analysis demonstrate that the proposed matching score level fusion scheme using Weighted Sum rule, tanh normalization, iris-FVF and facial features extracted by LBP achieves a significant improvement over unimodal and multimodal methods. Support Vector Machine (SVM) and t-norm normalization are also used to improve the recognition performance of the proposed method.

The biometrics is an alternative for password-based recognition systems in recent days. But biometric recognition systems are venerable to spoof attacks. Hence, anti-spoofing techniques are attracting growing interest in this field. Liveness detection is the anti-spoofing technique, which has the aim to identify the dead and living modalities presented at the time of authentication. This paper presents an efficient and robust multimodal biometric system integrated with liveness detection technique. In the proposed system, face and fingerprint modalities are used at the enrolment time and only face modality is used to authenticate a person. Here, fingerprint is used to generate a fingerprint key using K-means clustering algorithm and then encrypt the face feature set with asymmetric encryption standard (AES) using fingerprint key. At the time of authentication, liveness of a person is checked using challenge--response method at the sensor level. If in any case, an intruder has passed liveness test, he/she may be detected at matching score level as template of system is secured with AES encryption. Multimodal biometric system integrated with liveness detection technique can increase the speed of the system. Matrix Laboratory (MATLAB) 2017b and multi-biometric integration (MUBI) tool are used for the experimental work, and results show that the proposed system gives better performance as compared to others.KeywordsFace recognitionEncrypted face templateLiveness detectionMultimodal biometric system

The interface of computer technologies and biology is having a huge impact on society. Human recognition technology research projects promises new life to many security consulting firms and personal identification system manufacturers. The physiological or biological features of an individual, called biometrics, are unique to each human and remain unaltered during a person's lifetime and give a promising solution for security management. This paper presents an intelligent multimodal biometric verification system for physical access control, based on fusion of iris, face and fingerprint patterns. Feature vectors are created independently for query images and are then compared with the enrolled templates of each biometric trait to compute the matching score. The final decision is made by fusion at this matching score level. The proposed system is designed to suit embedded solutions for high security access in pervasive environments using biometric features.

This paper focus to analyze several fusion rule at matching score level to combine important features extracted from gait sequence images for human identification system. Gait sequence image is a non-stationary data and can be modelled using a statistical learning technique. The propose technique consists of three different stages. The pre-processing stage computes the average silhouette images to capture the important information and get a better representation for gait silhouette data. Then a principle component analysis (PCA) technique is applied on the average silhouette to extract the important gait features and reduce a dimension of gait data. Three different features are fused at matching score level by using sum, product and max rule. The proposed algorithm has been tested using a benchmark CASIA datasets. The experimental results show that the best recognition rate is 90% when the fusion is performed using sum rule.

Information fusion in biometrics has received considerable attention. This paper focuses on the application of information fusion techniques in iris recognition. To improve the reliability and accuracy of personal identification based on the iris pattern, this paper proposes the schemes of multialgorithmic fusion and multiinstance fusion. Multialgorithmic fusion integrates the improved phase algorithm and the DCT-based algorithm, and multiinstance fusion combines information from the left iris and the right iris of an individual. Both multialgorithmic fusion and multiinstance fusion are carried out at the matching score level and the support vector machine (SVM)-based fusion rule is utilized to generate fused scores for final decision. The experimental results on the noisy iris database UBIRIS demonstrate that the proposed fusion schemes can perform better than the single recognition systems, and further prove that information fusion techniques are feasible and effective to improve the accuracy and robustness of iris recognition especially under noisy conditions.

Multimodal biometrics is the frontier to unimodal biometrics as it integrates the information obtained from multiple biometric sources at various fusion levels i.e. sensor level, feature extraction level, match score level, or decision level. In this article, fingerprint, palmprint, and iris are used for verification of an individual. The wavelet transformation is used to extract features from fingerprint, palmprint, and iris. Further the PCA is used for dimensionality reduction. The fusion of traits is employed at three levels: feature level; feature level combined with match score level; and feature level combined with decision level. The main objective of this research is to observe effect of combined fusion levels on verification of an individual. The performance of three cases of fusion is measured in terms of EER and represented with ROC. The experiments performed on 100 different subjects from publicly available databases demonstrate that combining feature level with match score level and feature level with decision level fusion both outperforms fusion at only a feature level.

This paper reviews several information fusion techniques and strategies in the application of multimodal biometrics system using face and palmprint images. Multimodal biometric is able to overcome several limitations in single modal biometric such as intra-class variations, less discriminative power, noise data and redundant features. By consolidating two kinds of modality a better performance can be achieved. Information fusion in multimodal biometrics can be carried out at three possible levels, i.e. feature, matching score and decision levels. Fusions at these three levels have their own attributes, thus this paper is aimed to compare their effectiveness. A specific fusion rule is necessary to combine the information at each level. Several numbers of analyses on verification and identification shows matching score fusion is able to achieve the best performance which is 98% recognition rates and 98.5% GAR at 0.1% FAR when tested using AR face and PolyU palmprint datasets.

A spoof resistant multibiometric system based on the physiological and behavioral characteristics of fingerprint

Biometric systems utilize physiological or behavioral traits to automatically identify individuals. A unimodal biometric system utilizes only one source of biometric information and suffers from a variety of problems such as noisy data, intra-class variations, restricted degrees of freedom, non-universality, spoof attacks and unacceptable error rates. Multimodal biometrics refers to a system which utilizes multiple biometric information sources and can overcome some of the limitation of unimodal system. Biometric information can be combined at 4 different levels: (i) Raw data level; (ii) Feature level; (iii) Match-score level; and (iv) Decision level. Match score fusion and decision fusion have received significant attention due to convenient information representation and raw data fusion is extremely challenging due to large diversity of representation. Feature level fusion provides a good trade-off between fusion complexity and loss of information due to subsequent processing. This work presents generic feature information fusion techniques for fusion of most of the commonly used feature representation schemes. A novel concept of Local Distance Kernels is introduced to transform the available information into an arbitrary common distance space where they can be easily fused together. Also, a new dynamic learnable noise removal scheme based on thresholding is used to remove shot noise in the distance vectors. Finally we propose the use of AdaBoost and Support Vector Machines for learning the fusion rules to obtain highly reliable final matching scores from the transformed local distance vectors. The integration of the proposed methods leads to large performance improvement over match-score or decision level fusion.

The paper presents the Multimodal biometric techniques with Iris and Palmprint traits. Here the Different Color spaces are considered with score level fusion to get proposed multimodal identification technique using Block Truncation Coding (BTC) with Bit plane Slicing. Use of Color Spaces makes greater impact on iris images, which results in higher GAR. The experimentation done using test bed with 60 pairs of Iris & Palmprint images for 10 persons. Experimentation results indicate that YCgCb color space performs better than all other considered color spaces for proposed multimodal biometric identification technique. The proposed multimodal identification techniques with score level of Iris: Palmprint fusion with 1∶3 proportions has given best genuine acceptance rate with BTC.

We analyze the performance of an iris based recognition system. We consider a practical setting where matching scores are accessible for collecting data. We assume that multiple scans from the same iris are available and design the decision rules based on this assumption. We show that vectors of matching scores are described by a Gaussian model with dependent components both under the genuine and imposter hypotheses. Two test statistics: the average Hamming distance and the log-likelihood ratio are designed. We show that the log-likelihood ratio with well estimated maximum likelihood parameters in it outperforms the first test statistic. We further use an empirical approach, Chernoff bound, and large deviations approach to predict the performance of the recognition system.

In this paper, we investigate an efficient palmprint texture modeling method that incorporates a robust analysis based on fusing multiple information. In fact, a single descriptor alone may not achieve a high accuracy in palmprint biometric system. Hence, we propose the fusion of various information features extracted by the different descriptors, such as the fractal and the Multi-fractal techniques which produce a robustness to face the numerous challenging and variation of palmprint in unconstrained environments. To increase the performance of palmprint biometric systems, information fusion is proposed as a key phase in multi-characteristic systems. The obtained information can be combined at different levels, i.e., at the feature level, the score level or the decision level. Nevertheless, the feature level fusion is considered more effective than both the matching score and the classifier decision levels, thanks to a feature vector set which contains more and richer information about the input palmprint image. In order to improve the discriminating texture information, our proposed method extracts the fractal dimension features from the preprocessed palmprint images and fuses them with the Multi-fractal dimension features using the Canonical Correlation Analysis (CCA) incorporating the Linear Discriminant Analysis (LDA) in order to reduce the feature dimensionality for each feature set. To demonstrate the feasibility and effectiveness of our proposed method, we performed the experimental results on two benchmark datasets. These results outperform other well-known state of the art methods and produce promising recognition rates by achieving 96.02% for PolyU-Palmprint database and 97.00% for CASIA-Palmprint database.

Multi-biometrics aims at building more accurate unified biometric decisions based on the information provided by multiple biometric sources. Information fusion is used to optimize the process of creating this unified decision. In previous works dealing with score-level multi-biometric fusion, the scores of different biometric sources belonging to the comparison of interest are used to create the fused score. This is usually achieved by assigning static weights for the different biometric sources. In contrast, we focus on integrating the information imbedded in the relative relation between the comparison scores (within a 1:N comparison) in the biometric fusion process using a dynamic weighting scheme. This is performed by considering the neighbors distance ratio in the ranked comparisons to influence the dynamic weights of the fused scores. The evaluation was performed on the Biometric Scores Set BSSR1 database. The enhanced performance induced by including the neighbors distance ratio information within a dynamic weighting scheme in comparison to the baseline solution was shown by an average reduction of the equal error rate by more than 40% over the different test scenarios.

The current wireless network information fusion matching method is based on the calculation of the uncertainty of a large number of data samples, and gets the information fusion results according to the corresponding decision. However, due to the uncertainty of data samples, it is difficult to complete statistics, which leads to low processing accuracy and poor information fusion effect of information fusion matching method. In order to solve the above problems, a multi-source information matching and fusion method based on fuzzy set is studied. After matching with multi-source information, Markov distance is used to allocate the information. According to the probability of supporting information conflict, information fusion rules are formulated, and multi-source fusion is realized by using fuzzy sets. Simulation results show that the proposed information fusion method can reduce the energy consumption of network nodes by 81.4%, and has high fusion accuracy and reliability.