Multimodal biometric recognition using iris & fingerprint: By texture feature extraction using hybrid wavelets

In the field of data security, biometric security is a significant emerging concern. The multimodal biometrics system with enhanced accuracy and detection rate for smart environments is still a significant challenge. The fusion of an electrocardiogram (ECG) signal with a fingerprint is an effective multimodal recognition system. In this work, unimodal and multimodal biometric systems using Convolutional Neural Network (CNN) are conducted and compared with traditional methods using different levels of fusion of fingerprint and ECG signal. This study is concerned with the evaluation of the effectiveness of proposed parallel and sequential multimodal biometric systems with various feature extraction and classification methods. Additionally, the performance of unimodal biometrics of ECG and fingerprint utilizing deep learning and traditional classification technique is examined. The suggested biometric systems were evaluated utilizing ECG (MIT-BIH) and fingerprint (FVC2004) databases. Additional tests are conducted to examine the suggested models with:1) virtual dataset without augmentation (ODB) and 2) virtual dataset with augmentation (VDB). The findings show that the optimum performance of the parallel multimodal achieved 0.96 Area Under the ROC Curve (AUC) and sequential multimodal achieved 0.99 AUC, in comparison to unimodal biometrics which achieved 0.87 and 0.99 AUCs, for the fingerprint and ECG biometrics, respectively. The overall performance of the proposed multimodal biometrics outperformed unimodal biometrics using CNN. Moreover, the performance of the suggested CNN model for ECG signal and sequential multimodal system based on neural network outperformed other systems. Lastly, the performance of the proposed systems is compared with previously existing works.

A biometric system is an amalgamation of algorithms that uses an individual’s unique biological data innate physical features (fingerprints, retina, face, ears, etc.) or behavioural features (signature, voice, keystroke dynamics, etc.) or both to authenticate the individual. This essentially makes a biometric system function as a pattern recognition system that helps an individual in any kind of adversarial environment. Hence, like any conventional authentication system, it is vulnerable to the attacks of malicious adversaries that try to manipulate the data and thus decline the security of the system by compromising its robustness. These possible attacks have not been considered while developing most biometric authentication systems. Our work describes multimodal biometrics, its feature extraction methods, research challenges and focuses on the major security issues in both unimodal and multimodal biometric systems. This paper summarizes some robust multimodal systems, their countermeasures and algorithms that have been devised to tackle these security challenges.KeywordsBiometricsMultimodal biometricsBiometric fusionSecurityAttacksCountermeasuresEncryption

Biometrics is an ever-emerging field which is now being utilized in many applications and systems. Face biometrics are quite prevalent and have already been deployed in many devices and applications. Iris biometrics though already studied and deployed in certain areas are considered very effective due to their lesser chances of changing with time and uniqueness. Face detection and iris detection for verification have been employed in various biometric applications already. Unimodal systems of face and iris are secure, but for enhanced levels of security, multimodal biometric systems are being created. Multimodal biometric systems are those systems which use the various biometric traits simultaneously, in order to authenticate a person’s identity. There is a direct enhancement in the verification accuracy due to such systems. The fusion of these two biometrics in consideration to make the process of unauthenticated or unauthorized intervention complex because it will be difficult and inefficient to get multiple biometric traits simultaneously in real time. In order to draw a contrast between a unimodal approach and multimodal approach for the biometrics, this paper presents a survey on using individual face classifiers or individual iris classifiers and compares it with the combined classifier results. After analysing the various techniques, it is concluded with the directions towards the future scope.

"This paper explores the application of neural networks in multimodal biometric authentication systems, emphasizing the integration of multiple biometric modalities to enhance security, accuracy, and robustness against various attacks. Traditional authentication methods, such as passwords and single-modal biometrics, often suffer from vulnerabilities, including spoofing, environmental factors, and data breaches. To address these challenges, multimodal authentication systems combine several biometric traits, such as facial recognition, fingerprint scanning, voice recognition, and keystroke dynamics, to achieve higher reliability and resistance to security threats. The study provides an overview of public datasets used for training neural network-based biometric authentication models, including VoxCeleb, RAVDESS, MOBIO, and SDUMLA-HMT. These datasets contain diverse biometric information necessary for developing robust multimodal authentication systems. The paper evaluates the effectiveness of existing approaches using key performance metrics such as accuracy, false acceptance rate (FAR), false rejection rate (FRR), and area under the curve (AUC). Additionally, specialized metrics are considered, including failure to enroll rate (FTE), failure to acquire rate (FTA), and template stability (TS), which are crucial for real-world applications. The role of neural networks in multimodal biometric authentication is analyzed by examining state-of-the-art architectures, including convolutional neural networks (CNNs) and deep learning-based feature fusion methods. Various fusion levels—feature-level, score-level, and decision-level—are discussed to determine the optimal integration strategy for improving authentication performance. The results indicate that multimodal systems significantly outperform unimodal authentication methods by reducing vulnerability to spoofing and environmental variations. Experimental findings suggest that integrating multiple biometric traits enhances the system’s adaptability to dynamic conditions, reducing both false acceptance and false rejection rates. Despite these advantages, several challenges remain, including computational complexity, data privacy concerns, and the need for real-time processing capabilities. Future research should focus on optimizing multimodal fusion techniques, improving generalization across different datasets, and enhancing the security of biometric templates against adversarial attacks. Additionally, developing lightweight neural network architectures suitable for mobile and embedded systems is essential for the practical deployment of multimodal authentication technologies"

Unimodal biometric systems often face significant limitations due to sensitivity to noise intraclass variability and other factors. Multimodal biometric systems seek to alleviate some of these problems by providing multiple pieces of evidence of the same identity. However, the multimodal biometric system is limited to the time constraints due to its multiple processing stages. To overcome these limitations this paper presents a fast multimodal verification system by using the dynamic regions of the fingerprint image and enhanced iris segmentation method. The multimodal system is fused using rank level fusion at the verification stage. The performance of the biometric system shows improvement in the False Acceptance Rate (FAR) and Equal Error Rate (EER) curves. Furthermore, the time taken for the training and verification phase has a reduction of 15% when compared with the existing system tested on the slow processing mobile devices.

Recent works have shown that multi-modal biometric systems are not robust against spoofing attacks [12, 15, 13]. However, this conclusion has been obtained under the hypothesis of a “worst case” attack, where the attacker is able to replicate perfectly the genuine biometric traits. Aim of this paper is to analyse the robustness of some multi-modal verification systems, combining fingerprint and face biometrics, under realistic spoofing attacks, in order to investigate the validity of the results obtained under the worst-case attack assumption.

Biometric authentication systems operating in real world environments using a single modality are found to be insecure and unreliable due to numerous limitations. Multimodal biometric systems have better accuracy and reliability due to the use of multiple biometric traits to authenticate a claimed identity or perform identification. In this paper a novel method for person identification using multimodal biometrics with hand geometry and palmprint biometric traits is proposed. The geometrical information embedded in the user hand and palmprint images are brought out through the graph representations. The topological characterization of the image moments, represented as the virtual nodes of the palmprint image graph is a novel feature of this work. The user hand and palmprint images are represented as weighted undirected graphs and spectral characteristics of the graphs are extracted as features vectors. The feature vectors of the hand geometry and palmprint are fused at feature level to obtain a graph spectral feature vector to represent the person. User identification is performed by using a multiclass support vector machine (SVM) classifier. The experimental results demonstrate, an appreciable performance giving identification rate of 99.19% for multimodal biometric after feature level fusion of hand geometry and palmprint modalities. The performance is investigated by conducting the experiments separately for handgeometry, palmprint and fused feature vectors for person identification. Experimental results show that the proposed multimodal system achieves better performance than the unimodal cues, and can be used in high security applications. Further comparison show that it is better than similar other multimodal techniques.

Biometric identification referes to idetifying an individual based on his or her physilogical or beavioral characteristics. The use of more than one biometric identfiers in a biometric system, called the multimodal biometric system, increases the overall system accuracy and hence increase security, as well as reduce the enrollment problems. An effective and appropriate fusion strategy is needed to integrate different biometric information in such multimodal systems. This chapter provides an in-depth overview of traditional multimodal biometric systems and current trends in multimodal biometric fusion. Various approaches of rank level fusion, which is an not heavily investigated by researchers yet, are also illustrated in details in this chapter. Pros and cons of these rank fusion approaches are discussed which can be helpful for large scale multimodal biometric system deployment.

Ear based identity recognition subject to uncontrolled conditions such as illumination changes, pose variation, low contrast, partial occlusion and noise, is an active research area in the field of biometrics. Meanwhile, multimodal biometrics is becoming increasingly popular and offers improved performance due to the use of multiple sources of information. In this paper, a multimodal biometrics system is proposed based on the ear and profile face that not only alleviates the short-comings of ear biometrics but also improves the overall recognition rate. The ear and profile face modalities are first represented individually using the combination of two efficient local feature descriptors namely, local phase quantization (LPQ) and local directional patterns (LDP). These histogram-based local descriptors are then combined into a high-dimensional feature vector that preserves complementary information in both frequency and spatial domains. The PCA along with the z-score normalization technique is independently applied on each feature vector and the resultant reduced feature vectors are combined at the feature level. The kernel discriminative common vector (KDCV) approach is finally exploited over the combined feature set to derive more discriminative and non-linear features for the identification of individuals using kNN classifier. The effectiveness of the proposed model has been verified with the deep features derived from three popular pre-trained CNN models such as AlexNet, VGG16 and GoogleNet. Experimental results on two benchmark databases clearly show that the proposed approach achieves better performance than individual modality and other state-of-the-art methods.

The aim of this paper is to exploit the best possible combinations of hand geometry, palmprint and offline signatures for multimodal biometric systems by integrating the information at score level fusion. Initially, Zernike moments are extracted for each biometric trait of a person and study the identification accuracy. Subsequently, the effect of identification accuracy using score level fusion of multiple traits of a person is studied. Experiments are conducted on GPDS hand geometry database, PolyU two dimensional palmprint database and UOM offline signature database to assess the actual advantage of the fusion of multiple biometric traits performed at score level fusion, in comparison to the unimodal biometric system. The proposed methodology has shown promising results.

A multi-modal biometric authentication system based on iterative fusion operator trees is considered, where the per-user performance is also depending on the order of biometric feature evaluations. Therefore, each user would have its own optimal choice of order parameters of the biometric system. However, for a system approach there should be only one general parametrization of the whole biometric system for all users, and the necessary consequence are performance wins and losses for each user. The common approach for this purpose is to use the parameter setting that maximizes the average performance over users. However, this does not necessarily reflect a good balance of performance wins and losses. In order to gain more insight into the corresponding trade-offs, and to facilitate an effective selection of an order parameter, the concept of fairness relations and their maximality, which has become a recent topic of many investigations in communication network resource sharing tasks, is applied to this problem of multi-modal biometric systems. The central idea of the paper is that by applying fairness relation to select the parameters, we obtain a system where subjects have a more fair chance of being right authenticated. A comparative study of an experimental test data set shows that maxmin fairness gives solutions with major drawbacks for the majority of users, while proportional fairness comes close to the maximum average.

The primary factor driving the growing interest in novel biometric features is the vulnerability of traditional methods like fingerprint and facial recognition to forgery. This study focuses on a multimodal biometric identification system that integrates data from electroencephalograms (EEG) and facial features. To derive valuable insights from EEG data, we apply signal processing techniques such as filtering, segmentation, and feature extraction, alongside Daubechies-4 (DB4) wavelet analysis with five decomposition levels. The enhanced facial video features include entropy calculations and tracking of facial measurements. Six classifiers Gaussian Naïve Bayes, K-Nearest Neighbour, Random Forest, AdaBoost, Support Vector Machine, and Multilayer Perceptron were trained utilizing the combined EEG and facial data. Findings reveal that AdaBoost and Random Forest emerged as the most effective classifiers for this application, achieving accuracies of 99.87±0.13% and requiring EEG recording times of 2s and 1.5s, respectively, showcasing excellent precision.

Review Paper on Applications of Principal Component Analysis in Multimodal Biometrics System

A spoof resistant multibiometric system based on the physiological and behavioral characteristics of fingerprint

The biometric recognition on contactless multi-spectrum finger images