System for multimodal biometric recognition based on finger knuckle and finger vein using feature‐level fusion and k‐support vector machine classifier

Recent years have seen a plenty of personal identification methods with different biometrics such as finger pattern, face, palm-print and vein. The majority of these methods focus on complex image data projections and transforms in Fourier space, wavelet space or other domains, which usually bring heavy load in computation and difficult understanding in perceptual intuition. Moreover, these methods, oriented to multiple samples learning, are constricted usually in application. Among so much biometrics, vein, as a living feature with high anti-counterfeiting capability, has attracted considerable attention. In this paper, we propose a structured personal identification approach using finger vein Location and Direction Coding(LDC). First of all, we design a finger vein imaging device with near-infrared(NIR) light source, by which a database for finger vein images is established. Subsequently, we make use of the brightness difference in the finger vein image to extract the vein pattern. Furthermore, finger vein LDC is proposed and performed, which creates a structured feature image for each finger vein. Finally, the structured feature image is utilized to conduct the personal identification on our image database for finger vein, which includes 440 vein images from 220 different fingers. The equal error rate of our method for this database is 0.44%.

Recently, finger vein sensors have been embedded in all kinds of electronic devices for personal identification, such as intelligent door locks and attendance machines. The embedded sensors are generally small, thus capturing only part of the finger vein. However, prior studies have focused on near-full finger vein recognition, without considering the partial finger vein image caused by the small imaging window of the finger vein sensor. This paper aims to study personal identification based on partial finger vein images, known as small-area finger vein recognition. The effect of the small-area finger vein on recognition performance is first analyzed by cutting out the local part from the near-full finger vein image to model a small-area finger vein image. Second, a small-area finger vein database is built using a commercial finger vein imaging device, in which the vein pattern from approximately one-third of one adult finger is captured. To explore more discriminative information from small-area finger vein images, we propose a locality-constrained consistent dictionary learning (LCDL) method to fuse multiple features for small-area finger vein recognition. Finally, the proposed method is evaluated on the self-built small-area finger vein database and four synthetic small-area finger vein databases. Experimental results show the promising recognition performance of the proposed method.

Finger vein verification is a promising biometric pattern for personal identification in terms of security and convenience. The recognition performance of this technology heavily relies on the quality of finger vein images and on the recognition algorithm. To achieve efficient recognition performance, a special finger vein imaging device is developed, and a finger vein recognition method based on sparse representation is proposed. The motivation for the proposed method is that finger vein images exhibit a sparse property. In the proposed system, the regions of interest (ROIs) in the finger vein images are segmented and enhanced. Sparse representation and sparsity preserving projection on ROIs are performed to obtain the features. Finally, the features are measured for recognition. An equal error rate of 0.017% was achieved based on the finger vein image database, which contains images that were captured by using the near-IR imaging device that was developed in this study. The experimental results demonstrate that the proposed method is faster and more robust than previous methods.

Exploring finger vein based personal authentication for secure IoT

Finger vein recognition has become a research hotspot in the field of biometrics due to its advantages of non-contact acquisition, unique information, and difficulty in terms of forging or pirating. However, in the real-world application process, the extraction of image features for the biometric remains a significant challenge when the captured finger vein images suffer from blur, noise, or missing feature information. To address the above challenges, we propose a novel deep reinforcement learning-based finger vein image recovery method, DRL-FVRestore, which trained an agent that adaptively selects the appropriate restoration behavior according to the state of the finger vein image, enabling continuous restoration of the image. The behaviors of image restoration are divided into three tasks: deblurring restoration, defect restoration, and denoising and enhancement restoration. Specifically, a DeblurGAN-v2 based on the Inception-Resnet-v2 backbone is proposed to achieve deblurring restoration of finger vein images. A finger vein feature-guided restoration network is proposed to achieve defect image restoration. The DRL-FVRestore is proposed to deal with multi-image problems in complex situations. In this paper, extensive experimental results are conducted based on using four publicly accessible datasets. The experimental results show that for restoration with single image problems, the EER values of the deblurring network and damage restoration network are reduced by an average of 4.31% and 1.71%, respectively, compared to other methods. For images with multiple vision problems, the EER value of the proposed DRL-FVRestore is reduced by an average of 3.98%.

Compared with single biometric recognition, multimodal biometric recognition based on fingerprint and finger vein has been widely considered because of its convenient sample collection, high security and accurate recognition. However, according to our investigation, there is no public dataset of fingerprint and finger vein collected at the same time. The existing work uses fingerprint datasets and finger vein datasets from different sources for research, besides the researchers data from building their own equipment, which lacks consideration of practical applications. This is not conducive to the promotion of multibiometric technology based on finger. To promote research on multimodal biometric recognition based on fingerprint and finger vein, we design a finger collection device and introduce a new dataset, NUPT-FPV. It is the first public dataset to collect fingerprint and finger vein simultaneously in real-world applications. NUPT-FPV obtained 840 finger information from 140 volunteers, each finger was collected 20 times (collected in two sessions), and 33600 fingerprint and finger vein images were obtained. In addition, we propose a novel multimodal fusion method based on a convolutional neural network as a benchmark. Extensive experiments were conducted to verify the necessity of our dataset. Through the released dataset and benchmark, we hope to further promote the development of multimodal biometrics based on fingerprint and finger vein.

Biometric systems have been actively emerging in various industries in the past few years and continue to provide higher-security features for access control systems. Many types of unimodal biometric systems have been developed. However, these systems are only capable of providing low- to mid-range security features. Thus, for higher-security features, the combination of two or more unimodal biometrics (multiple modalities) is required. In this paper, we propose a multimodal biometric system for person recognition using face, fingerprint, and finger vein images. Addressing this problem, we propose an efficient matching algorithm that is based on secondary calculation of the Fisher vector and uses three biometric modalities: face, fingerprint, and finger vein. The three modalities are combined and fusion is performed at the feature level. Furthermore, based on the method of feature fusion, the paper studies the fake feature which appears in the practical scene. The liveness detection is append to the system, detect the picture is real or fake based on DCT, then remove the fake picture to reduce the influence of accuracy rate, and increase the robust of system. The experimental results showed that the designed framework can achieve an excellent recognition rate and provide higher security than a unimodal biometric-based system, which are very important for a IoMT platform.

Finger vein identification using Convolutional Neural Network and supervised discrete hashing

In the process of image acquisition, the contrast between veins and non-veins in finger vein images is not high due to the influence of the fuzzy light source, skin scattering and finger movement. To solve this problem, a finger vein image enhancement method is proposed (GTGFs), which enhances finger vein patterns by setting guided image as input image firstly. On this basis, the tri-Gaussian model is based on disinhibitory properties of the concentric receptive field used to locally enhancing the image. The parameters of the tri-Gaussian model are determined based on the finger vein width information. The experiment results show that the proposed enhancement method can significantly enhance the finger vein patterns and improve the recognition effect of the methods based on vein pattern segmentation.

The modern-day finger vein based human recognition techniques provide good performance, yet they are highly finger vein image quality dependent. To address this problem, a novel deep learning-based approach using convolution-neural-network (CNN) for finger vein identification has been introduced here. The prime objective of our work is to achieve a stable response with accurate performance keeping varying quality finger vein images in account. The proposed approach is tested on the considered publicly available dataset and reported experiment results show that with effective training and testing strategy high identification accuracy can be achieved.

Trilateral Filterative Hermitian feature transformed deep perceptive fuzzy neural network for finger vein verification

Finger vein is a new and secure biometric for personal authentication due to its line-structure network with abundant local and orientation features. However, these features cannot be well represented by the existing local descriptors. To effectively utilize these rich orientation features in finger vein images, this paper proposes a new local descriptor, namely, pyramid histogram of double competitive pattern (PHDCP). For a finger vein image, the PHDCP first obtains a bank of filtered images using Gabor filters with large kernel size and rich orientations, by which the local line features are captured. Then, the orientation orders with the largest and smallest responses, which are the most robust features, are selected to generate an encoded map. Finally, a column-partition-based pyramid histogram extraction method is presented to capture the hierarchical features from the encoded image. Numerical experiments are conducted on two public finger vein data sets, MMCBNU_6000 and UTFVP. The experimental results demonstrate that the proposed PHDCP performs much better than the existing local descriptors.

Vascular pattern based biometric recognition is gaining more and more attention, with a trend towards contactless acquisition. An important requirement for conducting research in vascular pattern recognition are available datasets. These datasets can be established using a suitable biometric capturing device. A sophisticated capturing device design is important for good image quality and, furthermore, at a decent recognition rate. We propose a novel contactless capturing device design, including technical details of its individual parts. Our capturing device is suitable for finger and hand vein image acquisition and is able to acquire palmar finger vein images using light transmission as well as palmar hand vein images using reflected light. An experimental evaluation using several well-established vein recognition schemes on a dataset acquired with the proposed capturing device confirms its good image quality and competitive recognition performance. This challenging dataset, which is one of the first publicly available contactless finger and hand vein datasets, is published as well.

Finger Vein Recognition System (FVRS) is a biometric technology that identifies or verifies an individual based on unique vein patterns. Region of interest (ROI) extraction is one of the essential steps in FVRS. Current ROI extraction methods cannot extract an accurate ROI for a finger vein image with non-uniform background illumination. In this paper, we propose a new ROI extraction method that is immune to non-uniform background illumination. To detect the edge of the finger for the ROI extraction, we utilise watershed segmentation with distance transform and Canny edge detector. Experimental results show that the proposed ROI extraction method can extract consistent ROI from a finger vein image with non-uniform background illumination.

Low-quality finger vein images seriously affect the performance of the recognition system. Aiming at filtering high- and low-quality finger vein images, this paper presents a finger-vein image quality assessment method based on light-CNN (convolutional neural network). The previous quality assessment method aims to establish a model that is consistent with the evaluation effect of the human visual system. In contrast, our model further evaluates the quality of the finger vein image for the purpose of distinguishing whether the image contains rich and stable vein characteristics. The rich and stable vein characteristics in finger vein images play a more important role in practical applications. First, the finger vein image is automatically annotated based on a traditional finger vein image quality assessment method; secondly, the finger vein image is cut into image blocks to expand the training set, and the image block instead of the entire image is input to the CNN; then, the network and its variants are trained; in the final test, the average quality score of multiple image blocks from an image is the final quality score of the image. The experimental results show that the proposed light-CNN accurately identifies high and low quality images and significantly outperforms existing approaches in terms of distinguishing whether there are rich and stable vein characteristics in the image.