When Face Recognition Meets with Deep Learning: An Evaluation of Convolutional Neural Networks for Face Recognition

Application of Face Recognition Method Under Deep Learning Algorithm in Embedded Systems

Smart Library Automation System is increasingly attractive as an effective digital library system. Adapting automation in the library helps reduce the duplication of work, time-saving, and boosts work efficiency. One such significant feature is face recognition integrated. With this application, the system can use face recognition to enter and get the details of an end user. In recent years, face recognition has achieved many prodigious accomplishments based on Deep Convolutional Neural Networks (DCNN). In addition to constructing large face datasets, designing new effective DCNN architectures and loss functions are two trends to improve the performance of face recognition systems. Therefore, many studies have been published in state-of-the-art methods, making high-accuracy face recognition systems more possible than days in the past. However, it is still difficult for all research communities to train robust face recognition models because it depends heavily on their resources. This paper investigates and analyzes the effect of several effective loss functions based on softmax. Moreover, we also evaluate how hyper-parameter settings can impact the optimization process as well as the final recognition performance of the model trained by re-implementing these methods. The results of our experiments achieve state-of-the-art figures, which show the proposed method’s massive potential in improving face recognition performance. KeywordsFace recognitionDCNNEffective loss function

Recognition of human activity based on convolutional neural network has received the interest of researchers in recent years due to its significant improvement in accuracy. A large number of algorithms based on the deep learning approach have been proposed for activity recognition purpose. However, with the increasing advancements in technologies having limited computational resources, it needs to design an efficient deep learning-based approaches with improved utilization of computational resources. This paper presents a simple and efficient 2-Dimensional convolutional neural network (2-D CNN) architecture with very small size convolutional kernel for human activity recognition. The merit of the proposed CNN architecture over standard deep learning architectures is fewer trainable parameters and lesser memory requirement which enables it to train the proposed CNN architecture on low GPU memory-based devices and also works well with smaller as well as larger size datasets. The proposed approach consists of mainly four stages: namely (1) creation of dataset and data augmentation, (2) designing 2-D convolutional neural network (CNN) architecture, (3) the proposed 2-D CNN architecture trained from scratch up to optimum stage, and (4) evaluation of the trained 2-D CNN architecture. To illustrate the effectiveness of the proposed architecture several extensive experiments are conducted on three publicly available datasets, namely IXMAS, YouTube, and UCF101 dataset. The results of the proposed method and its comparison with other state-of-the-art methods [8-12,14,18-26,29-33] demonstrate the usefulness of the proposed method.

An empirical study of the impact of masks on face recognition

Secure Learning using Face Recognition has gained significant attention due to its potential solution in curbing and elimination of electronic examination impersonation through enrollment, authentication and authorization. Despite the advancements, existing system often focuses on individual entities, void of models and special dataset to enhance security measure in comprehensively curbing electronic examination impersonation. This study aims to address this gap by performing a model using face recognition: Labeled Face in the Wild (LFW), Custom Dataset, algorithms using TensorFlowJs and Face Application Programming Interface (API) model. The research evaluates this model on a unified facial recognition dataset, assessing their performance based on face verification and recognition. The LFW dataset a popular benchmark dataset for face verification and recognition focuses on detecting and alignment of captured images, where TensorFlowJs extract face embedding, while the Face API verifies captured image by loading the Custom Dataset (Enrolled images) comparing with that of the recent before successful authentication. The LFW-TensorFlowJs combines these approaches to leverage both Secure and accurate information. Results shows that integrating LFW, TensorFlowJs and Face API model outperforms the standalone LFW.

Deep Learning (DL) is a fastest growing and a broader part of machine learning family. Deep learning uses Convolutional Neural Networks (CNN) for image classification as it gives the most accurate results in solving real- world problem. CNN has various pre-trained architecture like AlexNet, GoogleNet, DenseNet, SqueezeNet, ResNet, VGGNet etc. In this study, we have used CNN and AlexNet architecture for detecting the disease in Mango and Potato leaf and compare the accuracy and efficiency between these architectures. The dataset containing 4004 images were used for this work. The images for potato were taken from plantvillage website, while images for mango were collected from GBPUAT field location. The results show that accuracy achieved from AlexNet is higher than CNN architecture.

Recently, many researches have been conducted on recognition of facial emotion using convolutional neural networks (CNNs), which show excellent performance in computer vision. To obtain a high classification accuracy, a CNN architecture with many parameters and high computational complexity is required. However, this is not suitable for embedded systems where hardware resources are limited. In this paper, we present a lightweight CNN architecture optimized for embedded systems. The proposed CNN architecture has a small memory footprint and low computational complexity. Furthermore, a novel hardware-friendly quantization method that uses only integer-arithmetic is proposed. The proposed hardware-friendly quantization method maps the scale factors to power-of-two terms and replaces multiplication and division operations using scale factors with shift operations. To improve the generalization and classification performance of the CNN, we create the FERPlus-A dataset. This is a new training dataset created using a variety of image processing algorithms. After training with FERPlus-A, quantization has been performed. The size of a quantized CNN parameter is about 0.39 MB, and the number of operations is about 28 M integer operations (IOPs). By evaluating the performance of the quantized CNN that uses only integer-arithmetic on the FERPlus test dataset, the classification accuracy is approximately 86.58%. It achieved higher accuracy than other lightweight CNNs in prior studies. The proposed CNN architecture that uses only integer-arithmetic is implemented on the Xilinx ZC706 SoC platform for real-time facial emotion recognition by applying parallelism strategies and efficient data caching strategies. The FPGA-based CNN accelerator implemented for real-time facial emotion recognition achieves about 10 frame per second (FPS) at 250 MHz and consumes 2.3 W.

Face Recognition (FR) problem is one of the significant fields in computer vision. FR is used to identify the faces that appear over distributed cameras over the network. The problem of face recognition can be divided into two categories, the first is recognition with more than one sample per person, which can be called traditional face recognition problem. The second is the recognition of faces using only a Single Sample Per Person (SSPP). The efficiency of face recognition systems decreases because of limited references especially (SSPP) and faces taken in the Operational Domain (OD) different from faces in the Enrollment Domain (ED) in illumination, pose, low-resolution, and blurriness. This paper proposed a method that deals with all problems related to face recognition with SSPP. 3D face reconstruction is used to increase the reference gallery set with different poses and generate a design domain dictionary to overcome the problem of limited reference. Besides, the design domain dictionary is used to feed different deep learning models. Face illumination transfer techniques are utilized to overcome the illumination problem. Labeled Faces in the Wild (LFW) dataset is used to train Super-Resolution Generative Adversarial Network (SRGAN) to overcome the low-resolution problem. Deblur Generative Adversarial Network (DeblurGAN) is trained on the LFW dataset to overcome the problem of blurriness. The proposed method is evaluated using the Chokepoint dataset and COX-S2V dataset. The final results confirm an overall enhancement in accuracy compared to techniques that use SSPP for face recognition (generic learning and face synthesizing approaches). Also, the proposed method outperforms of Traditional and Deep Learning (TDL) method accuracy, which uses SSPP for face recognition.

Facial recognition technology has advanced significantly due to the development of deep learning algorithms. This paper explores deep learning, a branch of machine learning that employs multi-layered neural networks to simulate human decision-making processes in facial recognition. It provides a brief literature review of significant works in various deep learning architectures, including Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks. The core of the study is the implementation of the GhostFaceNets model, an enhancement of GhostNets, which is specifically designed for efficient and accurate facial recognition. By using Ghost Modules, this model reduces computational redundancy in generating additional feature maps through linear operations. An integrated attention mechanism is used in this study to emphasize critical facial features. Additionally, this study also employs the ArcFace loss function to improve class separation accuracy. The VGG2-FP dataset was used to train and evaluate this model and achieved an accuracy of 94.45%. This study contributes to the evolution of facial recognition systems, particularly in constrained computational environments.

Although font recognition is a fundamental issue in the field of document analysis and recognition, it was usually ignored in the past. With the development of optical character recognition (OCR), font recognition becomes more and more important. This paper proposed a well-designed convolutional neural network (CNN) architecture for traditional Mongolian font recognition by means of a single word. To be specific, the whole word image is regarded as input of CNN. Hence, the word images should be normalized into the same size before being inputted into CNN. By comparison, an appropriate aspect ratio for the traditional Mongolian word images has been determined. Experimental results demonstrate that the proposed CNN architecture outperforms three classic CNN architectures, including LeNet-5, AlexNet and GoogLeNet. Therefore, the proposed CNN is much more suitable for the task of the traditional Mongolian font recognition in the way of a single word.

In this paper, the Convolutional Neural Network (CNN) architecture, which is one of the deep learning architectures, is used to classify the basic circuit components drawn by hand. During the training and testing stages of the model, a new dataset containing images of 863 circuit components manually drawn by different people is created. The data set contains images of four different classes of circuit components such as resistor, inductor, capacitor and voltage source. All images have been fixed to the same size and converted to grayscale to increase recognition performance and reduce process complexity. In the study, training for four classes is performed with CNN architecture. Based on the CNN architecture, four new CNN models are employed with different the number of layers. The training and validation results of these models are compared separately, the model with the highest training and validation performance is observed with four layer CNN model (CNN-4). This model obtained 84.41% accuracy rate at classification task.

In this paper, we study the performance of variants of well-known Convolutional Neural Network (CNN) architectures on different audio tasks. We show that tuning the Receptive Field (RF) of CNNs is crucial to their generalization. An insufficient RF limits the CNN's ability to fit the training data. In contrast, CNNs with an excessive RF tend to over-fit the training data and fail to generalize to unseen testing data. As state-of-the-art CNN architectures - in computer vision and other domains - tend to go deeper in terms of number of layers, their RF size increases and therefore they degrade in performance in several audio classification and tagging tasks. We study well-known CNN architectures and how their building blocks affect their receptive field. We propose several systematic approaches to control the RF of CNNs and systematically test the resulting architectures on different audio classification and tagging tasks and datasets. The experiments show that regularizing the RF of CNNs using our proposed approaches can drastically improve the generalization of models, out-performing complex architectures and pre-trained models on larger datasets. The proposed CNNs achieve state-of-the-art results in multiple tasks, from acoustic scene classification to emotion and theme detection in music to instrument recognition, as demonstrated by top ranks in several pertinent challenges (DCASE, MediaEval).

Every year, new Convolutional Neural Network (CNN) architectures appear to deal with different problems in the activity of image and video recognition. These architectures usually work along the ImageNet dataset for looking for the best performance of the CNNs without taking into account the video task where they are used. This can represent a problem if the task is Human Action Recognition (HAR) in video, since the CNN architectures are pre-trained with an image dataset that can practically contain any object, while HAR problem requires consecutive frames of people doing actions. To prove the idea that using CNNs pre-trained on an image dataset does not always achieve the best performance on a video dataset and that, therefore, it is worth comparing the performance of different CNNs under similar circumstances for the HAR problem, this work proposes an analysis between eight different CNN architectures. Each one of the CNN was exclusively trained with RGB images, which were extracted from the frames of the different classes of videos of HMDB51 dataset. To make the classification of an activity in video, we average the predictions taking into account the successes. We also made some ensembles with the best performance CNNs to measure the improvement in accuracy. Our results suggest that Xception is a strong baseline model that could be used by the community to make their comparisons of their proposals more robust.

Convolutional neural networks have significantly boosted the performance of face recognition in recent years due to its high capacity in learning discriminative features. In order to enhance the discriminative power of the deeply learned features, we propose a new supervision signal named marginal loss for deep face recognition. Specifically, the marginal loss simultaneously minimises the intra-class variances as well as maximises the inter-class distances by focusing on the marginal samples. With the joint supervision of softmax loss and marginal loss, we can easily train a robust CNNs to obtain more discriminative deep features. Extensive experiments on several relevant face recognition benchmarks, Labelled Faces in the Wild (LFW), YouTube Faces (YTF), Cross-Age Celebrity Dataset (CACD), Age Database (AgeDB) and MegaFace Challenge, prove the effectiveness of the proposed marginal loss.

With the rapid development of electronic computers and information technology, face recognition is widely used in fields such as enterprises, entertainment, information security, and daily life. However, the current face recognition technology is still relatively poor in distinguishing facial features, resulting in a low accuracy of face recognition, which cannot meet increasing application requirements. For this reason, it is necessary to develop more accurate face recognition technology. Residual neural network (ResNet) neural network is a deep residual learning convolutional neural network, which can be used to solve the degeneration problem (i.e., after adding more layers to the neural network, the performance drops rapidly) of deep-learning neural networks. We aim to study the specific principles, calculation methods, and characteristics of the ResNet neural network, analyze the complexity of the classroom environment, propose the use of ResNet network for face feature extraction, and use additive angular margin loss for deep face recognition (ArcFace) as the loss function of the ResNet network to improve the ResNet network. Because the ArcFace function has the advantages of high performance, easy programming, low complexity and high training efficiency. We use this scheme to conduct field tests of face recognition on many students in the classroom. The test results show that this scheme enhances the discrimination of facial features and improves the accuracy of face recognition. In the case of different numbers of people, facial defects, and strong light exposure, the system can still detect and recognize faces stably. In the case of facial defects, the recognition accuracy rate is still 63.3%, and the recognition accuracy rate is still more than 60% under the illumination of strong light, and the recognition accuracy rate under correct conditions is more than 70%.