Face Mask Detection Using Multi-Task Cascaded Convolutional Neural Networks

The main precondition for applications such as face recognition and face de-identification for privacy protection is efficient face detection in real scenes. In this paper, we propose a hybrid cascade model for face detection in the wild. The cascaded two-stage model is based on the fast normalized pixel difference (NPD) detector at the first stage, and a deep convolutional neural network (CNN) at the second stage. The outputs of the NPD detector are characterized by a very small number of false negative (FN) and a much higher number of false positive face (FP) detections. The FP detections are typically an order of magnitude higher than the FN ones. This very high number of FPs has a negative impact on recognition and/or de-identification processing time and on the naturalness of the de-identified images. To reduce the large number of FP face detections, a CNN is used at the second stage. The CNN is applied only on vague face region candidates obtained by the NPD detector that have an NPD score in the interval between two experimentally determined thresholds. The experimental results on the Annotated Faces in the Wild (AFW) test set and the Face Detection Dataset and Benchmark (FDDB) show that the hybrid cascade model significantly reduces the number of FP detections while the number of FN detections are only slightly increased.

The corona virus COVID-19 pandemic is causing a global health crisis so the effective protection methods is wearing a face mask in public areas according to the World Health Organization (WHO). The COVID-19 pandemic forced governments across the world to impose lockdown to prevent virus transmissions. Reports indicate that wearing facemasks while at work clearly reduces the risk of transmission. An efficient and economic approach of using AI to create a safe environment in a manufacturing setup. A hybrid model using deep and classical machine learning for face mask detection will be presented. A face mask detection dataset consists of with mask and without mask images, we are going to use OpenCV to do real-time face detection from a live stream via our webcam. We will use the dataset to build a COVID-19 face mask detector with computer vision using Python, OpenCV, and Tensor Flow and Keras. Our goal is to identify whether the person on image/video stream is wearing a face mask or not with the help of computer vision and deep learning. As a surveillance task performer, it can also detect a face along with a mask in motion. The method attains accuracy up to 95.77% and 94.58% respectively on two different datasets. We explore optimized values of parameters using the Sequential Convolutional Neural Network of Deep Learning model to detect the presence of masks correctly without causing over-fitting.

A new and deadly virus known as SARS-CoV-2, which is responsible for the coronavirus disease (COVID-19), is spreading rapidly around the world causing more than 3 million deaths. Hence, there is an urgent need to find new and innovative ways to reduce the likelihood of infection. One of the most common ways of catching the virus is by being in contact with droplets delivered by a sick person. The risk can be reduced by wearing a face mask as suggested by the World Health Organization (WHO), especially in closed environments such as classrooms, hospitals, and supermarkets. However, people hesitate to use a face mask leading to an increase in the risk of spreading the disease, moreover when the face mask is used, sometimes it is worn in the wrong way. In this work, an autonomic face mask detection system with deep learning and powered by the image tracking technique used for the augmented reality development is proposed as a mechanism to request the correct use of face masks to grant access to people to critical areas. To achieve this, a machine learning model based on Convolutional Neural Networks was built on top of an IoT framework to enforce the correct use of the face mask in required areas as it is requested by law in some regions.

In recent years, pattern recognition has garnered widespread attention, especially in the domain of face recognition. Traditional face recognition methods have certain limitations in unconstrained environments due to factors such as lighting, facial expressions, and poses. Deep learning can be used to address these challenges. This paper proposes a comprehensive approach to face occlusion recognition based on a two-stage Convolutional Neural Network (CNN). Face verification aims at verifying whether two face images belong to the same individual, and it is a more fundamental task compared to face recognition. The process of face recognition essentially involves multiple instances of face verification, sequentially validating different individuals to ultimately determine the corresponding individual for each face. The primary steps in this research include facial detection, image preprocessing, facial landmark localization, facial landmark extraction, feature matching recognition, and 2D image-assisted 3D face reconstruction. A novel two-stage CNN was designed for facial detection and alignment. The first stage of the network is dedicated to the search for facial windows and regressing vector boundaries. The second stage utilizes 2D images to assist in 3D face reconstruction and perform secondary recognition for cases not identified in the first stage. This method demonstrated excellent performance in handling facial occlusions, achieving high accuracy on datasets such as AFW and FDDB. On the test dataset, face recognition accuracy reached 97.3%, surpassing the original network accuracy of 89.1%. This method outperforms traditional algorithms and general CNN approaches. This study achieved efficient face validation and further handling of unrecognized situations, contributing to the enhancement of face recognition system performance.

In recent years, face detection and counting have undergone a remarkable transfor-mation due to the emergence of deep learning techniques, particularly Convolutional Neural Networks (CNNs). These methods have surpassed traditional computer vision approaches, benefiting from vast datasets and robust computational resources. CNN’s, the cornerstone of contemporary face recognition systems, excel in accurately identifying faces across diverse conditions and environments. The ascendancy of CNNs in face detection stems from their capacity to autonomously learn hierarchical features from raw pixel data, obviating the need for manual feature engineering. Consequently, they yield resilient systems capable of accommodating real-world variations like lighting, pose, expression, and occlusion. Their scalability enables the efficient processing of extensive image databases, rendering them invaluable for applications requiring face counting amidst crowded scenes. Nonetheless, challenges persist, particularly in deploying these systems on resources-constrained devices. The computational complexity and storage demand of deep CNNs necessitate ongoing exploration of lightweight network architectures that balances accuracy with reduced computational footprint. The historical Violajones algorithm, while foundational, has been eclipsed by the superior performance of CNNs. Deep learning’s prowess lies in its adaptability to various tasks and its capacity to continuously refine itself with more data. By learning features directly from data, CNNs excel in capturing intricate patterns crucial for precise face detection and counting. Deep learning, especially through CNNs, has revolutionized face detection and counting by delivering unparal-leled accuracy and robustness. However, ongoing efforts are crucial to address challenges in the efficiency and accessibility of these systems for broader deployment across various applications and devices.

Deep learning (also known as deep structured learning, hierarchical learning, or deep machine learning) is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and nonlinear transformations. Deep learning has been characterized as a class of machine learning algorithms with the following characteristics [257]: • They use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised). • They are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher-level features are derived from lower-level features to form a hierarchical representation. • They are part of the broader machine learning field of learning representations of data. • They learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts. These definitions have in common: multiple layers of nonlinear processing units and the supervised or unsupervised learning of feature representations in each layer, with the layers forming a hierarchy from low-level to high-level features. Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks (DBN), and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition, and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. In this chapter we start in Section 7.1 with an introduction, giving a brief history of this field, the relevant literature, and its applications. Then we study some basic concepts of deep learning such as convolutional neural networks, recurrent neural networks, backpropagation algorithm, restricted Boltzmann machines, and deep learning networks in Section 7.2. Then we illustrate three examples for Apache Spark implementation for mobile big data (MBD), user moving pattern extraction, and combination with nonparametric Bayesian learning, respectively, in Sections 7.3 through 7.5. Finally, we have summary in Section 7.6.

The proliferation of Internet of Things (IoT) devices has created unprecedented cybersecurity vulnerabilities, with botnets emerging as a critical threat to network infrastructure. This study focuses on traditional machine learning and deep learning approaches, proposes a novel ensemble framework to address these issues, integrating Convolutional Neural Network (CNN), Bidirectional Long Short-Term Memory (BiLSTM), Random Forest (RF), and Logistic Regression (LR) via a weighted soft-voting mechanism. Our approach introduces a Quantile Uniform transformation to reduce feature skewness, a multi-layered feature selection method to enhance discriminative power, an individual performance of deep learning-traditional machine learning and a hybrid models (ensemble models) for robust detection. Evaluated on BOT-IOT, CICIOT2023, and IOT23 datasets, the framework achieves 100% accuracy on BOT-IOT, 99.2% on CICIOT2023, and 91.5% on IOT23, outperforming state-of-the-art models by up to 6.2%. These contributions advance IoT security by enabling scalable, high-performance detection adaptable to diverse network scenarios, with practical optimizations for real-world deployment.

The objective is to build an efficient face mask detector using Single Shot Detector (SSD). The algorithm used for face mask detection was a novel SSD and with the comparison of Convolutional Neural Network (CNN). The face mask detection dataset was usedand the ability of the algorithm was measured with the sample size of 136. SSD has achieved accuracy of 92.25% and for CNN it was 82.6%. By using a base architecture of VGG-16, SSD was able to outperform other object detectors like CNN without compromising speed and accuracy. The SSD and CNN are statistically satisfied with the independent sample t-test value (p<0.05) with a confidence level of 95%. Face mask detection using SSD was significantly better accurate than CNN.

Structural safety, optimization of materials, and sustainable construction practice depend on the prediction of concrete compressive strength. Traditional methods of testing use the laboratory method, which is time‑consuming, expensive, and destructive. Recent progress in deep learning has made it possible to predict the compressive strength in an accurate, rapid, and non‑destructive way by modeling nonlinear complex relationships between the constituents of concrete, curing conditions, and mechanical performance. This review is a systematic review of the deep learning architectures that have been applied to predict the concrete compressive strength with state‑of‑the‑art, such as Convolutional Neural Networks (CNNs), Artiϐicial Neural Networks (ANNs), Deep Neural Networks (DNNs), Long Short‑Term Memory (LSTM) networks, Gated Recurrent Units (GRU), Transformer‑based models, and hybrid architectures (CNN‑LSTM, CNN‑GRU, and ensemble stacking). It has been shown in the literature that higher hybrid and ensemble models allow the high predictive performance to be achieved, with the value of R² often exceeding 0.95, with the best possible models having an R² of 0.99 when using controlled datasets. Both metaheuristic optimization algorithms (e.g., PSO, GA, ACO, TLBO) and Bayesian hyperparameter tuning would greatly increase the model generalization and robustness. Moreover, interpretable artificial intelligence tools, such as SHAP and sensitivity analysis, have enhanced interpretability, and cement content, curing age, and water‑cement ratio are confirmed to be the most significant predictors of strength. Applications have been spread over the spe‑ cialized materials like ultra‑high‑performance concrete (UHPC), geopolymer concrete, recycled aggregate concrete, self‑compacting concrete, and waste‑based sustainable concretes. However, the issues of data standardization, cross‑laboratory generalization, and model transparency persist in spite of impressive advances. The future research is to be directed at physics‑informed neural networks, the multi‑objective optimization that considers the metrics of environmental impact, real‑time edge deployment, and the standardized benchmark datasets. In general, methods using deep learning as its core technology can be discussed as a revolutionary development in intelligent concrete design and sustainable construction engineering

The coronavirus COVID-19 pandemic has caused a global health crisis. According to According to the World Health Assembly, one of the best preventative measures is to wear a face mask while out outdoors (WHO). This work presents a hybrid model for face mask identification that combines deep and traditional machine learning. I have trained the proposed system, which consists of convolutional neural networks (ConNN), support vector machines (SVM), and random forests (RF), in three stages, the first stage, used ConNN, the second stage, used the same ConNN with the SVM method, and in the third stage, used ConNN and RF. This paper suggests three different kinds of masked face recognition datasets: the Incorrectly Masked Face Dataset (IMFD), the Correctly Masked Face Dataset (CMFD), and the combination for MaskedFace-Net, a worldwide masked face detection system. Two objectives are presented for the realistic masked face datasets: i) to identify individuals whose faces are covered or not covered, ii) to identify faces whose masks are put on properly or improperly (for example, at airport entrances or among crowds). The suggested model is made up of two parts. The first part is designed for feature extraction using a convolutional neural networks. In contrast, the second section is made to classify face masks using SVM and RF methods. The ConNN achieved 99.92%. and achieved for ConNN and SVM 99.94%. ConNN and RF 98.79%. Moreover,The system has been tested in real world scenarios and can recognize and classify any image selected by Google with high accuracy. we a comparison and the results aim to evaluate the proposed model.

In this paper, we investigate the problem of face mask compliance classification in response to the Corona Virus Disease (COVID-19) pandemic. Since the start of the pandemic, many governments and businesses have been continually updating policies to help slow the spread of the virus, including requiring face masks to use many public and private services. In response to these policies, many researchers have developed new face detection and recognition techniques for masked faces. Many of the developed approaches proposed to address the problem of masked face detection have been relatively successful. However, these approaches almost exclusively focus on detecting the presence or absence of someone wearing a face mask. It is understood and broadly discussed in various reports and the media that there are people not always following the suggested guidelines provided by public health authorities for wearing face masks, which include ensuring the face mask properly covers the nose and mouth. To date, very few research publications exist that investigate the capability of modern classification algorithms to efficiently distinguish between masked faces in the visible band that are either compliant or non-compliant with the suggested guidelines. Furthermore, to the best of our knowledge, there is no publication in the open literature that focuses on the investigation of face mask classification in the thermal band. As thermal sensors continue to improve in quality and decrease in cost, surveillance applications using thermal imagery are expected to continue to grow and benefit those organizations considering the automation of face mask detection and compliance. In this study, we propose an investigation on face mask compliance in both the thermal and visible bands. It is composed of the following salient steps; (1) the creation of a multi-spectral masked face database from subjects wearing or not wearing face masks, (2) the augmentation of the generated database with synthetic face masks to simulate two different levels of non-compliant wearing of face masks, and (3) the assessment of a variety of CNN architectures on the previous augmented database to investigate any differences between classifying thermal and visible masked faces. Experimental results show that face mask compliance classification in both studied bands yield a classification accuracy that reaches 100% for most models studied, when experimenting on frontal face images captured at short distances with adequate illumination.KeywordsFace masksCOVID-19PandemicFace mask classificationDeep learningMask complianceThermal imagingMulti-spectral Imaging

As the network goes deep into all aspects of people''s lives, the number and the complexity of network traffic is increasing, and traffic classification becomes more and more important. How to classify them effectively is an important prerequisite for network management and planning, and ensuring network security. With the continuous development of deep learning, more and more traffic classification begins to use it as the main method, which achieves better results than traditional classification methods. In this paper, we provide a comprehensive review of network traffic classification based on deep learning. Firstly, we introduce the research background and progress of network traffic classification. Then, we summarize and compare traffic classification based on deep learning such as stack autoencoder, one-dimensional convolution neural network, two-dimensional convolution neural network, three-dimensional convolution neural network, long short-term memory network and Deep Belief Networks. In addition, we compare traffic classification based on deep learning with other methods such as based on port number, deep packets detection and machine learning. Finally, the future research directions of network traffic classification based on deep learning are prospected.

Deep solar radiation forecasting with convolutional neural network and long short-term memory network algorithms

Following recent advancements in deep learning and artificial intelligence, spoken language identification applications are playing an increasingly significant role in our day-to-day lives, especially in the domain of multi-lingual speech recognition. In this article, we propose a spoken language identification system that depends on the sequence of feature vectors. The proposed system uses a hybrid Convolutional Recurrent Neural Network (CRNN), which combines a Convolutional Neural Network (CNN) with a Recurrent Neural Network (RNN) network, for spoken language identification on seven languages, including Arabic, chosen from subsets of the Mozilla Common Voice (MCV) corpus. The proposed system exploits the advantages of both CNN and RNN architectures to construct the CRNN architecture. At the feature extraction stage, it compares the Gammatone Cepstral Coefficient (GTCC) feature and Mel Frequency Cepstral Coefficient (MFCC) feature, as well as a combination of both. Finally, the speech signals were represented as frames and used as the input for the CRNN architecture. After conducting experiments, the results of the proposed system indicate higher performance with combined GTCC and MFCC features compared to GTCC or MFCC features used individually. The average accuracy of the proposed system was 92.81% in the best experiment for spoken language identification. Furthermore, the system can learn language-specific patterns in various filter size representations of speech files.

Objectives/Aim: The present paper deals with building a smart assistant with the aim of assisting the visually impaired people in mobility with confidence by realizing the nearby obstacles and also implement image processing techniques to recognize people. Methods: We use Raspberry Pi 4 which has increased computing performance and is interfaced to the picamera, GPS and GSM modules. Arduino pro mini with buzzer, ultrasonic sensors and vibration motors are used for obstacle detection. Certain libraries important for image processing are used such as OpenCV, Dlib, face detection (Haar cascades, HOG + Linear SVM, or CNNs), espeak for converting text to speech. Programming was implemented through Python and Arduino compiler. Findings: Analysis was carried out using the proposed system for the blind and visually impaired people who could move around comfortably with confidence and were also able to detect objects and recognize people. Hence the proposed system removes the use for the cumbersome white cane in exchange for small and handy modules which can be used in the form of wearables mounted on shoulders, hands and legs to detect the obstacles from multiple directions and provide for a comfortable wear. It was determined that the Raspberry pi 4 was incapable of running CNN detection for which ideally computer GPU was required, so HOG detection method was used instead. Application/Improvements: This project can be implemented mainly in the commercial field of helping visually impaired people with poor eyesight or being completely blind. Industrial applications can be devised and enhanced like robots and machineries along with Security, Identifying and Tracking. Keywords: Face Recognition; Obstacle Detection; Open Source Computer Vision (OpenCV); Deep Learning; Histogram of Oriented Gradients (HOG); Support Vector Machine (SVM); Convolutional Neural Network (CNN)