AD-VAE: Adversarial Disentangling Variational Autoencoder.

Deep Learning is a rapidly evolving field with critical contributions to various domains including security, healthcare, and human — computer interaction, etc. It reviews the significant developments in the area of facial recognition using deep learning techniques. It explains deep learning models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Long Short-Term Memory Networks (LSTMs), and Generative Adversarial Networks (GANs), as well as hybrid models and transfer learning uses. It also addresses technical, ethical, and legal challenges that arise for facial analysis systems and emphasizes the need for real-time processing, multi-modal systems, and robust algorithms to improve the technical accuracy and fairness of facial analysis.

The effectiveness of detecting malicious files heavily relies on the quality of the training dataset, particularly its size and authenticity. However, the lack of high-quality training data remains one of the biggest challenges in achieving widespread adoption of malware detection by trained machine and deep learning models. In response to this challenge, researchers have made initial strides by employing generative techniques to create synthetic malware samples. This work utilizes deep variational autoencoders (VAE) and generative adversarial networks (GAN) to produce malware samples as opcode sequences. The generated malware opcodes are then distinguished from authentic opcode samples using machine and deep learning techniques as validation methods. The primary objective of this study was to compare synthetic malware generated using VAE and GAN technologies. The results showed that neither approach could create synthetic malware that could deceive machine learning classification. However, the WGAN-GP algorithm showed more promise by requiring a higher number of synthetic malware samples in the train set to effectively be detected, proving ita better approach in synthetic malware generation.

Among the wide variety of image generative models, two models stand out: Variational Auto Encoders (VAE) and Generative Adversarial Networks (GAN). GANs can produce realistic images, but they suffer from mode collapse and do not provide simple ways to get the latent representation of an image. On the other hand, VAEs do not have these problems, but they often generate images less realistic than GANs. In this article, we explain that this lack of realism is partially due to a common underestimation of the natural image manifold dimensionality. To solve this issue we introduce a new framework that combines VAE and GAN in a novel and complementary way to produce an auto-encoding model that keeps VAEs properties while generating images of GAN-quality. We evaluate our approach both qualitatively and quantitatively on five image datasets.

The gas chromatography analysis method for chemical substances enables accurate analysis to precisely distinguish the components of a mixture. This paper presents a technique for augmenting time-series data of chemicals measured by gas chromatography instruments with artificial intelligence techniques such as generative adversarial networks (GAN). We propose a novel GAN algorithm called GCGAN for gas chromatography data, a unified model of autoencoder (AE) and GAN for effective time-series data learning with an attention mechanism. The proposed GCGAN utilizes AE to learn a limited number of data more effectively. We also build a layer of high-performance generative adversarial neural networks based on the analysis of the features of data measured by gas chromatography instruments. Then, based on the proposed learning, we synthesize the features embedded in the gas chromatography data into a feature distribution that extracts the temporal variability. GCGAN synthesizes the features embedded in the gas chromatography data into a feature distribution that extracts the temporal variability of the data over time. We have fully implemented the proposed GCGAN and experimentally verified that the data augmented by the GCGAN have the characteristic properties of the original gas chromatography data. The augmented data demonstrate high quality with the Pearson correlation coefficient, Spearman correlation coefficient, and cosine similarity all exceeding 0.9, significantly enhancing the performance of AI classification models by 40%. This research can be effectively applied to various small dataset domains other than gas chromatography data, where data samples are limited and difficult to obtain.

Discovering new chemical compounds with specific properties can provide advantages for fields that rely on materials for their development, although this task comes at a high cost in terms of complexity and resources. Since the beginning of the data age, deep learning techniques have revolutionized the process of designing molecules by analyzing and learning from representations of molecular data, greatly reducing the resources and time involved. Various deep learning approaches have been developed to date, using a variety of architectures and strategies, in order to explore the extensive and discontinuous chemical space, providing benefits for generating compounds with specific properties. In this study, we present a systematic review that offers a statistical description and comparison of the strategies utilized to generate molecules through deep learning techniques, utilizing the metrics proposed in Molecular Sets (MOSES) or Guacamol. The study included 48 articles retrieved from a query-based search of Scopus and Web of Science and 25 articles retrieved from citation search, yielding a total of 72 retrieved articles, of which 62 correspond to chemical language models approaches to molecule generation and other 10 retrieved articles correspond to molecular graph representations. Transformers, recurrent neural networks (RNNs), generative adversarial networks (GANs), Structured Space State Sequence (S4) models, and variational autoencoders (VAEs) are considered the main deep learning architectures used for molecule generation in the set of retrieved articles. In addition, transfer learning, reinforcement learning, and conditional learning are the most employed techniques for biased model generation and exploration of specific chemical space regions. Finally, this analysis focuses on the central themes of molecular representation, databases, training dataset size, validity-novelty trade-off, and performance of unbiased and biased chemical language models. These themes were selected to conduct a statistical analysis utilizing graphical representation and statistical tests. The resulting analysis reveals the main challenges, advantages, and opportunities in the field of chemical language models over the past four years.

Authentication is one of the significant issues in the era of information system. Among other things, human face recognition (HFR) is one of known techniques which can be used for user authentication. As an important branch of biometric verification, HFR has been widely used in many applications, such as video monitoring/surveillance system, human-computer interaction, door access control system and network security. This paper proposes a method for student attendance system in classroom using face recognition technique by combining Discrete Wavelet Transforms (DWT) and Discrete Cosine Transform (DCT) to extract the features of student's face which is followed by applying Radial Basis Function (RBF) for classifying the facial objects. From the experiments which is conducted by involving 16 students situated in classroom setting, it results in 121 out of 148 successful faces recognition.

The lack of the sufficient and diverse training data is one of the main challenges limiting performances of the machine learning enabled applications in optical networks. Here, we propose a deep learning based sequential data augmentation technique for the aggregate traffic data augmentation for diverse optical network scenarios. A generative adversarial network (GAN) model is trained with the experimental traffic data to automatically extract the substantial characteristics of the experimental traffic data through the zero-sum game theory and then augment the traffic data adaptively. The statistical evaluation parameters of the augmented traffic are mean, variance and Hurst exponent. To add comparisons, two other classical generative models including the statistical parameter configuration (SPC) model and the variational autoencoder (VAE) model are also adopted to generate the traffic data that are similar to the actual traffic data. The comprehensive comparisons among the proposed GAN, the SPC and VAE show that the performances of the GAN exceed those of the SPC and the VAE obviously. The mean and the variance of the augmented traffic data from the GAN are almost equal to those of the experimental traffic data, where the average deviations are both within 2%. The Hurst exponent of the augmented traffic data from the GAN is respectively near 90% and 96% of those of the experimental traffic data in the access network and the core network. To estimate the similarity intuitively, the well-known k-mean algorithm is used to cluster the augmented traffic data according to the centroids determined by the corresponding experimental traffic data and the clustering accuracies are all higher than 95% for 6 kinds of typical traffic types in the optical networks. These results demonstrate that the proposed GAN is able to effectively generate the traffic data that is very close to the experimental traffic data and is difficult to be distinguished for diverse traffic types. Moreover, a relatively small dataset with a few hundred pieces of experimental traffic data is required and the amount of the augmented traffic data from the GAN is unlimited in theory, which can be augmented as much as we need. The proposed traffic data augmentation technique also has the potential to be utilized in other sequential data augmentation applications for the optical networks.

In the field of deep learning, the generative model did not attract much attention until GANs (generative adversarial networks) appeared. In 2014, Google’s Ian Goodfellow proposed a generative model called GANs. GANs use different structures and objective functions from the existing generative model. For example, GANs use two neural networks: a generator that creates a realistic image, and a discriminator that distinguishes whether the input is real or synthetic. If there are no problems in the training process, GANs can generate images that are difficult even for experts to distinguish in terms of authenticity. Currently, GANs are the most researched subject in the field of computer vision, which deals with the technology of image style translation, synthesis, and generation, and various models have been unveiled. The issues raised are also improving one by one. In image synthesis, BEGAN (Boundary Equilibrium Generative Adversarial Network), which outperforms the previously announced GANs, learns the latent space of the image, while balancing the generator and discriminator. Nonetheless, BEGAN also has a mode collapse wherein the generator generates only a few images or a single one. Although BEGAN-CS (Boundary Equilibrium Generative Adversarial Network with Constrained Space), which was improved in terms of loss function, was introduced, it did not solve the mode collapse. The discriminator structure of BEGAN-CS is AE (AutoEncoder), which cannot create a particularly useful or structured latent space. Compression performance is not good either. In this paper, this characteristic of AE is considered to be related to the occurrence of mode collapse. Thus, we used VAE (Variational AutoEncoder), which added statistical techniques to AE. As a result of the experiment, the proposed model did not cause mode collapse but converged to a better state than BEGAN-CS.

Alzheimer’s disease (AD) is a progressive neurodegenerative condition that affects the elderly population. The early detection and diagnosis of AD is critical for achieving effective treatment, as it can greatly improve the patient experience. AD can be viewed through imaging techniques like MRI, PET, and SPECT, providing valuable information about structural and functional changes. These findings are important in understanding this area. However, each imaging modality offers a different perspective. This information can be better collected from several of the other modalities as well as from some others to improve accuracy and reliability in AD detection. By combining information from different imaging modalities, such as MRI, PET, DTI, and fMRI, automated multimodal medical image frameworks aim to create a fused representation that preserves the relevant features from each modality. Convolutional neural networks (CNNs) and generative adversarial networks (GANs), among other deep learning techniques, have been prevalent in these frameworks for learning discriminative and informative features from multi-modal data. In this paper, The Alzheimer’s Disease Neuroimaging Initiative (ADNI) is used for experimental analysis. The proposed work gives 98.94% of accuracy and 1.06% of error which is greater than the existing approaches.

Video surveillance systems play a crucial role in ensuring public safety and security. However, the traditional methods of surveillance often fall short in effectively identifying individuals, particularly in crowded or dynamic environments. This research addresses the limitations of conventional video surveillance by proposing a machine learning-based facial recognition system. The increasing demand for robust security measures necessitates the development of advanced technologies in video surveillance. Facial recognition has emerged as a promising solution, but existing systems struggle with accuracy and efficiency. This research aims to bridge these gaps by leveraging machine learning techniques for facial recognition in video surveillance. Conventional video surveillance struggles with accurate and rapid identification of individuals, leading to potential security lapses. This research addresses the challenge of enhancing facial recognition accuracy in real-time video feeds, especially in scenarios with varying lighting conditions and occlusions. While facial recognition has gained traction, there is a significant research gap in the implementation of machine learning algorithms tailored for video surveillance. This study aims to fill this void by proposing a novel methodology that combines deep learning and computer vision techniques for robust facial recognition in dynamic environments. The proposed methodology involves training a deep neural network on a diverse dataset of facial images to enable the model to learn intricate facial features. Additionally, computer vision algorithms will be employed to handle challenges such as occlusions and varying lighting conditions. The model''''s performance will be evaluated using real-world video surveillance data. Preliminary results demonstrate a significant improvement in facial recognition accuracy compared to traditional methods. The machine learning-based system exhibits enhanced performance in challenging scenarios, showcasing its potential for practical implementation in video surveillance systems.

Face alignment and face recognition are two fundamental problems in the facial analysis community. For face alignment, it forms the basis for the accurate face recognition, age estimation, and facial expression recognition. For face recognition, it has been widely applied in various practical scenarios such as access control system, massive surveillance, human computer interaction, etc.. There mainly exist two lines of works in these two fields, namely holistic face alignment and recognition, and partial face alignment and recognition. Numerous holistic face alignment and recognition works

Face recognition is among the most productive image processing applications and has a pivotal role in the technical field. In the recent time automated face recognition has become a trend and has been developed very much, this is mainly due to two reasons first it is due to availability of modern technologies and second is due to the ability to save time using face recognition in the process of taking attendance of students. Its usage will grow vast in the future as it saves a lot of time. It consumes a lot of time to take attendance manually and few might also fake the attendance, in order to prevent time consumption and avoid faking the attendance. Face recognition is used to identify the person present in the class and mark their attendance , this is done with the help of image or video frame. We proposed an automatic attendance management system using techniques such as PCA algorithm. The face detection and recognition will automatically detect the students in the classroom and mark the attendance by recognizing the person. The traditional process of making attendance and present biometric systems are vulnerable to proxies. This paper is therefore proposed to tackle all these problems. The proposed system makes the use of Haar classifiers, KNN, CNN, SVM, Generative adversarial networks, and Gabor filters. After face recognition attendance reports will be generated and stored in excel format. The system is tested under various conditions like illumination, head movements, the variation of distance between the student and cameras. After vigorous testing overall complexity and accuracy are calculated. The Proposed system proved to be an efficient and robust device for taking attendance in a classroom without any time consumption and manual work. The system developed is cost-efficient and need less installation

The fast development of modern technologies has led to the frequent usage of face detection and recognition approaches in various fields due to their user-friendly nature. Generally, face recognition approaches identify individuals by their facial features. Recently, numerous face recognition methods were designed by leveraging the significance of deep learning approaches. These approaches are divided into numerous tasks, and implementing these tasks is time consuming as they require real-time images for processing. However, facial features vary across time because of ageing, haircuts, etc. Furthermore, images with poor resolution may also influence the recognition ability of the framework. Therefore, an advanced face recognition framework is designed in this work. The key intent of this designed model is to tackle the obstacles of the classical models and detect individuals in diverse environmental circumstances with better accuracy. Here, the relevant images are collected from a standard data source, and the quality of the image is enhanced using a Retinex-based image enhancement technique. Next, the Generative Adversarial Network (GAN) is employed to synthesize real images that mitigate the effects of pose discrepancies and occlusion, providing clearer features for recognition. Next, synthesized images are fed to Residual network 50 (ResNet50) for face recognition. Finally, the precise face segmentation is done with the support of Gather-Excite Networks of ResUNet (GEN-ResUNet). This integrated approach enhances the accuracy of face recognition, especially in challenging environments with lighting variations and occlusions. The effectiveness of the model is proven by conducting extensive experimentation.

In recent years, machine learning and Deep Learning have increased and gathered epic success in traditional application domains and new areas of Artificial Intelligence. The performance using Deep Learning has dominated experimental results compared to conventional machine learning algorithms. This paper presents an overview of the progress that has occurred in Deep Learning (DL) concerning some application domains like Autonomous Driving, Healthcare, Voice Recognition, Image Recognition, Advertising, Predicting Natural Calamities, National Stock Exchange and many more. Additionally, deeper insights into several Deep Learning techniques, their working principles, and experimental results are scrutinized. The survey covers Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), including Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRU), Auto-Encoder (AE), Deep Belief Network (DBN), Generative Adversarial Network (GAN), and Deep Reinforcement Learning (DRL).

Generative models such as variational autoencoders (VAEs) and generative adversarial networks (GANs) have been recently applied to various fields. However, the VAE and GAN models have blur and mode collapse problems, respectively. Here, the authors propose a novel generative model, self‐converging generative network (SCGN), to address the issues. Self‐converging means the convergence of latent vectors into themselves through being trained in pairs with training data, by which the SCGN can reconstruct all training data. In the authors’ model, the latent vectors and weights of the generator are alternately trained. Specifically, the latent vectors are trained to follow a normal distribution, using a loss function derived from the Kullback–Leibler divergence and a pixel‐wise loss. The weights of the generator are adjusted for the generator to produce training data by means of a pixel‐wise loss. As a result, their SCGN did not fall into the mode collapse, which occurs in GANs, and made clearer images than VAEs thanks to no use of sampling. Moreover, the SCGN successfully learned the manifold of the dataset in the extensive experiments with CelebA.