Variants and Applications of Generative Adversarial Networks

This article explores the application of Generative Adversarial Networks (GANs) in improving subsurface rock analysis. GANs generate realistic images of rock features, enhancing the accuracy and efficiency of estimating rock properties. The objective is to advance the field of subsurface rock analysis, offering insights into the potential of GAN techniques. The article reviews recent developments in data-driven rock reconstruction technology, specifically focusing on GANs. It highlights GANs’ ability to generate and estimate rock features like porosity and permeability. These GAN methods are complemented by discriminators to select or reject features, making them integral to the reconstruction model. The article provides a framework for engineers and researchers to effectively utilize these techniques for rock reconstruction, offering an assessment of their strengths and limitations. Digital rock reconstruction, aided by GANs, has promising implications for site selection and recovery. GANs enhance image resolution, improving the field of view and dynamism of parameters in rock analysis. However, GANs heavily rely on high-quality data, which poses a limitation. To address this, conditional GANs have been proposed. The article comprehensively reviews the latest developments in GAN methods for digital rock reconstruction, offering valuable insights for engineers and researchers using GANs for accurate subsurface rock analysis. It also proposes ways to enhance these methods and advance the field. The novelty of this article lies in its exploration of Generative Adversarial Networks (GANs) in the context of subsurface rock analysis. It emphasizes the potential of GAN techniques to generate realistic rock images and estimate properties like porosity and permeability. Additionally, the article discusses the integration of GANs into the digital rock concept, highlighting their role in improving predictive models and supporting decision-making in the oil and gas industry's resource extraction and production strategies.

Applications of generative adversarial networks in neuroimaging and clinical neuroscience

Mechanical fault diagnosis is crucial for ensuring the normal operation of mechanical equipment. With the rapid development of deep learning technology, the methods based on big data-driven provide a new perspective for the fault diagnosis of machinery. However, mechanical equipment operates in the normal condition most of the time, resulting in the collected data being imbalanced, which affects the performance of mechanical fault diagnosis. As a new approach for generating data, generative adversarial network (GAN) can effectively address the issues of limited data and imbalanced data in practical engineering applications. This paper provides a comprehensive review of GAN for mechanical fault diagnosis. Firstly, the development of GAN-based mechanical fault diagnosis, the basic theory of GAN and various GAN variants (GANs) are briefly introduced. Subsequently, GANs are summarized and categorized from the perspective of labels and models, and the corresponding applications are outlined. Lastly, the limitations of current research, future challenges, future trends and selecting the GAN in the practical application are discussed.

ABSTRACTData mining and natural language processing (NLP) are fundamental fields that interact in many ways. Text mining shares many topics, such as sentiment analysis and content understanding. Combining these two fields enables more efficient mining of text data and the extraction of valuable information. In particular, the GAN (Generative Adversarial Network) architecture has achieved success in image generation and has started to be used on text data. However, training GANs is fraught with difficulties due to the complexity of text data. Linguistic studies show important differences between languages. Language is characterized by fluidity, ambiguity, and context‐sensitive interpretations, and text‐generating GAN models can struggle to deal with these complexities. The interaction between data quality, language structure, and complex interpretation can lead to inconsistency and ambiguity in the text production of GAN models. These problems are particularly pronounced when complexities such as semantic subtleties, idiomatic expressions, and context‐dependent usages come into play. Text generation is an area of GAN models used in NLP to generate language and enrich text‐based applications. Work in this area can contribute to analyzing, classifying, and processing text data. Many methods and techniques have been proposed to improve the performance of text GANs. However, some problems may be encountered in the optimization of these methods. Therefore, it is essential to use optimized methods. In conclusion, GANs can be an important tool to improve text generation in NLP. Still, they require continuous research and innovation to deal with factors such as language complexity and data quality.

As a promising generative modeling method, Generative Adversarial Networks are a deep-learning-based generative model, in which two networks, namely the generative network and the discriminant network, contest with each other in a game during which the generator “learns” and get trained to be able to fool the discriminator of believing a specific image is (superficially) authentic. It is widely used to generate pictures based on existing data. Based on the MNIST data set, this paper studies and analyzes the application of Generative Adversarial Networks in the generation of handwritten digital images. In addition, by studying the Deep Convolutional Generative Adversarial Network and the Conditional Generation Adversarial Network model, we compared the connections and differences between these three models in training the MNIST dataset to generate handwritten digits algorithms, and gave an optimization method for generating handwritten digits.

Adopting an accurate anomaly detection mechanism is crucial for industrial software systems in order to prevent system outages that can deteriorate system availability. However, employing a supervised machine learning technique to detect anomalies in large production scale industrial software systems is highly impractical due to the requirement of annotated data. This raises the need for comprehensive semi-supervised and unsupervised anomaly detection mechanisms. This paper presents the application of Generative Adversarial Network (GAN) based models to detect system anomalies using semi-supervised one-class learning. We show that the use of a variant of GAN known as bidirectional GAN (BiGAN) gives augmented results when compared to the traditional GAN based anomaly detection, for the selected industrial system. Moreover, the experiments clearly show that the performance of the BiGAN has a direct correlation with the dimensions of the dataset used for training. The BiGAN even tends to outperform the well-established semi-supervised One-class SVM classifier and a prominent generative network for semi-supervised anomaly detection, Variational Autoencoders (VAEs) when the size of the feature space increases.

In recent years, researchers have introduced various methods in many domains into medical image processing so that its effectiveness and efficiency can be improved to some extent. The applications of generative adversarial networks (GAN) in medical image processing are evolving very fast. In this paper, the state of the art in this area has been reviewed. Firstly, the basic concepts of the GAN were introduced. And then, from the perspectives of the medical image denoising, detection, segmentation, synthesis, reconstruction and classification, the applications of the GAN were summarized. Finally, prospects for further research in this area were presented.

The new research approaches are needed to be adopted to deal with security threats in Artificial Intelligence (AI)-based systems. This research is aimed at investigating the AI attacks that are “malicious by design.” It also deals with conceptualization of the problem and strategies for attacks on AI using digital forensic tools. A specific class of problems in adversarial attacks are tampering of images for computational processing in applications of digital photography, computer vision, pattern recognition (facial capping algorithms). State-of-the-art developments in forensics, such as 1. Application of end-to-end Neural Network training pipeline for image rendering and provenance analysis. 2. Deep fake image analysis using frequency methods, wavelet analysis, and tools like Amped Authenticate. 3. Capsule networks for detecting forged images. 4. Information transformation for feature extraction via image forensic tools, such as EXIF-SC, Splice Radar, and Noiseprint. 5. Application of generative adversarial networks (GAN) based models as anti-image forensics [8], will be studied in great detail and a new research approach will be designed incorporating these advancements for utility of digital forensics.

This research proposes an application of generative adversarial networks (GANs) to solve the class imbalance problem in the fault detection and classification study of a plasma etching process. Small changes in the equipment part condition of the plasma equipment may cause an equipment fault, resulting in a process anomaly. Thus, fault detection in the semiconductor process is essential for success in advanced process control. Two datasets that assume faults of the mass flow controller (MFC) in equipment components were acquired using optical emission spectroscopy (OES) in the plasma etching process of a silicon trench: The abnormal process changed by the MFC is assumed to be faults, and the minority class of Case 1 is the normal class, and that of Case 2 is the abnormal class. In each case, additional minority class data were generated using GANs to compensate for the degradation of model training due to class-imbalanced data. Comparisons of five existing fault detection algorithms with the augmented datasets showed improved modeling performances. Generating a dataset for the minority group using GANs is beneficial for class imbalance problems of OES datasets in fault detection for the semiconductor plasma equipment.

Three-dimensional microstructure reconstruction is indispensable for understanding the performance and reliability of SOFC electrodes. Not only the microstructure parameters, but also SOFC electrochemical characteristics such as overpotentials can be calculated when combined with numerical simulations. The most common method to analyze 3-D structures with a feature size of 0.01 – 10 μm is a focused ion beam - scanning electron microscope (FIB-SEM). However, there’s a tradeoff between reconstruction volume size and resolution. Besides, in order to obtain high quality reconstruction, accumulation of know-hows for pre and post-processing is required. Therefore, fast screening of the microstructures is not easy for FIB-SEM due to the difficulty of measurement. On the other hand, a single SEM image can be obtained very easily. An arising question is if it is possible to extract properties of microstructures and numerically synthesize 3-D model directly from a single 2-D SEM image.In recent years, machine learning techniques have become a powerful tool for image processing. Nevertheless, applications of machine learning in the field of porous materials, in particular fuel cells and batteries are still limited. The previous works concentrated on relatively simple artificial neural networks (ANN), but the class of neural networks that can effectively analyze visual images is the convolutional neural network (CNN). Gayon-Lombardo et al. (1) demonstrated a successful application of generative adversarial network (GAN) based on CNN layers to fabricate synthetic 3-D SOFC microstructures. It is indicated that the GAN-based approach can be very effective, but the algorithm requires 3-D teaching data (GAN3Dto3D).In the scope of this research, a novel method for fabrication of synthetic 3-D microstructure directly from a 2-D SEM image is proposed (Fig. 1A). The GAN2Dto3D network consists of a 3-D microstructure generator and a discriminator which operate on 2-D data. Each microstructure fabricated by the generator is treated as a set of individual cross-sectional 2-D images. The discriminator checks the validity of each 2-D slice in the generated microstructure in all spatial directions (height, width and thickness). Patches extracted from a real 2-D cross-section image are used as training data. In each training iteration, new random patches are extracted to increase the number of available training data. Additionally, the training images are augmented by random horizontal and vertical flipping. As all of the cross-section of the newly generated microstructure has to be statistically equivalent to the real 2-D cross-section, the generated 3-D microstructure is smooth in all spatial directions.The GAN2Dto3D approach is tested on the dataset of real SOFC microstructures. For the real microstructure, a set of nickel (Ni) – gadolinium doped ceria (GDC) microstructures was fabricated. All composite anode samples were prepared with NiO (AGC Seimi, Japan) and GDC (Gd0.1Ce0.9O ShinEtsu, Japan) powders mixed in a designated proportion and sintered at 1350 oC. Differences in the structure are due to the initial anode slurry composition and packing density. The solid phase fractions were controlled by GDC share in the composite in the range of 30 – 70 vol.%, and their porosity was controlled by isostatic pressing (2). 3-D microstructures were reconstructed by FIB-SEM and used as the ground truth data for the validation of GAN2Dto3D model. The results of the GAN2Dto3D algorithm applied to generate two synthetic microstructures with different GDC share and the porosity are shown in Fig. 1B and 1C. The size of the generated microstructures is 64 × 64 × 64 voxels, which is equivalent to 6.4 × 6.4 × 6.4 µm. The real microstructures reconstructed with FIB-SEM are shown for comparison. The proposed GAN algorithm produces realistic microstructures, which indicates that GAN has a great potential to enable fast evaluation of various samples without carrying out complex FIB-SEM measurements.1. Gayon-Lombardo, L. Mosser, N. P. Brandon, and S. J. Cooper, npj Comput. Mater., 6, 1–11 (2020).2. Komatsu, A. Sciazko, and N. Shikazono, J. Power Sources, 485, 229317 (2021). Figure 1

In this paper, we propose a novel application of Generative Adversarial Networks (GAN) to the synthesis of cells imaged by fluorescence microscopy. Compared to natural images, cells tend to have a simpler and more geometric global structure that facilitates image generation. However, the correlation between the spatial pattern of different fluorescent proteins reflects important biological functions, and synthesized images have to capture these relationships to be relevant for biological applications. We adapt GANs to the task at hand and propose new models with casual dependencies between image channels that can generate multi-channel images, which would be impossible to obtain experimentally. We evaluate our approach using two independent techniques and compare it against sensible baselines. Finally, we demonstrate that by interpolating across the latent space we can mimic the known changes in protein localization that occur through time during the cell cycle, allowing us to predict temporal evolution from static images.

We propose a deep-learning approach based on generative adversarial networks (GANs) to reduce noise in weak lensing mass maps under realistic conditions. We apply image-to-image translation using conditional GANs to the mass map obtained from the first-year data of Subaru Hyper Suprime-Cam (HSC) Survey. We train the conditional GANs by using 25 000 mock HSC catalogues that directly incorporate a variety of observational effects. We study the non-Gaussian information in denoised maps using one-point probability distribution functions (PDFs) and also perform matching analysis for positive peaks and massive clusters. An ensemble learning technique with our GANs is successfully applied to reproduce the PDFs of the lensing convergence. About $60{{\ \rm per\ cent}}$ of the peaks in the denoised maps with height greater than 5σ have counterparts of massive clusters within a separation of 6 arcmin. We show that PDFs in the denoised maps are not compromised by details of multiplicative biases and photometric redshift distributions, nor by shape measurement errors, and that the PDFs show stronger cosmological dependence compared to the noisy counterpart. We apply our denoising method to a part of the first-year HSC data to show that the observed mass distribution is statistically consistent with the prediction from the standard ΛCDM model.

The gas chromatography analysis method for chemical substances enables accurate analysis to precisely distinguish the components of a mixture. This paper presents a technique for augmenting time-series data of chemicals measured by gas chromatography instruments with artificial intelligence techniques such as generative adversarial networks (GAN). We propose a novel GAN algorithm called GCGAN for gas chromatography data, a unified model of autoencoder (AE) and GAN for effective time-series data learning with an attention mechanism. The proposed GCGAN utilizes AE to learn a limited number of data more effectively. We also build a layer of high-performance generative adversarial neural networks based on the analysis of the features of data measured by gas chromatography instruments. Then, based on the proposed learning, we synthesize the features embedded in the gas chromatography data into a feature distribution that extracts the temporal variability. GCGAN synthesizes the features embedded in the gas chromatography data into a feature distribution that extracts the temporal variability of the data over time. We have fully implemented the proposed GCGAN and experimentally verified that the data augmented by the GCGAN have the characteristic properties of the original gas chromatography data. The augmented data demonstrate high quality with the Pearson correlation coefficient, Spearman correlation coefficient, and cosine similarity all exceeding 0.9, significantly enhancing the performance of AI classification models by 40%. This research can be effectively applied to various small dataset domains other than gas chromatography data, where data samples are limited and difficult to obtain.

Generative Adversarial Network is the topic of interest in today’s research in the field of image processing and computer vision. A basic GAN model was introduced by Ian Goodfellow et al. in 2014. After that advancement in the field of research in GAN models has been application specific. In computer vision and image to image translation GANs are playing very effective role either in the case of face detection and recognition or in image resolution enhancement and image augmentation. This paper represents a concise overview of various GAN models along with their features and applications. Pix2Pix and conditional GAN models work upon paired datasets while other models like cycle GAN, discover GAN, dual GAN, info GAN, deep convolutional GAN etc. work upon unpaired datasets. Various image datasets which are commonly used for training of generator and discriminator networks are also discussed in this paper. Since partial mode collapse is a common problem to occur during training process for all models, therefore various normalization techniques are also preferred during the training of generator and discriminator networks. As the advancements in GAN models are increasing at a very fast rate, soon these models will also be preferred in commercial applications.

Computer vision is one of the hottest research fields in deep learning. The emergence of generative adversarial networks (GANs) provides a new method and model for computer vision. The idea of GANs using the game training method is superior to traditional machine learning algorithms in terms of feature learning and image generation. GANs are widely used not only in image generation and style transfer but also in the text, voice, video processing, and other fields. However, there are still some problems with GANs, such as model collapse and uncontrollable training. This paper deeply reviews the theoretical basis of GANs and surveys some recently developed GAN models, in comparison with traditional GAN models. The applications of GANs in computer vision include data enhancement, domain transfer, high-quality sample generation, and image restoration. The latest research progress of GANs in artificial intelligence (AI) based security attack and defense is introduced. The future development of GANs in computer vision is also discussed at the end of the paper with possible applications of AI in computer vision.