Handwriting Digital Image Generation based on GAN: A Comparative Study of Basic GAN and CGAN Models

Stock market forecasting using DRAGAN and feature matching

Generative Adversarial Network is the topic of interest in today’s research in the field of image processing and computer vision. A basic GAN model was introduced by Ian Goodfellow et al. in 2014. After that advancement in the field of research in GAN models has been application specific. In computer vision and image to image translation GANs are playing very effective role either in the case of face detection and recognition or in image resolution enhancement and image augmentation. This paper represents a concise overview of various GAN models along with their features and applications. Pix2Pix and conditional GAN models work upon paired datasets while other models like cycle GAN, discover GAN, dual GAN, info GAN, deep convolutional GAN etc. work upon unpaired datasets. Various image datasets which are commonly used for training of generator and discriminator networks are also discussed in this paper. Since partial mode collapse is a common problem to occur during training process for all models, therefore various normalization techniques are also preferred during the training of generator and discriminator networks. As the advancements in GAN models are increasing at a very fast rate, soon these models will also be preferred in commercial applications.

Computer vision is one of the hottest research fields in deep learning. The emergence of generative adversarial networks (GANs) provides a new method and model for computer vision. The idea of GANs using the game training method is superior to traditional machine learning algorithms in terms of feature learning and image generation. GANs are widely used not only in image generation and style transfer but also in the text, voice, video processing, and other fields. However, there are still some problems with GANs, such as model collapse and uncontrollable training. This paper deeply reviews the theoretical basis of GANs and surveys some recently developed GAN models, in comparison with traditional GAN models. The applications of GANs in computer vision include data enhancement, domain transfer, high-quality sample generation, and image restoration. The latest research progress of GANs in artificial intelligence (AI) based security attack and defense is introduced. The future development of GANs in computer vision is also discussed at the end of the paper with possible applications of AI in computer vision.

The application of the Generative Adversarial Networks (GANs) model has increased rapidly in the past few years. This paper will demonstrate the training results of different GANs models in different epochs. Since GANs is a structure, they can be applied to different neural network layers such as Convolutional Neural Network (CNN) and multilayer perceptron (MLP). Different neural network layers are constructed and trained separately to compare their performance and efficiency in this experiment. To achieve this goal, all models perform the same task, generating handwritten numbers. In the experiment, three GANs models are tested. Two of them are based on MLP. They use the same structure and the same number of units. The only difference is the activation function. One uses the sigmoid function, and the other uses the LeakyRelu function. The last model is based on CNN. Specifically, the GANs model using Convolutional layers is called DCGAN. All models are constructed using TensorFlow, each of them was trained for 10, 20, 40, 80, 120, and 160 epochs. The generated images and loss value are recorded in all cases of the previously mentioned epochs of training. The experimental results demonstrated that Compared with the GANs model based on MLP, DCGAN has higher training efficiency and better image quality. Different activation functions can also affect the efficiency of the GANs model.

Image dehazing has always been a challenging topic in image processing. The development of deep learning methods, especially the generative adversarial networks (GAN), provides a new way for image dehazing. In recent years, many deep learning methods based on GAN have been applied to image dehazing. However, GAN has two problems in image dehazing. Firstly, For haze image, haze not only reduces the quality of the image but also blurs the details of the image. For GAN network, it is difficult for the generator to restore the details of the whole image while removing the haze. Secondly, GAN model is defined as a minimax problem, which weakens the loss function. It is difficult to distinguish whether GAN is making progress in the training process. Therefore, we propose a guided generative adversarial dehazing network (GGADN). Different from other generation adversarial networks, GGADN adds a guided module on the generator. The guided module verifies the network of each layer of the generator. At the same time, the details of the map generated by each layer are strengthened. Network training is based on the pre-trained VGG feature model and L1-regularized gradient prior which is developed by new loss function parameters. From the dehazing results of synthetic images and real images, the proposed method is better than the state-of-the-art dehazing methods.

We propose the HumanGAN, a generative adversarial network (GAN) incorporating human perception as a discriminator. A basic GAN trains a generator to represent a real-data distribution by fooling the discriminator that distinguishes real and generated data. Therefore, the basic GAN cannot represent the outside of a real-data distribution. In the case of speech perception, humans can recognize not only human voices but also processed (i.e., a non-existent human) voices as human voice. Such a human-acceptable distribution is typically wider than a real-data one and cannot be modeled by the basic GAN. To model the human-acceptable distribution, we formulate a backpropagation-based generator training algorithm by regarding human perception as a black-boxed discriminator. The training efficiently iterates generator training by using a computer and discrimination by human. We evaluate our HumanGAN in speech naturalness modeling and demonstrate that it can represent a human-acceptable distribution that is wider than a real-data distribution.

Generative Adversarial Networks (GANs) have been used as a deep learning approach to solving physics and engineering problems. Using deep learning for these problems is attractive in that reasonably accurate models can be inferred from only raw data, eliminating the need to define the exact physical equations governing a problem. We expand on previous work [Farimani et al. 2017] using GANs to generate steady-state solutions to the two-dimensional heat equation. Using a basic conditional GAN (cGAN), we generate accurate solutions for rectangular domains conditioned on four edge boundary conditions (MAE%3C0.5%). For finding steady-state solutions over arbitrary two-dimensional domains (not constrained to rectangles), we use a cGAN designed for image-to-image translation. We train this GAN on various types of geometric domains (circles, squares, triangles, shapes with one circular or rectangular hole), achieving accurate results on test data made up of geometries similar to those in training (MAE%3C1%). For both of these GANs, we experiment with different loss function terms, showing that a term using the gradients of solution images significantly improves the basic cGAN but not the image-to-image GAN. Lastly, we show that the image-to-image GAN performs poorly when applied to two-dimensional geometries that vary in structure from training data (MAE%3C8% for shapes with multiple holes or different shaped holes). This demonstrates the cGAN's lack of generalizability. While the cGAN is an accurate and computationally efficient method when trained and tested on similarly structured data, it is a much less reliable method when applied to data that is slightly different in structure from the training data.

Generative adversarial network (GAN) model generates and discriminates images using an adversarial competitive strategy to generate high-quality images. The implementation of GAN in different fields is helpful for generating samples that are not easy to obtain. Image generation can help machine learning to balance data and improve the accuracy of the classifier. This paper introduces the principles of the GAN model and analyzes the advantages and disadvantages of improving GANs. The applications of GANs in image generation are analyzed. Finally, the problems of GANs in image generation are summarized.

ABSTRACTData mining and natural language processing (NLP) are fundamental fields that interact in many ways. Text mining shares many topics, such as sentiment analysis and content understanding. Combining these two fields enables more efficient mining of text data and the extraction of valuable information. In particular, the GAN (Generative Adversarial Network) architecture has achieved success in image generation and has started to be used on text data. However, training GANs is fraught with difficulties due to the complexity of text data. Linguistic studies show important differences between languages. Language is characterized by fluidity, ambiguity, and context‐sensitive interpretations, and text‐generating GAN models can struggle to deal with these complexities. The interaction between data quality, language structure, and complex interpretation can lead to inconsistency and ambiguity in the text production of GAN models. These problems are particularly pronounced when complexities such as semantic subtleties, idiomatic expressions, and context‐dependent usages come into play. Text generation is an area of GAN models used in NLP to generate language and enrich text‐based applications. Work in this area can contribute to analyzing, classifying, and processing text data. Many methods and techniques have been proposed to improve the performance of text GANs. However, some problems may be encountered in the optimization of these methods. Therefore, it is essential to use optimized methods. In conclusion, GANs can be an important tool to improve text generation in NLP. Still, they require continuous research and innovation to deal with factors such as language complexity and data quality.

Accurate modulation identification of the received signals is undoubtedly a central component in multiple-input multiple-output (MIMO) communication systems, facilitating the demodulation task. This study presents a flexible and semi-supervised deep learning-driven strategy for automatic modulation identification. To this end, the multiclass classification problem is treated as multiple binary discrimination problems to address modulation identification challenges. Here, we merge the features extraction ability of the Generative Adversarial Network (GAN) model and the semi-supervised anomaly detection scheme, the one-class Support Vector Machine (1SVM). Essentially, a single GAN-based 1SVM detector is trained using training data of each class, with the samples of that class as inlier and all other samples as anomalies (i.e., one-vs.-rest). The 1SVM is trained using the features learned by the GAN model. A dataset consisting of three digital modulations (i.e., BFSK, CPFSK, and PAM4) and three analog modulations (i.e., AM-DSB, AM-SSB, and WB-FM), widely used in wireless communications systems, is employed to demonstrate the performance of the considered deep learning-based methods. Compared to Restricted Boltzmann Machine (RBM) and Deep Belief Network (DBN)-based 1SVM, the conventional GAN, DBN, and RBM with softmax layer as discriminator layer, the proposed GAN-based 1SVM detector offers superior discrimination performance of modulation types by achieving an averaged accuracy of 0.951 and F1-Score of 0.954. Results also showed that the GAN-1SVM detector dominates the state-of-the-art modulation classification techniques.

Event prediction is essential in social network (SN) analysis to study the SN's evolutionary patterns (communities). Machine learning (ML) models are often used to predict events in SN communities. The ML algorithms manifest the results with biasness for the same dataset. Hence, the performance of an ML model requires validation for the unseen data to avoid biasness in learning. Generally, researchers use the generative adversarial network (GAN) model for generating realistic sample data to enhance the prediction of events. It is challenging for the discriminator to learn features using a single layer with similar weights in a conventional GAN technique. Therefore, this article proposes an improved version of the GAN model named generative adversarial network classifier (GAN‐C). The proposed GAN‐C model contains an additional layer, called classifier, that generates different feature maps. Wherein weights are adjusted dynamically based on the conditions to predict the events. To be precise, conditioning the weights in a classifier layer using entropy values of the features is a simple and effective way to minimize the classifier loss function (categorical cross‐entropy). GAN‐C model results in 16% loss up to 10 batches, and after that, the loss becomes negligible and can generate non‐overlapping events. The gaps between such non‐overlapping events are analyzed using the Jensen–Shannon divergence technique. The experimental results show that the existing single‐GAN and multi‐GAN methods predict events with 79.34% and 82.17% accuracy, respectively. While the proposed GAN‐C comparatively predicts events with improved accuracy of 88.56% on the same dataset. The data generated by the GAN‐C model are also approximately 55.85% and 80.59% more realistic than multi‐GAN and single‐GAN, respectively, based on root mean square error and inception score comparisons. GAN‐C is also approximately 68.01% faster than other GAN models. Thus, this article's theoretical and experimental analysis justifies that GAN‐C works suitably for predicting events in a massive dataset.

To train generative adversarial network (GAN) models to generate predictive optical coherence tomography (OCT) images of central serous chorioretinopathy (CSC) at 3months after observation using multi-modal OCT images. Four hundred forty CSC eyes of 440 patients who underwent Cirrus OCT imaging were included. Baseline OCT B-scan images through the foveal center, en face choroid, and en face ellipsoid zone were collected from each patient. The datasets were divided into training and validation (n = 390) and test (n = 50) sets. The input images for each model comprised either baseline B-scan alone or a combination of en face choroid and ellipsoid zones. Predictive post-treatment OCT B-scan images were generated using GAN models and compared with real 3-month images. Of 50 generated OCT images, there were 48, 47, and 48 acceptable images for UNIT, CycleGAN, and RegGAN, respectively. In comparison with real 3-month images, the generated images showed sensitivity, specificity, and positive predictive values (PPV) for residual fluid in the ranges of 0.762-1.000, 0.483-0.724, and 0.583-0.704; for pigment epithelial detachment (PED) of 0.917-1.000, 0.974-1.000, and 0.917-1.000; and for subretinal hyperreflective material (SHRM) of 0.667-0.778, 0.925-0.950 and 0.700-0.750, respectively. RegGAN exhibited the highest values except for sensitivity. GAN models could generate prognostic OCT images with good performance for prediction of residual fluid, PED, and SHRM presence in CSC. Implementation of the models may help predict disease activity in CSC, facilitating the establishment of a proper treatment plan.

A novel model watermarking for protecting generative adversarial network

Nucleic acids are the basic units of deoxyribonucleic acid (DNA) sequencing. Every organism demonstrates different DNA sequences with specific nucleotides. It reveals the genetic information carried by a particular DNA segment. Nucleic acid sequencing expresses the evolutionary changes among organisms and revolutionizes disease diagnosis in animals. This paper proposes a generative adversarial networks (GAN) model to create synthetic nucleic acid sequences of the cat genome tuned to exhibit specific desired properties. We obtained the raw sequence data from Illumina next generation sequencing. Various data preprocessing steps were performed using Cutadapt and DADA2 tools. The processed data were fed to the GAN model that was designed following the architecture of Wasserstein GAN with gradient penalty (WGAN-GP). We introduced a predictor and an evaluator in our proposed GAN model to tune the synthetic sequences to acquire certain realistic properties. The predictor was built for extracting samples with a promoter sequence, and the evaluator was built for filtering samples that scored high for motif-matching. The filtered samples were then passed to the discriminator. We evaluated our model based on multiple metrics and demonstrated outputs for latent interpolation, latent complementation, and motif-matching. Evaluation results showed our proposed GAN model achieved 93.7% correlation with the original data and produced significant outcomes as compared to existing models for sequence generation.

Imputation of missing images via source-to-target modality translation can improve diversity in medical imaging protocols. A pervasive approach for synthesizing target images involves one-shot mapping through generative adversarial networks (GAN). Yet, GAN models that implicitly characterize the image distribution can suffer from limited sample fidelity. Here, we propose a novel method based on adversarial diffusion modeling, SynDiff, for improved performance in medical image translation. To capture a direct correlate of the image distribution, SynDiff leverages a conditional diffusion process that progressively maps noise and source images onto the target image. For fast and accurate image sampling during inference, large diffusion steps are taken with adversarial projections in the reverse diffusion direction. To enable training on unpaired datasets, a cycle-consistent architecture is devised with coupled diffusive and non-diffusive modules that bilaterally translate between two modalities. Extensive assessments are reported on the utility of SynDiff against competing GAN and diffusion models in multi-contrast MRI and MRI-CT translation. Our demonstrations indicate that SynDiff offers quantitatively and qualitatively superior performance against competing baselines.