Classification of lung nodules in CT images using conditional generative adversarial – convolutional neural network

Diminution index: A novel 3D feature for pulmonary nodule detection

Adaptive morphology aided 2-pathway convolutional neural network for lung nodule classification

Due to the real working conditions, the collected mechanical fault datasets are actually limited and always highly imbalanced, which restricts the diagnosis accuracy and stability. To solve these problems, we present an imbalanced fault diagnosis method based on the generative model of conditional-deep convolutional generative adversarial network (C-DCGAN) and provide a study in detail. Deep convolutional generative adversarial network (DCGAN), based on traditional generative adversarial networks (GAN), introduces convolutional neural network into the training for unsupervised learning to improve the effect of generative networks. Conditional generative adversarial network (CGAN) is a conditional model obtained through introducing conditional extension into GAN. C-DCGAN is a combination of DCGAN and CGAN. In C-DCGAN, based on the feature extraction ability of convolutional networks, through the structural optimization, conditional auxiliary generative samples are used as augmented data and applied in machine fault diagnosis. Two datasets (Bearing dataset and Planetary gear box dataset) are carried out to validate. The simulation experiments showed that the improved performance is mainly due to the generated signals from C-DCGAN to balance the dataset. The proposed method can deal with imbalanced fault classification problem much more effectively. This model could improve the accuracy of fault diagnosis and the generalization ability of the classifier in the case of small samples and display better fault diagnosis performance.

Thanks to the availability of large-scale data, deep Convolutional Neural Networks (CNNs) have witnessed success in various applications of computer vision. However, the performance of CNNs on Synthetic Aperture Radar (SAR) image classification is unsatisfactory due to the lack of well-labeled SAR data, as well as the differences in imaging mechanisms between SAR images and optical images. Therefore, this paper addresses the problem of SAR image classification by employing the Generative Adversarial Network (GAN) to produce more labeled SAR data. We propose special GANs for generating SAR images to be used in the training process. First, we incorporate the quadratic operation into the GAN, extending the convolution to make the discriminator better represent the SAR data; second, the statistical characteristics of SAR images are integrated into the GAN to make its value function more reasonable; finally, two types of parallel connected GANs are designed, one of which we call PWGAN, combining the Deep Convolutional GAN (DCGAN) and Wasserstein GAN with Gradient Penalty (WGAN-GP) together in the structure, and the other, which we call CNN-PGAN, applying a pre-trained CNN as a discriminator to the parallel GAN. Both PWGAN and CNN-PGAN consist of a number of discriminators and generators according to the number of target categories. Experimental results on the TerraSAR-X single polarization dataset demonstrate the effectiveness of the proposed method.

Classification of lung nodule malignancy in computed tomography imaging utilising generative adversarial networks and semi-supervised transfer learning

Lung Cancer is the most common cause of cancer-related death worldwide. Early and automatic diagnosis of Solitary Pulmonary Nodules (SPN) in Computer Tomography (CT) chest scans can provide early treatment as well as doctor liberation from time-consuming procedures. Deep Learning has been proven as a popular and influential method in many medical imaging diagnosis areas. In this study, we consider the problem of diagnostic classification between benign and malignant lung nodules in CT images derived from a PET/CT scanner. More specifically, we intend to develop experimental Convolutional Neural Network (CNN) architectures and conduct experiments, by tuning their parameters, to investigate their behavior, and to define the optimal setup for the accurate classification. For the experiments, we utilize PET/CT images obtained from the Laboratory of Nuclear Medicine of the University of Patras, and the publically available database called Lung Image Database Consortium Image Collection (LIDC-IDRI). Furthermore, we apply simple data augmentation to generate new instances and to inspect the performance of the developed networks. Classification accuracy of 91% and 93% on the PET/CT dataset and on a selection of nodule images form the LIDC-IDRI dataset, is achieved accordingly. The results demonstrate that CNNs are a trustworth method for nodule classification. Also, the experiment confirms that data augmentation enhances the robustness of the CNNs.

From real–time tumor classification to operative outcome prediction, applications of machine learning to neurosurgery are powerful. However, the translation of many of these applications are restricted by the lack of “big data” in neurosurgery. Important restrictions in patient privacy and sharing of imaging data reduce the diversity of the datasets used to train resulting models and therefore limit generalizability. Synthetic learning is a recent development in machine learning that generates synthetic data from real data and uses the synthetic data to train downstream models while preserving patient privacy. Such an approach has yet to be successfully demonstrated in the spine surgery domain. Spine radiographs were collected from the VinDR–SpineXR dataset, with 1470 labeled as abnormal and 2303 labeled as normal. A conditional generative adversarial network (GAN) was trained on the radiographs to generate a spine radiograph and normal/abnormal label. A modified conditional GAN (SpineGAN) was trained on the same task. A convolutional neural network (CNN) was trained using the real data to label abnormal radiographs. A CNN was trained to label abnormal radiographs using synthetic images from the GAN and in a separate experiment from SpineGAN. Using the real radiographs, an AUC of 0.856 was achieved in abnormality classification. Training on synthetic data generated by the standard GAN (AUC of 0.814) and synthetic data generated by our SpineGAN (AUC of 0.830) resulted in similar classifier performance. SpineGAN generated images with higher FID and lower precision scores, but with higher recall and increased performance when used for synthetic learning. The successful application of synthetic learning was demonstrated in the spine surgery domain for the classification of spine radiographs as abnormal or normal. A modified domain–relevant GAN is introduced for the generation of spine images, evidencing the importance of domain–relevant generation techniques in synthetic learning. Synthetic learning can allow neurosurgery to use larger and more diverse patient imaging sets to train more generalizable algorithms with greater patient privacy.

paper, we focus on exploring the relationship between weave patterns and their mechanical properties in woven fiber composites through Machine Learning. Specifically, we explore the interactions between woven architectures and in-plane stiffness properties through Deep Convolutional Neural Network (DCNN) and Generative Adversarial Network (GAN). Our research is important for exploring how woven composite’s pattern is related to its mechanical properties and accelerating woven composite design as well as optimization. We focus on two tasks: (1) Stiffness prediction: Predicting in-plane stiffness properties for given weave patterns. Our DCNN extracts high-level features through several convolutional and fully connected layers to determine the final predictions. (2) Weave pattern prediction: Predicting weave patterns for target stiffness properties, which can be treated as the reverse task of the first one. Due to many-to-one mapping between weave patterns and the composite properties, we utilize a Decoder Neural Network as our baseline model and compare its performance with GAN and Genetic Algorithm. We represent the weave patterns as 2D checkerboard models and use finite element analysis (FEA) to determine in-plane stiffness properties, which serve as input data for our ML framework. We show that: (1) for stiffness prediction, DCNN can predict stiffness values for a given weave pattern with relatively high accuracy (above 93%); (2) for weave pattern prediction, the GAN model gives the best prediction accuracy (above 92%) while Decoder Neural Network has the best time efficiency. HAOTIAN FENG

We demonstrate the feasibility of solving atmospheric remote sensing problems with machine learning using conditional generative adversarial networks (CGANs), implemented using convolutional neural networks. We apply the CGAN to generating two‐dimensional cloud vertical structures that would be observed by the CloudSat satellite‐based radar, using only the collocated Moderate‐Resolution Imaging Spectrometer measurements as input. The CGAN is usually able to generate reasonable guesses of the cloud structure and can infer complex structures such as multilayer clouds from the Moderate‐Resolution Imaging Spectrometer data. This network, which is formulated probabilistically, also estimates the uncertainty of its own predictions. We examine the statistics of the generated data and analyze the response of the network to each input parameter. The success of the CGAN in solving this problem suggests that generative adversarial networks are applicable to a wide range of problems in atmospheric science, a field characterized by complex spatial structures and observational uncertainties.

This project is intended to gift the ability of expression to the speech deprived by building a module that extracts thoughts from the human brain and presents it to the outside world as a digital image. This novel approach reconstructs same images of different colours from the EEG brain waves. Standalone datasets are being used to train the model which is obtained by using Enobio8 headset. EEG signals are acquired by providing six different shapes of three unique colors as the visual stimuli. After processing these signals EEG features are extracted using a convolutional Neural Network (CNN). The extracted features alongside noise are passed as an input to conditional Deep Convolutional Generative Adversarial Networks (cDCGANs) and conditional Generative Adversarial Networks (cGANs) which reconstruct the visual stimuli corresponding to the EEG data. The results obtained by the same are noted and analysed. The paper explicitly compares the working and performance of cGAN and cDCGAN models.

Motor imaging (MI) has been commonly employed in the domains of nervous analysis and robot control as an essential model of impulsive brain-computer interfaces (BCIs). Several approaches for extraction and classification based on MI signals have presented by researchers. Because of its random initialization technique, deep-learning (DL) procedures like convolutional neural networks (CNNs) employed in motor imagery categorization would suffer from the problem of extracting the features and improving the classification performance. To overcome these shortcomings, the proposed work presented a technique for reconstructing MI signals using empirical mode decomposition (EMD). In which it can manage the non-stationary problem and mix their Intrinsic Mode Functions (IMFs) extended to multichannel analysis. The proposed works uses the transformation technique of discrete wavelet transform (DWT) for extracting the signal. In classification wise, the proposed work used conditional generative adversarial network (CGAN), which provides the better classification performance and reduces the computational time. The proposed work used both binary class and multi-class classification. Scalp swarm optimization (SSO) used to enhance and optimize the learning parameters of the GAN model because in multi-class subjects, the performance of CGAN gradually degrades. In this BCI experimentation, the proposed work used two BCI competition datasets, such as BCI competition three dataset III (a) and BCI competition three dataset IV (a). Furthermore, evaluate the proposed technique performance by evaluating and comparing with DL technique as CNN (Alexnet and Resnet) model. The CNN achieved a classification accuracy performance of 81.61% in multiclass, while the CGAN showed better performance at 89.11%.

Sugar maple tar spot is caused by the water mold Rhytisma acerinum and is one of the unique systemic leaf pathogens affecting sugar maple (Acer saccharum) in North America and Europe. The exact tar spot of the sugar maple class fraction is paramount to developing effective control practices. As our task, we suggest a new Convolutional Neural Networks (CNN)- Generative Adversarial Networks (GAN)-based framework for increasing the accuracy of severity classification through a convolutional neural network-generative adversarial network architecture. The CNN-GAN infrastructure blends machine intelligence methods to make the process of automation and increase disease classification accuracy. We carried out the multistep process of collecting a comprehensive dataset of sugar maple leaf images representing different levels of degree of tar spot and finally trained the CNN-GAN network using a systematic methodology. Experiments conducted indicate successful implementation of the algorithm based on the CNN-GAN model as the network system has yielded the accuracies of classification of sugar maple tar spot severity being 95.62%. The tabular results with details and analysis as well as an indication of the model's performance among patients with different severity levels of this psychiatric disorder. This aspect expands the field of automated disease detection and management in agriculture and forestry which can be used in earlier screening and suitable interventions. The proposed method of a CNN-GAN framework entails great promise as it enhances the precision in diagnoses and instead provides more efficient disease-fighting strategies such as sugar maple tar sport and other plant diseases.

Every year, new Convolutional Neural Network (CNN) architectures appear to deal with different problems in the activity of image and video recognition. These architectures usually work along the ImageNet dataset for looking for the best performance of the CNNs without taking into account the video task where they are used. This can represent a problem if the task is Human Action Recognition (HAR) in video, since the CNN architectures are pre-trained with an image dataset that can practically contain any object, while HAR problem requires consecutive frames of people doing actions. To prove the idea that using CNNs pre-trained on an image dataset does not always achieve the best performance on a video dataset and that, therefore, it is worth comparing the performance of different CNNs under similar circumstances for the HAR problem, this work proposes an analysis between eight different CNN architectures. Each one of the CNN was exclusively trained with RGB images, which were extracted from the frames of the different classes of videos of HMDB51 dataset. To make the classification of an activity in video, we average the predictions taking into account the successes. We also made some ensembles with the best performance CNNs to measure the improvement in accuracy. Our results suggest that Xception is a strong baseline model that could be used by the community to make their comparisons of their proposals more robust.

Brain tumors are formed due to the abnormal growth of the cells that get multiplied and become in uncontrollable perspective. Tumors can damage brain cells by pressing down the skull, which consociate begins in, which negatively affects human health. In advanced stages, a brain tumor is a more dangerous infection that cannot be relieved. Brain tumor detection and early prevention are necessary in today's world. An extreme learning machine (ELM) is a widely adopted algorithm in machine learning. It is proposed to use classification models in brain tumor imaging. This classification is based on the techniques implemented: Convolutional Neural Networks(CNN) and Generative Adversarial Networks(GAN). CNN efficiently solves the convex optimization problem and is faster, requiring less human effort. The algorithmic architecture of GAN uses two neural networks, pocking one against the other. These networks are implemented in various fields to classify brain Tumor images. The present study mainly aims to introduce a new proposed classification system of preschool children brain imaging with Hybrid Convolutional Neural Networks and with the techniques of GAN. The proposed technique is compared with the existing hybrid-CNN and hybrid-GAN techniques. The outcomes are encouraging because the loss is deduced, and the accuracy facet increases. The proposed system achieved a training accuracy of 97.8% and a validation accuracy of 89%. The outcomes of the studies show that ELM in the platform of GAN for preschool children brain imaging classification has achieved higher predictive performance than the traditional classification mechanisms in increasingly complex scenarios. Time elapsed for training brain images samples finds inference value for training samples and time elapsed value increased by 28.9855%. Approximation ratio for cost based on probability, finding Approximation ratio for low probability range is increased by 88.1%. The combination of CNN, GAN and hybrid-CNN, hybrid-GAN, and hybrid CNN + GAN, compared with the proposed hybrid system, increased Detection latency for low range learning rate by 3.31%.

Conditional Generative Adversarial Network (GAN) is a GAN that generates data with the desired condition from the latent vector. The auxiliary classifier GAN is the most used among the variations of conditional GANs. In this study, we explain the problem of auxiliary classifier GAN and propose conditional activation GAN that can replace auxiliary classifier GAN to reduce the number of hyperparameters and improve training speed. The loss function of conditional activation GAN is defined as the sum of the loss of each GAN created for each condition. Since each GAN shares all hidden layers, the GANs can be considered as a single GAN and it does not increase the amount of computation much. Also, in order to prevent ignorance of conditions in the discriminator of conditional GANs with batch normalization, we propose a mixed batch training, in which each batch for discriminator is always configured to have the same ratio of real data and generated data so that each batch always has the similar condition distribution