High-Accuracy Maize Disease Detection Based on Attention Generative Adversarial Network and Few-Shot Learning.

Wind Turbine (WT) is one of the primary renewable energy sources that provide a reliable and longlasting power supply. It does not contribute to global pollution by releasing emissions of carbon dioxide. Since wind speed is unpredictable, electricity generation forecast and monitoring for wind farms provide a challenging task. As a consequence, it restricts the capacity of managerial staff to make decisions and effectively plan for energy use. This paper proposes an Enhanced Predictive Modeling for Wind Turbines based Digital Twin Optimized Multi-Scale Fusion Self Attention Generative Adversarial Network (EPM-WT-DT-MSFSAGAN). By virtually monitoring wind turbines, this technology uses a cloud-based Digital Twin's (DT) architecture enabled by the 5G-NG-RAN (radio access network) to estimate wind speed and electrical power. The model creates a fivedimensional digital twin architecture built on the digital duplicates foundation of Microsoft Azure. The input data is collected from Onshore wind farm dataset. Next, the Multi-Scale Fusion Self Attention Generative Adversarial Network (MSFSAGAN) is used to predict the wind speed and power. Finally, Humboldt Squid Optimization Algorithm (HSOA) is employed to optimize the weight parameter of MSFSAGAN. The proposed method is implemented in Python. The proposed method achieves 25.68%, 22.54% and 31.24% higher accuracy, 28.89%, 18.26% and 23.49% lower mean square error compared to the existing methods: machine learning-based digital twin for predictive modeling in wind turbines (ML-DT-PM-WT), a digital twin of wind farms using physics-informed deep learning (DT-WF-PI-DL), and a deep learning-based predictive digital twin for offshore wind farms (DL-DT-OWT).

With the widespread adoption of Generative Adversarial Networks (GANs) in image generation and processing, enhancing their generation quality and visualization capabilities has become a prominent research focus. This study introduces a deep learning framework that integrates multi-scale information chart generation with visualization enhancement to improve the performance of GAN-based image generation models across various domains. Based on the Self-Attention Generative Adversarial Network (SAGAN), which leverages self-attention mechanisms to capture long-range dependencies in images, the proposed approach significantly enhances image quality and detail representation. The framework incorporates a multi-scale feature extraction method to optimize the feature maps at each layer of the generative network. Experimental results demonstrate that SAGAN outperforms traditional GAN models in terms of image clarity, detail preservation, and visual effects. The proposed model achieves notable improvements in diversity and generalization, with a mutual information content of 0.91, clustering uniformity of 0.89, and inter-cluster dissimilarity of 0.92 on the CelebA dataset. Furthermore, in terms of image quality, SAGAN attains a Structural Similarity Index Measure (SSIM) of 0.94 and a Peak Signal-to-Noise Ratio (PSNR) of 30.1, surpassing traditional GANs by a significant margin.

Our generation has seen the boom and ubiquitous advent of Internet connectivity. Adversaries have been exploiting this omnipresent connectivity as an opportunity to launch cyber attacks. As a consequence, researchers around the globe devoted a big attention to data mining and machine learning with emphasis on improving the accuracy of intrusion detection system (IDS). In this paper, we present a few-shot deep learning approach for improved intrusion detection. We first trained a deep convolutional neural network (CNN) for intrusion detection. We then extracted outputs from different layers in the deep CNN and implemented a linear support vector machine (SVM) and 1-nearest neighbor (1-NN) classifier for few-shot intrusion detection. few-shot learning is a recently developed strategy to handle situation where training samples for a certain class are limited. We applied our proposed method to the two well-known datasets simulating intrusion in a military network: KDD 99 and NSL-KDD. These datasets are imbalanced, and some classes have much less training samples than others. Experimental results show that the proposed method achieved better performances than the state-of-the-art on those two datasets.

Shadow removal is a fundamental task that aims at restoring dark areas in an image where the light source is blocked by an opaque object, to improve the visibility of shadowed areas. Existing shadow removal methods have developed for decades and yielded many promising results, but most of them are poor at maintaining consistency between shadowed regions and shadow-free regions, resulting in obvious artifacts in restored areas. In this paper, we propose a two-stage (i.e., shadow detection and shadow removal) method based on the Generative Adversarial Network (GAN) to remove shadows. In the shadow detection stage, a Recurrent Neural Network (RNN) is trained to obtain the attention map of shadowed areas. Then the attention map is injected into both generator and discriminator to guide the shadow removal stage. The generator is a dual encoder-decoder that processes the shadowed regions and shadow-free regions separately to reduce inconsistency. The whole network is trained with a spatial variant reconstruction loss along with the GAN loss to make the recovered images more natural. In addition, a novel feature-level perceptual loss is proposed to ensure enhanced images more similar to ground truths. Quantitative metrics like PSNR and SSIM on the ISTD dataset demonstrate that our method outperforms other compared methods. In the meantime, the qualitative comparison shows our approach can effectively avoid artifacts in the restored shadowed areas while keeping structural consistency between shadowed regions and shadow-free regions.

The early and precise diagnosis of stroke plays an important role in its treatment planning. Computed Tomography (CT) is utilised as a first diagnostic tool for quick diagnosis and to rule out haemorrhage. Diffusion Magnetic Resonance Imaging (MRI) provides superior sensitivity in comparison to CT for detecting early acute ischaemia and small lesions. However, the long scan time and limited availability of MRI make it not feasible for emergency settings. To deal with this problem, this study presents a brain mask-guided and fidelity-constrained cycle-consistent generative adversarial network for translating CT images into diffusion MRI images for stroke diagnosis. A brain mask is concatenated with the input CT image and given as input to the generator to encourage more focus on the critical foreground areas. A fidelity-constrained loss is utilised to preserve details for better translation results. A publicly available dataset, A Paired CT-MRI Dataset for Ischemic Stroke Segmentation (APIS) is utilised to train and test the models. The proposed method yields MSE 197.45 [95% CI: 180.80, 214.10], PSNR 25.50 [95% CI: 25.10, 25.92], and SSIM 88.50 [95% CI: 87.50, 89.50] on a testing set. The proposed method significantly improves techniques based on UNet, cycle-consistent generative adversarial networks (CycleGAN) and Attention generative adversarial networks (GAN). Furthermore, an ablation study was performed, which demonstrates the effectiveness of incorporating fidelity-constrained loss and brain mask information as a soft guide in translating CT images into diffusion MRI images. The experimental results demonstrate that the proposed approach has the potential to support faster and precise diagnosis of stroke.

Blind single-channel source separation is a long-standing machine learning and signal processing problem. Traditional blind source separation (BSS) algorithms were proposed to solve this task utilizing multiple signal constraints. Generative adversarial network (GAN) are free from statistical constraints and samples, but the role of adversarial training in the task of BSS has not been fully demonstrated. Therefore, a new separation network model that enables to learn the known separated signal distribution from the stepwise fine estimation of the unknown mixture distribution was presented in this paper, and a self-attention mechanism was introduced to solve the problem of the blurring details of the generated image by the generator which preserves image details in the process of image separation. Compared with the existing single-channel blind source separation algorithm based on generative adversarial network-neural egg separation (NES), the detailed information of this new separation algorithm is more prominent, and the source signal in the mixed image has been separated more effectively, and has better separation performance than the classic blind source separation algorithms.

Image motion deblurring via attention generative adversarial network

Artificial intelligence technologies and vision systems are used in various devices, such as automotive navigation systems, object-tracking systems, and intelligent closed-circuit televisions. In particular, outdoor vision systems have been applied across numerous fields of analysis. Despite their widespread use, current systems work well under good weather conditions. They cannot account for inclement conditions, such as rain, fog, mist, and snow. Images captured under inclement conditions degrade the performance of vision systems. Vision systems need to detect, recognize, and remove noise because of rain, snow, and mist to boost the performance of the algorithms employed in image processing. Several studies have targeted the removal of noise resulting from inclement conditions. We focused on eliminating the effects of raindrops on images captured with outdoor vision systems in which the camera was exposed to rain. An attentive generative adversarial network (ATTGAN) was used to remove raindrops from the images. This network was composed of two parts: an attentive-recurrent network and a contextual autoencoder. The ATTGAN generated an attention map to detect rain droplets. A de-rained image was generated by increasing the number of attentive-recurrent network layers. We increased the number of visual attentive-recurrent network layers in order to prevent gradient sparsity so that the entire generation was more stable against the network without preventing the network from converging. The experimental results confirmed that the extended ATTGAN could effectively remove various types of raindrops from images.

To improve the accuracy of partial discharge pattern recognition under unbalanced and small sample conditions, a method of partial discharge data augmentation and pattern recognition using the generative adversarial network embedded deep auto-encoder (DAE-GAN) is proposed. First, deep Auto-encoder (DAE) is embedded into a Generative Adversarial Network (GAN), and DAE is used to guide the generation process to improve the authenticity of generated samples. Second, complement samples of PD samples are added to the training process of the Generative Adversarial Network to solve the problem of small PD samples. Finally, extended equalization training samples are used to fine-tune the discriminator of the model to realize PD pattern recognition. DAE-GAN is used for data augmentation and pattern recognition of partial discharge experimental signals. The results show that, compared with other algorithms, the authenticity and probability distribution fitting accuracy of partial discharge samples generated by DAE-GAN are higher and the accuracy of partial discharge recognition is improved by 8.24% after data augmentation.

Few-shot learning in image classification aims at learning a model to identify novel categories from a few training samples. Many few-shot learning methods have been proposed to improve the model performance. However, they still suffer from data dependencies, weak feature representation ability, and poor performance on complex tasks. To address these three issues, we propose a global and local attention-based multiscale prototypical network (called GLAP), which includes a feature extraction network and a multiscale classification head. The feature extraction network is stacked by four global attention modules (GAMs) and four local attention modules (LAMs). On the one hand, each GAM learns the global context information in the whole image by calculating the global attention map of all pixels, thereby extracting general features to alleviate data dependencies. On the other hand, each LAM learns the local correspondences between features extracted by the corresponding GAM and features extracted by pre-trained ResNet50 at different scales, which combines high-level semantic features with low-level visual features to enhance feature representation ability. Afterward, the multiscale classification head is designed, which adopts a multiscale metric-based meta-learning (MMML) training method. MMML first calculates the category prototypes of four scales for metric classification, with the aim of generating intermediate predictions of four scales. Then, MMML generates the classification result by combining the intermediate predictions of four scales, thus improving the model performance on complex tasks. Extensive experiments on three benchmark datasets demonstrate that GLAP performs better than state-of-the-art few-shot learning methods.

Few-shot learning (FSL) is of great significance to the field of machine learning. The ability to learn and generalize using a small number of samples is an obvious distinction between artificial intelligence and humans. In the FSL domain, most graph neural networks (GNNs) focus on transferring labeled sample information to an unlabeled query sample, ignoring the important role of semantic information during the classification process. Our proposed method embeds semantic information of classes into a GNN, creating a word embedding distribution propagation graph network (WPGN) for FSL. We merge the attention mechanism with our backbone network, use the Mahalanobis distance to calculate the similarity of classes, select the Funnel ReLU (FReLU) function as the activation function of the Transform layer, and update the point graph and word embedding distribution graph. In extensive experiments on FSL benchmarks, compared with the baseline model, the accuracy of the WPGN on the 5-way-1/2/5 shot tasks increased by 9.03, 4.56, and 4.15%, respectively.

High-performance neural networks for synthetic aperture radar (SAR) automatic target recognition (ATR) often encounter the challenge of data scarcity. The lack of sufficient labeled SAR image datasets leads to the consideration of using simulated data to supplement the dataset. On the one hand, electromagnetic computation simulations provide high amplitude accuracy but are inefficient for large-scale datasets due to their complex computations and physical models. On the other hand, ray tracing simulations offer high geometric accuracy and computational efficiency but struggle with low amplitude correctness, hindering accurate numerical feature extraction. Furthermore, the emergence of generative adversarial networks (GANs) provides a way to generate simulated datasets, trying to balance computational efficiency with image quality. Nevertheless, the simulated SAR images generated based on random noise lack constraints, and it is also difficult to generate images that exceed the parameter conditions of the real image’s training set. Hence, it is essential to integrate physics-based simulation techniques into GANs to enhance the generalization ability of the imaging parameters. In this paper, we present the SingleScene-SAR Simulator, an efficient framework for SAR image simulation that operates under limited real SAR data. This simulator integrates rasterized shooting and bouncing rays (SBR) with cycle GAN, effectively achieving both amplitude correctness and geometric accuracy. The simulated images are appropriate for augmenting datasets in target recognition networks. Firstly, the SingleScene-SAR Simulator employs a rasterized SBR algorithm to generate radar cross section (RCS) images of target models. Secondly, a specific training pattern for cycle GAN is established to translate noisy RCS images into simulated SAR images that closely resemble real ones. Finally, these simulated images are utilized for data augmentation. Experimental results based on the constructed dataset show that with only one scene SAR image containing 30 target chips, the SingleScene-SAR Simulator can efficiently produce simulated SAR images that exhibit high similarity in both spatial and statistical distributions compared with real images. By employing simulated SAR images for data augmentation, the accuracy of target recognition networks can be consistently and significantly enhanced.

Object detection models available on smartphones such as YOLOv8 can potentially help identify and locate objects of interest to people who are blind or low vision (pBLV). However, current models may miss crucial objects for pBLV. Here, we compared 5 transfer learning methods for adding new classes of interest to pBLV navigation that are absent from the Common Objects in Context (COCO) training dataset. Using a rebalanced COCO dataset with these new classes, we revised public YOLOv8s models via the following methods: revising all pretrained weights; freezing 22, 21 or 15 layers; and few-shot learning. These approaches achieved overall mean average precision (mAP-50) from 0.342 (20 min training time; few-shot learning) to 0.420 (9.2 hrs; revising all pretrained weights). Among the frozen layer models, the 15 frozen layer model had the best mAP-50 performance of 0.419 (7.7 hrs); hyperparameter tuning on this model increased mAP-50 to 0.423. When applied to a larger YOLOv8xl model, mAP-50 reached 0.511 after 50 epochs. Our results highlight how object detection models can be adapted for the benefit of pBLV users even when developers have limited training data or computational resources.

paper, we focus on exploring the relationship between weave patterns and their mechanical properties in woven fiber composites through Machine Learning. Specifically, we explore the interactions between woven architectures and in-plane stiffness properties through Deep Convolutional Neural Network (DCNN) and Generative Adversarial Network (GAN). Our research is important for exploring how woven composite’s pattern is related to its mechanical properties and accelerating woven composite design as well as optimization. We focus on two tasks: (1) Stiffness prediction: Predicting in-plane stiffness properties for given weave patterns. Our DCNN extracts high-level features through several convolutional and fully connected layers to determine the final predictions. (2) Weave pattern prediction: Predicting weave patterns for target stiffness properties, which can be treated as the reverse task of the first one. Due to many-to-one mapping between weave patterns and the composite properties, we utilize a Decoder Neural Network as our baseline model and compare its performance with GAN and Genetic Algorithm. We represent the weave patterns as 2D checkerboard models and use finite element analysis (FEA) to determine in-plane stiffness properties, which serve as input data for our ML framework. We show that: (1) for stiffness prediction, DCNN can predict stiffness values for a given weave pattern with relatively high accuracy (above 93%); (2) for weave pattern prediction, the GAN model gives the best prediction accuracy (above 92%) while Decoder Neural Network has the best time efficiency. HAOTIAN FENG

Making machines learn like humans is the ultimate goal of artificial intelligence. Few-shot learning attempts to simulate the learning mechanism of humans, which is a task that can learn novel concepts from very few labeled samples. Due to the lack of sufficient labeled training data, existing methods often increase the risk of over-fitting or cause a considerable gap between clean and augmented data. To solve these problems, we present a novel compare network to perform robust few-shot learning in a meta-learned end-to-end manner. Specifically, we argue that it is desirable to learn a robust encoder that can draw inferences about other cases from one example. To this end, we improve the accuracy of few-shot learning by mining the internal mechanism of deep networks, which can leverage label information more effectively. By introducing shift-invariant blocks and a self-attention block in our architecture, all these components are seamlessly integrated into our framework, which can give feedback to each other without data augmentation. Furthermore, we provide ablative analyses of different blocks to help understand how each term contributes to performance. Extensive experiments demonstrate that our method can provide more robust results and outperform state-of-the-art few-shot learning methods.