A novel rice plant leaf diseases detection using deep spectral generative adversarial neural network

Deep learning models are highly parameterized, resulting in difficulty in inference and transfer learning for image recognition tasks. In this work, we propose a layered pathway evolution method to compress a deep convolutional neural network (DCNN) for classification of masses in digital breast tomosynthesis (DBT). The objective is to prune the number of tunable parameters while preserving the classification accuracy. In the first stage transfer learning, 19 632 augmented regions-of-interest (ROIs) from 2454 mass lesions on mammograms were used to train a pre-trained DCNN on ImageNet. In the second stage transfer learning, the DCNN was used as a feature extractor followed by feature selection and random forest classification. The pathway evolution was performed using genetic algorithm in an iterative approach with tournament selection driven by count-preserving crossover and mutation. The second stage was trained with 9120 DBT ROIs from 228 mass lesions using leave-one-case-out cross-validation. The DCNN was reduced by 87% in the number of neurons, 34% in the number of parameters, and 95% in the number of multiply-and-add operations required in the convolutional layers. The test AUC on 89 mass lesions from 94 independent DBT cases before and after pruning were 0.88 and 0.90, respectively, and the difference was not statistically significant (p > 0.05). The proposed DCNN compression approach can reduce the number of required operations by 95% while maintaining the classification performance. The approach can be extended to other deep neural networks and imaging tasks where transfer learning is appropriate.

In today’s world, fashion has become intricately linked to personal identity and cultural expression, with clothing choices varying significantly across individuals based on factors such as body structure, gender, social influences, and geographic background. While traditional shopping at brick-and-mortar stores allows customers to physically try on garments, this experience can often be time-consuming and limited by the availability of fitting rooms, leading to inconvenience and frustration. With the rapid expansion of online shopping plat- forms, consumers now seek more realistic and interactive ways to evaluate clothing virtually, yet existing systems frequently fall short of providing an immersive, tactile experience. This gap results in higher dissatisfaction, inaccurate visualizations, and increased product returns due to poor fit or misrepresentation of garments. To address these issues, this research introduces an advanced Virtual Fitting Room (VFR) system that leverages cutting-edge deep learning techniques, including Deep Neural Networks (DNNs) and Generative Adversarial Networks (GANs), within a two-dimensional framework to enable highly realistic virtual try-on experiences. The proposed system incorporates sophisticated computer vision methods, such as precise image segmentation, garment warping, and fabric behavior simulation, to create a natural, seamless inter- action wherein users can see how clothing appears on virtual avatars with remarkable accuracy. By focusing on realistic garment overlays that adapt to various body shapes and poses, this platform delivers an immersive environment that closely mimics physical fitting experiences, thereby enhancing user engagement and confidence. Implementing this technology not only improves customer satisfaction by providing a more authentic and visually appealing visualization but also reduces the likelihood of returns caused by mismatched expectations. Ultimately, this innovative approach contributes to a more sustainable and technologically advanced fashion retail ecosystem, transforming online clothing shopping into a more enjoyable and reliable process while addressing the needs of modern consumers and retailers alike.

paper, we focus on exploring the relationship between weave patterns and their mechanical properties in woven fiber composites through Machine Learning. Specifically, we explore the interactions between woven architectures and in-plane stiffness properties through Deep Convolutional Neural Network (DCNN) and Generative Adversarial Network (GAN). Our research is important for exploring how woven composite’s pattern is related to its mechanical properties and accelerating woven composite design as well as optimization. We focus on two tasks: (1) Stiffness prediction: Predicting in-plane stiffness properties for given weave patterns. Our DCNN extracts high-level features through several convolutional and fully connected layers to determine the final predictions. (2) Weave pattern prediction: Predicting weave patterns for target stiffness properties, which can be treated as the reverse task of the first one. Due to many-to-one mapping between weave patterns and the composite properties, we utilize a Decoder Neural Network as our baseline model and compare its performance with GAN and Genetic Algorithm. We represent the weave patterns as 2D checkerboard models and use finite element analysis (FEA) to determine in-plane stiffness properties, which serve as input data for our ML framework. We show that: (1) for stiffness prediction, DCNN can predict stiffness values for a given weave pattern with relatively high accuracy (above 93%); (2) for weave pattern prediction, the GAN model gives the best prediction accuracy (above 92%) while Decoder Neural Network has the best time efficiency. HAOTIAN FENG

Prediction of the stage of cancer plays an important role in planning the course of treatment and has been largely reliant on imaging tools which do not capture molecular events that cause cancer progression. Gene-expression data-based analyses are able to identify these events, allowing RNA-sequence and microarray cancer data to be used for cancer analyses. Breast cancer is the most common cancer worldwide, and is classified into four stages - stages 1, 2, 3, and 4 [2]. While machine learning models have previously been explored to perform stage classification with limited success, multi-class stage classification has not had significant progress. There is a need for improved multi-class classification models, such as by investigating deep learning models. Gene-expression-based cancer data is characterised by the small size of available datasets, class imbalance, and high dimensionality. Class balancing methods must be applied to the dataset. Since all the genes are not necessary for stage prediction, retaining only the necessary genes can improve classification accuracy. The breast cancer samples are to be classified into 4 classes of stages 1 to 4. Invasive ductal carcinoma breast cancer samples are obtained from The Cancer Genome Atlas (TCGA) and Molecular Taxonomy of Breast Cancer International Consortium (METABRIC) datasets and combined. Two class balancing techniques are explored, synthetic minority oversampling technique (SMOTE) and SMOTE followed by random undersampling. A hybrid feature selection pipeline is proposed, with three pipelines explored involving combinations of filter and embedded feature selection methods: Pipeline 1 - minimum-redundancy maximum-relevancy (mRMR) and correlation feature selection (CFS), Pipeline 2 - mRMR, mutual information (MI) and CFS, and Pipeline 3 - mRMR and support vector machine-recursive feature elimination (SVM-RFE). The classification is done using deep learning models, namely deep neural network, convolutional neural network, recurrent neural network, a modified deep neural network, and an AutoKeras generated model. Classification performance post class-balancing and various feature selection techniques show marked improvement over classification prior to feature selection. The best multiclass classification was found to be by a deep neural network post SMOTE and random undersampling, and feature selection using mRMR and recursive feature elimination, with a Cohen-Kappa score of 0.303 and a classification accuracy of 53.1%. For binary classification into early and late-stage cancer, the best performance is obtained by a modified deep neural network (DNN) post SMOTE and random undersampling, and feature selection using mRMR and recursive feature elimination, with an accuracy of 81.0% and a Cohen-Kappa score (CKS) of 0.280. This pipeline also showed improved multiclass classification performance on neuroblastoma cancer data, with a best area under the receiver operating characteristic (auROC) curve score of 0.872, as compared to 0.71 obtained in previous work, an improvement of 22.81%. The results and analysis reveal that feature selection techniques play a vital role in gene-expression data-based classification, and the proposed hybrid feature selection pipeline improves classification performance. Multi-class classification is possible using deep learning models, though further improvement particularly in late-stage classification is necessary and should be explored further.

Self-mixing interferometry (SMI) is superior to other laser interferometry methods due to its simplicity and compactness. However, SMI signals are often complex and difficult to process due to interference in the form of variations in the effective reflectivity of the target, noisy signals, complex signal shapes, and other dependencies. Deep neural networks have been a very popular area of research in computer artificial intelligence in recent years, allowing more implicit features to be uncovered than traditional shallow machine learning. It has been shown that convolutional and back-propagation neural networks can be used for SMI signal processing. There are also studies that have used machine learning genetic algorithms for absolute distance measurement. Based on the above, this study used convolutional neural networks to form a deep neural network for absolute distance measurement based on SMI technology. We first trained the deep convolutional neural network at different feedback strengths. The results of the Convolutional Neural Network (CNN) model showed a coefficient of determination of 0.9987. which is consistent with the required model. The trained network was then used to estimate absolute distances with and without the addition of noise. The comparison proves that the proposed method is noise-proof and has high adaptability for measurements under different conditions.

Pulse diagnosis has been a requisite facet in traditional Chinese medicine as well as in western medicine, yet the prognosis of lung cancer hinged on wrist pulse analysis entails the quotidian approaches. In spite of diagnosing the lung cancer, in traditional methods, the identification stratagem is divaricated into assorted steps: analysis of signals procured, synthetic extraction and selection of features, and subsequently the classification. However, the vague and mundane feature selection and signal analysis steers to the inadequate classification accuracy due to intrinsic deficiencies. In this study, we have proposed a novel deep convolutional neural network (DCNN) based approach to discern the lung cancer against the acquired wrist pulse signals. In order to ensnare the features, vanquishing the overfitting, a 1-dimensional 15-layers DCNN model is devised hinged on 1-D convolutional, batch normalization, and pooling layers. Considering the instinctive feature extraction, from the experimental data comprised of 45,969 samples of 16 lung cancer and 20 healthy individuals, assorted units are heaped in the lodged DCNN. The experimental comparison with the state-of-art deep neural networks (DNNs) and conventional methods evinced that our lodged approach conquer the deficiencies of conventional signal processing and manual feature selection approaches. Finally, the results, with the validation precision of 97.67%, outperform the recent existing approach for lung cancer recognition.

Automated image classification is an essential task of the computer vision field. The tagging of images into a set of predefined groups is referred to as image classification. The implementation of computer vision to automate image classification would be beneficial because manual image evaluation and identification can be time-consuming, particularly when there are many images of different classes. Deep learning approaches are proven to overperform existing machine learning techniques in many fields in recent years, and computer vision is one of the most notable examples. The very deep neural network (VDCNN) is a powerful deep learning model for image classification, and this paper examines it briefly using MNIST handwritten digit dataset. This dataset is used to prove the efficacy of very deep neural networks over other deep learning models. The proposed study aims to comprehend the very deep neural network architecture used to accomplish a handwritten digit recognition task. The feasibility of the proposed model is evaluated using mean accuracy, validation accuracy, and standard deviation. The study results of the very deep neural network model are compared to a convolutional neural network and convolutional neural network with batch normalization. According to the results of the comparison study, very deep neural networks achieve high accuracy of 99.1% for a handwritten dataset. The outcome of the proposed work is used to interpret how well a very deep neural network performs when compared to the other two models of deep neural networks. This proposed architecture may be used to automate the classification of handwritten digits dataset.

Video hyperlinking represents a classical example of multimodal problems. Common approaches to such problems are early fusion of the initial modalities and crossmodal translation from one modality to the other. Recently, deep neural networks, especially deep autoencoders, have proven promising both for crossmodal translation and for early fusion via multimodal embedding. A particular architecture, bidirectional symmetrical deep neural networks, have been proven to yield improved multimodal embeddings over classical autoencoders, while also being able to perform crossmodal translation. In this work, we focus firstly at evaluating good single-modal continuous representations both for textual and for visual information. Word2Vec and paragraph vectors are evaluated for representing collections of words, such as parts of automatic transcripts and multiple visual concepts, while different deep convolutional neural networks are evaluated for directly embedding visual information, avoiding the creation of visual concepts. Secondly, we evaluate methods for multimodal fusion and crossmodal translation, with different single-modal pairs, in the task of video hyperlinking. Bidirectional (symmetrical) deep neural networks were shown to successfully tackle downsides of multimodal autoencoders and yield a superior multimodal representation. In this work, we extensively tests them in different settings, with different single-modal representations, within the context of video-hyperlinking. Our novel bidirectional symmetrical deep neural networks are compared to classical autoencoders and are shown to yield significantly improved multimodal embeddings that significantly (alpha=0.0001) outperform multimodal embeddings obtained by deep autoencoders with an absolute improvement in precision at 10 of 14.1% when embedding visual concepts and automatic transcripts and an absolute improvement of 4.3% when embedding automatic transcripts with features obtained with very deep convolutional neural networks, yielding 80% of precision at 10.

Deep neural networks such as convolutional neural networks (CNNs) have achieved a great success in a broad range of fields. Spiking neural networks (SNNs) are designed as a solution for realizing ultra-low power consumption using spikebased neuromorphic hardware. To enable the mapping between conventional artificial neural networks (ANNs) and spike-based neuromorphic hardware, direct conversion from conventional ANNs into SNNs has recently been proposed. However, performance loss is hard to avoid after conversion. To reduce the loss, we analyze the encoding methods of SNNs and the optimization methods for converting. We use the rate coding and approximate the output of an activation function of CNNs by the number of spikes produced by a neuron within a given time window in SNNs. We propose a method for generating fixed uniform spike train whose number of spikes is as exact as we expect, and present an optimization method to reduce the loss by rescaling the threshold of each layer in SNNs. For evaluation, we train three different CNNs with MNIST and SVHN datasets separately and convert all of them into SNNs. The networks achieve a max accuracy of 99.17% on MNIST and of 93.36% on additional training dataset of SVHN. The results show the proposed fixed and uniform spike train not only outperforms the Poisson distributed spike train but also costs less time to generate. Our threshold rescaling method greatly improves the performance of SNNs.

Maxout neurons for deep convolutional and LSTM neural networks in speech recognition

Land cover and its dynamic information is the basis for characterizing surface conditions, supporting land resource management and optimization, and assessing the impacts of climate change and human activities. In land cover information extraction, the traditional convolutional neural network (CNN) method has several problems, such as the inability to be applied to multispectral and hyperspectral satellite imagery, the weak generalization ability of the model and the difficulty of automating the construction of a training database. To solve these problems, this study proposes a new type of deep convolutional neural network based on Landsat-8 Operational Land Imager (OLI) imagery. The network integrates cascaded cross-channel parametric pooling and average pooling layer, applies a hierarchical sampling strategy to realize the automatic construction of the training dataset, determines the technical scheme of model-related parameters, and finally performs the automatic classification of remote sensing images. This study used the new type of deep convolutional neural network to extract land cover information from Qinhuangdao City, Hebei Province, and compared the experimental results with those obtained by traditional methods. The results show that: (1) The proposed deep convolutional neural network (DCNN) model can automatically construct the training dataset and classify images. This model performs the classification of multispectral and hyperspectral satellite images using deep neural networks, which improves the generalization ability of the model and simplifies the application of the model. (2) The proposed DCNN model provides the best classification results in the Qinhuangdao area. The overall accuracy of the land cover data obtained is 82.0%, and the kappa coefficient is 0.76. The overall accuracy is improved by 5% and 14% compared to the support vector machine method and the maximum likelihood classification method, respectively.

Deep Convolutional Neural Networks for Large-scale Speech Tasks

Experimental validation of saliency maps for understanding deep neural networks for weld penetration prediction

Customer turnover prediction can assist enterprises in identifying potential lost customers early and formulating marketing strategies to retain them. This paper used telecom enterprise A as an illustrative example for customer turnover prediction. A balanced dataset was obtained through the synthetic minority oversampling technique (SMOTE) algorithm. Feature selection was conducted using the IV value. Additionally, the Inception v1 structure was optimized based on a deep neural network to design a deep convolutional neural network (CNN). Experiments were performed on the dataset of telecom enterprise A and the customer turnover datasets from Kaggle. On the Kaggle datasets, the deep CNN demonstrated superior classification performance compared to conventional approaches such as random forest (RF) and XGBoost. It exhibited a higher recall rate, score, and area under the curve (AUC) value. The dataset of telecom enterprise A enhanced the prediction effectiveness of the deep CNN after processing by the SMOTE algorithm, and a recall rate of 0.97, a score of 0.98, and an AUC value of 0.98 were achieved. These results show the reliability of the deep CNN for customer turnover prediction and its practical applicability.

Deep Neural Networks (DNNs) have been recently in the focus of interest owing to their high-quality results in various application domains of big data analytics. The lack of end-to-end toolchains that can automatically optimize and translate a DNN algorithm, usually implemented in high-level languages, on FPGA-based platform hinders software developers to exploit such platforms. A few available toolchains, namely Xilinx DPU, have been optimized for computational expensive applications, e.g., real-time image and video processing, and therefore they introduce large performance overhead on lightweight applications, e.g., sensor-driven decision analytics. In this paper, we introduce the FLight framework to fully automatize the acceleration of lightweight DNN algorithms on FPGA-based embedded platforms. The framework takes a trained model in TensorFlow/Keras as input and generates an optimized synthesizable C++ version and maps it on the target platform using HLS tools. FLight is an easy-to-use framework and does not require deep knowledge of embedded system design since it automatically performs all the required mapping steps. FLight supports the acceleration of various deep learning algorithms, e.g., Feed-Forward Neural networks (FFNNs), Convolutional Neural Networks (CNNs), and sequential models like Recurrent Neural Networks (RNNs). We evaluated the applicability of FLight with various DNN models on both academic and industrial datasets. As a case study, we exploited the FLight framework for wind turbine condition monitoring using an industrial dataset provided by Weidmüller Monitoring Systems GmbH. The experimental results revealed the 40 times speedup compared to the Xilinx DPU framework.