From data to fault diagnosis: Using predictive maintenance image transformation and nature-inspired optimization techniques for fault classification

Introduction: This paper presents a novel approach for classifying different types of steel rods using a combination of pre-trained convolutional neural networks (CNNs) and fuzzy logic systems. We utilize VGG16, ResNet50, and InceptionV3 models to extract features from grayscale images of steel rods, which are then classified using Support Vector Machines (SVM). Furthermore, we incorporate a fuzzy logic system to improve the final classification accuracy by combining the individual accuracies of each CNN model. Experimental results demonstrate the effectiveness of our approach in achieving high classification accuracy compared to traditional methods. Objectives: This research presents a novel multi-model approach for steel rod classification utilizing three distinct fuzzy logic systems: Fuzzy Recurrent Neural Network (RNN), Fuzzy Convolutional Neural Network (CNN), and Fuzzy Neural Network. The proposed system addresses the critical challenge of accurate defect detection and classification in steel manufacturing processes. By combining these complementary approaches, we achieve enhanced feature extraction capabilities and improved classification accuracy. Experimental results demonstrate that our multi-model system achieves a classification accuracy of 97.8%, surpassing single-model approaches by an average of 8.2%. The system successfully identifies surface defects, structural anomalies, and dimensional variations with high precision, making it suitable for real-time industrial applications. Methods: This paper introduces a novel approach for the feature extraction and classification of steel rods by integrating multiple models and utilizing fuzzy logic systems. The methodology leverages pre-trained convolutional neural networks (CNNs) for extracting comprehensive feature representations from steel rod images. These extracted features are then combined and integrated using fuzzy logic to enhance classification accuracy and reliability. By addressing the limitations of traditional manual inspection methods and single-model approaches, this integrated multi-model system offers a robust solution for real-time industrial implementation. The proposed system aims to improve the efficiency and effectiveness of quality control processes in steel rod manufacturing, ensuring consistent and accurate classification even under varying conditions and complexities. This innovative approach paves the way for more advanced and adaptable automated inspection systems in the industry. Results: The paper aims to develop an integrated multi-model system that combines three distinct fuzzy logic approaches to enhance feature extraction capabilities through complementary methodologies. By improving the classification accuracy and reliability, the system addresses the limitations of existing methods. The goal is to create a robust and adaptable system that is suitable for real-time industrial implementation for steel rod analysis and classification. This comprehensive approach leverages the strengths of multiple models and fuzzy logic techniques, ensuring accurate and efficient classification processes, even under complex and varying conditions. The proposed multi model system is designed to meet the stringent quality control requirements of industrial applications, ultimately improving productivity and product quality through reliable automated inspection and classification for steel rod with accuracy of 97.80%, precision of 97.30% and recall 97.50%. Conclusions: This paper presents a novel approach for the classification of steel rods using a combination of pre-trained CNN models and fuzzy logic systems. The experimental results demonstrate the effectiveness of our method in achieving high classification accuracy. This research demonstrates the effectiveness of a multi-model fuzzy logic approach for steel rod classification. The system achieves significant improvements over single-model approaches while maintaining real-time processing capabilities. Our approach provides a foundation for further research and development in automated industrial image classification.

In this chapter, one gives an introduction to different kinds of particle swarm optimization (PSO) algorithms. One also introduces artificial neural networks (ANNs), support vector machines (SVMs) and evolutionary computing to show how PSO may be used to determine optimal parameters using an ANN or SVM regime, for classification of DNA strings. In addition, PSO is used in the design of an SVM-based clustering algorithm. Ant colony optimization (ACO) algorithms are also introduced in the chapter. Using ACO algorithms has been of great success to solve many discrete optimization and non-deterministic polynomial (NP)-hard problems, for instance the travelling salesman problem. The behaviour of ants is also used, for instance, to design an algorithm for data clustering. We want to develop later a similar application based on this clustering algorithm and compare it with the SVM one using PSO.

Enhancing CNN-based network intrusion detection through hyperparameter optimization

I335 the training of Support Vector Machine (SVM) classification model, some problems such as over-fitting, under-fitting, slow training speed and prediction affected by penalty and kernel function parameters are exposed. A fault classification method of rolling bearing based on Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) and Grey Wolf Optimization (GWO) -SVM is proposed. Firstly, the acquire signals are adaptively decomposed into a plurality of Intrinsic Mode Function(IMF) component by CEEMDAN, and the energy entropy of each IMF component is extracted to form a set of high dimensional feature vector. Then, the processed feature vectors are introduced into the diagnosis network of GWO-SVM algorithm to build a fault classification model of motor rolling bearing. The classification results show that the CEEMDAN and GWO-SVM fault classification network of motor rolling bearing has higher accuracy and shorter diagnosis time than Particle Swarm Optimization (PSO) -SVM and Cross Validation (CV) -SVM.

Deep learning approaches for COVID-19 detection based on chest X-ray images

PurposeThe purpose of this paper is to propose a predictive maintenance (PdM) system for hybrid degradation processes with continuous degradation and sudden damage to improve maintenance effectiveness.Design/methodology/approachThe PdM system updates the degradation model using partial condition monitoring information based on degradation type judgment. In addition, an extended multi-step-ahead updating stopping condition is adopted for performance enhancement of the PdM system.FindingsAn extensive numerical investigation compares the performance of the PdM system with the corresponding preventive maintenance (PM) policy. By carefully choosing the updating stopping condition, the PdM policy performs better than the corresponding PM policy.Research limitations/implicationsThe proposed PdM system is applicable to single-unit systems. And the continuous degradation process should be well modeled by the stochastic linear degradation model (Gebraeel et al., 2009).Originality/valueIn literature, there are abundant studies on PdM policies for continuous degradation processes. However, research on hybrid degradation processes still focuses on condition-based maintenance policy and a PdM policy for a hybrid degradation process is still unreported. In this paper, a PdM system for hybrid degradation processes with continuous degradation and sudden damage is proposed. The PdM system decides PM schedules by fully utilizing the condition monitoring data of each specific product, and can hopefully improve maintenance effectiveness.

The Odia language is one of the many regional languages spoken in India. It is the official language of Odisha, a State in eastern India. The Odia language carries a 1500-year-old history and worldwide is spoken by more than 50 million people. The Odia digits are complex due to the presence of many curves in each character. Handwritten scripts are even more complex due to free-style writing. However, the development of an innovative machine learning model is essential because Odia scripts consist of a huge number of historical documents of more than 1000 years old. A robust automation method will help in converting historical documents into digital form and will help to preserve the documents. This will solve a big problem in society. This work experiments with handwritten Odia numerals by implementing two different classifiers. The first one is the implementation of a Convolutional Neural Network (CNN) and the second experiment implements a Support Vector Machine (SVM). Finally, results from both experiments have been compared. The dataset has been generated through software by writing the digits on MS Paint. Both CNN and SVM models have been implemented through Python programming to recognize the inputs into a particular class. Both training and testing of the models have been done using this dataset. The accuracy from the CNN Model is obtained to be 94.999% which is ≈95% and for SVM, the model accuracy is 86%. Comparing both results, it is concluded that the CNN model is comparatively better than the SVM classifier in the case of the proposed work.

E-commerce industries nowadays implement the latest AI and ML techniques to improve their own performance and prediction accuracy. This helps to gain a huge profit from the online market. Ant Colony Optimization, Genetic algorithm, Particle Swarm Optimization, Neural Network, and Grey Wolf Optimization (GWO) help many E-commerce industries for upgradation of their predictive performance. These algorithms provide optimum results in various applications, such as stock price prediction, prediction of drug–target interaction, and user ratings of similar products in E-commerce sites. In this study, customer reviews play an important role in prediction analysis. People show much interest in buying a lot of services and products suggested by other customers which ultimately increases the net profit. In this work, a Convolution Neural Network (CNN) is proposed which is useful to optimize the prediction accuracy of an e-commerce Web site. This method shows that CNN is used to optimize hyperparameters of GWO algorithm using an appropriate coding scheme. Accurate model results are verified by comparing them to PSO results whose hyperparameters have been optimized by CNN in Amazon's customer review dataset. Here, experimental outcome proves that this proposed system using the GWO algorithm achieves superior execution in terms of accuracy, precision, recovery, etc., in prediction analysis when compared to the existing systems.KeywordsPrediction analysisE-commerceMachine Learning (ML)Grey wolf optimizationParticle swarm optimization and CNN

Purpose: The aim of the article is to develop an algorithm for classifying cracks in the analyzed images using modern methods of deep machine learning and transfer learning based on pretrained convolutional neural network - Inception-ResNet-v2. Design/Methodology/Approach: Transfer learning based on the pretrained convolutional neural network was used to categorize the images. The fully conected layer of the Inception-ResNet-v2 network has been modified. The last layer was trained using a two-class (binary) linear SVM (Support Vector Machine). In total, 20,000 training cases (images) were used to train the fully connected layer within transfer learning process. The research analyzed the possibility of using the deep neural networks for quick and fully automatic identification of cracks / defects on the surface of analyzed parts. Findings: The results indicate that pretrained convolutional neural network using SVM to train a fully connected layer is a very effective solution for visual crack / fault detection. In the analyzed model, a positive classification was obtained at the level of 99.89%. Practical Implications: The model presented in the article can be used in quality control carried out by process monitoring. An effective model for identifying defective parts can be used in both logistics and production processes. Originality/Value: A novelty is the use of a freely available, deep neural network trained to classify 1000 categories of various images for binary categorization of faults (cracks). The algorithm was adjusted by replacing the primary, 1000-output fully connected layer in the Inception-ResNet-v2 network with a binary layer (2 categories). The fully connected layer has been trained using the classification version of the popular SVM learner, but thanks to the combination of this layer with the sophisticated fearure extraction ability of the pre-trained Inception-ResNet-v2 deep network, the resulting predictive model enables the classification of defects with a very high level of accuracy.

Emotions expressed by humans can be identified from facial expressions, speech signals, or physiological signals. Among them, the use of physiological signals for emotion classification is a notable emerging area of research. In emotion recognition, a person’s electrocardiogram (ECG) and galvanic skin response (GSR) signals cannot be manipulated, unlike facial and voice signals. Moreover, wearables such as smartwatches and wristbands enable the detection of emotions in people’s naturalistic environment. During the COVID-19 pandemic, it was necessary to detect people’s emotions in order to ensure that appropriate actions were taken according to the prevailing situation and achieve societal balance. Experimentally, the duration of the emotion stimulus period and the social and non-social contexts of participants influence the emotion classification process. Hence, classification of emotions when participants are exposed to the elicitation process for a longer duration and taking into consideration the social context needs to be explored. This work explores the classification of emotions using five pretrained convolutional neural network (CNN) models: MobileNet, NASNetMobile, DenseNet 201, InceptionResnetV2, and EfficientNetB7. The continuous wavelet transform (CWT) coefficients were detected from ECG and GSR recordings from the AMIGOS database with suitable filtering. Scalograms of the sum of frequency coefficients versus time were obtained and converted into images. Emotions were classified using the pre-trained CNN models. The valence and arousal emotion classification accuracy obtained using ECG and GSR data were, respectively, 91.27% and 91.45% using the InceptionResnetV2 CNN classifier and 99.19% and 98.39% using the MobileNet CNN classifier. Other studies have not explored the use of scalograms to represent ECG and GSR CWT features for emotion classification using deep learning models. Additionally, this study provides a novel classification of emotions built on individual and group settings using ECG data. When the participants watched long-duration emotion elicitation videos individually and in groups, the accuracy was around 99.8%. MobileNet had the highest accuracy and shortest execution time. These subject-independent classification methods enable emotion classification independent of varying human behavior.

Deep learning theory demonstrates its great power in the complicated data processing field. As a prevalent deep learning technology, convolutional neural network (CNN) has achieved some successful applications in the field of fault detection and classification in the complicated industrial systems because of its strong nonlinear feature extraction capability. However, the basic CNN views all the features equally and can not highlight these features which play a more important role in the fault classification procedure. To deal with this problem, this paper proposes an improved CNN model, called multi-head attention CNN (MACNN), to distinguish the importance of different features for better fault classification performance. In the MACNN framework, the raw training data are firstly analyzed by the multiple convolutional layers for feature extraction. Then, the features obtained by the convolution layers are used as the input of the multi-head attention (MA) layers. The introduction of the MA mechanism can help exploit more meaningful information by emphasizing the important features. Lastly, the softmax classifier is utilized to classify the fault patterns. To test the method performance, one case study on the benchmark Tennessee Eastman industrial system is performed and the results show that MACNN gives the better fault classification results than the traditional feedforward neural network (FNN) and CNN models.

Metaheuristic approaches receive a great interest in the area of optimization, especially when exact methods are missing, or the cost is extremely high. Besides the possibility to report good solutions in reasonable time, metaheuristic techniques are widely applicable. There are diverse categories of techniques that differ in number of search agents (or solutions), solution representation, and movement mechanism in search space. Just mentioned ingredients are determined according to the motivation or inspiration philosophy behind the technique. Nature-inspired optimization category is very popular and has proven high efficiency in many problems. It contains famous subclasses like evolutionary algorithms, swarm intelligence, and single-based techniques. Famous and classical examples of each subclass are genetic algorithm, particle swarm, and ant colony optimization, and simulated annealing, respectively. Nature-inspired optimization family grows so fast, and many members have joined it recently, for example, emperor penguin colony (2019), seagull optimization algorithm (2019), sailfish optimizer (2019), pity beetle algorithm (2018), emperor penguin optimizer (2018), multi-objective artificial sheep algorithm (2018), salp swarm algorithm (2017), electromagnetic field optimization (2016), sine cosine algorithm (2016), moth-flame optimization (2015), grey wolf optimizer (2014), flower pollination algorithm (2012), bat algorithm (2010), cuckoo search algorithm (2009), firefly algorithm (2008), and many others. There are many proposed hybridization and cooperation methods between techniques to produce improved versions of original ones. Nature-inspired techniques have been used in many application areas like theoretical computer science, engineering and control, forecasting, medical field, finance, management, operation research, and others. Also, new scientific disciplines like renewable energy, robotics, and navigation are feasible areas to make use of nature-inspired techniques. This chapter sheds light on six so recently new techniques that belong to nature-inspired optimization class.

Artificial intelligence as a screening tool for eyelid lesions will be helpful for early diagnosis of eyelid malignancies and proper decision-making. This study aimed to evaluate the performance of a deep learning model in differentiating eyelid lesions using clinical eyelid photographs in comparison with human ophthalmologists. We included 4954 photographs from 928 patients in this retrospective cross-sectional study. Images were classified into three categories: malignant lesion, benign lesion, and no lesion. Two pre-trained convolutional neural network (CNN) models, DenseNet-161 and EfficientNetV2-M architectures, were fine-tuned to classify images into three or two (malignant versus benign) categories. For a ternary classification, the mean diagnostic accuracies of the CNNs were 82.1% and 83.0% using DenseNet-161 and EfficientNetV2-M, respectively, which were inferior to those of the nine clinicians (87.0–89.5%). For the binary classification, the mean accuracies were 87.5% and 92.5% using DenseNet-161 and EfficientNetV2-M models, which was similar to that of the clinicians (85.8–90.0%). The mean AUC of the two CNN models was 0.908 and 0.950, respectively. Gradient-weighted class activation map successfully highlighted the eyelid tumors on clinical photographs. Deep learning models showed a promising performance in discriminating malignant versus benign eyelid lesions on clinical photographs, reaching the level of human observers.

Images are important judicial materials. With the deepening of intelligent systems in the judicial area, image quality plays a vital role in the result of many judicial applications. This paper firstly introduces deep learning into judicial image quality assessment. Pre-trained convolutional neural network (CNN) models are fine-tuned and then used to extract image features. Based on the features extracted from CNN models, we convert them into specific numbers representing the quality. A preliminary experiment has been designed and conducted on three types of judicial images. The experimental results show that our approach can outperform the existing image processing technique. Images used as investigation materials are more distinctive than the other two types, and they need an independent model for analyzing.

A case study on computer-aided diagnosis of nonerosive reflux disease using deep learning techniques