A hybrid intelligent technique for recognition of control chart patterns

Application of the PSO–SVM model for recognition of control chart patterns

Accurate control chart patterns recognition (CCPR) plays an essential role in the implementation of control charts. However, it is a challenging problem since nonrandom control chart patterns (CCPs) are normally distorted by “common process variations”. In this paper, a novel method of CCPR by integrating fuzzy support vector machine (SVM) with hybrid kernel function and genetic algorithm (GA) is proposed. Firstly, two shape features and two statistical features that do not depend on the distribution parameters and number of samples are presented to explicitly describe the characteristics of CCPs. Then, a novel multiclass method based on fuzzy SVM with a hybrid kernel function is proposed. In this method, the influence of outliers on classification accuracy of SVM-based classifiers is weakened by assigning a degree of membership for every training sample. Meanwhile, a hybrid kernel function combining Gaussian kernel and polynomial kernel is adopted to further enhance the generalization ability of the classifiers. To solve the issue of features selection and parameters optimization, GA is used to simultaneously optimize the input features subsets and parameters of fuzzy SVM-based classifier. Finally, several simulation experiments and a real example are addressed to validate the feasibility and effectiveness of the proposed methodology. And the results of simulation experiments demonstrate that it can achieve excellent performance for CCPR and outperforms other approaches, such as learning vector quantization network, multi-layer perceptron network, probability neural network, fuzzy clustering and SVM, in term of recognition accuracy. The results of the practical cases manifest that the proposed method has application potential for solving the problem of control chart interpretation in real-world.

Recognition of abnormal patterns in control charts provides clues to reveal potential quality problems in the manufacturing processes. One potentially popular approach for recognizing different control chart patterns (CCPs) is to develop heuristics based on various shape features of the patterns. The advantage of this approach is that the users can easily understand how a particular pattern is identified. However, consistency in the recognition performance is found to be considerably poor in the heuristics approach. Since shape features represent the main characteristics of the patterns in a condensed form, artificial neural network (ANN) with features extracted from the process data as input vector representation can facilitate efficient pattern recognition with a smaller network size. In this paper, a set of seven shape features is selected, whose magnitudes are independent of the process mean and standard deviation under a special representation of the sampling interval in the control chart plot. Based on these features, the CCPs are recognized using a multilayered perceptron neural network trained by back-propagation algorithm. The recognizer can recognize all the eight commonly observed CCPs. Extensive performance evaluation of this recognizer is carried out using simulated pattern data. Numerical results indicate that the developed ANN recognizer can perform well in real time process control applications with respect to both recognition accuracy and consistency.

To accomplish the effective classifier and secure the accurate classification capabilities of black plastics, a comprehensive design methodology of fuzzy radial basis function neural networks is developed with the aid of principal component analysis and particle swarm optimization. Plastics recycling is the competitive method which can deal with the shortage of natural resource. To recycle and reuse the waste plastics, this study is given as the key issue to identify and classify waste plastics by resin type such as polyethylene terephthalate, polypropylene, polystyrene, etc. To complement the weak points of recognition and classification of the near-infrared radiation equipment, Raman spectroscopy is used to obtain qualitative as well as quantitative analysis of black plastics. To improve the identification performance of black plastics, an intelligent computing algorithm such as fuzzy radial basis function neural networks classifier and preprocessing algorithm as principal component analysis are applied to analyze and classify the obtained spectrum of black plastics. Finally, to optimize the structure as well as parameters of fuzzy radial basis function neural networks, particle swarm optimization technique is used. The obtained experimental results show that the proposed network architecture exhibits high classification capabilities in practical applications.

Fast control chart pattern recognition aids in instantaneous detection of abnormal functioning of a system. In this paper, we present a parallel algorithm for fast control chart pattern recognition. It addresses three major issues of control chart pattern recognition: (i) transparency (ii) accuracy and (iii) fast detection of abnormal patterns. The algorithm uses novel shape features extracted from a control chart pattern (CCP) instead of the unprocessed CCP data or its statistical properties. These shape features can be extracted in parallel. A parallel algorithm that is based on distributed and synergistic neural network structure for recognition of CCPs is described. The paper presents the results of analyzing several hundred control chart patterns and gives a comparison with those reported in previous work.

Quality control for small samples is growing in popularity due to its broad application prospects and high research value, and one of the commonly used methods for quality control nowadays is control chart pattern recognition (CCPR). Deep learning is an effective way for CCPR, but its recognition rate of control chart patterns for small samples is low and the quality control capability is limited. Therefore, to solve these problems, this paper first proposes a Perceptron-Convolutional Siamese Neural Network (PCSNN) model to improve the pattern recognition rate of small sample control chart. And then, three pattern recognition models (Convolutional Neural Network, Perceptron-Convolutional Neural Network, and PCSNN) are compared to verify the validity of the proposed model. After that, simulation experiments are conducted, and results show that the proposed PCSNN model has a high recognition rate of control chart patterns for small samples and performs well when the sample quality parameters change within a certain range. Finally, the proposed model is applied to the manufacturing process of automatic boring of enterprise gearbox shell, and its validity is verified.

Control Chart Pattern Recognition (CCPR) plays a crucial role in maintaining product quality. This paper presents some recognition models that utilizes a custom convolutional network alongside pretrained VGG19, MobileNet, and LeNet networks to identify Control Chart Patterns (CCP) for autocorrelated processes. The suggested architectures autonomously extract features from input data, in contrast to conventional methods that necessitate manual feature engineering. This study addresses the challenge of training deep networks with insufficient training data by employing transfer learning to refine a VGG19, MobileNet, and LeNet model, for a new CCPR task. The comparison of the performance between pre-trained networks and the extended convolutional network as a 2D CNN, which does not utilize transfer learning, indicates that pre-trained networks attain superior recognition accuracies with a smaller training data. On the other hand, the pretrained VGG19 demonstrates superior performance when compared to 1D CNN and conventional machine learning techniques, highlighting the advantages of utilizing transfer learning. Additionally, the utilization of pre-trained models addresses the challenge of the intricate design involved in the feature extraction component of deep networks that possess numerous hyperparameters. The suggested method has demonstrated significant potential for identifying CCPs, as evidenced by comparative experimental findings and a real-world case study.

A control chart pattern recognition system using a statistical correlation coefficient method

Control charts have been widely utilized for monitoring process variation in numerous applications. Abnormal patterns exhibited by control charts imply certain potentially assignable causes that may deteriorate the process performance. Most of the previous studies are concerned with the recognition of single abnormal control chart patterns (CCPs). This paper introduces an intelligent hybrid model for recognizing the mixture CCPs that includes three main aspects: feature extraction, classifier, and parameters optimization. In the feature extraction, statistical and shape features of observation data are used in the data input to get the effective data for the classifier. A multiclass support vector machine (MSVM) applies for recognizing the mixture CCPs. Finally, genetic algorithm (GA) is utilized to optimize the MSVM classifier by searching the best values of the parameters of MSVM and kernel function. The performance of the hybrid approach is evaluated by simulation experiments, and simulation results demonstrate that the proposed approach is able to effectively recognize mixture CCPs.

In this paper, control chart pattern recognition using artificial neural networks is presented. An important motivation of this research is the growing interest in intelligent manufacturing systems, specifically in the area of Statistical Process Control (SPC). On-line automated process analysis is an important area of research since it allows the interfacing of process control with Computer Integrated Manufacturing (CIM) techniques. A back propagation artificial neural network is used to model X-bar quality control charts and identify process instability situations as specified by the Western Electric Statistical Quality Control handbook. Results indicate that the performance of the back propagation neural network is very accurate in identifying these control chart patterns. This work is significant in that the neural network output can serve as a link to process parameters in a closed-loop control system. In this way, adjustments to the process can be made on-line and quality problems averted.

This paper presents a supervised competitive learning network approach, called a fuzzy-soft learning vector quantization, for control chart pattern recognition. Unnatural patterns in control charts mean that there are some unnatural causes for variations in statistical process control (SPC). Hence, control chart pattern recognition becomes more important in SPC. In order to detect effectively the patterns for the six main types of control charts, Pham and Oztemel described a class of pattern recognizers for control charts based on the learning vector quantization (LVQ) such as LVQ, LVQ2 and LVQ-X etc. In this paper, we propose a new supervised LVQ for control charts based on a fuzzy-soft competitive learning network. The proposed fuzzy-soft LVQ (FS-LVQ) uses a fuzzy relaxation technique and simultaneously updates all neurons. It can increase correct recognition accuracy and also decrease the learning time. Comparisons between LVQ, LVQ-X and FS-LVQ are made. Numerical results show that the proposed FS-LVQ has better accuracy and less learning epochs for all neurons being completely learned than LVQ and LVQ-X. Overall, FS-LVQ is highly recommended to be used as a control chart pattern recognizer.

Unnatural control chart patterns (CCPs) are associated with a particular set of assignable causes for process variation. Hence, effectively recognizing CCPs can substantially narrow down the set of possible causes to be examined, and accelerate the diagnostic search. Recently, machine-learning techniques, especially the artificial neural network (ANN), have been widely used as an effective tool for CCP recognition (CCPR) tasks. Most ANN applications in CCPR have been using static supervised ANNs, such as back propagation networks (BPNs) and learning vector quantization (LVQ) networks. The false recognition problem (i.e. the patterns are misclassified) commonly encountered for these ANN-based CCPR models is mainly due to the fact that the static ANNs cannot appropriately deal with dynamic patterns, such as CCPs. In this research, a dynamic training algorithm is designed to provide an LVQ network-based CCPR model the capability to on-line recognize the dynamic CCPs that vary over time. The numerical results using simulation show that the dynamically trained LVQ network-based model proposed in this research performs much better than other ANN-based models reported in literature with respective to recognition accuracy and speed. Although this research considers the specific application of a real-time CCPR model based on an LVQ network, the proposed dynamic training algorithm could be applied to CCPR systems based on other ANN architectures in general.

An offline optimization approach based on energy storage management response in a microgrid was not fast and not reliable enough to control and adjust the system efficiently after the loss of the utility grid. Thus, it causes system inefficiency and collapse in the presence of violent changes of loads or outage of distributed generations. To solve such a problem, more real-time management is needed. Any changes in loads/generations should be compensated successfully by a battery energy storage system (BESS) in a short period of time. This paper presents a new method for the intelligent online management of both active and reactive power of a BESS based on a radial basis function neural network (RBFNN) incorporating particle swarm optimization (PSO) to prevent the stand-alone microgrid from instability and system collapse. BESS is centrally controlled by a controller developed by the proposed RBFNN. PSO is used to determine the optimized active and reactive power at every load/generation changing situation to monitor the effect of system frequency, voltage, and reference power regulation. These optimized power data are then employed as target data for the RBFNN generalization and training process. To enable the online updating of the operating parameters, the proposed RBFNN is implemented in the management process. With an appropriate RBFNN training, the optimum active and reactive power can directly be obtained without the necessity of performing the PSO optimization process at any change of load/generation. The results show that the predictive results of the proposed RBFNN model only slightly differed from the target results based on PSO and have a minimum statistical error compared to the predictive results based on the multilayer perceptron neural network (MLPNN) model. The proposed RBFNN is suitable for the online estimation of the active and reactive power of BESS and can be used for real-time energy storage management as an online controller.

The aim of this paper is twofold. First, we present a thorough experimental study to show the superiority of the generalization capability of the support vector machine (SVM) approach in the automatic classification of electrocardiogram (ECG) beats. Second, we propose a novel classification system based on particle swarm optimization (PSO) to improve the generalization performance of the SVM classifier. For this purpose, we have optimized the SVM classifier design by searching for the best value of the parameters that tune its discriminant function, and upstream by looking for the best subset of features that feed the classifier. The experiments were conducted on the basis of ECG data from the Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) arrhythmia database to classify five kinds of abnormal waveforms and normal beats. In particular, they were organized so as to test the sensitivity of the SVM classifier and that of two reference classifiers used for comparison, i.e., the k-nearest neighbor (kNN) classifier and the radial basis function (RBF) neural network classifier, with respect to the curse of dimensionality and the number of available training beats. The obtained results clearly confirm the superiority of the SVM approach as compared to traditional classifiers, and suggest that further substantial improvements in terms of classification accuracy can be achieved by the proposed PSO-SVM classification system. On an average, over three experiments making use of a different total number of training beats (250, 500, and 750, respectively), the PSO-SVM yielded an overall accuracy of 89.72% on 40438 test beats selected from 20 patient records against 85.98%, 83.70%, and 82.34% for the SVM, the kNN, and the RBF classifiers, respectively.

Quality Management (QM) is one of the key supply chain processes. Previous studies have shown that QM provides a major contribution to the supply chain performance. One area that is essential in the managing of quality is Statistical Process Control (SPC). Control chart is one of the quality tools used in SPC for achieving process stability, controlling process and improving process by the reduction of process variations. Numerous techniques have been used to identify the presence of unnatural control chart patterns (CCPs); however, these approaches mostly focus on recognizing basic CCPs from a single type of unnatural assignable cause. In the situation where a mixture of CCPs exist, where more than one type of unnatural variation exist at the same time within the manufacturing process, this mixture of CCPs might be incorrectly classified. The Independent Component Analysis (ICA) technique has been applied recently to separate independent components from a mixture of two basic CCPs. This technique tries to maximize the statistical independence of the mixing components and uses kurtosis or a fourth-cumulant as a measure of non-Gaussianity, which implies statistical independence. Therefore, the CCP mixture separation performance and accuracy of using ICA greatly depend on kurtosis values and distributions of the basic CCPs. This paper will investigate the impact of the kurtosis values and distributions of basic CCPs on the effectiveness of the ICA-based approach in terms of being able to separate basic CCPs from a mixture, when using neural network as the pattern classifier.