Acoustical damage detection of wind turbine blade using the improved incremental support vector data description

As one classical anomaly detection technology, support vector data description (SVDD) has been successfully applied to nonlinear chemical process monitoring. However, the basic SVDD model cannot achieve a satisfactory fault detection performance in the complicated cases because of its intrinsic shallow learning structure. Motivated by the deep learning theory, one improved SVDD method, called ensemble deep SVDD (EDeSVDD), is proposed in order to monitor the process faults more effectively. In the proposed method, a deep support vector data description (DeSVDD) framework is firstly constructed by introducing the deep feature extraction procedure. Different to the traditional SVDD with only one feature extraction layer, DeSVDD is designed with multi-layer feature extraction structure and optimized by minimizing the data-enclosing hypersphere with the regularization of the deep network weights. Further considering the problem that DeSVDD monitoring performance is easily affected by the model structure and the initial weight parameters, an ensemble DeSVDD (EDeSVDD) is presented by applying the ensemble learning strategy based on Bayesian inference. A series of DeSVDD sub-models are generated at the parameter level and the structure level, respectively. These two levels of sub-models are integrated for a holistic monitoring model. To identify the cause variables for the detected faults, a fault isolation scheme is designed by applying the distance correlation coefficients to measure the nonlinear dependency between the original variables and the holistic monitoring index. The applications to the Tennessee Eastman process demonstrate that the proposed EDeSVDD model outperforms the traditional SVDD model and the DeSVDD model in terms of fault detection performance and can identify the fault cause variables effectively.

Anomaly detection using improved deep SVDD model with data structure preservation

Enhanced multiclass support vector data description model for fault diagnosis of gears

Monitoring of solid-state fermentation of wheat straw in a pilot scale using FT-NIR spectroscopy and support vector data description

Complex industrial processes are often non-linear and non-Gaussian, while the traditional principal component analysis (PCA) method assumes that the data are Gaussian and linear. In this paper, a novel process monitoring method based on maximum information coefficient-PCA (MIC-PCA) and support vector data description (SVDD) is proposed. First, the covariance matrix is replaced by the MIC matrix which can measure the non-linear correlation between the variables. Then the SVDD models are built in the principal component subspace (PCS) and the residual subspace (RS) to improve the monitoring of non-linear and non-Gaussian processes. Finally, the feasibility and effectiveness of the proposed method are validated by high-pressure and low-density polyethylene (LDPE) industrial process.

In the actual maintenance of manufacturing enterprises, abnormal changes in after-sale parts demand data often make the inventory strategies unreasonable. Due to the intermittent and small-scale characteristics of demand sequences, it is difficult to accurately identify the anomalies in such sequences using current anomaly detection algorithms. To solve this problem, this paper proposes an unsupervised anomaly detection method for intermittent time series. First, a new abnormal fluctuation similarity matrix is built by calculating the squared coefficient of variation and the maximum information coefficient from the macroscopic granularity. The abnormal fluctuation sequence can then be adaptively screened by using agglomerative hierarchical clustering. Second, the demand change feature and interval feature of the abnormal sequence are constructed and fed into the support vector data description model to perform hypersphere training. Then, the unsupervised abnormal point location detection is realized at the micro-granularity level from the abnormal sequence. Comparative experiments are carried out on the actual demand data of after-sale parts of two large manufacturing enterprises. The results show that, compared with the current representative anomaly detection methods, the proposed approach can effectively identify the abnormal fluctuation position in the intermittent sequence of small samples, and also obtain better detection results.

Feature extraction methods in the industrial process may affect the performance of process monitoring and fault assessment. In order to reduce the influence of model preference, a novel fault assessment method integrating global and local structure information is proposed by using the strategy of parallel extraction and weighted combination. First, kernel sparse locally linear embedding and kernel principal component analysis models are constructed to handle nonlinear system states and describe the local and global information in parallel. Second, the fault assessment indicators are obtained through support vector data description models. Then, a comprehensive fault assessment index is established by the weighted fusion method, which can keep the global and local neighbor information of the original sample space, and thus more feature information is included. Finally, the feasibility and effectiveness of the proposed assessment method are illustrated by the application in the simulation process of Tennessee Eastman Process, and the results show that the fusion of two basic models can bring a model with better generalization performance than a single model.

Detection and classification are two significant tasks for industrial fault diagnosis. However, conventional methods typically treat these tasks as separate and independent problems, and necessitate a retraining process when new fault samples or classes are collected. Therefore, an incremental support vector data description scheme using Gaussian kernel function is pro-posed for industrial process fault diagnosis in a unified frame-work. In this framework, the decision boundary is updated incrementally only based on the specific original support vectors and newly collected samples. An adaptive threshold and a restructured radius are proposed to promote accuracy in the fault detection. In the classification procedure, the hyperspheres for all known classes are constructed by decision tree. The new sample that does not belong to any known class is identified as an unknown class. Without a time-consuming retraining process, the proposed diagnosis method with the incremental learning capability can synchronously achieve the fault detection and classification task. Experimental results demonstrate the effectiveness and superiority in terms of diagnosis performance. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Note to Practitioners</i> —In practical industrial processes, new fault samples are collected and new fault classes emerge continually. Under such scenarios, fault diagnosis with incremental learning capability is becoming increasingly important. This work proposes a unified incremental framework for fault diagnosis based on support vector data description, which is able to achieve fault detection and classification synchronously. For fault detection, an adaptive threshold and a restructured radius are developed. For fault classification, hypersphere-shaped boundaries of all fault classes are given via the decision tree-based strategy. The proposed method is updated to include new fault samples and fault classes without dimensionality reduction or any distributional assumptions.

While detecting anomalies in hyperspectral imagery with support vector data description (SVDD), large numbers of operation was run because of the high dimension character of dataset and the complexity of background and the high miss rate was discovered because of the interfered background by interior anomalies. This paper used incremental support vector data description (ISVDD) method that samples are divided many sub-sample, and incremental study is designed to simplify the computation. On every sub-sample study, optimization is needed according of the support vectors obtained from above sub-sample and current sub-sample data. By the experiment on the HYMAP data, computation complexity of the algorithm decrease obviously and the computation speed increase highly under the similar detection effect compared with SVDD algorithm.

The SVDD (support vector data description) is one of the most well-known one-class support vector learning methods, in which one tries the strategy of utilizing balls defined on the feature space in order to distinguish a set of normal data from all other possible abnormal objects. The usual strategy of the SVDD depends on the process of finding the region for the normal-class training data with somewhat neglecting the distribution of the abnormal data, thus it may not work well if applied to the binary classification problems in which two classes have similar number of data. In this paper, we consider the problem of performing binary classification based on the SVDD techniques, and in order to overcome the possible drawback of the usual SVDD strategy focusing on the normal-class data only, we propose a new SVDD algorithm which is based on the use of two different SVDD balls for the positive and negative classes along with the SVDD projection and nearest neighbor rule. To investigate how the proposed method works, we compared the performance of the proposed method with SVC (support vector classifier) and conventional SVDD using several real datasets.

Support vector data description (SVDD) is an effective algorithm for nonlinear process monitoring. However, the conventional SVDD method can't deal with the incipient faults well, which has the small fault amplitude and is easy to be overlapped by industrial noises. Aiming at this problem, an improved SVDD, called probability related SVDD in local variable field (LVPSVDD), is proposed to detect the incipient faults in nonlinear processes. Firstly, the method divides process variables into several local variable fields by hierarchical clustering, and the SVDD model of each variable field is built. Then the sliding window technology is applied to the SVDD distance statistics, and the probability distribution change in the sliding window is measured by Kullback Leibler divergence (KLD). For each local variable field, the corresponding probability related monitoring statistic is developed to replace the original distance statistic. Finally, the global monitoring statistic is obtained by integrating the monitoring results of all local variable fields with Bayesian inference strategy. The method is illustrated with simulation on the continuous stirred tank reactor (CSTR).

Support vector data description (SVDD) is a well-known kernel-based one-class classification method that exhibits intrinsic regularization ability and robustness versus low numbers of high-dimensional samples. However, the efficiency of SVDD is limited by the cubic time complexity. To solve this problem, this paper first investigates the effect of selecting a reduced subset as the training set of SVDD, while guaranteeing the classification quality. To this end, a new heuristic sample condensed rule, termed HSC, is proposed to accurately identify those potential support vectors that characterize the classification boundary. HSC can consider both the spatial distribution and local density features of training samples, and focus on selecting samples very close to the decision boundary. When dealing with the local density computation, we introduce the idea of K nearest neighbors (KNN) to examine the density of samples in the neighbors of the object to be classified. Finally, a condensed but informative subset obtained by HSC will be applied to train SVDD breezily. The experimental results show that HSC-based SVDD sensibly improves over conventional SVDD, in terms of the size of the training set while guaranteeing a comparable classification quality. In addition, it is competitive over other improved SVDD classifiers in terms of training and testing time.

This article is concerned with the data-driven health state assessment task with unknown scenarios. Unknown scenarios are inaccessible in the stage of model training but they can appear unexpectedly during the running stage. A new problem called the within-class distribution mismatch is raised by assuming that unknown scenarios still belong to known classes. To tackle this challenging problem, a novel active incremental learning scheme with a classifier and an out-of-distribution (OOD) detector is proposed. A <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">k</i> -fast incremental support vector data description ( <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">k</i> -FISVDD) model is put forward as the OOD detector to recognize distribution mismatch samples online for label annotation. Specifically, it integrates the clustering algorithm to build local support vector sets, based on which an active query strategy is developed. An incremental learning mechanism is also designed to reduce the labeling cost. Then, the new labeled data can simultaneously refine the classifier and OOD detector. Two cases, including a bearing benchmark dataset and the operation data of a practical deep-sea manned submersible, are studied to demonstrate the effectiveness of the proposed scheme.

Converting SVDD scores into probability estimates: Application to outlier detection

Solving one-class problem with outlier examples by SVM