Robust Online Support Vector Regression with Truncated ε-Insensitive Pinball Loss

Processing experimental data with uncertainty is a huge challenge for robust regression modeling and high-accuracy data forecasting. The objective of the present study is the development of a robust support vector regression model for processing observed data of independent variables containing polyhedral perturbation and achievement of high forecasting precision. Firstly, the conception of the data collection of polyhedral perturbation is given and analyzed. Secondly, a novel robust support vector regression model is constructed by replacing the original independent variables in a linear support vector regression model with the independent variables containing polyhedral perturbation. Thirdly, the novel robust linear support vector regression method is also expanded to the non-linear regression model. Both the two models are validated by the linear and nonlinear numerical regression experiments. Comparison of the experimental results show that the proposed method provide more accurate predictions than the traditional regression method for processing data with polyhedral perturbation.

A robust support vector regression with exact predictors and fuzzy responses

Construction of robust regression learning models to fit training data corrupted by noise is an important and challenging research problem in machine learning. It is well-known that loss functions play an important role in reducing the effect of noise present in the input data. With the objective of obtaining a robust regression model, motivated by the link between the pinball loss and quantile regression, a novel squared pinball loss twin support vector machine for regression (SPTSVR) is proposed in this work. Further with the introduction of a regularization term, our proposed model solves a pair of strongly convex minimization problems having unique solutions by simple functional iterative method. Experiments were performed on synthetic datasets with different noise models and on real world datasets and those results were compared with support vector regression (SVR), least squares support vector regression (LS-SVR) and twin support vector regression (TSVR) methods. The comparative results clearly show that our proposed SPTSVR is an effective and a useful addition in the machine learning literature.

Pipelines are a nonlinear and complex component to transfer fluid or gas from one place to another. From economic and environmental points of view, the safety of transmission lines is incredibly important. Furthermore, condition monitoring and effective data analysis are important to leak detection and localization in pipelines. Thus, an effective technique for leak detection and localization is presented in this study. The proposed scheme has four main steps. First, the learning autoregressive technique is selected to approximate the flow signal under normal conditions and extract the mathematical state-space formulation with uncertainty estimations using a combination of robust autoregressive and support vector regression techniques. In the next step, the intelligence-based learning observer is designed using a combination of the robust learning backstepping method and a fuzzy-based technique. The learning backstepping algorithm is the main part of the algorithm that determines the leak estimation. After estimating the signals, in the third step, their classification is performed by the support vector machine algorithm. Finally, to find the size and position of the leak, the multivariable backstepping algorithm is recommended. The effectiveness of the proposed learning control algorithm is analyzed using both experimental and simulation setups.

A novel hybrid multivariate nonlinear grey model for forecasting the traffic-related emissions

We investigate the use of Fourier plane nonlinear filtering for phase-encoded images. We investigate the performance of the nonlinear joint transform correlator and the nonlinearly transformed matched filter for phase-encoded images with different types of input noise. We use the peak-to-output-energy ratio, peak-to-sidelobe ratio, and discrimination ratio as the metrics for measuring the performances. We mathematically analyze the peak-to-output-energy ratio of the nonlinearly transformed matched filter for phase-encoded images with spatially nonoverlapping white noise. Computer simulations are provided to show the performance improvements of the nonlinear filtering techniques for the phase-encoded images. In comparison with linear filtering techniques, we find that the nonlinear filtering techniques substantially improve the performance metrics. From the computer-simulation results it can be seen that the nonlinear joint transform correlator performs better than the nonlinearly transformed matched filter in detecting phase-encoded targets in the presence of different types of noise, such as additive overlapping white noise, spatially nonoverlapping white background noise, spatially nonoverlapping colored background noise, and nontarget objects.

Robust support vector regression in the primal

<div>An accurate Unmanned Aerial System (UAS) Flight Dynamics Model (FDM) allows us to design its efficient controller in early development phases and to increase safety while reducing costs. Flight tests are normally conducted for a pre-established number of flight conditions, and then mathematical methods are used to obtain the FDM for the entire flight envelope. For our UAS-S4 Ehecatl, 216 local FDMs corresponding to different flight conditions were utilized to create its Local Linear Scheduled Flight Dynamics Model (LLS-FDM). The initial flight envelope data containing 216 local FDMs was further augmented using interpolation and extrapolation methodologies, thus increasing the number of trimmed local FDMs of up to 3,642. Relying on this augmented dataset, the Support Vector Machine (SVM) methodology was used as a benchmarking regression algorithm due to its excellent performance when training samples could not be separated linearly. The trained Support Vector Regression (SVR) predicted the FDM for the entire flight envelope. Although the SVR-FDM showed excellent performance, it remained vulnerable to adversarial attacks. Hence, we modified it using an adversarial retraining defense algorithm by transforming it into a Robust SVR-FDM. For validation studies, the quality of predicted UAS-S4 FDM was evaluated based on the Root Locus diagram. The closeness of predicted eigenvalues to the original eigenvalues confirmed the high accuracy of the UAS-S4 SVR-FDM. The SVR prediction accuracy was evaluated at 216 flight conditions, for different numbers of neighbors, and a variety of kernel functions were also considered. In addition, the regression performance was analyzed based on the step response of state variables in the closed-loop control architecture. The SVR-FDM provided the shortest rise time and settling time, but it failed when adversarial attacks were imposed on the SVR. The Robust-SVR-FDM step response properties showed that it could provide more accurate results than the LLS-FDM approach while protecting the controller from adversarial attacks.</div>

As every day 2.5 quintillion bytes of data are generated, the era of Big Data is undoubtedly upon us. Nonetheless, a significant percentage of the data accrued can be omitted while maintaining a certain quality of statistical inference with a limited computational budget. In this context, estimating adaptively high-dimensional signals from massive data observed sequentially is challenging but equally important in practice. The present paper deals with this challenge based on a novel approach that leverages interval censoring for data reduction. An online maximum likelihood, least mean-square (LMS)-type algorithm, and an online support vector regression algorithm are developed for censored data. The proposed algorithms entail simple, low-complexity, closed-form updates, and have provably bounded regret. Simulated tests corroborate their efficacy.

In this paper, design and implementation the feature extraction method of Speeded-Up Robust Features (SURF) and Support Vector Machine (SVM) classification method into the traffic signs recognition application. The output of this application is the meaning of the traffic sign with two languages, indonesia and english. In the SURF method, the smallest large number of keypoints will affect the accuracy level to recognize a image. Based on the results, accuracy of this traffic signs detection has a high accuracy rate of 96%, when taking this image right in the green box displayed on the smartphone screen and taken when the brightness level of the light on 4106 lux up to 10896 lux.

This study aims to develop an intelligent algorithm by integrating robust independent component analysis (RobustICA) and support vector machines (SVMs). According to different characteristics of source signals including real or complex, super-Gaussian or sub-Gaussian and pollution of signal noise, a new method for fault detection that uses RobustICA based on kurtosis is put forward in this paper. The basic idea of the approach is to use RobustICA optimized by iterative technique to separate independent components which drive a process after wavelet de-noising of the original data. On this basis, statistics are established for fault detection and the kernel density estimation is used in calculating the confidence limit of statistics. After that, support vector machines (SVMs) is utilized to classify the faults. The simulation results of signal experiment and TE model clearly show the effectiveness and advantages of the proposed method in comparison to FastICA method.

Oscillator noise is generally modeled by a power law spectral density. Thus it is possible to characterize different noise sources, each of them corresponding to a particular power law. The measurement of the contribution of these sources is necessary to know their origin and to remedy these causes in order to improve oscillator performance. Usually, an estimation of the different types of noise present in a signal is obtained by using a variance. However, the sensitivity of these variances differs for each type of noise and then limits this method. On the other hand, the use of several variances, each of them more sensitive to one type of noise, permits one to notably improve the measurement accuracy. The method suggested here uses as many different variances as there are types of noise to measure. The improvement of measurement accuracy of the noise coefficient is discussed in this paper.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

In this work, the effects of background noises on nonlinear dynamics of a modelled standing-wave thermoacoustic system with subcritical Hopf bifurcation behaviors are studied. These noises include (1) pressure-coupled (acoustic), (2) velocity-coupled (flow), and (3) external combustion noise. It is found that these three types of background noises play important, but different roles in changing the hysteresis width and stability boundary. In addition, the stochastic transition from stability to instability is investigated, as the noise intensity is varied. Two different stochastic P-bifurcations are identified. One is related to a craterlike probability density distribution. The other is associated with a probability density distribution characterized with two peaks and one trough. With each type of noise affecting the system's stochastic behaviors being evaluated, the effect of two different types of noises is then studied. It is shown that the combined noises (types 1 and 2) cannot only destabilize global stable thermoacoustic system, but also stabilize linearly unstable system. This depends strongly on the superimposition form of the two types of noises. In addition, when the thermoacoustic system is disturbed by the combined noise (types 3 and 1 or types 3 and 2), the transition process is dominated by the combustion noise.

Objective: to analyze speech perception in normally hearing adults when listening in silence and with different types of noise. Methods: 40 individuals of both sexes, aged 18 to 45 years, participated in the study. Speech perception was assessed with the Lists of Sentences in Portuguese test, without a competing noise and with speech-spectrum, babble, and cocktail party noise. A mixed-effects linear regression model and the 95% confidence interval were used. Results: the subjects’ performance was worse in the three types of noise than in silence. When comparing the types of noise, differences were found in all combinations (speech-spectrum X babble, speech-spectrum X cocktail party, and babble X cocktail party), with a worse performance in babble, noise, followed by cocktail party. Conclusion: all noises negatively influenced speech perception, with a worse performance in babble, followed by cocktail party and speech-spectrum.

In this work, we propose ShallowDeepNet, a novel system architecture that includes a shallow and a deep neural network. The shallow neural network has the duty of data preprocessing and generating adversarial samples. The deep neural network has the duty of understanding data and information as well as detecting adversarial samples. The deep neural network gets its weights from transfer learning, adversarial training, and noise training. The system is examined on the biometric (fingerprint and iris) and the pharmaceutical data (pill image). According to the simulation results, the system is capable of improving the detection accuracy of the biometric data from 1.31% to 80.65% when the adversarial data is used and to 93.4% when the adversarial data as well as the noisy data are given to the network. The system performance on the pill image data is increased from 34.55% to 96.03% and then to 98.2%, respectively. Training on different types of noise can benefit us in detecting samples from unknown and unseen adversarial attacks. Meanwhile, the system training on the adversarial data as well as noisy data occurs only once. In fact, retraining the system may improve the performance further. Furthermore, training the system on new types of attacks and noise can help in enhancing the system performance.