On robust twin support vector regression in primal using squared pinball loss

Processing experimental data with uncertainty is a huge challenge for robust regression modeling and high-accuracy data forecasting. The objective of the present study is the development of a robust support vector regression model for processing observed data of independent variables containing polyhedral perturbation and achievement of high forecasting precision. Firstly, the conception of the data collection of polyhedral perturbation is given and analyzed. Secondly, a novel robust support vector regression model is constructed by replacing the original independent variables in a linear support vector regression model with the independent variables containing polyhedral perturbation. Thirdly, the novel robust linear support vector regression method is also expanded to the non-linear regression model. Both the two models are validated by the linear and nonlinear numerical regression experiments. Comparison of the experimental results show that the proposed method provide more accurate predictions than the traditional regression method for processing data with polyhedral perturbation.

Advances in information technology have led to the proliferation of data in the fields of finance, energy, and economics. Unforeseen elements can cause data to be contaminated by noise and outliers. In this study, a robust online support vector regression algorithm based on a non-convex asymmetric loss function is developed to handle the regression of noisy dynamic data streams. Inspired by pinball loss, a truncated ε-insensitive pinball loss (TIPL) is proposed to solve the problems caused by heavy noise and outliers. A TIPL-based online support vector regression algorithm (TIPOSVR) is constructed under the regularization framework, and the online gradient descent algorithm is implemented to execute it. Experiments are performed using synthetic datasets, UCI datasets, and real datasets. The results of the investigation show that in the majority of cases, the proposed algorithm is comparable, or even superior, to the comparison algorithms in terms of accuracy and robustness on datasets with different types of noise.

A robust support vector regression with exact predictors and fuzzy responses

A novel hybrid multivariate nonlinear grey model for forecasting the traffic-related emissions

Pipelines are a nonlinear and complex component to transfer fluid or gas from one place to another. From economic and environmental points of view, the safety of transmission lines is incredibly important. Furthermore, condition monitoring and effective data analysis are important to leak detection and localization in pipelines. Thus, an effective technique for leak detection and localization is presented in this study. The proposed scheme has four main steps. First, the learning autoregressive technique is selected to approximate the flow signal under normal conditions and extract the mathematical state-space formulation with uncertainty estimations using a combination of robust autoregressive and support vector regression techniques. In the next step, the intelligence-based learning observer is designed using a combination of the robust learning backstepping method and a fuzzy-based technique. The learning backstepping algorithm is the main part of the algorithm that determines the leak estimation. After estimating the signals, in the third step, their classification is performed by the support vector machine algorithm. Finally, to find the size and position of the leak, the multivariable backstepping algorithm is recommended. The effectiveness of the proposed learning control algorithm is analyzed using both experimental and simulation setups.

Robust support vector regression in the primal

<div>An accurate Unmanned Aerial System (UAS) Flight Dynamics Model (FDM) allows us to design its efficient controller in early development phases and to increase safety while reducing costs. Flight tests are normally conducted for a pre-established number of flight conditions, and then mathematical methods are used to obtain the FDM for the entire flight envelope. For our UAS-S4 Ehecatl, 216 local FDMs corresponding to different flight conditions were utilized to create its Local Linear Scheduled Flight Dynamics Model (LLS-FDM). The initial flight envelope data containing 216 local FDMs was further augmented using interpolation and extrapolation methodologies, thus increasing the number of trimmed local FDMs of up to 3,642. Relying on this augmented dataset, the Support Vector Machine (SVM) methodology was used as a benchmarking regression algorithm due to its excellent performance when training samples could not be separated linearly. The trained Support Vector Regression (SVR) predicted the FDM for the entire flight envelope. Although the SVR-FDM showed excellent performance, it remained vulnerable to adversarial attacks. Hence, we modified it using an adversarial retraining defense algorithm by transforming it into a Robust SVR-FDM. For validation studies, the quality of predicted UAS-S4 FDM was evaluated based on the Root Locus diagram. The closeness of predicted eigenvalues to the original eigenvalues confirmed the high accuracy of the UAS-S4 SVR-FDM. The SVR prediction accuracy was evaluated at 216 flight conditions, for different numbers of neighbors, and a variety of kernel functions were also considered. In addition, the regression performance was analyzed based on the step response of state variables in the closed-loop control architecture. The SVR-FDM provided the shortest rise time and settling time, but it failed when adversarial attacks were imposed on the SVR. The Robust-SVR-FDM step response properties showed that it could provide more accurate results than the LLS-FDM approach while protecting the controller from adversarial attacks.</div>

In this paper, design and implementation the feature extraction method of Speeded-Up Robust Features (SURF) and Support Vector Machine (SVM) classification method into the traffic signs recognition application. The output of this application is the meaning of the traffic sign with two languages, indonesia and english. In the SURF method, the smallest large number of keypoints will affect the accuracy level to recognize a image. Based on the results, accuracy of this traffic signs detection has a high accuracy rate of 96%, when taking this image right in the green box displayed on the smartphone screen and taken when the brightness level of the light on 4106 lux up to 10896 lux.

This study aims to develop an intelligent algorithm by integrating robust independent component analysis (RobustICA) and support vector machines (SVMs). According to different characteristics of source signals including real or complex, super-Gaussian or sub-Gaussian and pollution of signal noise, a new method for fault detection that uses RobustICA based on kurtosis is put forward in this paper. The basic idea of the approach is to use RobustICA optimized by iterative technique to separate independent components which drive a process after wavelet de-noising of the original data. On this basis, statistics are established for fault detection and the kernel density estimation is used in calculating the confidence limit of statistics. After that, support vector machines (SVMs) is utilized to classify the faults. The simulation results of signal experiment and TE model clearly show the effectiveness and advantages of the proposed method in comparison to FastICA method.

Since support vector regression (SVR) is a flexible regression algorithm, its computational complexity does not depend on the dimensionality of the input space, and it has excellent generalization capability. However, a central assumption with SVRs is that all the required data is available at the time of construction, which means these algorithms cannot be used with data streams. Incremental SVR has been offered as a potential solution, but its accuracy suffers with noise and learning speeds are slow. To overcome these two limitations, we propose a novel incremental regression algorithm, called online robust support vector regression (ORSVR). ORSVR solves nonparallel bound functions simultaneously. Hence, the large quadratic programming problem (QPP) in classical v-SVR are decomposed into two smaller QPPs. An incremental learning algorithm then solves each QPP step-by-step. The results of a series of comparative experiments demonstrate that the ORSVR algorithm efficiently solves regression problems in data streams, with or without noise, and speeds up the learning process.

PurposeTwin support vector machine (TSVM) is an effective machine learning technique. However, the TSVM model does not consider the influence of different data samples on the optimal hyperplane, which results in its sensitivity to noise. To solve this problem, this study proposes a twin support vector machine model based on fuzzy systems (FSTSVM).Design/methodology/approachThis study designs an effective fuzzy membership assignment strategy based on fuzzy systems. It describes the relationship between the three inputs and the fuzzy membership of the sample by defining fuzzy inference rules and then exports the fuzzy membership of the sample. Combining this strategy with TSVM, the FSTSVM is proposed. Moreover, to speed up the model training, this study employs a coordinate descent strategy with shrinking by active set. To evaluate the performance of FSTSVM, this study conducts experiments designed on artificial data sets and UCI data sets.FindingsThe experimental results affirm the effectiveness of FSTSVM in addressing binary classification problems with noise, demonstrating its superior robustness and generalization performance compared to existing learning models. This can be attributed to the proposed fuzzy membership assignment strategy based on fuzzy systems, which effectively mitigates the adverse effects of noise.Originality/valueThis study designs a fuzzy membership assignment strategy based on fuzzy systems that effectively reduces the negative impact caused by noise and then proposes the noise-robust FSTSVM model. Moreover, the model employs a coordinate descent strategy with shrinking by active set to accelerate the training speed of the model.

BackgroundTo develop and validate an MRI texture-based machine learning model for the noninvasive assessment of renal function.MethodsA retrospective study of 174 diabetic patients (training cohort, n = 123; validation cohort, n = 51) who underwent renal MRI scans was included. They were assigned to normal function (n = 71), mild or moderate impairment (n = 69), and severe impairment groups (n = 34) according to renal function. Four methods of kidney segmentation on T2-weighted images (T2WI) were compared, including regions of interest covering all coronal slices (All-K), the largest coronal slices (LC-K), and subregions of the largest coronal slices (TLCO-K and PIZZA-K). The speeded-up robust features (SURF) and support vector machine (SVM) algorithms were used for texture feature extraction and model construction, respectively. Receiver operating characteristic (ROC) curve analysis was used to evaluate the diagnostic performance of models.ResultsThe models based on LC-K and All-K achieved the nonsignificantly highest accuracy in the classification of renal function (all p values > 0.05). The optimal model yielded high performance in classifying the normal function, mild or moderate impairment, and severe impairment, with an area under the curve of 0.938 (95% confidence interval [CI] 0.935–0.940), 0.919 (95%CI 0.916–0.922), and 0.959 (95%CI 0.956–0.962) in the training cohorts, respectively, as well as 0.802 (95%CI 0.800–0.807), 0.852 (95%CI 0.846–0.857), and 0.863 (95%CI 0.857–0.887) in the validation cohorts, respectively.ConclusionWe developed and internally validated an MRI-based machine-learning model that can accurately evaluate renal function. Once externally validated, this model has the potential to facilitate the monitoring of patients with impaired renal function.

A novel robust nonparallel support vector classifier based on one optimization problem

Support vector machines (SVMs) are versatile learning models which are used for both classification and regression. Several authors have reported successful applications of SVM in a wide range of fields. With the continuous growth and development in machine learning using SVM, it was observed that SVM also has some limitations. This paper focuses on limitation regarding its boundary, i.e., sensitivity to noise or outliers in the dataset. Researchers have proposed many variants and extensions of SVM to make it robust. This paper gives an overview of the developments in the field of robust statistics in support vector machines and its variants. This paper includes an up to date survey of the research development in the field of robustness in SVM and its extensions. It also includes a discussion part which not only discusses the pros and cons of the proposed approaches but also highlights some important future directions in it. This paper would be helpful for researchers working in the field of robust statistics as well as supervised machine learning. This study would also encourage the researchers to work further in the development of SVM and even its variants to improve them.

Eating mussels contaminated with cadmium (Cd) can seriously harm health. In this study, a non-destructive and rapid detection method for Cd-contaminated mussels based on near-infrared reflectance spectroscopy was studied. The spectral data of Cd-contaminated and non-contaminated mussels were collected in the range of 950-1700nm. The model based on a robust energy-based least squares twin support vector machine (RELS-TSVM) was established to detect Cd-contaminated mussels. The influence of parameters on the RELS-TSVM model was analyzed, and the most suitable parameters were determined. The average accuracy of the proposed RELS-TSVM model in detecting Cd-contaminated mussels reached 99.92%, which was better than other twin support vector machine-derived models. For test datasets with different kinds of spectral noises (Gaussian noise, baseline shift, stray light, and wavelength shift), the RELS-TSVM model had a high robustness for noise disturbance. The results show that near-infrared spectroscopy combined with the RELS-TSVM model can realize the detection of Cd-contaminated mussels, which can provide technical support for the monitoring of heavy metals in shellfish. PRACTICAL APPLICATION: The method of detecting Cd-contaminated mussels by the NIRS has important practical significance for ensuring the safety of consumers. It provides a new way for the quality assessment and safety detection of shellfish and provides a technical basis for the marine environment assessment and management.