NARX Identification of Hammerstein Systems Using Least-Squares Support Vector Machines

A novel nonlinear modelling approach has been developed and implemented on Alstom gasifier using Wiener model. The linear element of the Wiener model was identified by a combined subspace state space method, which integrated MOESP (Multivariable Output-Error State Space) and N4SID (Numerical algorithms for subspace state space system identification) method in the estimation of system matrices. Then a single layer neural network was chosen as the nonlinearity of the model. The proposed model identification method was used to model Alstom gasifier with strong nonlinearity and multivariable couples. The results compared to a combined linear subspace identification method demonstrate that the nonlinear method proposed in this paper behave better approximation.

Summary form only given. In this paper, the authors use the numerical algorithm for subspace state space system identification (N4SID) to extract dynamic parameters from phasor measurements collected on the western North American Power Grid. The data were obtained during tests on June 7, 2000, and they represent wide area response to several kinds of probing signals including low-level pseudo-random noise (LLPRN) and single-mode square wave (SMSW) injected at the Celilo terminal of the Pacific HVDC Intertie (PDCI). An identified model is validated using a cross validation method. Also, the obtained electromechanical modes are compared with the results from Prony analysis of a ringdown and with signal analysis of ambient data measured under similar operating conditions. The consistent results show that methods in this class can be highly effective even when the probing signal is small.

The performance of machines and equipment degrades as a result of aging and wear. This decreases performance reliability and increases the potential for faults and failures. To ensure proper functionality of complex systems, advanced technologies for performance diagnosis and control are being incorporated into engineering designs, which requires an ever-increasing number of sensors and measurement devices. Nevertheless, a sensor, just as any other dynamic system, degrades and fails. A faulty sensor may cause process performance degradation, process shut down, or even a fatal accident because it is no longer able to deliver accurate information about the monitored system. Therefore, it is essential to assess sensor performance to ensure system reliability. In this paper, a method is proposed to detect, isolate, and compensate sensor degradation. The numerical algorithm for subspace state space system identification is used to track the changes of the time constants and gains of the sensor and the monitored system. Without imposing requirements for redundant sensors and measurement devices, this method utilizes the fact that sensor readings depict dynamic characteristics of the sensors as well as those of the monitored system. The newly proposed method is verified in angular sensor degradation detection using high-fidelity simulations of an automotive electronic throttle system.

System identification based structural damage aggravation detection in a large masonry building

This paper addresses processing of spectrophotometric array signals based on genetic algorithms (GA) least square support vector machines (LS-SVM) regression to provide a powerful model for machine learning and data mining. The key to complete LS-SVM regression is to choose its optimal parameters. Due to their outstanding ability in solving global optimization problems in complex multidimensional search space, GA are used in this study to obtain the optimal parameter combination of the LS-SVM model. Experimental results showed the GA-LS-SVM method to be successful for simultaneous multicomponent determination even where severe overlap of spectra was present. KeywordsLeast squares support vector machines; Genetic algorithms; Spectrophotometric array signals; Overlapping spectra; Artificial intelligence Nowadays, with the application of photometric diode array detector and computers, rapid scanning commercial spectrophotometers are capable of quickly generating huge data consisting of hundreds and even thousands of absorbance values per spectrum. The array data named fullspectrum contain sufficient information to be able to determine the contents of various compounds. The main drawback of ultraviolet-visible (UV-VIS) is its poor selectivity because in many cases UV-VIS spectra display strong overlaps, especially some less specific and selective chromagenic reagents often give rise to strongly overlapped spectra in many cases. The combination of artificial intelligence methods with the computer-controlled spectrophotometers was proven to be effective in overcoming this difficulty [1-3]. Artificial neural network (ANN) is a form of artificial intelligence that mathematically simulates biological nervous system [4, 5]. However, ANN often has slow convergence, is prone to the existence of many local minima during training, and has a tendency of overfitting. Recently, a promising technology called support vector machines (SVM) has been used for classification and regression problems. SVM pioneered by Vapnik is a kind of machine learning method based on modern statistical learning theory and has notable properties including absence of local minima and high generalization ability [6, 7]. Suykens and his coworkers [8] introduced a modified version of SVM called least square SVM (LS-SVM) , which requires solving a set of linear equations instead of a quadratic programming problem and is much easier and computationally simpler than SVM. SVM and LS-SVM represent relatively recent artificial intelligence method and have found some applications in image analysis, classification and disease diagnosis etc. [9, 10]. It is worth mentioning that the success of LS-SVM model is highly dependent on the optimum choice of two parameters, the relative weight of regression error γ and the kernel width σ of radial basis function (RBF). Genetic algorithms (GA) [11, 12] introduced by John Holland are probabilistic optimization techniques based on natural evolution and genetics and Darwin’s theory of survival of the best. With their efficient and robust global search ability, GA are used to search two optimal parameters for the LS-SVM model simultaneously and automatically. The LS-SVM model then performs the regression task using these optimal parameters.

In this paper, the inverted pendulum is controlled by Quanser universal benchtop equipment-direct current (QUBE DC) motor, and the motor inverted pendulum system is identified when the sinusoidal signal is input. However, there is a large error when the angle of the pendulum is pre-identified by numerical algorithms for subspace state space system identification algorithm. Therefore, this paper designs a multi strategy optimization simulated annealing particle swarm optimization algorithm, which can accurately identify the complex system with sinusoidal input signal. In the identification experiments of sinusoidal signals with multiple frequencies and amplitudes, this paper found that the algorithm performs relatively best at a frequency of 8 rad/s. Moreover, at a frequency of 8 rad/s, the algorithm can quickly reduce the error to 1.69% within 100 generations. Finally, based on the hardware model identified by particle swarm optimization, this paper designs an explicit model predictive control method to control the inverted pendulum, and tests the constraint processing and anti-disturbance performance of the system under the voltage pulse interference with different duty cycles, which realizes the inverted pendulum balance and has robustness under the interference.

A normal least squares support vector machine (NLS-SVM) and its learning algorithm

Improving forecasts, particularly the accuracy, efficiency, and precision of time-series forecasts, is becoming critical for authorities to predict, monitor, and prevent the spread of the Coronavirus disease. However, the results obtained from the predictive models are imprecise and inefficient because the dataset contains linear and non-linear patterns, respectively. Linear models such as autoregressive integrated moving average cannot be used effectively to predict complex time series, so nonlinear approaches are better suited for such a purpose. Therefore, to achieve a more accurate and efficient predictive value of COVID-19 that is closer to the true value of COVID-19, a hybrid approach was implemented. Therefore, the objectives of this study are twofold. The first objective is to propose intelligence-based prediction methods to achieve better prediction results called autoregressive integrated moving average-least-squares support vector machine. The second objective is to investigate the performance of these proposed models by comparing them with the autoregressive integrated moving average, support vector machine, least-squares support vector machine, and autoregressive integrated moving average-support vector machine. Our investigation is based on three COVID-19 real datasets, i.e., daily new cases data, daily new death cases data, and daily new recovered cases data. Then, statistical measures such as mean square error, root mean square error, mean absolute error, and mean absolute percentage error were performed to verify that the proposed models are better than the autoregressive integrated moving average, support vector machine model, least-squares support vector machine, and autoregressive integrated moving average-support vector machine. Empirical results using three recent datasets of known the Coronavirus Disease-19 cases in Malaysia show that the proposed model generates the smallest mean square error, root mean square error, mean absolute error, and mean absolute percentage error values for training and testing datasets compared to the autoregressive integrated moving average, support vector machine, least-squares support vector machine, and autoregressive integrated moving average-support vector machine models. This means that the predicted value of the proposed model is closer to the true value. These results demonstrate that the proposed model can generate estimates more accurately and efficiently. Compared to the autoregressive integrated moving average, support vector machine, least-squares support vector machine, and autoregressive integrated moving average-support vector machine models, our proposed models perform much better in terms of percent error reduction for both training and testing all datasets. Therefore, the proposed model is possibly the most efficient and effective way to improve prediction for future pandemic performance with a higher level of accuracy and efficiency.

Utilization of SVM, LSSVM and GP for Predicting the Medical Waste Generation

The prediction of wastes generated in the hospital will help their management for several activities like storage, transport and disposing. This chapter adopts Support Vector Machine (SVM), Least Square Support Vector Machine (LSSVM) and Genetic Programming (GP) in order to estimate the rate of medical waste generation. In the event of predicting the rate, type of hospital, capacity and bed occupancy has been used as inputs of SVM, LSSVM and GP. SVM is based on statistical learning theory, which provides an elegant tool for nonlinear system modeling. LSSVM is the re-formulation to the general SVM. GP, a best part of evolutionary algorithm and also the specification of Genetic Algorithm (GA). These SVM, LSSVM and GP have been used as the regression techniques. The results show the performance of the developed SVM, LSSVM and GP models were elegant and outstanding.

The objective of this paper was to determine soluble solids content (SSC) of intact Gannan navel orange by a portable near-infrared (NIR) spectrometer with the optical fiber in the wavelength range of 551~950nm. The effective wavelength regions (EWs) were chosen from the spectra pro-processed by second derivative by interval partial least square (iPLS) and backward interval partial least square (Bipls). Then the partial least square (PLS) and least square support vector machine (LS-SVM) models were developed with EWs. 60 unknown samples were used to evaluate the performance of them. The LS-SVM model was better than others with EWs chosen by Bilps. The correlation coefficient (R) and root mean square error of prediction (RMSEP) for LS-SVM (Bipls) were 0.86 and 0.55°Brix. The results showed that the portable NIR combination with LS-SVM was a feasible method to determine SSC of intact Gannan navel orange nondestructively.

The prediction of wastes generated in the hospital will help their management for several activities like storage, transport and disposing. This chapter adopts Support Vector Machine (SVM), Least Square Support Vector Machine (LSSVM) and Genetic Programming (GP) in order to estimate the rate of medical waste generation. In the event of predicting the rate, type of hospital, capacity and bed occupancy has been used as inputs of SVM, LSSVM and GP. SVM is based on statistical learning theory, which provides an elegant tool for nonlinear system modeling. LSSVM is the re-formulation to the general SVM. GP, a best part of evolutionary algorithm and also the specification of Genetic Algorithm (GA). These SVM, LSSVM and GP have been used as the regression techniques. The results show the performance of the developed SVM, LSSVM and GP models were elegant and outstanding.

The minimal complexity support vector machine is a fusion of the support vector machine (SVM) and the minimal complexity machine (MCM), and results in maximizing the minimum margin and minimizing the maximum margin. It works to improve the generalization ability of the L1 SVM (standard SVM) and LP (Linear Programming) SVM. In this paper, we discuss whether it also works for the LS (Least Squares) SVM. The minimal complexity LS SVM (MLS SVM) is trained by minimizing the sum of squared margin errors and minimizing the maximum margin. This results in solving a set of linear equations and a quadratic program, alternatingly. According to the computer experiments for two-class and multiclass problems, the MLS SVM does not outperform the LS SVM for the test data although it does for the cross-validation data.

This article adopts three soft computing techniques including support vector machine (SVM), least square support vector machine (LSSVM) and relevance vector machine (RVM) for prediction of status of epimetemorphic rock slope. The input variables of SVM, LSSVM and RVM are bulk density, height, inclination, cohesion and internal friction angle. There are 53 datasets which have been used to develop the SVM, LSSVM and RVM models. The developed SVM, LSSVM and RVM give equations for prediction of status of epimetemorphic rock slope. The performance of SVM, LSSVM and RVM is 100%. A comparative study has been presented between the developed SVM, LSSVM and RVM. The results confirm that the developed SVM, LSSVM and RVM are effective tools for prediction of status of epimetemorphic rock slope.

A novel method based on combination of highly sensitive spectrofluorimetry and flexible the machine learning techniques was proposed for the simultaneous spectrofluorimetric determination of α-naphthol, β-naphthylamine and carbazole with overlapping peaks. This method addresses multivariate calibration based on the least square support vector machines (LS-SVM) regression to provide a powerful model for machine learning and data mining. The LS-SVM technique has the advantages to offer the capability of learning a high dimensional feature with fewer training data, and to decrease the computational complexity by only requiring to solve a set of linear equations instead of a quadratic programming problem. Experimental results showed the LS-SVM method to be successful for simultaneous multicomponent determination even where severe overlap of spectra was present. The relative standard errors of prediction (RSEP) obtained for total components using LS-SVM and PLS were compared. It is found that the LS-SVM method is better than the conventional PLS methods.