Electricity Consumption Forecasting Scheme via Improved LSSVM with Maximum Correntropy Criterion

Application of least square support vector machine and multivariate adaptive regression spline models in long term prediction of river water pollution

The present investigation introduces a robust soft computing model by comparing twelve least square support vector machine (LSSVM), six long short-term memory (LSTM), and thirty-six artificial neural network (ANN) models to predict the unconfined compressive strength (UCS) of fine-grained soil. For that purpose, a database of fine content, dry unit weight, porosity, void ratio, degree of saturation, and specific gravity results of 85 soil specimens has been compiled from the literature. 75 and 10 soil specimens were trained and tested for each model. Six training databases have been prepared to analyze the effect of quality and quantity of training database by selecting 50%, 60%, 70%, 80%, 90%, and 100% of 75 soil specimens. The performance comparison demonstrated that the LSTM model (MD 113) requires fewer training datasets (50% of 75) than the LSSVM (MD 102 and MD 108) and ANN (MD 120, MD 127, MD 136, MD139, MD 148, and MD 150) models. Also, it was observed that the nonlinear LSSVM model (MD 108) is unaffected by multicollinearity in training datasets and predicted UCS better than the linear LSSVM model (MD 102). Furthermore, the Levenberg-Marquardt neural network model (MD 120) has outperformed the other ANN models with the root mean square error (RMSE) of 5.1214 N/cm2, the mean absolute error (MAE) of 4.1379 N/cm2, and correlation (R) of 0.9836. The overall performance comparison revealed that the LSTM model is more potent than the LSSVM and ANN models. The LSTM model predicted the UCS of fine-grained soil with the RMSE of 4.7539 N/cm2, the MAE of 4.2461 N/cm2, and R of 0.9880. Conversely, cosine amplitude sensitivity analysis demonstrated that the fine content and dry unit weight influence the prediction of virgin UCS of fine-grained soils.

The basic oxygen furnace (BOF) steelmaking process in the steel industry is highly complicated, and subject to variations in raw material composition. During the BOF steelmaking process, it is essential to maintain the carbon content and the endpoint temperature at their set points in the liquid steel. This paper presents intelligent models used to estimate the endpoint temperature in the basic oxygen furnace (BOF) steelmaking process. An artificial neural network (ANN) model and a least-squares support vector machine (LSSVM) model are proposed and their estimation performance compared. The classical partial least-squares (PLS) method was also compared with the others. Results of the estimations using the ANN, LSSVM and PLS models were compared with the operation data, and the root-mean square error (RMSE) for each model was calculated to evaluate estimation performance. The RMSE of the LSSVM model 15.91, which turned out to be the best estimation. RMSE values for the ANN and PLS models were 17.24 and 21.31, respectively, indicating their relative estimation performance. The essential input parameters used in the models can be selected by sensitivity analysis. The RMSE for each model was calculated again after a sequential input selection process was used to remove insignificant input parameters. The RMSE of the LSSVM was then 13.21, which is better than the previous RMSE with all 16 parameters. The results show that LSSVM model using 13 input parameters can be utilized to calculate the required values for oxygen volume and coolant needed to optimally adjust the steel target temperature. (Received July 30, 2018; Accepted September 28, 2018)

Online analysis of watercore apples by considering different speeds and orientations based on Vis/NIR full-transmittance spectroscopy

The application of near infrared spectroscopy for quantitative analysis of cotton-polyester textile was investigated in the present work. A total of 214 cotton-polyester fabric samples, covering the range from 0% to 100% cotton were measured and analyzed. Partial least squares and least-squares support vector machine models with all variables as input data were established. Furthermore, successive projection algorithm was used to select effective wavelengths and establish the successive projection algorithm-least-squares support vector machine models, with the comparison of two other effective wavelength selection methods: loading weights analysis and regression coefficient analysis. The calibration and validation results show that the successive projection algorithm-least-squares support vector machine model outperformed not only the partial least squares and least-squares support vector machine models with all variables as inputs, but also the least-squares support vector machine models with loading weights analysis and regression coefficient analysis effective wavelength selection. The root mean squared error of calibration and root mean squared error of prediction values of the successive projection algorithm-least-squares support vector machine regression model with the optimal performance were 0.77% and 1.17%, respectively. The overall results demonstrated that near infrared spectroscopy combined with least-squares support vector machine and successive projection algorithm could provide a simple, rapid, economical and non-destructive method for determining the composition of cotton-polyester textiles.

Estimation of CO2 adsorption in high capacity metal−organic frameworks: Applications to greenhouse gas control

IRIS flower data is a class of multi variable data set, which is widely applied in data classification. This paper aims at the parameter optimization problem of least squares support vector machine (LS-SVM) in data classification, an improved particle swarm optimization(IMPSO) algorithm is introduced into the LS-SVM model for improving the learning performance and generalization ability of LS-SVM model. A new data classification method based on IMPSO algorithm and LS-SVM (IMPSO-LS-SVM) model is proposed. First, the numbers of current iteration and population are added into the control strategy of adaptive adjustment inertia weight in order to improve the performance of inertia weight of PSO algorithm. Then the IMPSO algorithm is used to search the optimal combination values of the parameters of kernel function for obtaining the IMPSO-LS-SVM. Finally, the training samples are used to comprehensively train the IMPSO-LS-SVM, and the best large-scale data classification model is constructed. The IRIS flower data is used to validate the effectiveness of the IMPSO-LS-SVM model. The result indicates that the IMPSO algorithm can effectively search the optimal combination values of the parameters, and the proposed data classification model has better generalization performance, faster training speed and higher classification precision.

Two chemometric methods were performed for the determination of acetic acid of fruit vinegars using near infrared (NIR) spectroscopy. Three varieties of fruit vinegars were prepared and 135 samples (45 samples for each variety) were selected for the calibration set, whereas 45 samples (15 samples for each variety) for the validation set. Partial least squares (PLS) analysis was the calibration method as well as extraction method for latent variables (LVs). The first eight LVs were employed as the inputs of least squares-support vector machine (LS-SVM) model. Then LS-SVM model with radial basis function (RBF) kernel was applied to build the regression model compared with PLS model. The correlation coefficient (r), root mean square error of prediction (RMSEP) and bias for validation set were 0.994, 0.814 and -0.091 by PLS, whereas 0.997, 0.651 and 0.011 by LS-SVM, respectively. LS-SVM model outperformed PLS model, but both models achieved an excellent prediction precision. The results indicated that NIR spectroscopy combined with chemometrics could be utilized as a high precision and fast way for the determination of acetic acid of fruit vinegars.

The objective of this paper was to determine soluble solids content (SSC) of intact Gannan navel orange by a portable near-infrared (NIR) spectrometer with the optical fiber in the wavelength range of 551~950nm. The effective wavelength regions (EWs) were chosen from the spectra pro-processed by second derivative by interval partial least square (iPLS) and backward interval partial least square (Bipls). Then the partial least square (PLS) and least square support vector machine (LS-SVM) models were developed with EWs. 60 unknown samples were used to evaluate the performance of them. The LS-SVM model was better than others with EWs chosen by Bilps. The correlation coefficient (R) and root mean square error of prediction (RMSEP) for LS-SVM (Bipls) were 0.86 and 0.55°Brix. The results showed that the portable NIR combination with LS-SVM was a feasible method to determine SSC of intact Gannan navel orange nondestructively.

In this paper, based on the Discrete Wavelet Transform (DWT) and Least Square Support Vector Machine (LSSVM), the torque observer for hybrid electric vehicles (HEV) is established. Data from the benchmarking test is employed as the training sample, and the DWT-LSSVM based multi-layer observer was trained to observe the torque distribution results of hybrid electric vehicles. The DWT -LSSVM based multi-layer observer can accurately offer the control results of the original vehicle and solve the problem that it is difficult to reproduce the control results of the original vehicle completely. The main work is as follows: first, a multi-layer observation model based on DWT-LSSVM is established. Multiple LSSVM modules are used to observe the input signals with different frequency that are decomposed by wavelet method, and wavelet reconstruction method is used to integrate the observation results of different input signals to obtain the final observation result of vehicle torque distribution. Secondly, the cross-validation method is used to optimize the parameters in LSSVM model to ensure the accuracy of model prediction. Thirdly, taking the test data of a four-wheel drive hybrid electric vehicle (4WD-HEV)as an example, the observation model proposed in this paper is compared with the simply LSSVM observation model. The results show that the observation results of the torque observation model based on DWT-LSSVM are better than those by the simply LSSVM observation model. The compare results justify the proposed method can improve the accuracy of torque observation.

Wind speed is an important data in the research of the output power in wind farm, but the measured wind speed data have the problem of missing data, meanwhile, the wind speed data also have the characteristics of nonlinearity. Least squares support vector machines (LSSVM) model has strong ability of nonlinear fitting, so LSSVM model is used as the model of interpolating missing wind speed data in this paper, and optimal interpolation model of missing wind speed data is established by using comprehensive learning particle swarm optimization (CLPSO) that has good global search ability to optimize hyper-parameters of LSSVM model. The simulation results indicate: the precision of interpolating tested data by optimized LSSVM model is better, the results of interpolating missing wind speed data fit with the variation of wind speed data at adjacent level, the effectiveness of the interpolation model is verified.

In nuclear power plant's peripheral environmental radiation monitoring wireless sensor network, the γ dose rate data collected in sensor node may be missed due to various factors, which will influence the validity of environmental radiation monitoring. To solve the problem, a missing data imputation algorithm based on least squares support vector machine(LSSVM) is proposed and particle swarm optimization is adopted to search the optimal set of the LSSVM model parameters. This LSSVM model imputes missing data utilizing node's previous monitoring data and neighbor node's current monitoring data jointly. The experimental results using the real radiation monitoring data around a nuclear power plant demonstrate that the proposed algorithm can achieve higher imputation accuracy than neural network model as well as direct LSSVM model, which has the non-optimized parameters.

Agriculture 4.0, as the future of farming technology, comprises numerous key enabling technologies towards sustainable agriculture. The use of state-of-the-art technologies, such as the Internet of Things, transform traditional cultivation practices, like irrigation, to modern solutions of precision agriculture. To achieve effective water resource usage and automated irrigation in precision agriculture, recent technologies like machine learning (ML) can be employed. With this motivation, this paper design an IoT and ML enabled smart irrigation system (IoTML-SIS) for precision agriculture. The proposed IoTML-SIS technique allows to sense the parameters of the farmland and make appropriate decisions for irrigation. The proposed IoTML-SIS model involves different IoT based sensors for soil moisture, humidity, temperature sensor, and light. Besides, the sensed data are transmitted to the cloud server for processing and decision making. Moreover, artificial algae algorithm (AAA) with least squares-support vector machine (LS-SVM) model is employed for the classification process to determine the need for irrigation. Furthermore, the AAA is applied to optimally tune the parameters involved in the LS-SVM model, and thereby the classification efficiency is significantly increased. The performance validation of the proposed IoTML-SIS technique ensured better performance over the compared methods with the maximum accuracy of 0.975.

Carbon Capture and Storage (CCS) is a promising technology that stops the release of CO2 from industrial processes such as electrical power generation. Accurate measurement of CO2 flows in a CCS system where CO2 flow is a gas, liquid, or gas-liquid two-phase mixture is essential for the fiscal purpose and potential leakage detection. This paper presents a novel method based on Coriolis mass flowmeters in conjunction with least squares support vector machine (LSSVM) models to measure gas-liquid two-phase CO2 flow under CCS conditions. The method uses a classifier to identify the flow pattern and individual LSSVM models for the metering of CO2 mass flowrate and prediction of gas volume fraction of CO2, respectively. Experimental work was undertaken on a multiphase CO2 flow test facility. Performance comparisons between the general LSSVM and flow pattern based LSSVM models are conducted. Results demonstrate that Coriolis mass flowmeters with the LSSVM model incorporating flow pattern identification algorithms perform significantly better than those using the general LSSVM model. The mass flowrate measurement of gas-liquid CO2 is found to yield errors less than ±2% on the horizontal pipeline and ±1.5% on the vertical pipeline, respectively, over flowrates from 250kg/h to 3200kg/h. The error in the estimation of CO2 gas volume fraction is within ±10% over the same range of flow rates.

This paper addresses processing of spectrophotometric array signals based on genetic algorithms (GA) least square support vector machines (LS-SVM) regression to provide a powerful model for machine learning and data mining. The key to complete LS-SVM regression is to choose its optimal parameters. Due to their outstanding ability in solving global optimization problems in complex multidimensional search space, GA are used in this study to obtain the optimal parameter combination of the LS-SVM model. Experimental results showed the GA-LS-SVM method to be successful for simultaneous multicomponent determination even where severe overlap of spectra was present. KeywordsLeast squares support vector machines; Genetic algorithms; Spectrophotometric array signals; Overlapping spectra; Artificial intelligence Nowadays, with the application of photometric diode array detector and computers, rapid scanning commercial spectrophotometers are capable of quickly generating huge data consisting of hundreds and even thousands of absorbance values per spectrum. The array data named fullspectrum contain sufficient information to be able to determine the contents of various compounds. The main drawback of ultraviolet-visible (UV-VIS) is its poor selectivity because in many cases UV-VIS spectra display strong overlaps, especially some less specific and selective chromagenic reagents often give rise to strongly overlapped spectra in many cases. The combination of artificial intelligence methods with the computer-controlled spectrophotometers was proven to be effective in overcoming this difficulty [1-3]. Artificial neural network (ANN) is a form of artificial intelligence that mathematically simulates biological nervous system [4, 5]. However, ANN often has slow convergence, is prone to the existence of many local minima during training, and has a tendency of overfitting. Recently, a promising technology called support vector machines (SVM) has been used for classification and regression problems. SVM pioneered by Vapnik is a kind of machine learning method based on modern statistical learning theory and has notable properties including absence of local minima and high generalization ability [6, 7]. Suykens and his coworkers [8] introduced a modified version of SVM called least square SVM (LS-SVM) , which requires solving a set of linear equations instead of a quadratic programming problem and is much easier and computationally simpler than SVM. SVM and LS-SVM represent relatively recent artificial intelligence method and have found some applications in image analysis, classification and disease diagnosis etc. [9, 10]. It is worth mentioning that the success of LS-SVM model is highly dependent on the optimum choice of two parameters, the relative weight of regression error γ and the kernel width σ of radial basis function (RBF). Genetic algorithms (GA) [11, 12] introduced by John Holland are probabilistic optimization techniques based on natural evolution and genetics and Darwin’s theory of survival of the best. With their efficient and robust global search ability, GA are used to search two optimal parameters for the LS-SVM model simultaneously and automatically. The LS-SVM model then performs the regression task using these optimal parameters.