A Novel Data Classification Method and its Application in IRIS Flower Shape

The present investigation introduces a robust soft computing model by comparing twelve least square support vector machine (LSSVM), six long short-term memory (LSTM), and thirty-six artificial neural network (ANN) models to predict the unconfined compressive strength (UCS) of fine-grained soil. For that purpose, a database of fine content, dry unit weight, porosity, void ratio, degree of saturation, and specific gravity results of 85 soil specimens has been compiled from the literature. 75 and 10 soil specimens were trained and tested for each model. Six training databases have been prepared to analyze the effect of quality and quantity of training database by selecting 50%, 60%, 70%, 80%, 90%, and 100% of 75 soil specimens. The performance comparison demonstrated that the LSTM model (MD 113) requires fewer training datasets (50% of 75) than the LSSVM (MD 102 and MD 108) and ANN (MD 120, MD 127, MD 136, MD139, MD 148, and MD 150) models. Also, it was observed that the nonlinear LSSVM model (MD 108) is unaffected by multicollinearity in training datasets and predicted UCS better than the linear LSSVM model (MD 102). Furthermore, the Levenberg-Marquardt neural network model (MD 120) has outperformed the other ANN models with the root mean square error (RMSE) of 5.1214 N/cm2, the mean absolute error (MAE) of 4.1379 N/cm2, and correlation (R) of 0.9836. The overall performance comparison revealed that the LSTM model is more potent than the LSSVM and ANN models. The LSTM model predicted the UCS of fine-grained soil with the RMSE of 4.7539 N/cm2, the MAE of 4.2461 N/cm2, and R of 0.9880. Conversely, cosine amplitude sensitivity analysis demonstrated that the fine content and dry unit weight influence the prediction of virgin UCS of fine-grained soils.

Application of least square support vector machine and multivariate adaptive regression spline models in long term prediction of river water pollution

In recent years, with the deepening of China’s electricity sales side reform and electricity market opening up gradually, the forecasting of electricity consumption (FoEC) becomes an extremely important technique for the electricity market. At present, how to forecast the electricity accurately and make an evaluation of results scientifically are still key research topics. In this paper, we propose a novel prediction scheme based on the least-square support vector machine (LSSVM) model with a maximum correntropy criterion (MCC) to forecast the electricity consumption (EC). Firstly, the electricity characteristics of various industries are analyzed to determine the factors that mainly affect the changes in electricity, such as the gross domestic product (GDP), temperature, and so on. Secondly, according to the statistics of the status quo of the small sample data, the LSSVM model is employed as the prediction model. In order to optimize the parameters of the LSSVM model, we further use the local similarity function MCC as the evaluation criterion. Thirdly, we employ the K-fold cross-validation and grid searching methods to improve the learning ability. In the experiments, we have used the EC data of Shaanxi Province in China to evaluate the proposed prediction scheme, and the results show that the proposed prediction scheme outperforms the method based on the traditional LSSVM model.

Estimation of CO2 adsorption in high capacity metal−organic frameworks: Applications to greenhouse gas control

This paper addresses processing of spectrophotometric array signals based on genetic algorithms (GA) least square support vector machines (LS-SVM) regression to provide a powerful model for machine learning and data mining. The key to complete LS-SVM regression is to choose its optimal parameters. Due to their outstanding ability in solving global optimization problems in complex multidimensional search space, GA are used in this study to obtain the optimal parameter combination of the LS-SVM model. Experimental results showed the GA-LS-SVM method to be successful for simultaneous multicomponent determination even where severe overlap of spectra was present. KeywordsLeast squares support vector machines; Genetic algorithms; Spectrophotometric array signals; Overlapping spectra; Artificial intelligence Nowadays, with the application of photometric diode array detector and computers, rapid scanning commercial spectrophotometers are capable of quickly generating huge data consisting of hundreds and even thousands of absorbance values per spectrum. The array data named fullspectrum contain sufficient information to be able to determine the contents of various compounds. The main drawback of ultraviolet-visible (UV-VIS) is its poor selectivity because in many cases UV-VIS spectra display strong overlaps, especially some less specific and selective chromagenic reagents often give rise to strongly overlapped spectra in many cases. The combination of artificial intelligence methods with the computer-controlled spectrophotometers was proven to be effective in overcoming this difficulty [1-3]. Artificial neural network (ANN) is a form of artificial intelligence that mathematically simulates biological nervous system [4, 5]. However, ANN often has slow convergence, is prone to the existence of many local minima during training, and has a tendency of overfitting. Recently, a promising technology called support vector machines (SVM) has been used for classification and regression problems. SVM pioneered by Vapnik is a kind of machine learning method based on modern statistical learning theory and has notable properties including absence of local minima and high generalization ability [6, 7]. Suykens and his coworkers [8] introduced a modified version of SVM called least square SVM (LS-SVM) , which requires solving a set of linear equations instead of a quadratic programming problem and is much easier and computationally simpler than SVM. SVM and LS-SVM represent relatively recent artificial intelligence method and have found some applications in image analysis, classification and disease diagnosis etc. [9, 10]. It is worth mentioning that the success of LS-SVM model is highly dependent on the optimum choice of two parameters, the relative weight of regression error γ and the kernel width σ of radial basis function (RBF). Genetic algorithms (GA) [11, 12] introduced by John Holland are probabilistic optimization techniques based on natural evolution and genetics and Darwin’s theory of survival of the best. With their efficient and robust global search ability, GA are used to search two optimal parameters for the LS-SVM model simultaneously and automatically. The LS-SVM model then performs the regression task using these optimal parameters.

Wind speed is an important data in the research of the output power in wind farm, but the measured wind speed data have the problem of missing data, meanwhile, the wind speed data also have the characteristics of nonlinearity. Least squares support vector machines (LSSVM) model has strong ability of nonlinear fitting, so LSSVM model is used as the model of interpolating missing wind speed data in this paper, and optimal interpolation model of missing wind speed data is established by using comprehensive learning particle swarm optimization (CLPSO) that has good global search ability to optimize hyper-parameters of LSSVM model. The simulation results indicate: the precision of interpolating tested data by optimized LSSVM model is better, the results of interpolating missing wind speed data fit with the variation of wind speed data at adjacent level, the effectiveness of the interpolation model is verified.

In nuclear power plant's peripheral environmental radiation monitoring wireless sensor network, the γ dose rate data collected in sensor node may be missed due to various factors, which will influence the validity of environmental radiation monitoring. To solve the problem, a missing data imputation algorithm based on least squares support vector machine(LSSVM) is proposed and particle swarm optimization is adopted to search the optimal set of the LSSVM model parameters. This LSSVM model imputes missing data utilizing node's previous monitoring data and neighbor node's current monitoring data jointly. The experimental results using the real radiation monitoring data around a nuclear power plant demonstrate that the proposed algorithm can achieve higher imputation accuracy than neural network model as well as direct LSSVM model, which has the non-optimized parameters.

The objective of this paper was to determine soluble solids content (SSC) of intact Gannan navel orange by a portable near-infrared (NIR) spectrometer with the optical fiber in the wavelength range of 551~950nm. The effective wavelength regions (EWs) were chosen from the spectra pro-processed by second derivative by interval partial least square (iPLS) and backward interval partial least square (Bipls). Then the partial least square (PLS) and least square support vector machine (LS-SVM) models were developed with EWs. 60 unknown samples were used to evaluate the performance of them. The LS-SVM model was better than others with EWs chosen by Bilps. The correlation coefficient (R) and root mean square error of prediction (RMSEP) for LS-SVM (Bipls) were 0.86 and 0.55°Brix. The results showed that the portable NIR combination with LS-SVM was a feasible method to determine SSC of intact Gannan navel orange nondestructively.

The basic oxygen furnace (BOF) steelmaking process in the steel industry is highly complicated, and subject to variations in raw material composition. During the BOF steelmaking process, it is essential to maintain the carbon content and the endpoint temperature at their set points in the liquid steel. This paper presents intelligent models used to estimate the endpoint temperature in the basic oxygen furnace (BOF) steelmaking process. An artificial neural network (ANN) model and a least-squares support vector machine (LSSVM) model are proposed and their estimation performance compared. The classical partial least-squares (PLS) method was also compared with the others. Results of the estimations using the ANN, LSSVM and PLS models were compared with the operation data, and the root-mean square error (RMSE) for each model was calculated to evaluate estimation performance. The RMSE of the LSSVM model 15.91, which turned out to be the best estimation. RMSE values for the ANN and PLS models were 17.24 and 21.31, respectively, indicating their relative estimation performance. The essential input parameters used in the models can be selected by sensitivity analysis. The RMSE for each model was calculated again after a sequential input selection process was used to remove insignificant input parameters. The RMSE of the LSSVM was then 13.21, which is better than the previous RMSE with all 16 parameters. The results show that LSSVM model using 13 input parameters can be utilized to calculate the required values for oxygen volume and coolant needed to optimally adjust the steel target temperature. (Received July 30, 2018; Accepted September 28, 2018)

In this paper, based on the Discrete Wavelet Transform (DWT) and Least Square Support Vector Machine (LSSVM), the torque observer for hybrid electric vehicles (HEV) is established. Data from the benchmarking test is employed as the training sample, and the DWT-LSSVM based multi-layer observer was trained to observe the torque distribution results of hybrid electric vehicles. The DWT -LSSVM based multi-layer observer can accurately offer the control results of the original vehicle and solve the problem that it is difficult to reproduce the control results of the original vehicle completely. The main work is as follows: first, a multi-layer observation model based on DWT-LSSVM is established. Multiple LSSVM modules are used to observe the input signals with different frequency that are decomposed by wavelet method, and wavelet reconstruction method is used to integrate the observation results of different input signals to obtain the final observation result of vehicle torque distribution. Secondly, the cross-validation method is used to optimize the parameters in LSSVM model to ensure the accuracy of model prediction. Thirdly, taking the test data of a four-wheel drive hybrid electric vehicle (4WD-HEV)as an example, the observation model proposed in this paper is compared with the simply LSSVM observation model. The results show that the observation results of the torque observation model based on DWT-LSSVM are better than those by the simply LSSVM observation model. The compare results justify the proposed method can improve the accuracy of torque observation.

The application of near infrared spectroscopy for quantitative analysis of cotton-polyester textile was investigated in the present work. A total of 214 cotton-polyester fabric samples, covering the range from 0% to 100% cotton were measured and analyzed. Partial least squares and least-squares support vector machine models with all variables as input data were established. Furthermore, successive projection algorithm was used to select effective wavelengths and establish the successive projection algorithm-least-squares support vector machine models, with the comparison of two other effective wavelength selection methods: loading weights analysis and regression coefficient analysis. The calibration and validation results show that the successive projection algorithm-least-squares support vector machine model outperformed not only the partial least squares and least-squares support vector machine models with all variables as inputs, but also the least-squares support vector machine models with loading weights analysis and regression coefficient analysis effective wavelength selection. The root mean squared error of calibration and root mean squared error of prediction values of the successive projection algorithm-least-squares support vector machine regression model with the optimal performance were 0.77% and 1.17%, respectively. The overall results demonstrated that near infrared spectroscopy combined with least-squares support vector machine and successive projection algorithm could provide a simple, rapid, economical and non-destructive method for determining the composition of cotton-polyester textiles.

Online analysis of watercore apples by considering different speeds and orientations based on Vis/NIR full-transmittance spectroscopy

This article investigates the feasibility of multivariate adaptive regression spline (MARS) and least squares support vector machine (LSSVM) for the prediction of over consolidation ratio (OCR) of clay deposits based on Piezocone Penetration Tests (PCPT) data. MARS uses piece-wise linear segments to describe the non-linear relationships between input and output variables. LSSVM is firmly based on the theory of statistical learning, and uses regression technique. The input parameters of the models are corrected cone resistance (q t ), vertical total stress (σv), hydrostatic pore pressure (u 0), pore pressure at the cone tip (u 1), and the pore pressure just above the cone base (u 2). The developed LSSVM model gives error bar of predicted OCR. Equations have also been developed for prediction of OCR. The performance of MARS and LSSVM models has been compared with the traditional methods for OCR prediction. As the results reveal, the proposed MARS and LSSVM models are robust models for determination of OCR.

Carbon Capture and Storage (CCS) is a promising technology that stops the release of CO2 from industrial processes such as electrical power generation. Accurate measurement of CO2 flows in a CCS system where CO2 flow is a gas, liquid, or gas-liquid two-phase mixture is essential for the fiscal purpose and potential leakage detection. This paper presents a novel method based on Coriolis mass flowmeters in conjunction with least squares support vector machine (LSSVM) models to measure gas-liquid two-phase CO2 flow under CCS conditions. The method uses a classifier to identify the flow pattern and individual LSSVM models for the metering of CO2 mass flowrate and prediction of gas volume fraction of CO2, respectively. Experimental work was undertaken on a multiphase CO2 flow test facility. Performance comparisons between the general LSSVM and flow pattern based LSSVM models are conducted. Results demonstrate that Coriolis mass flowmeters with the LSSVM model incorporating flow pattern identification algorithms perform significantly better than those using the general LSSVM model. The mass flowrate measurement of gas-liquid CO2 is found to yield errors less than ±2% on the horizontal pipeline and ±1.5% on the vertical pipeline, respectively, over flowrates from 250kg/h to 3200kg/h. The error in the estimation of CO2 gas volume fraction is within ±10% over the same range of flow rates.

Two chemometric methods were performed for the determination of acetic acid of fruit vinegars using near infrared (NIR) spectroscopy. Three varieties of fruit vinegars were prepared and 135 samples (45 samples for each variety) were selected for the calibration set, whereas 45 samples (15 samples for each variety) for the validation set. Partial least squares (PLS) analysis was the calibration method as well as extraction method for latent variables (LVs). The first eight LVs were employed as the inputs of least squares-support vector machine (LS-SVM) model. Then LS-SVM model with radial basis function (RBF) kernel was applied to build the regression model compared with PLS model. The correlation coefficient (r), root mean square error of prediction (RMSEP) and bias for validation set were 0.994, 0.814 and -0.091 by PLS, whereas 0.997, 0.651 and 0.011 by LS-SVM, respectively. LS-SVM model outperformed PLS model, but both models achieved an excellent prediction precision. The results indicated that NIR spectroscopy combined with chemometrics could be utilized as a high precision and fast way for the determination of acetic acid of fruit vinegars.