Using Cluster Analysis and Least Square Support Vector Machine to Predicting Power Demand for the Next-Day

Accurate electricity price prediction is key to the orderly operation of the electricity market. However, the uncertain, stochastic and fluctuant characteristics of electricity pricees make prediction difficult. With the aim of solving this issue, this investigation proposed a multi-stage intelligent model integrating the Beveridge–Nelson decomposition (B-N-D) model, the least square support vector machine (LSSVM), and a nature-inspired optimization model named the whale optimization algorithm (WOA). Firstly, the B-N-D model was utilized to decompose the hourly electricity price time series into determinacy component, periodic trend, and stochastic item. Secondly, the WOA–LSSVM model was proposed to forecast the future hourly data of three components respectively, of which the optimal parameters of LSSVM were determined by using WOA. Finally, the future hourly electricity price data were computed by multiplying the forecasted data of those terms. To verify the validity of the proposed electricity price prediction model in this paper, five comparison approaches based on the B-N-D approach were selected, which are auto-regressive integrated moving average (ARIMA), single LSSVM, LSSVM optimized by the fruit-fly optimization algorithm (FOA), LSSVM optimized by particle swarm optimization (PSO) models, and WOA–LSSVM without B-N-D. By comparatively analyzing the error criteria values of the above models through testing on the objective data of the Pennsylvania–New Jersey–Maryland (PJM) electricity market collected from 11 December 2017 to 18 December 2017, from 15 January 2018 to 22 January 2018, and from 1 February 2018 to 25 February 2018, we conclude that the constructed intelligent model in this paper can greatly enhance the prediction precision of electricity prices.

According to the current electricity price forecasting studies, it was very difficult to conclude whether support vector machine (SVM) or least squares support vector machine (LSSVM) is more suitable in solving highly non-linear regression problems with very large time horizon such as mid-term electricity market clearing price (MCP) forecasting. In this paper, a detailed evaluation process using price zones analysis technique is applied in evaluating single SVM and single LSSVM based mid-term electricity MCP forecasting models. Based on much more detailed performance evaluation results and consideration of requirements for machine learning techniques utilizing in longer time horizon and highly nonlinear questions, the proposed paper concluded that SVM is more suitable than LSSVM in mid-term electricity MCP forecasting. Numerical examples using PJM interconnection data are utilized to illustrate the conclusion.

A hybrid model of self-organizing maps (SOM) and least square support vector machine (LSSVM) for time-series forecasting

Improving forecasts, particularly the accuracy, efficiency, and precision of time-series forecasts, is becoming critical for authorities to predict, monitor, and prevent the spread of the Coronavirus disease. However, the results obtained from the predictive models are imprecise and inefficient because the dataset contains linear and non-linear patterns, respectively. Linear models such as autoregressive integrated moving average cannot be used effectively to predict complex time series, so nonlinear approaches are better suited for such a purpose. Therefore, to achieve a more accurate and efficient predictive value of COVID-19 that is closer to the true value of COVID-19, a hybrid approach was implemented. Therefore, the objectives of this study are twofold. The first objective is to propose intelligence-based prediction methods to achieve better prediction results called autoregressive integrated moving average-least-squares support vector machine. The second objective is to investigate the performance of these proposed models by comparing them with the autoregressive integrated moving average, support vector machine, least-squares support vector machine, and autoregressive integrated moving average-support vector machine. Our investigation is based on three COVID-19 real datasets, i.e., daily new cases data, daily new death cases data, and daily new recovered cases data. Then, statistical measures such as mean square error, root mean square error, mean absolute error, and mean absolute percentage error were performed to verify that the proposed models are better than the autoregressive integrated moving average, support vector machine model, least-squares support vector machine, and autoregressive integrated moving average-support vector machine. Empirical results using three recent datasets of known the Coronavirus Disease-19 cases in Malaysia show that the proposed model generates the smallest mean square error, root mean square error, mean absolute error, and mean absolute percentage error values for training and testing datasets compared to the autoregressive integrated moving average, support vector machine, least-squares support vector machine, and autoregressive integrated moving average-support vector machine models. This means that the predicted value of the proposed model is closer to the true value. These results demonstrate that the proposed model can generate estimates more accurately and efficiently. Compared to the autoregressive integrated moving average, support vector machine, least-squares support vector machine, and autoregressive integrated moving average-support vector machine models, our proposed models perform much better in terms of percent error reduction for both training and testing all datasets. Therefore, the proposed model is possibly the most efficient and effective way to improve prediction for future pandemic performance with a higher level of accuracy and efficiency.

Aiming at the nonlinearity, chaos, and small-sample of aero engine performance parameters data, a new ensemble model, named the least squares support vector machine (LSSVM) ensemble model with phase space reconstruction (PSR) and particle swarm optimization (PSO), is presented. First, to guarantee the diversity of individual members, different single kernel LSSVMs are selected as base predictors, and they also output the primary prediction results independently. Then, all the primary prediction results are integrated to produce the most appropriate prediction results by another particular LSSVM—a multiple kernel LSSVM, which reduces the dependence of modeling accuracy on kernel function and parameters. Phase space reconstruction theory is applied to extract the chaotic characteristic of input data source and reconstruct the data sample, and particle swarm optimization algorithm is used to obtain the best LSSVM individual members. A case study is employed to verify the effectiveness of presented model with real operation data of aero engine. The results show that prediction accuracy of the proposed model improves obviously compared with other three models.

Utilization of SVM, LSSVM and GP for Predicting the Medical Waste Generation

The prediction of wastes generated in the hospital will help their management for several activities like storage, transport and disposing. This chapter adopts Support Vector Machine (SVM), Least Square Support Vector Machine (LSSVM) and Genetic Programming (GP) in order to estimate the rate of medical waste generation. In the event of predicting the rate, type of hospital, capacity and bed occupancy has been used as inputs of SVM, LSSVM and GP. SVM is based on statistical learning theory, which provides an elegant tool for nonlinear system modeling. LSSVM is the re-formulation to the general SVM. GP, a best part of evolutionary algorithm and also the specification of Genetic Algorithm (GA). These SVM, LSSVM and GP have been used as the regression techniques. The results show the performance of the developed SVM, LSSVM and GP models were elegant and outstanding.

The objective of this paper was to determine soluble solids content (SSC) of intact Gannan navel orange by a portable near-infrared (NIR) spectrometer with the optical fiber in the wavelength range of 551~950nm. The effective wavelength regions (EWs) were chosen from the spectra pro-processed by second derivative by interval partial least square (iPLS) and backward interval partial least square (Bipls). Then the partial least square (PLS) and least square support vector machine (LS-SVM) models were developed with EWs. 60 unknown samples were used to evaluate the performance of them. The LS-SVM model was better than others with EWs chosen by Bilps. The correlation coefficient (R) and root mean square error of prediction (RMSEP) for LS-SVM (Bipls) were 0.86 and 0.55°Brix. The results showed that the portable NIR combination with LS-SVM was a feasible method to determine SSC of intact Gannan navel orange nondestructively.

The prediction of wastes generated in the hospital will help their management for several activities like storage, transport and disposing. This chapter adopts Support Vector Machine (SVM), Least Square Support Vector Machine (LSSVM) and Genetic Programming (GP) in order to estimate the rate of medical waste generation. In the event of predicting the rate, type of hospital, capacity and bed occupancy has been used as inputs of SVM, LSSVM and GP. SVM is based on statistical learning theory, which provides an elegant tool for nonlinear system modeling. LSSVM is the re-formulation to the general SVM. GP, a best part of evolutionary algorithm and also the specification of Genetic Algorithm (GA). These SVM, LSSVM and GP have been used as the regression techniques. The results show the performance of the developed SVM, LSSVM and GP models were elegant and outstanding.

This article adopts three soft computing techniques including support vector machine (SVM), least square support vector machine (LSSVM) and relevance vector machine (RVM) for prediction of status of epimetemorphic rock slope. The input variables of SVM, LSSVM and RVM are bulk density, height, inclination, cohesion and internal friction angle. There are 53 datasets which have been used to develop the SVM, LSSVM and RVM models. The developed SVM, LSSVM and RVM give equations for prediction of status of epimetemorphic rock slope. The performance of SVM, LSSVM and RVM is 100%. A comparative study has been presented between the developed SVM, LSSVM and RVM. The results confirm that the developed SVM, LSSVM and RVM are effective tools for prediction of status of epimetemorphic rock slope.

Daily PM2.5 concentration prediction based on principal component analysis and LSSVM optimized by cuckoo search algorithm

The minimal complexity support vector machine is a fusion of the support vector machine (SVM) and the minimal complexity machine (MCM), and results in maximizing the minimum margin and minimizing the maximum margin. It works to improve the generalization ability of the L1 SVM (standard SVM) and LP (Linear Programming) SVM. In this paper, we discuss whether it also works for the LS (Least Squares) SVM. The minimal complexity LS SVM (MLS SVM) is trained by minimizing the sum of squared margin errors and minimizing the maximum margin. This results in solving a set of linear equations and a quadratic program, alternatingly. According to the computer experiments for two-class and multiclass problems, the MLS SVM does not outperform the LS SVM for the test data although it does for the cross-validation data.

Predicting the price of electricity is crucial for the operation of power systems. Short-term electricity price forecasting deals with forecasts from an hour to a day ahead. Hourly-ahead forecasts offer expected prices to market participants before operation hours. This is especially useful for effective bidding strategies where the bidding amount can be reviewed or changed before the operation hours. Nevertheless, many existing models have relatively low prediction accuracy. Furthermore, single prediction models are typically less accurate for different scenarios. Thus, a hybrid model comprising least squares support vector machine (LSSVM) and genetic algorithm (GA) was developed in this work to predict electricity prices with higher accuracy. This model was tested on the Ontario electricity market. The inputs, which were the hourly Ontario electricity price (HOEP) and demand for the previous seven days, as well as 1-h pre-dispatch price (PDP), were optimized by GA to prevent losing potentially important inputs. At the same time, the LSSVM parameters were optimized by GA to obtain accurate forecasts. The hybrid LSSVM-GA model was shown to produce an average mean absolute percentage error (MAPE) of 8.13% and the structure of this model is less complex compared with other models developed in previous studies. This is due to the fact that only two algorithms were used (LSSVM and GA), with the load and HOEP for the week preceding the forecasting hour as the inputs. Based on the results, it is concluded that the proposed hybrid algorithm is a promising alternative to produce good electricity price forecasts.

Abstract. Successful river flow forecasting is a major goal and an essential procedure that is necessary in water resource planning and management. There are many forecasting techniques used for river flow forecasting. This study proposed a hybrid model based on a combination of two methods: Self Organizing Map (SOM) and Least Squares Support Vector Machine (LSSVM) model, referred to as the SOM-LSSVM model for river flow forecasting. The hybrid model uses the SOM algorithm to cluster the entire dataset into several disjointed clusters, where the monthly river flows data with similar input pattern are grouped together from a high dimensional input space onto a low dimensional output layer. By doing this, the data with similar input patterns will be mapped to neighbouring neurons in the SOM's output layer. After the dataset has been decomposed into several disjointed clusters, an individual LSSVM is applied to forecast the river flow. The feasibility of this proposed model is evaluated with respect to the actual river flow data from the Bernam River located in Selangor, Malaysia. The performance of the SOM-LSSVM was compared with other single models such as ARIMA, ANN and LSSVM. The performance of these models was then evaluated using various performance indicators. The experimental results show that the SOM-LSSVM model outperforms the other models and performs better than ANN, LSSVM as well as ARIMA for river flow forecasting. It also indicates that the proposed model can forecast more precisely, and provides a promising alternative technique for river flow forecasting.

With the in-depth implementation of China’s “National Strategy for Building a Strong Transportation Network,” the scale of expressway construction has continued to expand. As a result, the number of high-fill and deep-cut subgrade projects under complex geological conditions has increased significantly, leading to a surge in landslide-related issues. Consequently, accurate prediction of slope displacement is of critical importance for early warning and prevention of landslide disasters. This study proposes a hybrid prediction model, VMD-MPA-LSSVM-LSTM (VMLL), which integrates Variational Mode Decomposition (VMD), Marine Predators Algorithm (MPA), Least Squares Support Vector Machine (LSSVM), and Long Short-Term Memory (LSTM) networks. Using monitoring data from the high-fill embankment slope at Hongtuyao as the research subject, the VMLL model is employed to predict slope displacement based on small-sample data. The objective is to provide a more accurate method for early warning of slope displacement. Firstly, the original monitoring data are decomposed into trend displacement components and fluctuation displacement components using Variational Mode Decomposition (VMD). Subsequently, the trend component and the fluctuation component are predicted using Least Squares Support Vector Machine (LSSVM) and Long Short-Term Memory (LSTM) networks, respectively. Finally, the Marine Predators Algorithm (MPA) is employed to optimize the hyperparameters of the predictive models. Based on this framework, a VMLL-based slope displacement prediction model is constructed. To verify the superiority of the VMLL model, a comparative analysis was conducted against LSSVM, LSTM, and the VMD-LSSVM-LSTM models. The results demonstrate that the VMLL model achieves the highest prediction accuracy, with a Mean Absolute Percentage Error (MAPE) of 0.4022%, a Mean Absolute Error (MAE) of 0.016 mm, a Root Mean Square Error (RMSE) of 0.0206 mm, a coefficient of determination (R²) of 94.08%, and a Variance Accounted For (VAF) of 96.5%. Compared with the other three models, the VMLL model reduces the MAPE, MAE, and RMSE by 30.41–67.62%, 30.38–67.40%, and 27.32–71.00%, respectively. Meanwhile, it improves the R² and VAF by 5.95–217.51% and 0.38–11.48%, respectively. These improvements clearly demonstrate that the VMLL model outperforms the other models, indicating its significant advantage over single prediction models. Furthermore, three additional datasets were used to evaluate the model’s performance. The average values of the performance evaluation metrics for these datasets were 0.6207% (MAPE), 0.0238 mm(MAE), 0.0273 mm(RMSE), 90.33%(R²), and 96.81%(VAF), respectively. These results demonstrate the high accuracy and strong robustness of the proposed model in predicting both horizontal displacement and vertical settlement of slopes, providing a reliable methodological framework for slope stability assessment and landslide disaster early warning.