Performance Enhancement of Kernel Extreme Learning Machine Using Whale Optimization Algorithm in Fruit Image Classification

This paper proposes a novel artificial neural network called Parallel Layer Perceptron Fast Learning Network (PLP-FLN). In PLP-FLN, a parallel single hidden layer feed-forward neural network is added on the basis of Fast Learning Network (FLN) which is an improved Extreme Learning Machine (ELM). Input weights and hidden layer biases are randomly generated. The weights connect the output nodes and the input nodes, and the weights connect the output nodes and the hidden nodes are analytically determined based on least squares methods. In order to test the PLP-FLN validity, this paper compared it with ELM, FLN, Kernel ELM and Incremental ELM through 12 regression applications and 7 classification problems. By comparing the experimental results, it shows that the PLP-FLN with much more compact networks have demonstrated better approximations, classification performances and generalization ability.

It is well-known that solar power depends on many complex parameters such as humidity, radiation, temperature, dust and wind speed. In order to cope with these complex structures and to provide an accurate forecast, the development of reliable and effective forecasting methodology is very significant. In this study, an Artificial Neural Network (ANN)-based system has been developed to forecast very short-term (2 to 4-h) power output of a grid tied Photovoltaic Power Plant (PVPP). An algorithm called Extreme Learning Machine (ELM) has gained increasing interest through its extremely fast learning and good generalization capability. The Kernel Extreme Learning Machine (KELM) which is the improved version of the ELM is proposed to develop a very short-term PVPP power forecast system. The most important feature of KELM is that it has less adjustable parameters and better generalization ability when compared with classical ELM. Experimental studies have been carried out on a grid tied PVPP that has 1 (MW) installed power capacity. The inputs of the KELM-based forecast system are selected as solar power, humidity, radiation and temperature. All data are divided into four parts to analyze the effect of seasons on the performance of the proposed forecast system. The comparison studies are carried out to clearly observe the forecast ability and performance of the KELM. From the experimental studies of the winter season which has not symmetric diurnal mean power curve, Correlation Coefficients (R) values of KELM are calculated as 0.896 for 2-h ahead, 0.865 for 3-h ahead, 0.833 for 4-h ahead. Those of ELM and (Levenberg Marquardt) LM are 0.866–0.812 for 2-h ahead, 0.831–0.669 for 3-h ahead, 0.799–0.502 for 4-h ahead, respectively. Root Mean Square Error (RMSE) and Mean Absolute Error (MAE) values of KELM for winter season are 12.08%-6.14% for 2-h ahead, 14.06%-7.43% for 3-h ahead, 15.33%-7.74% for 4-h ahead, respectively. While these values of ELM are obtained as 13.82%-7.05% for 2-h ahead, 15.52%-8.77% for 3-h ahead, 17.63%-9.33% for 4-h ahead. The RMSE and MAE values of LM are 17.90%-9.14% for 2-h ahead, 20.04%-9.85% for 3-h ahead, 21.22%-10.68% for 4-h ahead. According to the obtained results, it is clearly seen that KELM provides a more powerful and reliable forecasting performance.

Spectra data classification with kernel extreme learning machine

Prediction of GHG emissions from Chengdu Metro in the construction stage based on WOA-DELM

The Extreme Learning Machine (ELM) is a fast and straightforward learning algorithm designed for single hidden layer feed-forward neural networks (SLFNs). The ELM randomly assigns input weights and calculates the output weights analytically using the Moore-Penrose generalized inverse (MP) (also called Pseudo inverse). However, the MP is not preferable for ill-posed systems as it is sensitive to perturbation and may produce inaccurate solutions. Furthermore, it is computationally expensive as it involves matrix inversion. Regularized ELM (RELM) was proposed to address the limitations of the MP. In RELM, the regularization parameter is the primary factor that controls the classifier's performance. Though the RELM is stable and produces accurate results, finding a n a ppropriate regularization parameter value is tedious and increases the computation. This work proposes a variant of ELM named LSQR-ELM algorithm, which balances the ELM and RELM by maintaining stability and accuracy and avoiding the regularization entirely. The LSQR-ELM is based on the Least Squares QR (LSQR) iterative technique. Since the LSQR finds p a rtial Q R rather than full QR, it reduces unnecessary computation. To verify the proposed algorithm's ability, comparisons are made with several existing methods including ELM, Minimum Residual Method (MT-ELM), SVD-based SG-ELM, Optimally Pruned ELM (OP-ELM), and K-nearest neighbor (KNN). Extensive experimen-tation on various datasets demonstrates that the LSQR-ELM algorithm outperforms ELM, SG-ELM, OP-ELM, and KNN on most datasets. Moreover, it exhibits comparable performance to MT-ELM while requiring significantly f e wer computations.

Human activity recognition (HAR) is a main research field of context-aware computing; the performance of HAR mainly depends on the feature extraction method and classification algorithm. Extreme learning machine (ELM) is a single hidden layer neural network, which has better classification and generalization ability. However, ELM is not suitable for feature extraction. Deep learning is a hot research field as it can automatically extract significant features from raw data. In this paper, we propose an approach: an ELM-based deep model, which combined convolutional neural network (CNN), multilayer ELM (ML-ELM) as feature extractor, and used kernel ELM (KELM) as classifier. We used CNN and ML-ELM to extract significant features, and used KELM to achieve stable performance. The performance of proposed approach is validated on two public HAR datasets, and the experimental results show that the proposed approach is effective.

This paper proposes two deep learning modes which combine sparse auto-encoder with extreme learning machine (ELM) and kernel extreme learning machine (KELM), namely as Stacked Sparse Auto-encoder-Extreme Learning Machine and Stacked Sparse Auto-encoder-Kernel Extreme Learning Machine. The proposed models are applied to the image recognition task. To learn features from the original input data, SSAE with deep architecture is employed. Then, to construct a unified neural network learning model, ELM and KELM are selected to classify the extracted features. To evaluate the performance of the two proposed models, we carry out experiments on three different image data sets respectively. The results show that the proposed models’ performance can be not only superior to the shallow architecture models of Support Vector Machine, ELM and KELM but also better than the deep architecture models, such as Stacked Auto-encoder, Deep Belief Network and Stacked Denoising Auto-encoder.

Extreme Learning Machine (ELM) is a single hidden layer feed-forward neural network learning method, which has a high generalization performance as well as faster. In this paper, odour data is discriminated based on the sensor response curve by using ELM, and the main objective is to investigate the optimum number of nodes in the hidden layer of ELM for olfactory detection. The relationship between the number of nodes in the hidden layer and the number of attributes or classes of dataset is queried to achieve the goal. Three odour datasets taken from different sources in literature and two transfer functions for the ELM are used to verify the results of the study. The backpropagation (BP) algorithm is also used for training an artificial neural network for comparison purposes. The analysis is performed for the three datasets by using ELM and BP and obtained results present that the time consumption of ELM is too small to be compared with BP even though the number of nodes is high and better accuracy rates are obtained by ELM.

The two-dimensional morphology of the cladding layer has an important influence on the quality of the cladding layer and the crack tendency. Using the powerful nonlinear processing ability of the single hidden layer feedforward neural network, a prediction model between the cladding technological parameters and the two-dimensional morphology of the cladding layer is established. Taking the cladding parameters as the input and the two-dimensional morphology of the cladding as the output, the experimental data is used to train the network to achieve a high-level mapping of the input and output. On this basis, the algorithm of extreme learning machine is used to optimize the single hidden layer feedforward neural network to overcome the problems of slow convergence speed, more network training parameters and easy local convergence in back-propagation algorithm. The results show that the relationship between the cladding process parameters and the two-dimensional morphology of the cladding layer can be roughly reflected by the back-propagation algorithm. However, the prediction results are not stable and the error rate is between 10% and 40%. The neural network optimized by the extreme learning machine is utilized to get a better prediction result. The error rate is 10–20%.

Extreme learning machine is a novel single hidden layer feedforward neural networks with a strong abilities, for example simple net structure, fast learning speed, good generalization and so on. Aimed at the system with a delay unit, A new control strategy for internal model control is proposed to set up an inverse model of the minimal phase subsystem by using extreme learning machine with in-out system datum. Moreover, the relative stable error for internal model control system with a delay unit is presented to evaluate the system performance. The features for the internal model control system based on extreme learning machine are compared with that based on neural network. The experimental results indicate that the internal model control system based on extreme learning machine has small stable error and strong robustness.

Extreme learning machine (ELM) is an emergent method for train- ing single hidden layer feedforward neural networks (SLFNs) with extremely fast training speed, easy implementation and good generalization performance. This work presents effective ensemble procedures for combining ELMs by exploiting di- versity. A large number of ELMs are initially trained in three different scenarios: the original feature input space, the obtained feature subset by forward selection and different random subsets of features. The best combination of ELMs is con- structed according to an exact ranking of the trained models and the useless net- works are discarded. The experimental results on several regression problems show that robust ensemble approaches that exploit diversity can effectively improve the performance compared with the standard ELM algorithm and other recent ELM extensions.

COVID-19 is a disease or virus that has recently spread worldwide. The disease has also taken many casualties because the virus is notoriously deadly. An examination can be carried out using a chest X-Ray because it costs cheaper compared to swab and PCR tests. The data used in this study was chest X-Ray image data. Chest X-Ray images can be identified using Computer-Aided Diagnosis by utilizing machine learning classification. The first step was the preprocessing stage and feature extraction using the Gray Level Co-Occurrence Matrix (GLCM). The result of the feature extraction was then used at the classification stage. The classification process used was Extreme Learning Machine (ELM). Extreme Learning Machine (ELM) is one of the artificial neural networks with advanced feedforward which has one hidden layer called Single Hidden Layer Feedforward Neural Networks (SLFNs). The results obtained by GLCM feature extraction and classification using ELM achieved the best accuracy of 91.21%, the sensitivity of 100%, and the specificity of 91% at 135° rotation using linear activation function with 15 hidden nodes.

The theory and implementation of extreme learning machine (ELM) prove that it is a simple, efficient, and accurate machine learning method. Compared with other single hidden layer feedforward neural network algorithms, ELM is characterized by simpler parameter selection rules, faster convergence speed, and less human intervention. The multiple hidden layer regularized extreme learning machine (MRELM) inherits these advantages of ELM and has higher prediction accuracy. In the MRELM model, the number of hidden layers is randomly initiated and fixed, and there is no iterative tuning process. However, the optimal number of hidden layers is the key factor to determine the generalization ability of MRELM. Given this situation, it is obviously unreasonable to determine this number by trial and random initialization. In this paper, an incremental MRELM training algorithm (FC-IMRELM) based on forced positive-definite Cholesky factorization is put forward to solve the network structure design problem of MRELM. First, an MRELM-based prediction model with one hidden layer is constructed, and then a new hidden layer is added to the prediction model in each training step until the generalization performance of the prediction model reaches its peak value. Thus, the optimal network structure of the prediction model is determined. In the training procedure, forced positive-definite Cholesky factorization is used to calculate the output weights of MRELM, which avoids the calculation of the inverse matrix and Moore-Penrose generalized inverse of matrix involved in the training process of hidden layer parameters. Therefore, FC-IMRELM prediction model can effectively reduce the computational cost brought by the process of increasing the number of hidden layers. Experiments on classification and regression problems indicate that the algorithm can be effectively used to determine the optimal network structure of MRELM, and the prediction model training by the algorithm has excellent performance in prediction accuracy and computational cost.

Ensemble dropout extreme learning machine via fuzzy integral for data classification

Extreme learning machine (ELM) has been developed for single hidden layer feedforward neural networks (SLFNs). In ELM algorithm, the connections between the input layer and the hidden neurons are randomly assigned and remain unchanged during the learning process. The output connections are then tuned via minimizing the cost function through a linear system. The computational burden of ELM has been significantly reduced as the only cost is solving a linear system. The low computational complexity attracted a great deal of attention from the research community, especially for high dimensional and large data applications. This paper provides an up-to-date survey on the recent developments of ELM and its applications in high dimensional and large data. Comprehensive reviews on image processing, video processing, medical signal processing, and other popular large data applications with ELM are presented in the paper.