Multi-label classification with extreme learning machine

A new off-line learning algorithm for single layer feed-forward neural networks (SLFNs) called Extreme Learning Machine (ELM) was introduced by Huang et al. [1, 2, 3, 4]. ELM is not as the same as traditional BP method as it can achieve good generalization performance at an extremely fast learning speed. In ELM, the hidden neuron parameters (the input weights and hidden biases or the RBF centers and impact factors) were pre-determined randomly so a set of non-optimized parameters might avoid ELM to achieve the global minimum in some applications. This paper tries to find a set of optimized value of input weights using gradient-based algorithm in training SLFN where the activation function is differentiable.

Among the different computational intelligence techniques avalaible for hyperspectral data classification, support vector machines (SVMs) have played a dominant role. Recently, a new learning algorithm for single-layer feedforward neural networks called the extreme learning machine (ELM) was proposed. This technique is competitive with SVMs in terms of accuracy, learning speed, and computational scalability. In this article, we propose and evaluate the use of ELM for land-cover classification from hyperspectral images. In addition, we consider two ELM-based techniques integrating spectral and spatial information of the image. The first is a scheme that uses a majority vote approach in order to combine the results of a pixel-wise spectral classification by ELM and a segmentation map obtained by a watershed algorithm. The second introduces spatial information from a small spatial neighbourhood after the classification by ELM. We show the usefulness of spatial–spectral ELM-based classification techniques in hyperspectral imaging. The results are compared to those obtained by similar SVM-based techniques and show improved classification results and much lower execution time. These simple and computationally cheap methods can be combined with others traditionally applied to hyperspectral images.

Ensemble dropout extreme learning machine via fuzzy integral for data classification

The theory and implementation of extreme learning machine (ELM) prove that it is a simple, efficient, and accurate machine learning method. Compared with other single hidden layer feedforward neural network algorithms, ELM is characterized by simpler parameter selection rules, faster convergence speed, and less human intervention. The multiple hidden layer regularized extreme learning machine (MRELM) inherits these advantages of ELM and has higher prediction accuracy. In the MRELM model, the number of hidden layers is randomly initiated and fixed, and there is no iterative tuning process. However, the optimal number of hidden layers is the key factor to determine the generalization ability of MRELM. Given this situation, it is obviously unreasonable to determine this number by trial and random initialization. In this paper, an incremental MRELM training algorithm (FC-IMRELM) based on forced positive-definite Cholesky factorization is put forward to solve the network structure design problem of MRELM. First, an MRELM-based prediction model with one hidden layer is constructed, and then a new hidden layer is added to the prediction model in each training step until the generalization performance of the prediction model reaches its peak value. Thus, the optimal network structure of the prediction model is determined. In the training procedure, forced positive-definite Cholesky factorization is used to calculate the output weights of MRELM, which avoids the calculation of the inverse matrix and Moore-Penrose generalized inverse of matrix involved in the training process of hidden layer parameters. Therefore, FC-IMRELM prediction model can effectively reduce the computational cost brought by the process of increasing the number of hidden layers. Experiments on classification and regression problems indicate that the algorithm can be effectively used to determine the optimal network structure of MRELM, and the prediction model training by the algorithm has excellent performance in prediction accuracy and computational cost.

Extreme learning machine is a novel single hidden layer feedforward neural networks with a strong abilities, for example simple net structure, fast learning speed, good generalization and so on. Aimed at the system with a delay unit, A new control strategy for internal model control is proposed to set up an inverse model of the minimal phase subsystem by using extreme learning machine with in-out system datum. Moreover, the relative stable error for internal model control system with a delay unit is presented to evaluate the system performance. The features for the internal model control system based on extreme learning machine are compared with that based on neural network. The experimental results indicate that the internal model control system based on extreme learning machine has small stable error and strong robustness.

Extreme learning machine (ELM) is a learning algorithm for single-hidden layer feedforward neural networks. In theory, this algorithm is able to provide good generalization capability at extremely fast learning speed. Comparative studies of benchmark function approximation problems revealed that ELM can learn thousands of times faster than conventional neural network (NN) and can produce good generalization performance in most cases. Unfortunately, the research on damage localization using ELM is limited in the literature. In this chapter, the ELM is extended to the domain of damage localization of plate structures. Its effectiveness in comparison with typical neural networks such as back-propagation neural network (BPNN) and least squares support vector machine (LSSVM) is illustrated through experimental studies. Comparative investigations in terms of learning time and localization accuracy are carried out in detail. It is shown that ELM paves a new way in the domain of plate structure health monitoring. Both advantages and disadvantages of using ELM are discussed.

This paper presents variable monsoon trends over Kerala in winter, pre-monsoon, summer monsoon and post-monsoon periods. The decreasing trends in seasonal rainfall and post-monsoon rainfall and increasing occurrence of the deficit rainfall years indicates the probable intensification of water scarcity in Kerala. Artificial intelligent methods like Single layer Feed-Forward Neural Network (SLFN) and Extreme Learning Machine (ELM) were used to predict the summer monsoon rainfall as heavy rainfall occurs during this period in the state. The proposed SLFN network prediction model provides 6.3977% of mean absolute error whereas ELM provides 3.8729% of error. ELM is better as compared to SLFN and can be used as a prediction tool for analyzing complex monsoon phenomena.

This paper proposes a novel artificial neural network called Parallel Layer Perceptron Fast Learning Network (PLP-FLN). In PLP-FLN, a parallel single hidden layer feed-forward neural network is added on the basis of Fast Learning Network (FLN) which is an improved Extreme Learning Machine (ELM). Input weights and hidden layer biases are randomly generated. The weights connect the output nodes and the input nodes, and the weights connect the output nodes and the hidden nodes are analytically determined based on least squares methods. In order to test the PLP-FLN validity, this paper compared it with ELM, FLN, Kernel ELM and Incremental ELM through 12 regression applications and 7 classification problems. By comparing the experimental results, it shows that the PLP-FLN with much more compact networks have demonstrated better approximations, classification performances and generalization ability.

The Extreme Learning Machine (ELM) is a fast and straightforward learning algorithm designed for single hidden layer feed-forward neural networks (SLFNs). The ELM randomly assigns input weights and calculates the output weights analytically using the Moore-Penrose generalized inverse (MP) (also called Pseudo inverse). However, the MP is not preferable for ill-posed systems as it is sensitive to perturbation and may produce inaccurate solutions. Furthermore, it is computationally expensive as it involves matrix inversion. Regularized ELM (RELM) was proposed to address the limitations of the MP. In RELM, the regularization parameter is the primary factor that controls the classifier's performance. Though the RELM is stable and produces accurate results, finding a n a ppropriate regularization parameter value is tedious and increases the computation. This work proposes a variant of ELM named LSQR-ELM algorithm, which balances the ELM and RELM by maintaining stability and accuracy and avoiding the regularization entirely. The LSQR-ELM is based on the Least Squares QR (LSQR) iterative technique. Since the LSQR finds p a rtial Q R rather than full QR, it reduces unnecessary computation. To verify the proposed algorithm's ability, comparisons are made with several existing methods including ELM, Minimum Residual Method (MT-ELM), SVD-based SG-ELM, Optimally Pruned ELM (OP-ELM), and K-nearest neighbor (KNN). Extensive experimen-tation on various datasets demonstrates that the LSQR-ELM algorithm outperforms ELM, SG-ELM, OP-ELM, and KNN on most datasets. Moreover, it exhibits comparable performance to MT-ELM while requiring significantly f e wer computations.

Extreme learning machine (ELM) is an easy-to use and effective learning algorithm of single-hidden layer feed-forward neural networks (SLFNs). The classical learning algorithm in neural network, e. g. backpropagation, requires setting several user-defined parameters and may get into local minimum. However, ELM only requires setting the number of hidden neurons and the activation function. It does not require adjusting the input weights and hidden layer biases during the implementation of the algorithm, and it produces only one optimal solution. Therefore, ELM has the advantages of fast learning speed and good generalization performance. In this paper, ELM is introduced in predicting reservoir permeability. By comparing to SVM, we analyze its feasibility and advantages in reservoir permeability prediction. The experimental results show that ELM has similar accuracy compared to SVR, but it has obvious advantages in parameter selection and learning speed.

Extreme learning machine (ELM) is an emergent method for train- ing single hidden layer feedforward neural networks (SLFNs) with extremely fast training speed, easy implementation and good generalization performance. This work presents effective ensemble procedures for combining ELMs by exploiting di- versity. A large number of ELMs are initially trained in three different scenarios: the original feature input space, the obtained feature subset by forward selection and different random subsets of features. The best combination of ELMs is con- structed according to an exact ranking of the trained models and the useless net- works are discarded. The experimental results on several regression problems show that robust ensemble approaches that exploit diversity can effectively improve the performance compared with the standard ELM algorithm and other recent ELM extensions.

Stream-flow forecasting using extreme learning machines: A case study in a semi-arid region in Iraq

Extreme Learning Machine (ELM) is a single hidden layer feed-forward neural network learning method, which has a high generalization performance as well as faster. In this paper, odour data is discriminated based on the sensor response curve by using ELM, and the main objective is to investigate the optimum number of nodes in the hidden layer of ELM for olfactory detection. The relationship between the number of nodes in the hidden layer and the number of attributes or classes of dataset is queried to achieve the goal. Three odour datasets taken from different sources in literature and two transfer functions for the ELM are used to verify the results of the study. The backpropagation (BP) algorithm is also used for training an artificial neural network for comparison purposes. The analysis is performed for the three datasets by using ELM and BP and obtained results present that the time consumption of ELM is too small to be compared with BP even though the number of nodes is high and better accuracy rates are obtained by ELM.

In this paper, we have proposed a new algorithm to train neural network, called Class-Constrained Extreme Learning Machine (C\(^{2}\)ELM), which is based on Extreme Learning Machine (ELM). In C\(^{2}\)ELM, we use class information to constrain different parts of connection weights between input layer and hidden layer using Extreme Learning Machine Auto Encoder (ELM-AE). In this way, we add class information to the connection weights and make the features in the hidden layer which are learned from input space be more discriminative than other methods based on ELM. Meanwhile, C\(^{2}\)ELM can retain the advantages of ELM. The experiments shown that C\(^{2}\)ELM is effective and efficient and can achieve a higher performance in contrast to other ELM based methods.

In this paper, we present a robust semi-blind video watermarking scheme in lifting wavelet transform (LWT) domain using Extreme Learning Machine (ELM). In this scheme, first the static video summary is generated using extraction of color features from video frames. Second, the frames comprised of video summary are watermarked in LWT domain. To develop a robust and real time watermarking scheme, a fast Single hidden Layer Feedforward Neural Network (SLFN) known as ELM is used for watermark embedding and extraction. To evaluate the performance of the present scheme, several signal processing attacks are applied to each watermarked frame. Experimental evidence shows that the proposed scheme is robust against selected attacks. Due to fastprocessing of frames, the proposed scheme is also found to be suitable for real time watermarking of video.