Ensemble dropout extreme learning machine via fuzzy integral for data classification

Extreme learning machine (ELM) is an emergent method for train- ing single hidden layer feedforward neural networks (SLFNs) with extremely fast training speed, easy implementation and good generalization performance. This work presents effective ensemble procedures for combining ELMs by exploiting di- versity. A large number of ELMs are initially trained in three different scenarios: the original feature input space, the obtained feature subset by forward selection and different random subsets of features. The best combination of ELMs is con- structed according to an exact ranking of the trained models and the useless net- works are discarded. The experimental results on several regression problems show that robust ensemble approaches that exploit diversity can effectively improve the performance compared with the standard ELM algorithm and other recent ELM extensions.

The Extreme Learning Machine (ELM) is a fast and straightforward learning algorithm designed for single hidden layer feed-forward neural networks (SLFNs). The ELM randomly assigns input weights and calculates the output weights analytically using the Moore-Penrose generalized inverse (MP) (also called Pseudo inverse). However, the MP is not preferable for ill-posed systems as it is sensitive to perturbation and may produce inaccurate solutions. Furthermore, it is computationally expensive as it involves matrix inversion. Regularized ELM (RELM) was proposed to address the limitations of the MP. In RELM, the regularization parameter is the primary factor that controls the classifier's performance. Though the RELM is stable and produces accurate results, finding a n a ppropriate regularization parameter value is tedious and increases the computation. This work proposes a variant of ELM named LSQR-ELM algorithm, which balances the ELM and RELM by maintaining stability and accuracy and avoiding the regularization entirely. The LSQR-ELM is based on the Least Squares QR (LSQR) iterative technique. Since the LSQR finds p a rtial Q R rather than full QR, it reduces unnecessary computation. To verify the proposed algorithm's ability, comparisons are made with several existing methods including ELM, Minimum Residual Method (MT-ELM), SVD-based SG-ELM, Optimally Pruned ELM (OP-ELM), and K-nearest neighbor (KNN). Extensive experimen-tation on various datasets demonstrates that the LSQR-ELM algorithm outperforms ELM, SG-ELM, OP-ELM, and KNN on most datasets. Moreover, it exhibits comparable performance to MT-ELM while requiring significantly f e wer computations.

Extreme learning machine is a novel single hidden layer feedforward neural networks with a strong abilities, for example simple net structure, fast learning speed, good generalization and so on. Aimed at the system with a delay unit, A new control strategy for internal model control is proposed to set up an inverse model of the minimal phase subsystem by using extreme learning machine with in-out system datum. Moreover, the relative stable error for internal model control system with a delay unit is presented to evaluate the system performance. The features for the internal model control system based on extreme learning machine are compared with that based on neural network. The experimental results indicate that the internal model control system based on extreme learning machine has small stable error and strong robustness.

Extreme learning machine (ELM) is a learning algorithm for single-hidden layer feedforward neural networks. In theory, this algorithm is able to provide good generalization capability at extremely fast learning speed. Comparative studies of benchmark function approximation problems revealed that ELM can learn thousands of times faster than conventional neural network (NN) and can produce good generalization performance in most cases. Unfortunately, the research on damage localization using ELM is limited in the literature. In this chapter, the ELM is extended to the domain of damage localization of plate structures. Its effectiveness in comparison with typical neural networks such as back-propagation neural network (BPNN) and least squares support vector machine (LSSVM) is illustrated through experimental studies. Comparative investigations in terms of learning time and localization accuracy are carried out in detail. It is shown that ELM paves a new way in the domain of plate structure health monitoring. Both advantages and disadvantages of using ELM are discussed.

Extreme learning machine (ELM) has been developed for single hidden layer feedforward neural networks (SLFNs). In ELM algorithm, the connections between the input layer and the hidden neurons are randomly assigned and remain unchanged during the learning process. The output connections are then tuned via minimizing the cost function through a linear system. The computational burden of ELM has been significantly reduced as the only cost is solving a linear system. The low computational complexity attracted a great deal of attention from the research community, especially for high dimensional and large data applications. This paper provides an up-to-date survey on the recent developments of ELM and its applications in high dimensional and large data. Comprehensive reviews on image processing, video processing, medical signal processing, and other popular large data applications with ELM are presented in the paper.

The main objective of this works is to study and improve the performances of the Single hidden Layer Feedforward Neural network (SLFN) for the application of Remaining Useful Life (RUL) prediction of aircraft engines. The most common problems in SLFNs based old training algorithms such as backpropagation are time consuming, over-fitting and the appropriate network architecture identification. In this paper a new incremental constructive learning algorithm based on Extreme Learning Machine algorithm is proposed for founding the appropriate architecture of a neural network under less computational costs. The aim of the proposed training approach is to study its maximum capabilities during RUL prediction by reducing over-fitting and human intervention. The performances of the proposed approach which are evaluated on C-MAPPS dataset and compared with its original variant from the literature. Experimental results proved that the new algorithm outperforms the old one in many metrics evaluations.

In this paper, we present a robust semi-blind video watermarking scheme in lifting wavelet transform (LWT) domain using Extreme Learning Machine (ELM). In this scheme, first the static video summary is generated using extraction of color features from video frames. Second, the frames comprised of video summary are watermarked in LWT domain. To develop a robust and real time watermarking scheme, a fast Single hidden Layer Feedforward Neural Network (SLFN) known as ELM is used for watermark embedding and extraction. To evaluate the performance of the present scheme, several signal processing attacks are applied to each watermarked frame. Experimental evidence shows that the proposed scheme is robust against selected attacks. Due to fastprocessing of frames, the proposed scheme is also found to be suitable for real time watermarking of video.

COVID-19 is a disease or virus that has recently spread worldwide. The disease has also taken many casualties because the virus is notoriously deadly. An examination can be carried out using a chest X-Ray because it costs cheaper compared to swab and PCR tests. The data used in this study was chest X-Ray image data. Chest X-Ray images can be identified using Computer-Aided Diagnosis by utilizing machine learning classification. The first step was the preprocessing stage and feature extraction using the Gray Level Co-Occurrence Matrix (GLCM). The result of the feature extraction was then used at the classification stage. The classification process used was Extreme Learning Machine (ELM). Extreme Learning Machine (ELM) is one of the artificial neural networks with advanced feedforward which has one hidden layer called Single Hidden Layer Feedforward Neural Networks (SLFNs). The results obtained by GLCM feature extraction and classification using ELM achieved the best accuracy of 91.21%, the sensitivity of 100%, and the specificity of 91% at 135° rotation using linear activation function with 15 hidden nodes.

The extreme learning machine (ELM) is a well-known approach for training single hidden layer feedforward neural networks (SLFNs) in machine learning. However, ELM is most effective when used for regression on datasets with simple Gaussian distributed error because it often employs a squared loss in its objective function. In contrast, real-world data is often collected from unpredictable and diverse contexts, which may contain complex noise that cannot be characterized by a single distribution. To address this challenge, we propose a robust mixture ELM algorithm, called Mixture-ELM, that enhances modeling capability and resilience to both Gaussian and non-Gaussian noise. The Mixture-ELM algorithm uses an adjusted objective function that blends Gaussian and Laplacian distributions to approximate any continuous distribution and match the noise. The Gaussian mixture accurately models the residual distribution, while the inclusion of the Laplacian distribution addresses the limitations of the Gaussian distribution in identifying outliers. We derive a solution to the novel objective function using the expectation maximization (EM) and iteratively reweighted least squares (IRLS) algorithms. We evaluate the effectiveness of the algorithm through numerical simulation and experiments on benchmark datasets, thereby demonstrating its superiority over other state-of-the-art machine learning methods in terms of robustness and generalization.

Multilayer perceptrons with hard-limiting (signum) activation functions can form complex decision regions. It is well known that a three-layer perceptron (two hidden layers) can form arbitrary disjoint decision regions and a two-layer perceptron (one hidden layer) can form single convex decision regions. This paper further proves that single hidden layer feedforward neural networks (SLFN's) with any continuous bounded nonconstant activation function or any arbitrary bounded (continuous or not continuous) activation function which has unequal limits at infinities (not just perceptrons) can form disjoint decision regions with arbitrary shapes in multidimensional cases. SLFN's with some unbounded activation function can also form disjoint decision regions with arbitrary shapes.

A new algorithm for single hidden layer feedforward neural networks (SLFN), Orthogonal Basis Extreme Learning (OBEL) algorithm, is proposed and the algorithm derivation is given in the paper. The algorithm can decide both the NNs parameters and the neuron number of hidden layer(s) during training while providing extreme fast learning speed. It will provide a practical way to develop NNs. The simulation results of function approximation showed that the algorithm is effective and feasible with good accuracy and adaptability.

Massive amounts of medical data led to a faster, more accurate diagnosis and course of treatment for cancer. Machine learning (ML) algorithms have been developed increasingly in order to process medical data. By embedding knowledge from data into the algorithm’s architecture we customize MLs to provide personalized diagnosis and personalized treatment plan. The goal of this study is to statistically analyze non-parametric correlation coefficients for initializing the input-hidden weight matrix of three single hidden layer feedforward neural networks (SLFNs). A SLFN is able to approximate a continuous function given a training dataset as input for a desired output. Using different non-parametric correlation coefficients, \(\rho , \tau \), and \(\gamma \), we developed three novel SLFNs that have their input hidden layer weight matrix initialized using the above-mentioned correlation coefficients computed between the input and the output. The matrix that contains the hidden output weights is computed in just one step, using the Moore-Penrose pseudoinverse matrix. A statistical analysis is performed for assessing the models’ results when applied on three medical datasets that regard differentiating lung, breast, and liver cancer. The statistical benchmarking showed that the \(\rho \)-SLFN is superior to the other two. All three models were overall competitive to other state-of-the-art algorithms.KeywordsSpearman correlationKendall tau correlationGoodman Kruskal GammaSomer’s DSingle hidden feedforward networkStatistical assessment

Extreme Learning Machine for large-scale graph classification based on MapReduce

Discriminative subgraph mining from a large collection of graph objects is a crucial problem for graph classification. Extreme Learning Machine (ELM) is a simple and efficient Single-hidden Layer Feedforward neural Networks (SLFNs) algorithm with extremely fast learning capacity. In this paper, we propose a discriminative subgraph mining approach based on ELM-Filter strategy within the scalable MapReduce computing model. We randomly partition the collection of graphs among worker nodes, and each worker applies a fast pattern evolutionary method to mine a set of discriminative subgraphs with the help of ELM-Filter strategy in its partition. And, the set of discriminative subgraphs must produce higher ELM training accuracy. The union of all such discriminative subgraphs is the mining result for the input large-scale graphs. Extensive experimental results on both real and synthetic datasets show that our method obviously outperforms the other approaches in terms of both classification accuracy and runtime efficiency.

Coral reefs are one of the most prominent marine ecosystems on the Earth; they are threatened due to various factors, including growing anthropogenic impacts and the effects of global change. Hence, the automatic classification of coral species is significant for tracking and detecting threatened and susceptible coral species. This paper proposes a new feature descriptor known as fractal adaptive weight synthesized-local directional pattern (FAWS-LDP) method to classify coral images using enhanced tree seed algorithm with extreme learning machine (ETSA-ELM) technique. The proposed feature descriptor (FAWS-LDP) inherits the advantage of both fractal pixel intensity information and local directional characteristics by indexing both feature vector values. Finally, the extracted features are imported to the extreme learning machine (ELM) network for classification. The ELM classifier is a single hidden layer feed-forward neural network with a faster learning speed and produces good generalization performance. The random selection of input weight and biases of the ELM classifier produces non-optimal or unnecessary input biases and weights to the network. Hence, to fine-tune the parameters of the ELM classifier, an enhanced tree seed algorithm (ETSA) is proposed. The proposed ETSA is a new learning technique to overcome the drawbacks like local optima and a lower coverage rate. The classification performance of ELM employing the ETSA optimizer is compared to the original TSA and other well-known metaheuristic algorithm (MHA) trainers, such as genetic algorithm (GA), particle swarm optimization (PSO), and artificial bee colony (ABC), utilizing model performance measures like specificity, sensitivity, and classification accuracy. The evaluation of coral classification datasets reveals that the proposed ETSA-ELM produces consistently superior performance to existing methods. Finally, the proposed feature descriptor technique is statistically analyzed using a non-parametric Friedman test to demonstrate the efficiency.