AdaBoostNet: An Efficient Hierarchical Neural Network for Image Classification

Heart failure is one of the leading causes of death worldwide and requires accurate and timely diagnosis to improve patient outcomes. However, early detection remains a significant challenge due to the complexity of clinical data, high dimensionality of features, and variability in patient conditions. Traditional clinical methods often fall short in identifying subtle patterns that indicate early stages of heart failure, motivating the need for intelligent computational techniques to support diagnostic decisions. This study aims to enhance predictive modeling for heart failure classification by comparing two supervised machine learning approaches: Extreme Learning Machine (ELM) and Hierarchical Extreme Learning Machine (HELM). The main contribution of this research is the empirical evaluation of HELM's performance improvements over conventional ELM using 10-fold cross-validation on a publicly available clinical dataset. Unlike traditional neural networks, ELM offers fast training by randomly assigning weights and analytically computing output connections, while HELM extends this with a multi-layer structure that allows for more complex feature representation and improved generalization. Both models were assessed based on classification accuracy and Area Under the Curve (AUC), two critical metrics in medical classification tasks. The ELM model achieved an accuracy of 73.95% ± 8.07 and an AUC of 0.7614 ± 0.093, whereas the HELM model obtained a comparable accuracy of 73.55% ± 7.85 but with a higher AUC of 0.7776 ± 0.085. In several validation folds, HELM outperformed ELM, notably reaching 90% accuracy and 0.9250 AUC in specific cases. In conclusion, HELM demonstrates improved robustness and discriminatory capability in identifying heart failure cases. These findings suggest that HELM is a promising candidate for implementation in clinical decision support systems. Future research may incorporate feature selection, hyperparameter optimization, and evaluation across multi-center datasets to improve generalizability and real-world applicability.

In Cassini ISS (Imaging Science Subsystem) images, contour detection is often performed on disk-resolved objects to accurately locate their center. Thus, contour detection is a key problem. Traditional edge detection methods, such as Canny and Roberts, often extract the contour with too much interior details and noise. Although the deep convolutional neural network has been applied successfully in many image tasks, such as classification and object detection, it needs more time and computer resources. In this paper, a contour detection algorithm based on H-ELM (Hierarchical Extreme Learning Machine) and DenseCRF (Dense Conditional Random Field) is proposed for Cassini ISS images. The experimental results show that this algorithm’s performance is better than both traditional machine learning methods, such as Support Vector Machine, Extreme Learning Machine and even deep Convolutional Neural Network. The extracted contour is closer to the actual contour. Moreover, it can be trained and tested quickly on the general configuration of PC, and thus can be applied to contour detection for Cassini ISS images.

Estimation of rip density on intermediate beaches using an extreme learning machine model

Having stepped into the era of information explosion, storing, processing and analyzing the vast data sometimes are quite intractable problems. However, it is impossible for personal computer or devices to tackle with such heavy workloads. Then, companies that provides cloud computational services come into business. From the perspective of companies, the cost for providing fog computing services is much higher than the traditional computing services. Consequently, the price for real-time requests is more expensive than the reserved services. Aiming at minimizing the expenditures, the most important part is how many cloud services the customers should reserve in advance because different amounts they consume will yield different expenses and both of insufficient and excess consumption result in wastes. The emerging machine learning method provides a powerful tool to address such a prediction problem. In this paper, we propose a hierarchical Pythagorean fuzzy deep neural network (HPFDNN) to forecast the quantity of requisite cloud services. On account of obtaining the better interpretations of original data, beyond the employment of fuzzy logic, the neural representation is also utilized as a complementary method. The information or the knowledge acquired from fuzzy and neural perspectives are coalesced as the final transformed data to be put into the learning systems, so that the useful information concealed in the enormous contents can be effectively described. On the basis of the anticipation of the deep neural network, the consumers are able to decide the amount of cloud services to purchase. Numerical results based on the real data set from Carnegie Mellon University demonstrate that the proposed model yields the economical predictions and outperforms the prediction by the traditional deep neural network.

Fully connected multi layer neural networks such as Deep Boltzmann Machines (DBM) performs better than fully connected single layer neural networks in image classification tasks and has a smaller number of hidden layer neurons than Extreme Learning Machine (ELM) based fully connected multi layer neural networks such as Multi Layer ELM (MLELM) and Hierarchical ELM (H-ELM) However, ML-ELM and H-ELM has a smaller training time than DBM. This paper introduces a fully connected multi layer neural network referred to as Multi Layer Multi Objective Extreme Learning Machine (MLMO-ELM) which uses a multi objective formulation to pass the label and non-linear information in order to learn a network model which has a similar number of hidden layer parameters as DBM and smaller training time than DBM. The experimental results show that MLMO-ELM outperforms DBM, ML-ELM and H-ELM on OCR and NORB datasets.

Aging state prediction for supercapacitors based on heuristic kalman filter optimization extreme learning machine

Rapid detection of food quality indicators using ELM and near-infrared spectroscopy.

The learning-based methods have been widely applied to design a fault diagnosis model for rolling element bearing. However, the mainstream methods can only deal with the large training dataset, which is always violated in practical application. In this paper, we propose a physical knowledge-based hierarchical extreme learning machine(H-ELM) approach to adapt the problem of fault diagnosis for bearing with the small and imbalanced dataset. First, the proposed method uses the simple feature extraction algorithm to build a knowledge base for sample selection from the historical database, and the given training dataset is augmented with knowledge base. Second, a modified H-ELM algorithm is developed to identify fault location and recognize fault severity ranking based on the augmented dataset. Third, we design a self-optimizing module to optimize the sample selection and improve the performance of the H-ELM network. To evaluate the effectiveness of the proposed approach, the H-ELM without knowledge base and data augmentation-based support vector machine(SVM), back propagation neuron networks(BPNN) and deep belief networks(DBN) are tested in the numerical experiments to present a comprehensive comparison. The experimental results demonstrate that our approach outperforms in accuracy than other counterparts when dealing with the small and imbalanced datasets.

For learning in big datasets, the classification performance of ELM might be low due to input samples are not extracted features properly. To address this problem, the hierarchical extreme learning machine (H-ELM) framework was proposed based on the hierarchical learning architecture of multilayer perceptron. H-ELM composes of two parts; the first is the unsupervised multilayer encoding part and the second part is the supervised feature classification part. H-ELM can give higher accuracy rate than of the traditional ELM. However, it still has to enhance its classification performance. Therefore, this paper proposes a new method namely as the extending hierarchical extreme learning machine (EH-ELM). For the extended supervisor part of EH-ELM, we have got an idea from the two-layers extreme learning machine. To evaluate the performance of EH-ELM, three different image datasets; Semeion, MNIST, and NORB, were studied. The experimental results show that EH-ELM achieves better performance than of H-ELM and the other multi-layer framework.

Recently, multilayer extreme learning machine (ELM) algorithms have been extensively studied for hierarchical abstract representation learning in the ELM community. In this paper, we investigate the specific combination of $$L_{21}$$ -norm based loss function and regularization to improve the robustness and the sparsity of multilayer ELM. As we all known, the mean square error (MSE) cost function (or squared $$L_{2}$$ -norm cost function) is commonly used as optimization cost function for ELM, but it is sensitive to outliers and impulsive noises that are pervasive in real-world data. Our $$L_{21}$$ -norm loss function can lessen the harmful influence caused by noises and outliers and enhance robustness and stability of the learned model. Additionally, the row sparse inducing $$L_{21}$$ -norm regularization can learn the most-relevant sparse representation and reduce the intrinsic complexity of the learning model. We propose a specific combination of $$L_{21}$$ -norm loss function and regularization ELM auto-encoder (LR21-ELM-AE), and then stack LR21-ELM-AE hierarchically to construct the hierarchical extreme learning machine (H-LR21-ELM). Experiments conducted on several well-known benchmark datasets are presented, the results show that the proposed H-LR21-ELM can generate a more robust, more discriminative and sparser model compared with the other state-of-the-art multilayer ELM algorithms.

MI-ELM: Highly efficient multi-instance learning based on hierarchical extreme learning machine

A prediction method based on Extreme Learning Machines(ELM) is proposed. The parameters of ELM are optimized by immune optimization algorithm. The proposed model is used to predict the fiber quality of the melt spinning process. According to the limited samples, the spinning speed, the spinning temperature, the blowing speed and the blowing temperature of the melt spinning process are four key parameters that affect the fiber quality. The four indexes of polyester fiber are 1.5 times rate of elongation(EYS1.5), elongation inequality rate(EYSCV), breaking strength(DT) and elongation capacity(DE). We collect actual data samples in the factory and establish the ELM prediction model. The ELM model optimized by immune optimization algorithm (ELM-IA) is compared with PSO optimized ELM (ELM-PSO), ELM model and BP neural network. The experimental results show that the ELM-IA model is better than the ELM-PSO model, the ELM model and BP neural network in prediction. The ELM-IA model has a good generalization ability. It can play a guiding role in the actual fiber production process.

Deep Neural Networks (DNNs) have made significant improvements to reach the desired accuracy to be employed in a wide variety of Machine Learning (ML) applications. Recently the Google Brain's team demonstrated the ability of Capsule Networks (CapsNets) to encode and learn spatial correlations between different input features, thereby obtaining superior learning capabilities compared to traditional (i.e., non-capsule based) DNNs. However, designing CapsNets using conventional methods is a tedious job and incurs significant training effort. Recent studies have shown that powerful methods to automatically select the best/optimal DNN model configuration for a given set of applications and a training dataset are based on the Neural Architecture Search (NAS) algorithms. Moreover, due to their extreme computational and memory requirements, DNNs are employed using the specialized hardware accelerators in IoT-Edge/CPS devices. In this paper, we propose NASCaps, an automated framework for the hardware-aware NAS of different types of DNNs, covering both traditional convolutional DNNs and CapsNets. We study the efficacy of deploying a multi-objective Genetic Algorithm (e.g., based on the NSGA-II algorithm). The proposed framework can jointly optimize the network accuracy and the corresponding hardware efficiency, expressed in terms of energy, memory, and latency of a given hardware accelerator executing the DNN inference. Besides supporting the traditional DNN layers, our framework is the first to model and supports the specialized capsule layers and dynamic routing in the NAS-flow. We evaluate our framework on different datasets, generating different network configurations, and demonstrate the tradeoffs between the different output metrics. We will open-source the complete framework and configurations of the Pareto-optimal architectures at https://github.com/ehw-fit/nascaps.

Predicting water consumption is of key importance for water supply management, which is also relevant in processes for reviewing prices.In this study, a hybrid method based on extreme learning machine model with the adaptive metrics of inputs is proposed for improving forecasting accuracy.The adaptive metrics of inputs can solve the problems of amplitude changing and trend determination, and reduce the effect of the overfitting of networks.It was found that the proposed model is practical for water demand forecasting and outperforms the autoregression (AR), artificial neural network (ANN), support vector machine(SVM) and extreme learning machine (ELM) models.

To solve the problems of low prediction accuracy, poor stability, and low calculation efficiency in runoff forecasting, this study develops an extreme learning machine (ELM) model based on improved complete ensemble empirical mode decomposition adaptive noise (CEEMDAN). The model first uses orthogonal triangular decomposition (QR) to redefine the ELM hidden layer output to construct the orthogonal triangular ELM (QR-ELM). It then introduces the online sequence mechanism (OS) into the QR-ELM model to construct online sequence OR-ELM (OS-QR-ELM), which can effectively improve the efficiency of the ELM models. Then, it uses the correlation wave extension method to extend both ends of the original signal to solve the end effect of CEEMDAN. Finally, it integrates CEEMDAN and OS-QR-ELM combined with parallel computing ideas to construct a parallel CEEMDAN-OS-QR-ELM runoff prediction method. The experimental results show that compared with the support vector regression method combined with empirical mode decomposition, the accuracy and reliability of the parallel CEEMDAN-OS-QR-ELM model was 1.09% and 8% higher, respectively. Compared with the ELM model, the efficiency of OS-QR-ELM was 5%.