Transformer Intelligent Diagnosis Method Based on AFSA-MKELM Algorithm

Aiming at solving the problems of low accuracy and high false alarm rate for network intrusion detection, an algorithm of intrusion detection based on PSO and kernel Extreme learning is proposed in this article. Particle Swarm Optimization (PSO) is a kind of swarm intelligent algorithm. Kernel extreme learning machine (KELM) is a kind of classical learning method of kernel machine with its fast learning rate and strong generalization ability, but the selection of kernel function and parameters of KELM directly affects its classification performance. In this article, PSO is used to optimize the kernel parameters of kernel limit learning machine. The global kernel function with strong generalization ability of linear combination and the local kernel function with strong learning ability are used to form multi-kernel limit learning machine, which can improve the performance of single kernel Extreme Learning Machine (ELM) classifier. Finally, the performance of the algorithm is compared and analyzed through experiments and the experimental results verify the validity of this algorithm.

The kernel function is a key factor to determine the performance of a support vector machine (SVM) classifier. Choosing and constructing appropriate kernel function models has been a hot topic in SVM studies. But so far, its implementation can only rely on the experience and the specific sample characteristics without a unified pattern. Thus, this article explored the related theories and research findings of kernel functions, analyzed the classification characteristics of EO-1 Hyperion hyperspectral imagery, and combined a polynomial kernel function with a radial basis kernel function to form a new kernel function model (PRBF). Then, a hyperspectral remote sensing imagery classifier was constructed based on the PRBF model, and a genetic algorithm (GA) was used to optimize the SVM parameters. On the basis of theoretical analysis, this article completed object classification experiments on the Hyperion hyperspectral imagery of experimental areas and verified the high classification accuracy of the model. The experimental results show that the effect of hyperspectral image classification based on this PRBF model is apparently better than the model established by a single global or local kernel function and thus can greatly improve the accuracy of object identification and classification. The highest overall classification accuracy and kappa coefficient reached 93.246% and 0.907, respectively, in all experiments.

The study was intended to eliminate the noise in three-dimensional transvaginal ultrasound (3D-TVS) images and improve the diagnostic accuracy in intrauterine adhesion (IUA). The extreme learning machine (ELM) algorithm was introduced first for statement. One hundred and thirty cases of suspected IUA patients were taken as the research subjects. The denoising effects of ELM algorithm were evaluated in terms of mean square errors (MSE), peak signal-to-noise ratio (PSNR), and running time, and its diagnostic efficiency of IUA was identified from precise, specificity, and sensitivity. Furthermore, the support vector machine (SVM) algorithm was introduced for comparison. It was found that the MSE and PSNR of the ELM algorithm were 0.0021 and 64.5, respectively, and its average operation time was 11.22 ± 0.89s, that the MSE values of SVM algorithm and ELM algorithm were 0.0045 and 0.0021 and the PSNR values were 52.3 and 64.5, respectively, and that the average running time of SVM algorithm was 16.35 ± 1.33s, and the average running time of ELM algorithm was 11.22 ± 0.89s, superior to the SVM algorithm in denoising effects. Moreover, the ELM algorithm showed excellent diagnostic efficiency for patients with various degrees of IUA. In conclusion, ELM can effectively eliminate noise in 3D-TVS images and demonstrates excellent diagnostic efficiency on IUA, which is worthy of clinical application.

The purpose of this study was to predict students dropping out of the Education Management Doctoral Program of FKIP Mulawarman University and to evaluate the Extreme Learning Machine in predicting student dropouts. This research uses the Extreme Learning Machine algorithm, the feedforward neural network learning method and the Support Vector Machine algorithm for comparison of the level of accuracy using the same data. The data used is as much as 110 data according to the number of students from the class of 2012 to 2018, the data is taken from the SIA Education Management Study Program of the Mulawarman University Doctoral Program and then processed. In this case, how to predict student dropouts using the variable Gender, Semester 3 IP Value, Working Status, Family Status, Age, and using two DO and NON DO Classes? And calculating the accuracy value using a confusion matrix ?. From the results of this study, it can be concluded that students drop out in the Educational Management of the FKIP Mulawarman University Doctoral Program can be predicted by Extreme Learning Machine using the training value obtained from semester 3 of the 2012-2018 class. From the results of testing the predictive accuracy of the Extreme Learning Machine is 72 %.

Kernel function is dominant in regression process of Support Vector Machine (SVM), it influences the prediction performance of SVM directly. Single local or global kernel function has limitation in generalization or learning capacity. The mixture kernel function with two good capacities had been structured, and it had been used in soft-sensor modeling of refining process. The contrast of simulation results show: the generalization ability of SVM based on mixture kernel function is better than the ones based on the single local or global kernel function, the algorithm had been applied in the refining process of HETAO wood industry factory, and the prediction result meets the requirement of craft production.

It is well-known that solar power depends on many complex parameters such as humidity, radiation, temperature, dust and wind speed. In order to cope with these complex structures and to provide an accurate forecast, the development of reliable and effective forecasting methodology is very significant. In this study, an Artificial Neural Network (ANN)-based system has been developed to forecast very short-term (2 to 4-h) power output of a grid tied Photovoltaic Power Plant (PVPP). An algorithm called Extreme Learning Machine (ELM) has gained increasing interest through its extremely fast learning and good generalization capability. The Kernel Extreme Learning Machine (KELM) which is the improved version of the ELM is proposed to develop a very short-term PVPP power forecast system. The most important feature of KELM is that it has less adjustable parameters and better generalization ability when compared with classical ELM. Experimental studies have been carried out on a grid tied PVPP that has 1 (MW) installed power capacity. The inputs of the KELM-based forecast system are selected as solar power, humidity, radiation and temperature. All data are divided into four parts to analyze the effect of seasons on the performance of the proposed forecast system. The comparison studies are carried out to clearly observe the forecast ability and performance of the KELM. From the experimental studies of the winter season which has not symmetric diurnal mean power curve, Correlation Coefficients (R) values of KELM are calculated as 0.896 for 2-h ahead, 0.865 for 3-h ahead, 0.833 for 4-h ahead. Those of ELM and (Levenberg Marquardt) LM are 0.866–0.812 for 2-h ahead, 0.831–0.669 for 3-h ahead, 0.799–0.502 for 4-h ahead, respectively. Root Mean Square Error (RMSE) and Mean Absolute Error (MAE) values of KELM for winter season are 12.08%-6.14% for 2-h ahead, 14.06%-7.43% for 3-h ahead, 15.33%-7.74% for 4-h ahead, respectively. While these values of ELM are obtained as 13.82%-7.05% for 2-h ahead, 15.52%-8.77% for 3-h ahead, 17.63%-9.33% for 4-h ahead. The RMSE and MAE values of LM are 17.90%-9.14% for 2-h ahead, 20.04%-9.85% for 3-h ahead, 21.22%-10.68% for 4-h ahead. According to the obtained results, it is clearly seen that KELM provides a more powerful and reliable forecasting performance.

In this study, we investigates the application of three powerful kernel-based supervised learning algorithms to develop a global model of the wear rate of grinding media based on the input factors such as pH, solid percentage, throughout, charge weight of balls, rotation speed of mill and grinding time. It is found that there is a trade-off between the training and testing error when a single kernel function is used and therefore these methods cannot provide the generalization capability. However, this problem is solved utilizing the multiple kernel learning frameworks for support vector machine in which the kernel function was expressed as a combination of basis kernel functions. It is distinguished that compared to the single kernel and ANN-based techniques, the use of multiple kernel support vector machines benefit from a higher degree of correctness and generalization ability for prediction of wear rate of grinding media. Meanwhile, the findings indicate that in this state, the values of R2 are achieved 0.99417 and 0.993 for training and testing datasets, respectively.

Spectra data classification with kernel extreme learning machine

This paper develops a state-of-charge (SOC) estimation model for a lithium-ion battery using an improved extreme learning machine (ELM) algorithm. ELM is suitable for an SOC estimation since the ELM algorithm has fast estimation speed, good generalization performance, and high accuracy. However, the performance of ELM is highly dependent on training accuracy and the number of neurons in a hidden layer. Hence, a gravitational search algorithm (GSA) is applied to improve the ELM computational intelligence by searching for the optimal value hidden layer neurons. The optimal ELM-based GSA model does not require internal battery knowledge and mathematical model for an SOC estimation. The model robustness is validated at different temperatures using different electric vehicle drive cycles. The performance of the ELM-GSA model is verified with two popular neural network methods: back-propagation neural network (BPNN) and radial basis function neural network (RBFNN). The results are evaluated using different error rates and computation costs. The results demonstrate that the ELM-based GSA model offers a higher accuracy and lower SOC error rate than those of BPNN-based GSA and RBFNN-based GSA models. Furthermore, a detailed comparative study between the proposed model and existing SOC strategies is conducted, which also demonstrates the superiority of the proposed model.

The most usually used least squares support vector machines(LS-SVM) modeling method In near infrared(NIR) spectra measurement are based on a single kernel function. However, the single kernel function can not describe the whole data very well, thus affecting the LS-SVM modeling results. In this paper, we introduced the mixtures of kernels to replace the original single kernel, then the LS-SVM based on the mixtures of kernels was applied to model prediction. It was proved by the experimental results that the algorithm can obviously improve the model prediction performance of diesel cetane number based on the LS-SVM compared with other methods in existence.

Extreme Learning Machine (ELM) algorithm assigns the input weights and biases in a “one-time stamp” fashion, this method makes the algorithm to be ill-conditioned and reduces its classification accuracy. The contribution of this work is the enhancement of the performance of ELM with the Moth-Flame Optimization (MFO) algorithm to improve classification accuracy. A hybrid of the Moth-Flame Optimization and Extreme Learning Machine (MFO-ELM) algorithm is implemented in MATLAB. MFO ensures a concurrent simulation of exploration and exploitation of the search space to select an optimum candidate solution. The candidate solution is reshaped into input weights and biases for ELM classification. The hybrid algorithm is validated on five life-selected datasets. The performance improvement of MFO-ELM is compared with ELM-optimized Particle Swarm Optimization (PSO-ELM) and Competitive Swarm Optimization (CSO-ELM) algorithms. The improvement rates are qualitatively and quantitatively evaluated to show the improvement of MFO-ELM on ELM and the other meta-heuristic algorithms. MFO-ELM improved the accuracies of the basic ELM in all 100% of the simulations and performed better than the other meta-heuristic algorithms in 80% of the simulations. The performance of MFO-ELM is more competitive, and it is recommended for solving classification problems.

In this paper, a classification mode for commercial bank clients' classification using the extreme learning machine (ELM) algorithm is proposed to study the commercial banks VIP loss. Firstly, we adopt the existing data sets of banks to train the ELM model; then, customer classification algorithm and its parameters are selected for classification purpose. Lastly, comparative analysis with existed methods are also compared, which showed that its advantages with the traditional gradient algorithm and other classification algorithm, which further indicate that ELM algorithm can not only overcome their drawbacks but also has faster learning rate, higher rate of accuracy, and better generalization.

PARP1 is one of six enzymes required for the highly error-prone DNA repair pathway microhomology-mediated end joining (MMEJ) and needs to be inhibited when over-expressed. In order to study the PARP1 inhibitory effect of fused tetracyclic or pentacyclic dihydrodiazepinoindolone derivatives (FTPDDs) by quantitative structure-activity relationship technique, six models were established by four kinds of methods, heuristic method, gene expression programming, random forester, and support vector regression with single, double, and triple kernel function respectively. The single, double, and triple kernel functions were RBF kernel function, the integration of RBF and polynomial kernel functions, and the integration of RBF, polynomial, and linear kernel functions respectively. The problem of multi-parameter optimization introduced in the support vector regression model was solved by the particle swarm optimization algorithm. Among the models, the model established by support vector regression with triple kernel function, in which the optimal R2 and RMSE of training set and test set were 0.9353, 0.9348 and 0.0157, 0.0288, and R2cv of training set and test set were 0.9090 and 0.8971, shows the strongest prediction ability and robustness. The method of support vector regression with triple kernel function is a great promotion in the field of quantitative structure-activity relationship, which will contribute a lot to designing and screening new drug molecules. The information contained in the model can provide important factors that guide drug design. Based on these factors, six new FTPDDs have been designed. Using molecular docking experiments to determine the properties of new derivatives, the new drug was ultimately successfully designed.

A robust single hidden layer feed forward neural network (SLFN) is used in this study to model the in-flight particle characteristics of the atmospheric plasma spray (APS) process with regard to the input processing parameters. The in-flight particle characteristics influence the structure and properties of the APS coating and, thus, are considered important parameters to comprehend the manufacturing process. The training times of traditional back propagation algorithms, mostly used to model such processes, are far slower than desired for implementation of an on-line control system. Use of slow gradient based learning methods and iterative tuning of all network parameters during the learning process are the two major causes for such slower learning speed. An extreme learning machine (ELM) algorithm, which randomly selects the input weights and biases and analytically determines the output weights, is used in this work to train the SLFNs. Performance comparisons of the networks trained with ELM algorithm and standard error back propagation algorithms are presented. It is found that networks trained with ELM have good generalization performance, much shorter training times and stable performance with regard to the changes in number of hidden layer neurons. The trends represent robustness of the trained networks and enhance reliability of the application of the artificial neural network in modelling APS processes.

This paper presents an evaluation of the Extreme Learning Machine (ELM), Kernel Extreme Learning Machine (KELM), and the Kernel Extreme Learning Machine optimized by the Whale Optimization Algorithm (WOA-KELM) in the context of fruit image classification. Fruits play a crucial role in everyday life, and the application of machine learning for fruit classification can significantly improve efficiency. The ELM, a single hidden layer feedforward neural network, is the foundation for this comparison. The KELM, an evolution of the ELM, incorporates a kernel function to map input data into a high-dimensional feature space, thereby enhancing performance. The development of WOA-KELM involves optimizing the regularization parameter in KELM and the width parameter of the radial basis function through the Whale Optimization Algorithm, further enhancing its capabilities. In classifying twelve types of fruit images, the ELM achieved a classification accuracy of 77%. In contrast, the WOA-KELM, as proposed in this paper, significantly outperforms with a remarkable classification accuracy of 92%.