Chapter 21 - Optimally pruned extreme learning machine: A new nontuned machine learning model for predicting chlorophyll concentration

Solar radiation is the principal and fundamental energy for many physical, chemical and biological processes. Estimation of solar radiation from other measured meteorological variables offers an important alternative in the absence of availability of measured solar radiation data. In this paper, we validate and assess four commonly used air temperature-based models including the Hargreaves and Samani, Hargreaves, Bristow & Campbell and Chen model and a local regression model, developed using long-term data from 14 sites in Yangtze River basin in China. We present the two-step method to estimate solar radiation from the commonly measured air temperature. The model performance is evaluated using root mean square error (RMSE), relative root mean square error (RRMSE), mean absolute bias error (MABE) and mean absolute percentage error (MAPE). Results show that the two-step method gives good performance and significantly outperforms the temperature-based models. The parameters determination equations of the two-step method are proposed to solve the difficult problem in parameter calibration at the site where no long-term observations of solar radiation and sunshine duration are available. It is found that the two-step method using the parameters determined by the proposed equations gives good performance, with the averaged R-2 of 0.881, RRMSE of 15.04% and MAPE of 12.67%. Therefore, the two-step method with the parameters determined by the proposed equations could be used to estimate solar radiation in Yangtze River basin. It is believed to be useful for the site where no measured solar radiation and sunshine duration data is available, whereas the air temperatures are common measured.

Globally, wind energy if properly harnessed, could serve as a source of energy generation in Africa. This study compared the performance of two Machine Learning (ML) algorithms (Linear regression and Random Forest) in predicting wind speed in five major cities in Africa (Yaoundé, Pretoria, Nairobi, Cairo and Abuja). Wind data were collected between January 1, 2000, and December 31, 2022, using the Solar Radiation Data Archive. The data preprocessing was carried out with 80% of the data used for training and 20% for validation. The performance of these ML algorithms was evaluated using Mean Square Error (MSE), Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE) and coefficient of determination (R2). The result shows that Nairobi (3.814795 m/s) closely followed by Cairo (3.606453 m/s) has the highest mean wind speed while Yaoundé (1.090512 m/s) has the lowest. Based on the performance metrics used, the two Machine Learning algorithms were competitive. Still, the Linear Regression (LR) algorithm outperformed the Random Forest Algorithm in predicting wind speed in all the selected major African cities. In Yaoundé (RMSE = 0.3892, MAE= 0.3001, MAPE =0.5030), Pretoria (RMSE=1.2339, MAE=0.9480, MAPE=0.7450) Nairobi (RMSE= 0.4223, MAE =0.6499, MAPE =0.1872), Nairobi (RMSE=0.6499, MAE=0.5171, MAPE =0.1872), Cairo (RMSE =1.0909, MAE =0.8544, MAPE =0.3541) and Abuja (RMSE = 0.70245, MAE =0.5441, MAPE= 0.4515) the Linear regression algorithms was found to outperformed Random Forest Regression. Therefore, the Linear regression algorithm is more reliable in predicting wind speed compared with the Random Forest regression.

Resistance value (R-value) is one of the basic subgrade stiffness characterizations that express a material’s resistance to deformation. In this paper, artificial intelligence (AI)-based models—especially M5P, support vector machine (SVM), and Gaussian process regression (GPR) algorithms—are built for R-value evaluation that meets the high precision and rapidity requirements in highway engineering. The dataset of this study comprises seven parameters: hydrated lime-activated rice husk ash, liquid limit, plastic limit, plasticity index, optimum moisture content, and maximum dry density. The available data are divided into three parts: training set (70%), test set (15%), and validation set (15%). The output (i.e., R-value) of the developed models is evaluated using the performance measures coefficient of determination (R2), mean absolute error (MAE), relative squared error (RSE), root mean square error (RMSE), relative root mean square error (RRMSE), performance indicator (ρ), and visual framework (Taylor diagram). GPR is concluded to be the best performing model (R2, MAE, RSE, RMSE, RRMSE, and ρ equal to 0.9996, 0.0258, 0.0032, 0.0012, 0.0012, and 0.0006, respectively, in the validation phase), very closely followed by SVM, and M5P. The application used for the aforementioned approaches for predicting the R-value is also compared with the recently developed artificial neural network model in the literature. The analysis of performance measures for the R-value dataset demonstrates that all the AI-based models achieved comparatively better and reliable results and thus should be encouraged in further research. Sensitivity analysis suggests that all the input parameters have a significant influence on the output, with maximum dry density being the highest.

BackgroundMore than 79.2 million confirmed COVID-19 cases and 1.7 million deaths were caused by SARS-CoV-2; the disease was named COVID-19 by the World Health Organization. Control of the COVID-19 epidemic has become a crucial issue around the globe, but there are limited studies that investigate the global trend of the COVID-19 pandemic together with each country’s policy measures.ObjectiveWe aimed to develop an online artificial intelligence (AI) system to analyze the dynamic trend of the COVID-19 pandemic, facilitate forecasting and predictive modeling, and produce a heat map visualization of policy measures in 171 countries.MethodsThe COVID-19 Pandemic AI System (CPAIS) integrated two data sets: the data set from the Oxford COVID-19 Government Response Tracker from the Blavatnik School of Government, which is maintained by the University of Oxford, and the data set from the COVID-19 Data Repository, which was established by the Johns Hopkins University Center for Systems Science and Engineering. This study utilized four statistical and deep learning techniques for forecasting: autoregressive integrated moving average (ARIMA), feedforward neural network (FNN), multilayer perceptron (MLP) neural network, and long short-term memory (LSTM). With regard to 1-year records (ie, whole time series data), records from the last 14 days served as the validation set to evaluate the performance of the forecast, whereas earlier records served as the training set.ResultsA total of 171 countries that featured in both databases were included in the online system. The CPAIS was developed to explore variations, trends, and forecasts related to the COVID-19 pandemic across several counties. For instance, the number of confirmed monthly cases in the United States reached a local peak in July 2020 and another peak of 6,368,591 in December 2020. A dynamic heat map with policy measures depicts changes in COVID-19 measures for each country. A total of 19 measures were embedded within the three sections presented on the website, and only 4 of the 19 measures were continuous measures related to financial support or investment. Deep learning models were used to enable COVID-19 forecasting; the performances of ARIMA, FNN, and the MLP neural network were not stable because their forecast accuracy was only better than LSTM for a few countries. LSTM demonstrated the best forecast accuracy for Canada, as the root mean square error (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE) were 2272.551, 1501.248, and 0.2723075, respectively. ARIMA (RMSE=317.53169; MAPE=0.4641688) and FNN (RMSE=181.29894; MAPE=0.2708482) demonstrated better performance for South Korea.ConclusionsThe CPAIS collects and summarizes information about the COVID-19 pandemic and offers data visualization and deep learning–based prediction. It might be a useful reference for predicting a serious outbreak or epidemic. Moreover, the system undergoes daily updates and includes the latest information on vaccination, which may change the dynamics of the pandemic.

Wild blueberry yield prediction using a combination of computer simulation and machine learning algorithms

Predictive modeling of swell-strength of expansive soils using artificial intelligence approaches: ANN, ANFIS and GEP

This article uses machine learning techniques as fuzzy and neuro-fuzzy ANFISs, to develop and compare prediction models capable of relating pregnant women’s exposure to air pollutants, such as Nitrogen Dioxide and Particulate Matter, the mother’s age, and the number of prenatal consultations to the incidence of premature birth. In the current literature, studies can be found that relate prematurity to the exposure of pregnant women to NO2, O3, and PM10; to Toluene and benzene, mainly in the window 5 to 10 days before birth; and to PM10 in the week before birth. Both models used logistic regression to quantify the effects of pollutants as a result of premature birth. Datasets from Brazil—Departamento de Informatica do Sistema Único de Saúde (DATASUS) and Companhia Ambiental do Estado de São Paulo (CETESB)—were used, covering the period from 2016 to 2018 and comprising women living in the city of São José dos Campos (SP), Brazil. In order to evaluate and compare the different techniques used, evaluation metrics were calculated, such as correlation (r), coefficient of determination (R2), Root Mean Square Error (RMSE), Mean Absolute Percentage Error (MAPE), Mean Square Error (MSE), and Mean Absolute Error (MAE). These metrics are widely used in the literature due to their ability to evaluate the robustness and efficiency of prediction models. For the RMSE, MAPE, MSE, and MAE metrics, lower values indicate that prediction errors are smaller, demonstrating better model accuracy and confidence. In the case of (r) and R2, a positive and strong result indicates alignment and better performance between the real and predicted data. The neuro-fuzzy ANFIS model showed superior performance, with a correlation (r) of 0.59, R2 = 0.35, RMSE = 2.83, MAPE = 5.35%, MSE = 8.00, and MAE = 1.70, while the fuzzy model returned results of r = 0.20, R2 = 0.04, RMSE = 3.29, MSE = 10.81, MAPE = 6.67%, and MAE = 2.01. Therefore, the results from the ANFIS neuro-fuzzy system indicate greater prediction capacity and precision in relation to the fuzzy system. This superiority can be explained by integration with neural networks, allowing data learning and, consequently, more efficient modeling. In addition, the findings obtained in this study have potential for the formulation of public health policies aimed at reducing the number of premature births and promoting improvements in maternal and neonatal health.

Nowadays , nonlinear time series and artificial neural networks (ANN) models are used for forecasting in the field of business, agriculture and soon. Recent studies have shown, ANN have been successfully used for forecasting of financial and agriculture data series The classical methods used for time series prediction like Box-Jenkins or ARIMA assumes that there is a linear relationship between inputs and outputs. ANN have more advantages that can approximate to model both linear and nonlinear structures in time series, they are not able to handling both structures equally well. The autoregressive integrated moving average (ARIMA) model and two ANN models namely, Radial basis function neural networks (RBFNN), and Elman recurrent neural networks (ERNN) methods were applied to Hyderabad airport traffic data. The data obtained for 15 years from 2002–2003 to 2016–2017 about domestic and international passenger of International Airport of Hyderabad, India. In this research paper, we compared the performances of ARIMA, RBFNN and ERNN were based on three measures: mean absolute error (MAE), mean absolute percentage error (MAPE), and root mean square error (RMSE). The results showed that RBFNN obtained the smallest MAE, MAPE and RMSE in both the modeling and forecasting processes. The performances of the three models ranked in ascending order were: ARIMA, ERNN and the RBFNN model. Keywords: T ime series, forecasting, artificial neural networks, ARIMA models, radial basis function neural networks, and Elman recurrent neural networks Cite this Article R. Ramakrishna, Berhe Aregay, Tewodros Gebregergs. The Comparison in Time Series Forecasting of Air Traffic Data by Autoregressive Integrated Moving Average Model, Radial Basis Function and Elman Recurrent Neural Networks. Research & Reviews: Journal of Statistics . 2018; 7(3): 75–90p.

Drought is a complex and frequently occurring natural hazard in many parts of the world. Therefore, accurate drought forecasting is essential to mitigate its adverse impacts. This research has inferred the implication and the appropriateness of the extreme learning machine (ELM) algorithm for drought forecasting. For numerical evaluation, time series data of the Standardized Precipitating Temperature Index (SPTI) are used for nine meteorological stations located in various climatological zones of Pakistan. To assess the performance of ELM, this research includes parallel inferences of multilayer perceptron (MLP) and autoregressive integrated moving average (ARIMA) models. The performance of each model is assessed using root mean square error (RMSE), mean absolute error (MAE), mean absolute percent error (MAPE), Kling‐Gupta efficiency (KGE), Willmott index (WI), and Karl Pearson’s correlation coefficient. Generally, graphical results illustrated an excellent performance of the ELM algorithm over MLP and ARIMA models. For training data of SPTI‐1, ELM’s best performance has observed at Chitral station (RMSE = 0.374, KGE = 0.838, WI = 0.960, MAE = 0.272, MAPE = 259.59, R = 0.93). For SPTI‐1 at Astore station, the numerical results are (RMSE = 0.688, KGE = 0.988, WI = 0.997, MAE = 0.798, MAPE = 247.35). The overall results indicate that the ELM outperformed by producing the smallest RMSE, MAE, and MAPE values and maximum values for KGE, WI, and correlation coefficient values at almost all the selected meteorological stations for (1, 3, 6, 9, and 12) month time scales. In summary, this research endorses the use of ELM for accurate drought forecasting.

Stock price prediction targets to predict the future development direction of the stock market and the degree of rise and fall of the stock price according to stock market quotations. However, since the stock price has high nonlinear, high noisy, and dynamic characteristics, it is challenging to predict stock prices. This paper predicts stock price prediction with a long-short term memory (LSTM) model according to the above data characteristics. First, because the stock price is distributed in different price ranges, we pre-process the data by normalizing all the data to the range of 0 to 1. Then, we improve the model performance by adjusting the three main parameters, hidden layers, learning rate, and time window. LSTM adds a control part into LSTM to further catch these data to make the best of historical data. We compare the proposed method with Recurrent Neural Network (RNN) on a related dataset with relative root mean square error (RRMSE), mean absolute error (MAE) and mean absolute error percentage (MAPE). The lower the score on all three indicators, the more accurate the prediction. The experimental results show that the scores of LSTM are lower than RNN in three indicators, so its prediction is more accurate than RNN with appropriate parameters. Our analyses illustrate that LSTM can better predict the dynamic non-linear data like a stock price by considering the historical data.

Evaluation of artificial neurocomputing algorithms and their metacognitive robustness in predictive modeling of fuel consumption rates during tillage

Advances in industrial digital technologies have led to an increasing volume of data generated from industrial bioprocesses, which can be utilised within data-driven models (DDM). However, data volume and variability complications make developing models that captures the underlying biological nature of the bioprocesses challenging. In this study, a framework for developing data-driven models of bioprocesses is proposed and evaluated by modelling an industrial bioprocess, which treats industrial or agrifood wastewaters whilst simultaneously generating bioenergy. Six models were developed to predict the reduction in chemical oxygen demand from the wastewater by the bioprocess and statistically evaluated using both testing data (randomly partitioned data from the model development) and unseen data (new data not used during the model development). The statistical error metrics employed were the coefficient of determination (R2), root mean square error (RMSE), mean absolute error (MAE) and mean absolute percentage error (MAPE). The stacked neural network model was best able to model the bioprocess, having the highest accuracy on the testing data (R2: 0.98; RMSE: 1.29; MAE: 2.27; MAPE: 4.08) and the unseen data (R2: 0.82; RMSE: 2.57; MAE: 1.75; MAPE: 3.68). Data visualisation is used to observe (or confirm) whether new data points are within the model boundaries, helping to increase confidence in the model’s predictions on future data.

Tomatoes are among the world’s most significant vegetables, both in terms of production and consumption. Harvesting takes place in tomato production when the important quality attribute of total soluble solids content reaches its maximum possible level. Tomato total soluble solids content (TSS) is among the most crucial attribute parameters for assessing tomato quality and for tomato commercialization. Determination of total soluble solids content by conventional measurement methods is both destructive and time-consuming. Therefore, the tomato processing industry needs a rapid identification method to measure total soluble solids content (TSS). In this study, we aimed to estimate how much soluble solids there are in beef tomato fruit by Artificial Neural Networks (ANN) and Multiple Linear Regression (MLR) methods. The models were assessed using the Coefficient of Determination (R2), Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and Mean Absolute Percentage Error (MAPE) metrics. The training data set results of the MLR model established to estimate the amount of brix in tomato fruit, calculated as MAE: 0.2349, RMSE: 0.3048, R2: 0.8441, and MAPE: 5.5368, while, according to the ANN model, MAE: 0.0250, RMSE: 0.031, R2: 0.9982 and MAPE: 0.5814. According to the metric outcomes, the ANN-based model performed better in both the training and testing parts.

Compressive strength is an important mechanical property of high-strength concrete (HSC), but testing methods are usually uneconomical, time-consuming, and labor-intensive. To this end, in this paper, a long short-term memory (LSTM) model was proposed to predict the HSC compressive strength using 324 data sets with five input independent variables, namely water, cement, fine aggregate, coarse aggregate, and superplasticizer. The prediction results were compared with those of the conventional support vector regression (SVR) model using four metrics, root mean square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and correlation coefficient (R2). The results showed that the prediction accuracy and reliability of LSTM were higher with R2 = 0.997, RMSE = 0.508, MAE = 0.08, and MAPE = 0.653 compared to the evaluation metrics R2 = 0.973, RMSE = 1.595, MAE = 0.312, MAPE = 2.469 of the SVR model. The LSTM model is recommended for the pre-estimation of HSC compressive strength under a given mix ratio before the laboratory compression test. Additionally, the Shapley additive explanations (SHAP)-based approach was performed to analyze the relative importance and contribution of the input variables to the output compressive strength.

With the in-depth implementation of China’s “National Strategy for Building a Strong Transportation Network,” the scale of expressway construction has continued to expand. As a result, the number of high-fill and deep-cut subgrade projects under complex geological conditions has increased significantly, leading to a surge in landslide-related issues. Consequently, accurate prediction of slope displacement is of critical importance for early warning and prevention of landslide disasters. This study proposes a hybrid prediction model, VMD-MPA-LSSVM-LSTM (VMLL), which integrates Variational Mode Decomposition (VMD), Marine Predators Algorithm (MPA), Least Squares Support Vector Machine (LSSVM), and Long Short-Term Memory (LSTM) networks. Using monitoring data from the high-fill embankment slope at Hongtuyao as the research subject, the VMLL model is employed to predict slope displacement based on small-sample data. The objective is to provide a more accurate method for early warning of slope displacement. Firstly, the original monitoring data are decomposed into trend displacement components and fluctuation displacement components using Variational Mode Decomposition (VMD). Subsequently, the trend component and the fluctuation component are predicted using Least Squares Support Vector Machine (LSSVM) and Long Short-Term Memory (LSTM) networks, respectively. Finally, the Marine Predators Algorithm (MPA) is employed to optimize the hyperparameters of the predictive models. Based on this framework, a VMLL-based slope displacement prediction model is constructed. To verify the superiority of the VMLL model, a comparative analysis was conducted against LSSVM, LSTM, and the VMD-LSSVM-LSTM models. The results demonstrate that the VMLL model achieves the highest prediction accuracy, with a Mean Absolute Percentage Error (MAPE) of 0.4022%, a Mean Absolute Error (MAE) of 0.016 mm, a Root Mean Square Error (RMSE) of 0.0206 mm, a coefficient of determination (R²) of 94.08%, and a Variance Accounted For (VAF) of 96.5%. Compared with the other three models, the VMLL model reduces the MAPE, MAE, and RMSE by 30.41–67.62%, 30.38–67.40%, and 27.32–71.00%, respectively. Meanwhile, it improves the R² and VAF by 5.95–217.51% and 0.38–11.48%, respectively. These improvements clearly demonstrate that the VMLL model outperforms the other models, indicating its significant advantage over single prediction models. Furthermore, three additional datasets were used to evaluate the model’s performance. The average values of the performance evaluation metrics for these datasets were 0.6207% (MAPE), 0.0238 mm(MAE), 0.0273 mm(RMSE), 90.33%(R²), and 96.81%(VAF), respectively. These results demonstrate the high accuracy and strong robustness of the proposed model in predicting both horizontal displacement and vertical settlement of slopes, providing a reliable methodological framework for slope stability assessment and landslide disaster early warning.