Nondestructive prediction of leaf area in colored cotton cultivars: a comparative approach using machine learning models with an interactive web interface

Optimized machine learning models for predicting crown convergence of plateau mountain tunnels

<p>Accurate water level (WL) forecasting is important for water resources management and planning purposes in the Great Lakes. The objectives of this research are two-fold.  The first objective is to apply machine learning (ML) (i.e., random forest (RF) and support vector regression (SVR)) and hybrid convolutional neural network(CNN)-long-short term memory (LSTM) deep learning (DL) models for multi-step (i.e., one-, two- and three-monthly step ahead) WL forecasting in the Great Lakes (Michigan and Ontario). The second objective is to integrate the boundary corrected (BC) maximal overlap discrete wavelet transform (MODWT) with SVR, RF, and CNN-LSTM models to improve the performance of the individual models. By employing a BC-wavelet decomposition method, the ‘future data’ issue (i.e., data from the future that is not available), often overlooked in the literature and a major barrier to achieving realistic forecasting performance is overcome. </p><p>For Lakes Michigan and Ontario, 1212 monthly WL (m) records (spanning Jan 1918–Dec 2018) were used to develop the models. For the non-wavelet-based models (SVR, RF, and CNN-LSTM), candidate model inputs included the WL recorded over the previous 12 months.  For the BC-MODWT-based models (BC-MODWT-SVR, BC-MODWT-RF, and BC-MODWT-CNN-LSTM), the lagged input time series were decomposed into BC-wavelet and scaling coefficients by using different mother wavelets (Haar, Daubechies, Symlets, Fejer-Korovkin and Coiflets), filter lengths (from two up to 12) and decomposition levels (from one up to seven).  For each method (SVR, RF, and CNN-LSTM), mother wavelet, and decomposition level a model was generated.  For both wavelet- and non-wavelet-based models, the particle swarm optimization (PSO) method was used to select the most appropriate inputs to include in the proposed multi-step WL forecasting models.</p><p>The datasets were partitioned into calibration and validation subsets. After calibrating the models, various performance evaluation metrics, e.g., coefficient of determination (R<sup>2</sup>), root mean square error (RMSE), mean absolute error (MAE), root mean square percentage error (RMSPE), mean absolute percentage error (MAPE) and the Nash-Sutcliffe efficiency coefficient (NSC) were used to assess model accuracy.</p><p>Of the ML models, the SVR outperformed RF while the DL models outperformed the ML models for each forecast lead time (one-, two-, and three-step(s) ahead). Results from this case study indicate that not all wavelet families and decomposition levels perform equally and in some cases, the wavelet-based models do not improve performance over the non-wavelet-based models. However, the BC-MODWT-CNN-LSTM using suitable mother wavelets (e.g., Haar) outperforms the individual ML and BC-MODWT-ML-based models. More accurate forecasts were obtained for Lake Michigan although the performance in both Great Lakes was accurate. The outcomes of this research indicate that the BC-MODWT-CNN-LSTM model is a promising tool for generating accurate WL forecasts.</p>

Soft sensors are becoming increasingly important in our world today as tools for inferring difficult-to-measure process variables to achieve good operational performance and economic benefits. Recent advancement in machine learning provides an opportunity to integrate machine learning models for soft sensing applications, such as Least Square Support Vector Regression (LSSVR) which copes well with nonlinear process data. However, the LSSVR model usually uses the radial basis function (RBF) kernel function for prediction, which has demonstrated its usefulness in numerous applications. Thus, this study extends the use of non-conventional kernel functions in the LSSVR model with a comparative study against widely used partial least square (PLS) and principal component regression (PCR) models, measured with root mean square error (RMSE), mean absolute error (MAE) and error of approximation (Ea) as the performance benchmark. Based on the empirical result from the case study of the penicillin fermentation process, the Ea of the multiquadric kernel (MQ) is lowered by 63.44% as compared to the RBF kernel for the prediction of penicillin concentration. Hence, the MQ kernel LSSVR has outperformed the RBF kernel LSSVR. The study serves as empirical evidence of LSSVR performance as a machine learning model in soft sensing applications and as reference material for further development of non-conventional kernels in LSSVR-based models because many other functions can be used as well in the hope to increase the prediction accuracy.

The sea surface temperature (SST) is an environmental indicator closely related to climate, weather, and atmospheric events worldwide. Its forecasting is essential for supporting the decision of governments and environmental organizations. Literature has shown that single machine learning (ML) models are generally more accurate than traditional statistical models for SST time series modeling. However, the parameters tuning of these ML models is a challenging task, mainly when complex phenomena, such as SST forecasting, are addressed. Issues related to misspecification, overfitting, or underfitting of the ML models can lead to underperforming forecasts. This work proposes using hybrid systems (HS) that combine (ML) models using residual forecasting as an alternative to enhance the performance of SST forecasting. In this context, two types of combinations are evaluated using two ML models: support vector regression (SVR) and long short-term memory (LSTM). The experimental evaluation was performed on three datasets from different regions of the Atlantic Ocean using three well-known measures: mean square error (MSE), mean absolute percentage error (MAPE), and mean absolute error (MAE). The best HS based on SVR improved the MSE value for each analyzed series by 82.26%, 98.93%, and 65.03% compared to its respective single model. The HS employing the LSTM improved 92.15%, 98.69%, and 32.41% concerning the single LSTM model. Compared to literature approaches, at least one version of HS attained higher accuracy than statistical and ML models in all study cases. In particular, the nonlinear combination of the ML models obtained the best performance among the proposed HS versions.

It is necessary to develop general and efficient models for the representation of vapor-liquid equilibria (VLE) for the binary mixtures containing R1234ze(E) which will be new alternatives to conventional refrigerants. This work investigates the applicability of four machine learning models, including K-nearest neighbor (KNN), support vector regression (SVR), random forests (RF), and multi-layer perceptron (MLP), in representing VLE for 10 binary mixtures. The accuracy, stability, computational complexity and extrapolation ability of these machine learning models are analyzed and compared with two thermodynamic models including Soave–Redlich–Kwong (SRK) and Peng–Robinson (PR). The results show the KNN, RF and MLP models are not suitable to accurately represent the experimental pressure and vapor-phase mole fraction. The SVR model is the most accurate machine learning model in representing the experimental pressure with a mean absolute relative error of 0.71%, basically as accurate as the PR and SVR models. Meanwhile, the SVR model describes the experimental vapor-phase mole fraction more accurately with a mean absolute error of 0.0049 compared to the PR and SVR models. In addition, the SVR model has a low running-time cost and a certain extent of extrapolation ability.

This paper presents a data-driven approach to determine the load and flexural capacities of reinforced concrete (RC) beams strengthened with fabric reinforced cementitious matrix (FRCM) composites in flexure. A total of seven machine learning (ML) models such as kernel ridge regression, K-nearest neighbors, support vector regression, classification and regression trees, random forest, gradient boosted trees, and extreme gradient boosting (xgBoost) are evaluated to propose the best predictive model for FRCM-strengthened beams. Beam geometry, internal steel reinforcement area, FRCM reinforcement area, and mechanical characteristics of concrete, steel, and FRCM are the main input parameters included in the database. Among the studied ML models, the xgBoost model is the most accurate model with the highest coefficient of determination (R2=99.3%) and least root mean square (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE). A comparative study of the performance of the proposed and existing analytical models revealed the superior predictive capability and robustness of the proposed model. The predicted flexural and load capacities of the beams based on the existing analytical models are highly scattered and either over-conservative or unsafe. A unified SHapley Additive exPlanations approach is employed to explain the output of the best ML model and identify the most significant input features and interactions that influence the capacity of FRCM-strengthened RC beams in flexure. Furthermore, a reliability analysis is performed to calibrate the resistance reduction factor (ϕ) to achieve a specified target reliability index (βT=3.5).

Compressive strength is an important mechanical property of high-strength concrete (HSC), but testing methods are usually uneconomical, time-consuming, and labor-intensive. To this end, in this paper, a long short-term memory (LSTM) model was proposed to predict the HSC compressive strength using 324 data sets with five input independent variables, namely water, cement, fine aggregate, coarse aggregate, and superplasticizer. The prediction results were compared with those of the conventional support vector regression (SVR) model using four metrics, root mean square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and correlation coefficient (R2). The results showed that the prediction accuracy and reliability of LSTM were higher with R2 = 0.997, RMSE = 0.508, MAE = 0.08, and MAPE = 0.653 compared to the evaluation metrics R2 = 0.973, RMSE = 1.595, MAE = 0.312, MAPE = 2.469 of the SVR model. The LSTM model is recommended for the pre-estimation of HSC compressive strength under a given mix ratio before the laboratory compression test. Additionally, the Shapley additive explanations (SHAP)-based approach was performed to analyze the relative importance and contribution of the input variables to the output compressive strength.

. Based on two quantum chemical descriptors (the thermal energy Ethermal and the total energy of the whole system EHF) calculated from the structures of the repeat units of polyacrylamides by density functional theory (DFT), the support vector regression (SVR) approach combined with particle swarm optimization (PSO), is proposed to establish a model for prediction of the glass transition temperature (Tg) of polyacrylamides. The prediction performance of SVR was compared with that of multivariate linear regression (MLR). The results show that the mean absolute error (MAE=4.65K), mean absolute percentage error (MAPE=1.28%) and correlation coefficient (R2=0.9818) calculated by leave-one–out cross validation (LOOCV) via SVR models are superior to those achieved by QSPR (MAE=14.25K, MAPE=4.39% and R2=0.9211) and QSPR-LOO (MAE=17.01K, MAPE=5.66% and R2=0.8823) models for the identical samples, respectively. The prediction results strongly demonstrate that the modeling and generalization abilities of SVR model consistently surpass those of QSPR and QSPR-LOO models. It is revealed that the established SVR model is more suitable to be used for prediction of the Tg values for unknown polymers possessing similar structure than the conventional MLR approach. These suggest that SVR is a promising and practical methodology to predict the glass transition temperature of polyacrylamides.

Tomato is one of the most important vegetables due to its high production and nutritional value. With the development of digital agriculture, the tomato breeding and processing industries have seen a rapid increase in the need for simple, low-labor, and inexpensive methods for analyzing tomato composition. This study proposes a digital method to predict four minerals (calcium, potassium, phosphorus, and magnesium) in beef-type tomato using machine learning models, including k-nearest neighbors (kNN), artificial neural networks (ANNs), and Support Vector Regression (SVR). The models were discriminated using the coefficient of determination (R2), root mean square error (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE). The kNN model showed the best performance for estimation of quantity of calcium, potassium, phosphorus, and magnesium. The results demonstrate that kNN consistently outperforms ANNs and SVR across all target nutrients, achieving the highest R2 and the lowest error metrics (RMSE, MAE, and MAPE). Notably, kNN achieved an exceptional R2 of 0.8723 and a remarkably low MAPE of 3.95% in predicting phosphorus. This study highlights how machine learning can provide a versatile, accurate, and efficient solution for tomato mineral analysis in digital agriculture.

The primary objective of this study is to evaluate the accuracy of different forecasting models for monthly wind farm electricity production. This study compares the effectiveness of three forecasting models: Autoregressive Integrated Moving Average (ARIMA), Seasonal ARIMA (SARIMA), and Support Vector Regression (SVR). This study utilizes data from two wind farms located in Poland—‘Gizałki’ and ‘Łęki Dukielskie’—to exclude the possibility of biased results due to specific characteristics of a single farm and to allow for a more comprehensive comparison of the effectiveness of both time series analysis methods. Model parameterization was optimized through a grid search based on the Mean Absolute Percentage Error (MAPE). The performance of the best models was evaluated using Mean Bias Error (MBE), MAPE, Mean Absolute Error (MAE), and R2Score. For the Gizałki farm, the ARIMA model outperformed SARIMA and SVR, while for the Łęki Dukielskie farm, SARIMA proved to be the most accurate, highlighting the importance of optimizing seasonal parameters. The SVR method demonstrated the lowest effectiveness for both datasets. The results indicate that the ARIMA and SARIMA models are effective for forecasting wind farm energy production. However, their performance is influenced by the specificity of the data and seasonal patterns. The study provides an in-depth analysis of the results and offers suggestions for future research, such as extending the data to include multidimensional time series. Our findings have practical implications for enhancing the accuracy of wind farm energy forecasts, which can significantly improve operational efficiency and planning.

Globally, buildings are responsible for an estimated 40% of energy consumption and 33% of CO2 emissions. In a bid to reduce CO2 emissions and hence, global warming, it has become necessary to ensure the energy efficient construction and operation of buildings. Understanding how a building utilises energy is a critical step to increase its efficiency. In this study, we leverage on an open-source data obtained from UCI data repository. Exploratory data analysis and feature engineering were used to eliminate non-contributing features while identifying key attributes of the data for model training. Linear Regression (LR) and Support Vector Regression (SVR) were employed as the machine learning techniques for the study. The models were trained using a repeated cross-validation technique. The models’ performance was evaluated on an independent data set segregated for testing. The LR model was trained with nine out of thirty-three features, while the Support Vector Regression (SVR) model used twenty-eight features for its training. The SVR model had a higher variance (0.48), accuracy (92.41%), and lower Mean Absolute Percentage Error (MAPE) of 7.59% compared to the LR model's variance of 0.26, accuracy of 91.87%, and MAPE of 8.13%. The SVR model was more accurate in predicting energy consumption, as it showed better accuracy on the test set with lower MAPE and higher R-squared value. Both models outperformed a relatively complex and computationally expensive model in a previous study. It also identified areas with high energy consumption which could be used to inform the building's energy management strategy.

Hybrid random forest-based models for predicting shear strength of structural surfaces based on surface morphology parameters and metaheuristic algorithms

This article uses machine learning techniques as fuzzy and neuro-fuzzy ANFISs, to develop and compare prediction models capable of relating pregnant women’s exposure to air pollutants, such as Nitrogen Dioxide and Particulate Matter, the mother’s age, and the number of prenatal consultations to the incidence of premature birth. In the current literature, studies can be found that relate prematurity to the exposure of pregnant women to NO2, O3, and PM10; to Toluene and benzene, mainly in the window 5 to 10 days before birth; and to PM10 in the week before birth. Both models used logistic regression to quantify the effects of pollutants as a result of premature birth. Datasets from Brazil—Departamento de Informatica do Sistema Único de Saúde (DATASUS) and Companhia Ambiental do Estado de São Paulo (CETESB)—were used, covering the period from 2016 to 2018 and comprising women living in the city of São José dos Campos (SP), Brazil. In order to evaluate and compare the different techniques used, evaluation metrics were calculated, such as correlation (r), coefficient of determination (R2), Root Mean Square Error (RMSE), Mean Absolute Percentage Error (MAPE), Mean Square Error (MSE), and Mean Absolute Error (MAE). These metrics are widely used in the literature due to their ability to evaluate the robustness and efficiency of prediction models. For the RMSE, MAPE, MSE, and MAE metrics, lower values indicate that prediction errors are smaller, demonstrating better model accuracy and confidence. In the case of (r) and R2, a positive and strong result indicates alignment and better performance between the real and predicted data. The neuro-fuzzy ANFIS model showed superior performance, with a correlation (r) of 0.59, R2 = 0.35, RMSE = 2.83, MAPE = 5.35%, MSE = 8.00, and MAE = 1.70, while the fuzzy model returned results of r = 0.20, R2 = 0.04, RMSE = 3.29, MSE = 10.81, MAPE = 6.67%, and MAE = 2.01. Therefore, the results from the ANFIS neuro-fuzzy system indicate greater prediction capacity and precision in relation to the fuzzy system. This superiority can be explained by integration with neural networks, allowing data learning and, consequently, more efficient modeling. In addition, the findings obtained in this study have potential for the formulation of public health policies aimed at reducing the number of premature births and promoting improvements in maternal and neonatal health.

Optimizing asphalt mix design through predicting effective asphalt content and absorbed asphalt content using machine learning

. This study introduces support vector regression (SVR) approach to model the relationship between the glass transition temperature (Tg) and multipole moments for polymers. SVR was trained and tested via 60 samples by using two quantum chemical descriptors including the molecular traceless quadrupole moment and the molecular average hexadecapole moment Φ. The prediction performance of SVR was compared with that of reported quantitative structure property relationship (QSPR) model. The results show that the mean absolute error (MAE), mean absolute percentage error (MAPE) and root mean square error (RMSE) of training samples and test samples achieved by SVR model, are smaller than those achieved by the QSPR model, respectively. This investigation reveals that SVR-based modeling is a practically useful tool in prediction of the glass transition temperature of polymers.