River flow forecasting has been the focus of many researchers for many years.  The methods evolved from simple statistical methods to highly sophisticated mathematical models.  In recent years, due to the advancement of computers and artificial algorithms, new methods have become increasingly reliable and easier to use.  One of the promising artificial intelligence methods is the Extreme Gradient Boosting (XGBoost) model.  XGBoost is a scalable, distributed gradient-boosting decision tree machine learning library.  It provides parallel tree boosting and is the leading machine learning library for regression, classification, and ranking problems.  Three different algorithms of XGBoost were used in this research and the results were compared.  These algorithms were Random Search, Grid Search, and CatBoost. The proposed models were conducted in a station located Pò River basin which is the longest river in Italy, and it flows from the Cottian Alps and ends at a delta projecting into the Adriatic Sea new Venice.  The data were divided into training and validation sets.  The statistical indicators included mean square error, Nash-Sutcliffe efficiency, and mean absolute error were calculated for each set to compare the efficiency of each algorithm.  These indicators showed that XGBoost using random search algorithm had better performance, although the other algorithms were also acceptable predictions.  In general, the XGBoost model could be used as a reliable tool to forecast the river flow at locations with enough historical data.
92Comparison of ARIMA model and XGBoost model for prediction of human brucellosis in mainland China: a time-series study
ObjectivesHuman brucellosis is a public health problem endangering health and property in China. Predicting the trend and the seasonality of human brucellosis is of great significance for its prevention. In...
Read more
9Generalization Ability of Bagging and Boosting Type Deep Learning Models in Evapotranspiration Estimation
The potential of generalized deep learning models developed for crop water estimation was examined in the current study. This study was conducted in a semiarid region of India, i.e., Karnataka, with daily climatic data (maximum and minimum air temperatures, maximum and minimum relative humidity, wind speed, sunshine hours, and rainfall) of 44 years (1976–2020) for twelve locations. The Extreme Gradient Boosting (XGBoost), Gradient Boosting (GB), and Random Forest (RF) are three ensemble deep learning models that were developed using all of the climatic data from a single location (Bengaluru) from January 1976 to December 2017 and then immediately applied at eleven different locations (Ballari, Chikmaglur, Chitradurga, Devnagiri, Dharwad, Gadag, Haveri, Koppal, Mandya, Shivmoga, and Tumkuru) without the need for any local calibration. For the test period of January 2018–June 2020, the model’s capacity to estimate the numerical values of crop water requirement (Penman-Monteith (P-M) ETo values) was assessed. The developed ensemble deep learning models were evaluated using the performance criteria of mean absolute error (MAE), average absolute relative error (AARE), coefficient of correlation (r), noise to signal ratio (NS), Nash–Sutcliffe efficiency (ɳ), and weighted standard error of estimate (WSEE). The results indicated that the WSEE values of RF, GB, and XGBoost models for each location were smaller than 1 mm per day, and the model’s effectiveness varied from 96% to 99% across various locations. While all of the deep learning models performed better with respect to the P-M ETo approach, the XGBoost model was able to estimate ETo with greater accuracy than the GB and RF models. The XGBoost model’s strong performance was also indicated by the decreased noise-to-signal ratio. Thus, in this study, a generalized mathematical model for short-term ETo estimates is developed using ensemble deep learning techniques. Because of this type of model’s accuracy in calculating crop water requirements and its ability for generalization, it can be effortlessly integrated with a real-time water management system or an autonomous weather station at the regional level.
Read more13Optimized machine learning models for predicting crown convergence of plateau mountain tunnels
Optimized machine learning models for predicting crown convergence of plateau mountain tunnels
15Machine learning model-based risk prediction of severe complications after off-pump coronary artery bypass grafting.
Compared with coronary artery bypass grafting (CABG) under cardiopulmonary bypass, off-pump coronary artery bypass (OPCAB) is minimally invasive and reduces the risk of intraoperative blood transfusion and acute kidney injury. Nonetheless, OPCAB-related complications still pose a threat. Machine learning technology can analyze a large number of clinical data, establish risk prediction models and help clinicians make early and correct clinical decisions. Risk prediction models are available for mortality and morbidity after cardiac surgery, but they are not specific to OPCAB. This study aimed to develop a predictive model of severe complications after OPCAB, based on machine learning. Anesthesia records of OPCAB from the General Hospital of the Northern Theater Command (Shenyang, China) collected between January 1, 2019, and June 15, 2020, were analyzed. The endpoint of the study was the occurrence of serious complications after OPCAB (postoperative unplanned intra-aortic balloon pump, secondary surgery and death). The features entered into the models were as follows: intraoperative ventricular fibrillation, number of saphenous vein grafts, nerve block (NeB), venous oxygen saturation (SvO2), skin incision-bypass time, and hypertension. A total of 8 machine learning algorithms were tested: logistic regression analysis (LRA), k-nearest neighbor (KNN), naïve Bayes (NB), support vector machine (SVM), random forest (RF), extreme gradient boosting (XGBoost), light gradient boosting machine (LightGBM), and categorical features gradient boosting (CatBoost). Among the 506 patients found in the records, 27 met the endpoint. The highest area under the curve (AUC) value was achieved with the XGBoost model (AUC = 0.94), and the lowest with the SVM model (AUC = 0.75). The highest and lowest accuracy were observed with the XGBoost and NB models, respectively, while the highest and lowest precision were achieved using the SVM and NB models, respectively. Based on the receiver operating characteristic (ROC) curves, the XGBoost model was selected as the most useful in this study. This study suggests using the XGBoost model to predict the risk of complications after OPCAB.
Read more50Decision tree models for the estimation of geo-polymer concrete compressive strength.
The green concretes industry benefits from utilizing gel to replace parts of the cement in concretes. However, measuring the compressive strength of geo-polymer concretes (CSGPoC) needs a significant amount of work and expenditure. Therefore, the best idea is predicting CSGPoC with a high level of accuracy. To do this, the base learner and super learner machine learning models were proposed in this study to anticipate CSGPoC. The decision tree (DT) is applied as base learner, and the random forest and extreme gradient boosting (XGBoost) techniques are used as super learner system. In this regard, a database was provided involving 259 CSGPoC data samples, of which four-fifths of is considered for the training model and one-fifth is selected for the testing models. The values of fly ash, ground-granulated blast-furnace slag (GGBS), Na2SiO3, NaOH, fine aggregate, gravel 4/10 mm, gravel 10/20 mm, water/solids ratio, and NaOH molarity were considered as input of the models to estimate CSGPoC. To evaluate the reliability and performance of the decision tree (DT), XGBoost, and random forest (RF) models, 12 performance evaluation metrics were determined. Based on the obtained results, the highest degree of accuracy is achieved by the XGBoost model with mean absolute error (MAE) of 2.073, mean absolute percentage error (MAPE) of 5.547, Nash-Sutcliffe (NS) of 0.981, correlation coefficient (R) of 0.991, R2 of 0.982, root mean square error (RMSE) of 2.458, Willmott's index (WI) of 0.795, weighted mean absolute percentage error (WMAPE) of 0.046, Bias of 2.073, square index (SI) of 0.054, p of 0.027, mean relative error (MRE) of -0.014, and a20 of 0.983 for the training model and MAE of 2.06, MAPE of 6.553, NS of 0.985, R of 0.993, R2 of 0.986, RMSE of 2.307, WI of 0.818, WMAPE of 0.05, Bias of 2.06, SI of 0.056, p of 0.028, MRE of -0.015, and a20 of 0.949 for the testing model. By importing the testing set into trained models, values of 0.8969, 0.9857, and 0.9424 for R2 were obtained for DT, XGBoost, and RF, respectively, which show the superiority of the XGBoost model in CSGPoC estimation. In conclusion, the XGBoost model is capable of more accurately predicting CSGPoC than DT and RF models.
Read more4Glass forming ability prediction of bulk metallic glasses based on fused strategy
Glass forming ability prediction of bulk metallic glasses based on fused strategy
4Advancing Retail Predictions: Integrating Diverse Machine Learning Models for Accurate Walmart Sales Forecasting
In the rapidly evolving landscape of retail analytics, the accurate prediction of sales figures holds paramount importance for informed decision-making and operational optimization. Leveraging diverse machine learning methodologies, this study aims to enhance the precision of Walmart sales forecasting, utilizing a comprehensive dataset sourced from Kaggle. Exploratory data analysis reveals intricate patterns and temporal dependencies within the data, prompting the adoption of advanced predictive modeling techniques. Through the implementation of linear regression, ensemble methods such as Random Forest, Gradient Boosting Machines (GBM), eXtreme Gradient Boosting (XGBoost), and Light Gradient Boosting Machine (LightGBM), this research endeavors to identify the most effective approach for predicting Walmart sales. Comparative analysis of model performance showcases the superiority of advanced machine learning algorithms over traditional linear models. The results indicate that XGBoost emerges as the optimal predictor for sales forecasting, boasting the lowest Mean Absolute Error (MAE) of 1226.471, Root Mean Squared Error (RMSE) of 1700.981, and an exceptionally high R-squared value of 0.9999900, indicating near-perfect predictive accuracy. This model's performance significantly surpasses that of simpler models such as linear regression, which yielded an MAE of 35632.510 and an RMSE of 80153.858. Insights from bias and fairness measurements underscore the effectiveness of advanced models in mitigating bias and delivering equitable predictions across temporal segments. Our analysis revealed varying levels of bias across different models. Linear Regression, Multiple Regression, and GLM exhibited moderate bias, suggesting some systematic errors in predictions. Decision Tree showed slightly higher bias, while Random Forest demonstrated a unique scenario of negative bias, implying systematic underestimation of predictions. However, models like GBM, XGBoost, and LGB displayed biases closer to zero, indicating more accurate predictions with minimal systematic errors. Notably, the XGBoost model demonstrated the lowest bias, with an MAE of -7.548432 (Table 4), reflecting its superior ability to minimize prediction errors across different conditions. Additionally, fairness analysis revealed that XGBoost maintained robust performance in both holiday and non-holiday periods, with an MAE of 84273.385 for holidays and 1757.721 for non-holidays. Insights from the fairness measurements revealed that Linear Regression, Multiple Regression, and GLM showed consistent predictive performance across both subgroups. Meanwhile, Decision Tree performed similarly for holiday predictions but exhibited better accuracy for non-holiday sales, whereas, Random Forest, XGBoost, GBM, and LGB models displayed lower MAE values for the non-holiday subgroup, indicating potential fairness issues in predicting holiday sales. The study also highlights the importance of model selection and the impact of advanced machine learning techniques on achieving high predictive accuracy and fairness. Ensemble methods like Random Forest and GBM also showed strong performance, with Random Forest achieving an MAE of 12238.782 and an RMSE of 19814.965, and GBM achieving an MAE of 10839.822 and an RMSE of 1700.981. This research emphasizes the significance of leveraging sophisticated analytics tools to navigate the complexities of retail operations and drive strategic decision-making. By utilizing advanced machine learning models, retailers can achieve more accurate sales forecasts, ultimately leading to better inventory management and enhanced operational efficiency. The study reaffirms the transformative potential of data-driven approaches in driving business growth and innovation in the retail sector.
Read more29A new FCM-XGBoost system for predicting Pavement Condition Index
A new FCM-XGBoost system for predicting Pavement Condition Index
21Research on Provincial-Level Soil Moisture Prediction Based on Extreme Gradient Boosting Model
As one of the physical quantities concerned in agricultural production, soil moisture can effectively guide field irrigation and evaluate the distribution of water resources for crop growth in various regions. However, the spatial variability of soil moisture is dramatic, and its time series data are highly noisy, nonlinear, and nonstationary, and thus hard to predict accurately. In this study, taking Jiangsu Province in China as an example, the data of 70 meteorological and soil moisture automatic observation stations from 2014 to 2022 were used to establish prediction models of 0–10 cm soil relative humidity (RHs10cm) via the extreme gradient boosting (XGBoost) algorithm. Before constructing the model, according to the measured soil physical characteristics, the soil moisture observation data were divided into three categories: sandy soil, loam soil, and clay soil. Based on the impacts of various factors on the soil water budget balance, 14 predictors were chosen for constructing the model, among which atmospheric and soil factors accounted for 10 and 4, respectively. Considering the differences in soil physical characteristics and the lagged effects of environmental impacts, the best influence times of the predictors for different soil types were determined through correlation analysis to improve the rationality of the model construction. To better evaluate the importance of soil factors, two sets of models (Model_soil&atmo and Model_atmo) were designed by taking soil factors as optional predictors put into the XGBoost model. Meanwhile, the contributions of predictors to the prediction results were analyzed with Shapley additive explanation (SHAP). Six prediction effect indicators, as well as a typical drought process that happened in 2022, were analyzed to evaluate the prediction accuracy. The results show that the time with the highest correlations between environmental predictors and RHs10cm varied but was similar between soil types. Among these predictors, the contribution rates of maximum air temperature (Tamax), cumulative precipitation (Psum), and air relative humidity (RHa) in atmospheric factors, which functioned as a critical factor affecting the variation in soil moisture, are relatively high in both models. In addition, adding soil factors could improve the accuracy of soil moisture prediction. To a certain extent, the XGBoost model performed better when compared with artificial neural networks (ANNs), random forests (RFs), and support vector machines (SVMs). The values of the correlation coefficient (R), root mean square error (RMSE), mean absolute error (MAE), mean absolute relative error (MARE), Nash–Sutcliffe efficiency coefficient (NSE), and accuracy (ACC) of Model_soil&atmo were 0.69, 11.11, 4.87, 0.12, 0.50, and 88%, respectively. This study verified that the XGBoost model is applicable to the prediction of soil moisture at the provincial level, as it could reasonably predict the development processes of the typical drought event.
Read moreAB1138 APPLICATION OF MACHINE LEARNING METHODS TO PREDICT SF-36 MENTAL HEALTH DOMAIN FOR SYSTEMIC LUPUS ERYTHEMATOSUS PATIENTS
Background:Systemic lupus erythematosus (SLE) is a chronic autoimmune disease that affects multiple organs and systems. However, in addition to physical damage, patients with SLE have an increased risk of mental...
Read more20Enhancing Meteorological Drought Modeling Accuracy Using Hybrid Boost Regression Models: A Case Study from the Aegean Region, Türkiye
The impact of climate change has led to significant changes in hydroclimatic patterns and continuous stress on water resources through frequent wet and dry spells. Hence, understanding and effectively addressing the escalating impact of climate change on hydroclimatic patterns, especially in the context of meteorological drought, necessitates precise modeling of these phenomena. This study focuses on assessing the accuracy of drought modeling using the well-established Standard Precipitation Index (SPI) in the Aegean region of Türkiye. The study utilizes monthly precipitation data from six stations in Cesme, Kusadasi, Manisa, Seferihisar, Selcuk and Izmir at Kucuk Menderes Basin covering the period from 1973 to 2020. The dataset is divided into three sets, training (60%), validation (20%), and testing (20%) sets. The study aims to determine the SPI-3, SPI-6 and SPI-12 using a multi-station prediction technique. Three boosting regression models (BRMs), namely Extreme Gradient Boosting (XgBoost), Adaptive Boosting (AdaBoost), and Gradient Boosting (GradBoost), were employed and optimized with the help of the Weighted Mean of Vectors (INFO) technique. Model performances were then evaluated with the Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Mean Absolute Percentage Error (MAPE), Coefficient of Determination (R2) and the Willmott Index (WI). Results demonstrated a distinct superiority of the XgBoost model over AdaBoost and GradBoost in terms of accuracy. During the test phase, the XgBoost model achieved RMSEs of 0.496, 0.429 and 0.389 for SPI-3, SPI-6 and SPI-12, respectively. The WIs were 0.899, 0.901 and 0.825 for SPI-3, SPI-6 and SPI-12, respectively. These are considerably lower than the corresponding values obtained by the other models. Yet, the comparative statistical analysis further underscores the effectiveness of XgBoost in modeling extended periods of drought in the Aegean region of Türkiye.
Read more7Machine Learning Model of Oilfield Productivity Prediction and Performance Evaluation
Accurate and efficient prediction of oilfield productivity is very important for the formulation of development and adjustment plans. Machine learning (ML) productivity prediction model can quickly obtain the productivity of oilfield development. In this paper, an oilfield development productivity prediction model based on five ML algorithms including multivariable linear regression (LR), extreme gradient boosting (XGBoost), light gradient boosting machine (LightGBM), back propagation (BP) neural network and long short term memory (LSTM) neural network is established. Through the evaluation of model performance indicators (include the root mean square error (RMSE), the coefficient of determination (R2), the mean absolute error (MAE) and mean absolute percentage error (MAPE)), the best performance prediction model is selected. The research results show that the prediction results of LR model are greatly affected by the data of high productivity oil wells, XGBoost model are easily affected by fitting, and BP neural network model is far less effective than other models. Through comprehensive comparison of prediction results, LightGBM model has better stability and generalization performance. The difference between the prediction results of each model is mainly caused by the characteristics of the algorithm and the size of the data sets. At the same time, LSTM can predict the future oil well production based on the oil well time series observation data. The research results of this paper have guiding significance for the selection of productivity prediction model for oilfield development based on data-driven.
Read more166Explainable machine learning model and reliability analysis for flexural capacity prediction of RC beams strengthened in flexure with FRCM
This paper presents a data-driven approach to determine the load and flexural capacities of reinforced concrete (RC) beams strengthened with fabric reinforced cementitious matrix (FRCM) composites in flexure. A total of seven machine learning (ML) models such as kernel ridge regression, K-nearest neighbors, support vector regression, classification and regression trees, random forest, gradient boosted trees, and extreme gradient boosting (xgBoost) are evaluated to propose the best predictive model for FRCM-strengthened beams. Beam geometry, internal steel reinforcement area, FRCM reinforcement area, and mechanical characteristics of concrete, steel, and FRCM are the main input parameters included in the database. Among the studied ML models, the xgBoost model is the most accurate model with the highest coefficient of determination (R2=99.3%) and least root mean square (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE). A comparative study of the performance of the proposed and existing analytical models revealed the superior predictive capability and robustness of the proposed model. The predicted flexural and load capacities of the beams based on the existing analytical models are highly scattered and either over-conservative or unsafe. A unified SHapley Additive exPlanations approach is employed to explain the output of the best ML model and identify the most significant input features and interactions that influence the capacity of FRCM-strengthened RC beams in flexure. Furthermore, a reliability analysis is performed to calibrate the resistance reduction factor (ϕ) to achieve a specified target reliability index (βT=3.5).
Read moreFactors affecting and identification of key environmental determinants of the Oncomelania hupensis snail density in the Yangtze River Delta based on machine learning models
To identify factors affecting and key environmental factors of the Oncomelania hupensis snail density in the Yangtze River Delta region using machine learning methods. Administrative village-level O. hupensis snail survey data in the Yangtze River Delta (including Shanghai Municipality, Jiangsu Province, Zhejiang Province and Anhui Province) from 2011 to 2021 were retrieved from the Information Management System for Parasitic Disease Control of Chinese Center for Disease Control and Prevention. Environmental factor data were captured from the Google Earth Engine platform, including elevation, slope, terrain, normalized difference vegetation index (NDVI), vegetation type, soil type, total petroleum hydrocarbon (TPH), ammonium nitrogen, inorganic nitrogen, dissolved oxygen, pH of water, chemical oxygen demand (COD) and inorganic phosphorus, and climatic factor data in the study region were retrieved from the Copernicus Climate Data Store, including annual precipitation, aridity index and annual mean temperature (AMT). O. hupensis snail survey data in the Yangtze River Delta region from 2011 to 2021 were randomly divided into a training set (70%) and a test set (30%), and five machine learning models were selected for machine learning model construction and comparative analysis of the O. hupensis snail density using the software R 4.3.0, including random forest (RF), eXtreme gradient boosting (XGBoost), support vector machine (SVM), gradient boosting machine (GBM) and neural network (NN). The XGBoost model was employed to construct a predictive model for the O. hupensis snail density, and the impact of each environmental factor on O. hupensis snail distribution was quantified. The SHapley Additive exPlanations (SHAPs) values were calculated to estimate the average contribution of each variable to the model prediction, and the core environmental factors affecting the O. hupensis snail population density were screened. Among the five machine learning models, the XGBoost model exhibited the optimal comprehensive performance, with the coefficient of determination (R2) of 0.855, mean squared error (MSE) of 0.188, root mean squared error (RMSE) of 0.434 and mean absolute error (MAE) of 0.155, respectively. Analysis of factors affecting the O. hupensis snail density with the XGBoost model showed that among the 16 environmental factors, the top four high-impact factors ranked by SHAPs values included annual precipitation, elevation, aridity index and NDVI, with cumulative SHAPs contributions of 75%, which was higher than that of other environmental factors. If NDVI was higher than 0.6, the O. hupensis snail density increased with NDVI and peaked if NDVI was 0.8 (1.60 snails/0.1 m2). The O. hupensis snail density increased with elevation if the elevation ranged from 14 to 40 m, and slowly rose if the annual precipitation ranged from 900 to 1 300 mm, and then increased rapidly to the peak (1.52 snails/0.1 m2) if the annual precipitation ranged from 1 300 to 1 500 mm. In addition, the O. hupensis snail density increased rapidly to the maximum (1.60 snails/0.1 m2) if the aridity index ranged from 0.8 to 1.1, and decreased gradually if the aridity index exceeded 1.1. The XGBoost model shows excellent performance in prediction of the O. hupensis snail density and identification of key environmental factors in the Yangtze River Delta region. Annual precipitation, elevation, aridity index and NDVI are key environmental factors affecting the distribution and density of O. hupensis snails in the Yangtze River Delta region.
Read more17Machine learning algorithm to predict the in-hospital mortality in critically ill patients with chronic kidney disease
Background This study aimed to establish and validate a machine learning (ML) model for predicting in-hospital mortality in critically ill patients with chronic kidney disease (CKD). Methods This study collected data on CKD patients from 2008 to 2019 using the Medical Information Mart for Intensive Care IV. Six ML approaches were used to build the model. Accuracy and area under the curve (AUC) were used to choose the best model. In addition, the best model was interpreted using SHapley Additive exPlanations (SHAP) values. Results There were 8527 CKD patients eligible for participation; the median age was 75.1 (interquartile range: 65.0–83.5) years, and 61.7% (5259/8527) were male. We developed six ML models with clinical variables as input factors. Among the six models developed, the eXtreme Gradient Boosting (XGBoost) model had the highest AUC, at 0.860. According to the SHAP values, the sequential organ failure assessment score, urine output, respiratory rate, and simplified acute physiology score II were the four most influential variables in the XGBoost model. Conclusions In conclusion, we successfully developed and validated ML models for predicting mortality in critically ill patients with CKD. Among all ML models, the XGBoost model is the most effective ML model that can help clinicians accurately manage and implement early interventions, which may reduce mortality in critically ill CKD patients with a high risk of death.
Read more
Copyright 2026 Cactus Communications. All rights reserved.
