Prediction of thermal diffusivity of volcanic rocks using machine learning and genetic algorithm hybrid strategy

In this study, six machine learning (ML) models, namely, random forest (RF), Gaussian process regression (GPR), support vector regression (SVR), decision tree (DT), least squares support vector machine (LSSVM), and multivariate adaptive regression spline (MARS) models, were employed to reconstruct the missing daily‐averaged discharge in a mega‐delta from 1980 to 2015 using upstream‐downstream multi‐station data. The performance and accuracy of each ML model were assessed and compared with the stage‐discharge rating curves (RCs) using four statistical indicators, Taylor diagrams, violin plots, scatter plots, time‐series plots, and heatmaps. Model input selection was performed using mutual information and correlation coefficient methods after three data pre‐processing steps: normalization, Fourier series fitting, and first‐order differencing. The results showed that the ML models are superior to their RC counterparts, and MARS and RF are the most reliable algorithms, although MARS achieves marginally better performance than RF. Compared to RC, MARS and RF reduced the root mean square error (RMSE) by 135% and 141% and the mean absolute error by 194% and 179%, respectively, using year‐round data. However, the performance of MARS and RF developed for the climbing (wet season) and recession (dry season) limbs separately worsened slightly compared to that developed using the year‐round data. Specifically, the RMSE of MARS and RF in the falling limb was 856 and 1,040 m3/s, respectively, while that obtained using the year‐round data was 768 and 789 m3/s, respectively. In this study, the DT model is not recommended, while the GPR and SVR models provide acceptable results.

Melt electrowriting (MEW) is a solvent‐free (i.e., no volatile chemicals), a high‐resolution three‐dimensional (3D) printing method that enables the fabrication of semi‐flexible structures with rigid polymers. Despite its advantages, the MEW process is sensitive to changes in printing parameters (e.g., voltage, printing pressure, and temperature), which can cause fluid column breakage, jet lag, and/or fiber pulsing, ultimately deteriorating the resolution and printing quality. In spite of the commonly used error‐and‐trial method to determine the most suitable parameters, here, we present a machine learning (ML)‐enabled image analysis‐based method for determining the optimum MEW printing parameters through an easy‐to‐use graphical user interface (GUI). We trained five different ML algorithms using 168 MEW 3D print samples, among which the Gaussian process regression ML model yielded 93% accuracy of the variability in the dependent variable, 0.12329 on root mean square error for the validation set and 0.015201 mean square error in predicting line thickness. Integration of ML with a control feedback loop and MEW can reduce the error‐and‐trial steps prior to the 3D printing process, decreasing the printing time (i.e., increasing the overall throughput of MEW) and material waste (i.e., improving the cost‐effectiveness of MEW). Moreover, embedding a trained ML model with the feedback control system in a GUI facilitates a more straightforward use of ML‐based optimization techniques in the industrial section (i.e., for users with no ML skills).

Accurate prediction of energy consumption in district heating systems plays an important role in supporting effective and clean energy production and distribution in dense urban areas. Predictive models are needed for flexible and cost-effective operation of energy production and usage, e.g., using peak shaving or load shifting to compensate for heat losses in the pipeline. This helps to avoid exceedance of power plant capacity. The purpose of this study is to automate the process of building machine learning (ML) models to solve a short-term power demand prediction problem. The dataset contains a district heating network’s measured hourly power consumption and ambient temperature for 415 days. In this paper, we propose a hybrid evolutionary-based algorithm, named GA-SHADE, for the simultaneous optimization of ML models and feature selection. The GA-SHADE algorithm is a hybrid algorithm consisting of a Genetic Algorithm (GA) and success-history-based parameter adaptation for differential evolution (SHADE). The results of the numerical experiments show that the proposed GA-SHADE algorithm allows the identification of simplified ML models with good prediction performance in terms of the optimized feature subset and model hyperparameters. The main contributions of the study are (1) using the proposed GA-SHADE, ML models with varying numbers of features and performance are obtained. (2) The proposed GA-SHADE algorithm self-adapts during operation and has only one control parameter. There is no fine-tuning required before execution. (3) Due to the evolutionary nature of the algorithm, it is not sensitive to the number of features and hyperparameters to be optimized in ML models. In conclusion, this study confirms that each optimized ML model uses a unique set and number of features. Out of the six ML models considered, SVR and NN are better candidates and have demonstrated the best performance across several metrics. All numerical experiments were compared against the measurements and proven by the standard statistical tests.

Road crash prediction has proven to be an effective means of improving highway safety. In recent years, machine learning (ML) models have been embraced as efficient for the prediction of road accident frequency. This study applied two machine learning models for the prediction of road accident occurrence on selected South-West highway in Nigeria. Accident data were obtained for the period of 10 years from 2013 to 2022 from the Federal Road Safety Commission (FRSC) of Nigeria on the road under study and the traffic operations were determined on site using manual counting and stopwatch approach. Machine Learning (ML) models including Support Vector Machine (SVM) and Extreme Gradient Boosting (XGBoost) were also used as the statistical model for safety prediction of the highway with consideration to identified contributing factors. The performance of the models was compared for both training and testing dataset using coefficient of determination (R2), Mean Absolute Error (MAE) and Root Mean Square Error (RMSE). The study showed consistency and effective performance in both ML models with R2 of 0.99 in SVM, 0.97 and XGBoost for training data, also 0.93 in SVM and 0.76 in XGBoost testing data. ML models are also easy and fast to implement. The result of this study supports the use of ML as a predictive tool for road safety evaluation. The knowledge attained from this study will benefit transportation planners, engineers, and policymakers to implement effective measures aimed at reducing the crash occurrence, thereby enhancing overall transportation safety and efficiency.

Su kaynaklarının planlanması ve tarımsal su yönetimi için referans bitki su tüketiminin (ET0) doğru tahmin edilmesi oldukça önemlidir. Bu çalışmada üç farklı makine öğrenimi yönteminin, yapay sinir ağları (YSA), rassal ağaç (RT) ve gauss süreç regresyonu (GPR), yarı nemli iklim koşullarına sahip bir bölgeden alınan iklim verileri kullanılarak günlük ET0’ı tahmin etme performansları araştırılmıştır. Modelleri eğitmek ve test etmek için Bafra’da 2018–2020 döneminde toplanan günlük meteorolojik verilerin beş girdi kombinasyonu [günlük ortalama (Tort), maksimum (Tmax) ve minimum sıcaklık (Tmin), rüzgar hızı (u2), bağıl nem (RHort) ve güneşlenme şiddeti (Rs) hem tam hem de eksik kombinasyonları dahil] kullanılmıştır. Makine öğrenimi modellerinin performansı ise FAO-56 Penman Monteith (FAO-56 PM) standart denklemi ile karşılaştırılmıştır. Modellerin doğruluğunu değerlendirmek için dört farklı istatistiksel performans indeksi kullanılmıştır [belirleme katsayısı (R2), ortalama mutlak hata (MAE), hata kareleri toplamının karekökü (RMSE) ve Nash–Sutcliffe etkinlik katsayısı (NSE)]. Sonuçlar, her beş senaryoda da YSA modellerinin RT ve GPR modellerinden daha iyi performans gösterdiğini ortaya koymuştur. Tüm verilerin girdi olarak kullanıldığı beşinci senaryo için YSA modelleri tarafından tahmin edilen ET0 değerlerinin FAO-56 PM değerleri ile iyi bir uyum içinde olduğu belirlenmiştir (R2=0.988, MAE=0.166, RMSE=0.205, NSE=0.984). Bununla birlikte meteorolojik veriler tam olmadığında bile sadece Tort, RHort ve Rs ile oldukça yüksek günlük ET0 tahminleri elde edilmiştir. Genel olarak, radyasyona dayalı makine öğrenimi modelleri, sıcaklığa dayalı makine öğrenimi modellerinden daha iyi performans göstermiştir. Sonuçlar, yarı nemli iklim özelliklerine sahip bir bölgede YSA modelinin ET0'ı oldukça verimli ve doğru bir şekilde modellemek için etkili bir şekilde kullanılabileceğini göstermektedir.

Predicting total alkalinity in saline water using machine learning: A case study with RapidMiner

Machine learning (ML) models provide more choices to patients with diabetes mellitus (DM) to more properly manage blood glucose (BG) levels. However, because of numerous types of ML algorithms, choosing an appropriate model is vitally important. In a systematic review and network meta-analysis, this study aimed to comprehensively assess the performance of ML models in predicting BG levels. In addition, we assessed ML models used to detect and predict adverse BG (hypoglycemia) events by calculating pooled estimates of sensitivity and specificity. PubMed, Embase, Web of Science, and Institute of Electrical and Electronics Engineers Explore databases were systematically searched for studies on predicting BG levels and predicting or detecting adverse BG events using ML models, from inception to November 2022. Studies that assessed the performance of different ML models in predicting or detecting BG levels or adverse BG events of patients with DM were included. Studies with no derivation or performance metrics of ML models were excluded. The Quality Assessment of Diagnostic Accuracy Studies tool was applied to assess the quality of included studies. Primary outcomes were the relative ranking of ML models for predicting BG levels in different prediction horizons (PHs) and pooled estimates of the sensitivity and specificity of ML models in detecting or predicting adverse BG events. In total, 46 eligible studies were included for meta-analysis. Regarding ML models for predicting BG levels, the means of the absolute root mean square error (RMSE) in a PH of 15, 30, 45, and 60 minutes were 18.88 (SD 19.71), 21.40 (SD 12.56), 21.27 (SD 5.17), and 30.01 (SD 7.23) mg/dL, respectively. The neural network model (NNM) showed the highest relative performance in different PHs. Furthermore, the pooled estimates of the positive likelihood ratio and the negative likelihood ratio of ML models were 8.3 (95% CI 5.7-12.0) and 0.31 (95% CI 0.22-0.44), respectively, for predicting hypoglycemia and 2.4 (95% CI 1.6-3.7) and 0.37 (95% CI 0.29-0.46), respectively, for detecting hypoglycemia. Statistically significant high heterogeneity was detected in all subgroups, with different sources of heterogeneity. For predicting precise BG levels, the RMSE increases with a rise in the PH, and the NNM shows the highest relative performance among all the ML models. Meanwhile, current ML models have sufficient ability to predict adverse BG events, while their ability to detect adverse BG events needs to be enhanced. PROSPERO CRD42022375250; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=375250.

Among several indicators for river engineering sustainability, the longitudinal dispersion coefficient () is the main parameter that defines the transport of pollutants in natural streams. Accurate estimation of has been challenging for hydrologists due to the high stochasticity and non-linearity of this hydraulic-environmental parameter. This study presents a new hybrid machine learning (ML) model integrating a Gaussian Process Regression (GPR) and an evolutionary feature selection (FS) approach (i.e. Covariance Matrix Adaptation Evolution Strategy (CMAES)) to estimate in natural streams. The dataset consists of geometric and hydraulic river system parameters from 29 streams in the United States. The modeling results showed that the proposed model outperformed other models in the literature, producing more stable and accurate estimations. The FS approach evidenced the significance of the cross-sectional average flow velocity (U), channel width (B), and channel sinuosity σ to estimate the dispersion coefficient. In quantitative terms, the integrated GPR model with feature selection approach attained the minimum root mean square error () and maximum coefficient of determination (). The proposed hybrid evolutionary ML model arises as robust, flexible and reliable alternative computer aid technology for predicting the longitudinal dispersion coefficient in natural streams.

Abstract. An accurate spatially continuous air temperature data set is crucial for multiple applications in the environmental and ecological sciences. Existing spatial interpolation methods have relatively low accuracy, and the resolution of available long-term gridded products of air temperature for China is coarse. Point observations from meteorological stations can provide long-term air temperature data series but cannot represent spatially continuous information. Here, we devised a method for spatial interpolation of air temperature data from meteorological stations based on powerful machine learning tools. First, to determine the optimal method for interpolation of air temperature data, we employed three machine learning models: random forest, support vector machine, and Gaussian process regression. A comparison of the mean absolute error, root mean square error, coefficient of determination, and residuals revealed that a Gaussian process regression had high accuracy and clearly outperformed the other two models regarding the interpolation of monthly maximum, minimum, and mean air temperatures. The machine learning methods were compared with three traditional methods used frequently for spatial interpolation: inverse distance weighting, ordinary kriging, and ANUSPLIN (Australian National University Spline). Results showed that the Gaussian process regression model had higher accuracy and greater robustness than the traditional methods regarding interpolation of monthly maximum, minimum, and mean air temperatures in each month. A comparison with the TerraClimate (Monthly Climate and Climatic Water Balance for Global Terrestrial Surfaces), FLDAS (Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System), and ERA5 (ECMWF, European Centre for Medium-Range Weather Forecasts, Climate Reanalysis) data sets revealed that the accuracy of the temperature data generated using the Gaussian process regression model was higher. Finally, using the Gaussian process regression method, we produced a long-term (January 1951 to December 2020) gridded monthly air temperature data set, with 1 km resolution and high accuracy for China, which we named GPRChinaTemp1km. The data set consists of three variables: monthly mean air temperature, monthly maximum air temperature, and monthly minimum air temperature. The obtained GPRChinaTemp1km data were used to analyse the spatiotemporal variations of air temperature using Theil–Sen median trend analysis in combination with the Mann–Kendall test. It was found that the monthly mean and minimum air temperatures across China were characterised by a significant trend of increase in each month, whereas monthly maximum air temperatures showed a more spatially heterogeneous pattern, with significant increase, non-significant increase, and non-significant decrease. The GPRChinaTemp1km data set is publicly available at https://doi.org/10.5281/zenodo.5112122 (He et al., 2021a) for monthly maximum air temperature, at https://doi.org/10.5281/zenodo.5111989 (He et al., 2021b) for monthly mean air temperature, and at https://doi.org/10.5281/zenodo.5112232 (He et al., 2021c) for monthly minimum air temperature.

Machine learning for performance prediction in smart buildings: Photovoltaic self-consumption and life cycle cost optimization

Estimation of recompression coefficient of soil using a hybrid ANFIS-PSO machine learning model

Optimisation and interpretation of machine and deep learning models for improved water quality management in Lake Loktak

Scouring around bridge piers and abutments are the most common failure mode for bridges which can lead to infrastructure and economic losses. Thus, it is important to analyze the scour depth around bridge piers and abutments, however, most studies focus on the prediction of scour depth around pier of single geometry. This study focuses on predicting scour depth around vertical wall, 45° wing wall, and semicircular abutments using a comprehensive set of different machine learning (ML) models, i.e., Artificial Neural Network (ANN), Adaptive-Network-Based Fuzzy Inference System (ANFIS), Gene Expression Programming (GEP), Extreme Gradient Boosting (XGBoost), Random Forest (RF), Support Vector Machine (SVM), and Random Subspace KStar (RS-KStar) model. These models are validated using statistical indices like coefficient of determination (R 2 ), root mean square error (RMSE), and mean absolute error (MAE). The models were benchmarked against two existing empirical equations. The results indicate that, XGBoost and Random Forest achieved the highest accuracy for vertical wall and 45° wing wall due to their ability of capturing strong nonlinearities and skewed flow patterns. In case of semicircular abutment, ANN and ANFIS performed better as the flow behavior is smoother and more continuous. All ML models outperform the empirical equations highlighting the limited generalizability of these equations. The comparative analysis indicates that the performance of the model varies with different abutment geometries, highlighting the importance of selection of ML model based on structure geometry.

Accurate prediction of performance indices using impeller parameters is of great importance for the initial and optimal design of centrifugal pump. In this study, a kernel-based non-parametric machine learning method named with Gaussian process regression (GPR) was proposed, with the purpose of predicting the performance of centrifugal pump with less effort based on available impeller parameters. Nine impeller parameters were defined as model inputs, and the pump performance indices, that is, the head and efficiency, were determined as model outputs. The applicability of three widely used nonlinear kernel functions of GPR including squared exponential (SE), rational quadratic (RQ) and Matern5/2 was investigated, and it was found by comparing with the experimental data that the SE kernel function is more suitable to capture the relationship between impeller parameters and performance indices because of the highest R square and the lowest values of max absolute relative error (MARE), mean absolute proportional error (MAPE), and root mean square error (RMSE). In addition, the results predicted by GPR with SE kernel function were compared with the results given by other three machine learning models. The comparison shows that the GPR with SE kernel function is more accurate and robust than other models in centrifugal pump performance prediction, and its prediction errors and uncertainties are both acceptable in terms of engineering applications. The GPR method is less costly in the performance prediction of centrifugal pump with sufficient accuracy, which can be further used to effectively assist the design and manufacture of centrifugal pump and to speed up the optimization design process of impeller coupled with stochastic optimization methods.

This study focuses on using various machine learning (ML) models to evaluate the shear behaviors of ultra-high-performance concrete (UHPC) beams reinforced with glass fiber-reinforced polymer (GFRP) bars. The main objective of the study is to predict the shear strength of UHPC beams reinforced with GFRP bars using ML models. We use four different ML models: support vector machine (SVM), artificial neural network (ANN), random forest (R.F.), and extreme gradient boosting (XGBoost). The experimental database used in the study is acquired from various literature sources and comprises 54 test observations with 11 input features. These input features are likely parameters related to the composition, geometry, and properties of the UHPC beams and GFRP bars. To ensure the ML models' generalizability and scalability, random search methods are utilized to tune the hyperparameters of the algorithms. This tuning process helps improve the performance of the models when predicting the shear strength. The study uses the ACI318M-14 and Eurocode 2 standard building codes to predict the shear capacity behavior of GFRP bars-reinforced UHPC I-shaped beams. The ML models' predictions are compared to the results obtained from these building code standards. According to the findings, the XGBoost model demonstrates the highest predictive test performance among the investigated ML models. The study employs the SHAP (SHapley Additive exPlanations) analysis to assess the significance of each input parameter in the ML models' predictive capabilities. A Taylor diagram is used to statistically compare the accuracy of the ML models. This study concludes that ML models, particularly XGBoost, can effectively predict the shear capacity behavior of GFRP bars-reinforced UHPC I-shaped beams.