The application of machine learning models in a resource-constrained environment.

The increasing complexity of social science data and phenomena necessitates using advanced analytical techniques to capture nonlinear relationships that traditional linear models often overlook. This chapter explores the application of machine learning (ML) models in social science research, focusing on their ability to manage nonlinear interactions in multidimensional datasets. Nonlinear relationships are central to understanding social behaviors, socioeconomic factors, and psychological processes. Machine learning models, including decision trees, neural networks, random forests, and support vector machines, provide a flexible framework for capturing these intricate patterns. The chapter begins by examining the limitations of linear models and introduces essential machine learning techniques suited for nonlinear modeling. A discussion follows on how these models automatically detect interactions and threshold effects, offering superior predictive power and robustness against noise compared to traditional methods. The chapter also covers the practical challenges of model evaluation, validation, and handling imbalanced data, emphasizing cross-validation and performance metrics tailored to the nuances of social science datasets. Practical recommendations are offered to researchers, highlighting the balance between predictive accuracy and model interpretability, ethical considerations, and best practices for communicating results to diverse stakeholders. This chapter demonstrates that while machine learning models provide robust solutions for modeling nonlinear relationships, their successful application in social sciences requires careful attention to data quality, model selection, validation, and ethical considerations. Machine learning holds transformative potential for understanding complex social phenomena and informing data-driven psychology, sociology, and political science policy-making.

Systematic literature review of machine learning based software development effort estimation models

The best practice of watershed management is through the understanding of the hydrological processes. As a matter of fact, hydrological processes are highly associated with stochastic, non-linear, and non-stationary phenomena. Hydrological processes simulation and modeling are challenging issues in the domains of hydrology, climate and environment. Hence, the development of machine learning (ML) models for solving those complex hydrological problems took essential place over the past couple decades. It can be observed, hydrological data availability has increased remarkably, and thus computational resources has led to a resurgence in ML models’ development. It has been witnessed huge efforts on the hydrological processes modeling using the facility of ML models and several review researches have been conducted. Literature studies approved the capacity of ML models in the field of hydrology over the classical “traditional models” based on their forecastability, flexibility, precision, generalization, and modeling execution convergence speed. However, although several potential merits were observed in ML model’s development, several limitations are allied such as the interpretability of those black-box models, the practicality of the ML models in watershed management, and difficulty to explain the physical hydrological processes. In this survey, an exhibition for all the published review articles on the development of ML models for hydrological processes and recognize all the research gaps and potential research direction. The ultimate aim of the current survey is to establish a new milestone for the interested hydrology, environment and climate researchers on the applications of ML models.

Early detection of diabetes is essential to prevent serious complications in patients. The purpose of this work is to detect and classify type 2 diabetes in patients using machine learning (ML) models, and to select the most optimal model to predict the risk of diabetes. In this paper, five ML models, including K-nearest neighbor (K-NN), Bernoulli Naïve Bayes (BNB), decision tree (DT), logistic regression (LR), and support vector machine (SVM), are investigated to predict diabetic patients. A Kaggle-hosted Pima Indian dataset containing 768 patients with and without diabetes was used, including variables such as number of pregnancies the patient has had, blood glucose concentration, diastolic blood pressure, skinfold thickness, body insulin levels, body mass index (BMI), genetic background, diabetes in the family tree, age, and outcome (with/without diabetes). The results show that the K-NN and BNB models outperform the other models. The K-NN model obtained the best accuracy in detecting diabetes, with 79.6% accuracy, while the BNB model obtained 77.2% accuracy in detecting diabetes. Finally, it can be stated that the use of ML models for the early detection of diabetes is very promising.

This paper investigates the importance of explainability versus accuracy of machine learning (ML) models. We propose that greater task uncertainty makes people want to interact more with the ML model, which increases the importance of explainability relative to accuracy. We focus on the use of ML models for product cost estimation during new product development. The paper provides mixed-methods evidence on the trade-off between explainability and accuracy of ML models. Specifically, we find support for an inverse relationship between explainability and accuracy from the perspective of cost experts. We also find that the accurate but complex and less explainable ML model of gradient boosted regression (GBR) was preferred in only a few situations; mostly, the more basic, better explainable models of multiple linear regression (MLR) and case-based reasoning (CBR) were preferred, although these were less accurate. This suggests that lack of explainability can indeed be a major limitation for the application of ML models. Furthermore, we investigate specific characteristics that could increase task uncertainty and the importance of explainability in our context: project unpredictability, product cost granularity, predecessor product availability, target cost gap, and product development phase.

State-of-the art-on irrigation water quality management using data-driven methods: Practical application, limitations, and prospective directions

BackgroundDespite the interest in machine learning (ML) algorithms for analyzing real-world data (RWD) in healthcare, the use of ML in predicting time-to-event data, a common scenario in clinical practice, is less explored. ML models are capable of algorithmically learning from large, complex datasets and can offer advantages in predicting time-to-event data. We reviewed the recent applications of ML for survival analysis using RWD in healthcare.MethodsPUBMED and EMBASE were searched from database inception through March 2023 to identify peer-reviewed English-language studies of ML models for predicting time-to-event outcomes using the RWD. Two reviewers extracted information on the data source, patient population, survival outcome, ML algorithms, and the Area Under the Curve (AUC).ResultsOf 257 citations, 28 publications were included. Random survival forests (N = 16, 57%) and neural networks (N = 11, 39%) were the most popular ML algorithms. There was variability across AUC for these ML models (median 0.789, range 0.6–0.950). ML algorithms were predominately considered for predicting overall survival in oncology (N = 12, 43%). ML survival models were often used to predict disease prognosis or clinical events (N = 27, 96%) in the oncology, while less were used for treatment outcomes (N = 1, 4%).ConclusionsThe ML algorithms, random survival forests and neural networks, are mainly used for RWD to predict survival outcomes such as disease prognosis or clinical events in the oncology. This review shows that more opportunities remain to apply these ML algorithms to inform treatment decision-making in clinical practice. More methodological work is also needed to ensure the utility and applicability of ML models in survival outcomes.

BackgroundTo build machine learning predictive models for surgical risk assessment of extracapsular extension (ECE) in patients with prostate cancer (PCa) before radical prostatectomy; and to compare the use of decision curve analysis (DCA) and receiver operating characteristic (ROC) metrics for selecting input feature combinations in models.MethodsThis retrospective observational study included two independent data sets: 139 participants from a single institution (training), and 55 from 15 other institutions (external validation), both treated with Robotic Assisted Radical Prostatectomy (RARP). Five ML models, based on different combinations of clinical, semantic (interpreted by a radiologist) and radiomics features computed from T2W-MRI images, were built to predict extracapsular extension in the prostatectomy specimen (pECE+). DCA plots were used to rank the models’ net benefit when assigning patients to prostatectomy with non-nerve-sparing surgery (NNSS) or nerve-sparing surgery (NSS), depending on the predicted ECE status. DCA model rankings were compared with those drived from ROC area under the curve (AUC).ResultsIn the training data, the model using clinical, semantic, and radiomics features gave the highest net benefit values across relevant threshold probabilities, and similar decision curve was observed in the external validation data. The model ranking using the AUC was different in the discovery group and favoured the model using clinical + semantic features only.ConclusionsThe combined model based on clinical, semantic and radiomic features may be used to predict pECE + in patients with PCa and results in a positive net benefit when used to choose between prostatectomy with NNS or NNSS.

Objective: The objective of this article is to carry out a co-word study on the application of machine learning models in health prevention and promotion, and its effect on labor productivity. Methodology: The analysis of the relevant literature on the proposed topic, identified in the last 15 years in Scopus, is considered. Articles, books, book chapters, editorials, conference papers and reviews refereed publications were considered. A thematic mapping analysis was performed using factor analysis and strategy diagrams to derive primary research approaches and identify frequent themes as well as thematic evolution. Results: The results of this study show the selection of 87 relevant publications with an average annual growth rate of 23.25% in related production. The main machine learning algorithms used, the main research approaches and key authors, derived from the analysis of thematic maps, were identified. Conclusions: This study emphasizes the importance of using co-word analysis to understand trends in research on the impact of health prevention and promotion on labor productivity. The potential benefits of using machine learning models to address this issue are highlighted and anticipated to guide future research focused on improvements in labor productivity through prevention and promotion of health. Originality: The identification of the relationship between work productivity and health prevention and promotion through machine learning models is a relevant topic but little analyzed in recent literature. The analysis of co-words allows us to establish the reference point of the state of the art in this regard and future trends.

Self-reported periodontitis: A multiethnic community-based validation study.

Anemia is one of the common adverse reactions after hip fracture surgery. The traditional method to solve anemia is allogeneic transfusion. However, the transfusion may lead to some complications such as septicemia and fever. So far, few studies have reported roles of machine learning in predicting whether blood transfusion is needed or not after hip fracture surgery. Therefore, the purpose of this study is to develop machine learning models to predict the likelihood of postoperative blood transfusion in patients undergoing hip fracture surgery. This study enrolled 1355 patients who underwent hip fracture surgery at the Affiliated Hospital of Qingdao University from January 2016 to December 2021. Among all patients, 210 cases received postoperative blood transfusion. All patients were randomly divided into a training group and a testing group at a ratio of 7:3. In the training group, univariate and multivariate logistic regression analyses were used to determine independent risk factors for the postoperative transfusion. Then, based on these independent risk factors, tenfold cross-validation method was utilized to develop five machine learning models, including logistic, multilayer perceptron (MLP), extreme gradient boosting (XGBoost), random forest (RF), and support vector machine (SVM). The receiver operating characteristic (ROC) curve, area under ROC curve (AUC), and Matthews correlation coefficient (MCC) were generated to evaluate the performance of the models. Calibration plot and decision curve analysis (DCA) were used to test the performance, stability, and clinical applicability of the models. The models were validated using the testing group; and the ROC curve, MCC, calibration plot, and DCA curves were also generated to validate the performance, stability, and clinical applicability of the models. To further verify the robustness of the model, we randomly grabbed 70% of the samples in the testing set, performed 1000 iterations, and calculated the AUC and confidence interval of the five models. Finally, we used SHapley Additive exPlanations (SHAP) to explain these models. Multivariate logistic regression analysis showed that there were 8 independent risk factors, including age, blood transfusion history, albumin (ALB), globulin (GLO), total bilirubin (TBIL), indirect bilirubin (IBIL), hemoglobin (HB), and blood loss > 200ml. We finally selected five independent risk factors including HB, GLO, age, IBIL, and blood loss > 200ml. Based on these five independent risk factors, we generated six characteristic variables, namely HB, HB × HB, HB × blood loss, GLO × HB, age, age × IBIL, and established five machine learning models using a tenfold cross-validation method. In the training group, the AUC values of logistic, RF, MLP, SVM, and XGB were 0.9320, 0.8911, 0.9327, 0.9225, and 0.8825, respectively, and the average AUC was 0.9122 ± 0.0212. The MCC values were 0.65, 0.77, 0.65, 0.66, and 0.68, respectively, and the calibration plot and DCA performed well. In the testing group the AUC values of logistic, RF, MLP, SVM, and XGB were 0.8483, 0.7978, 0.8576, 0.8598, and 0.8216, respectively. The average AUC was 0.8370 ± 0.0238, and the MCC values were 0.41, 0.35, 0.40, 0.41, and 0.41, respectively. The calibration plot and DCA in the testing group also showed good performance. The AUC values and confidence intervals of the 1000-iteration model were: logistic (AUC, min confidence interval [CI]-max confidence interval [CI] 0.848, 0.804-0.903), RF (AUC, minCI-maxCI 0.797, 0.734-0.857), MLP (AUC, minCI-maxCI 0.858, 0.812-0.902), SVM (AUC, minCI-maxCI 0.859, 0.819-0.910), and XGB (AUC, minCI-maxCI 0.821, 0.764-0.894). The model performed well. Finally, according to SHAP, among all five models, HB played the most important role in model prediction and interpretation. The five models we developed all performed well in predicting the likelihood of blood transfusion after hip fracture surgery. Therefore, we believed that the prediction model based on machine learning had great application prospects in clinical practice, which could help clinicians better predict the risk of blood transfusion after hip fracture surgery.

The advent of modern genotyping technologies has revolutionized genomic selection in animal breeding. Large marker datasets have shown several drawbacks for traditional genomic prediction methods in terms of flexibility, accuracy, and computational power. Recently, the application of machine learning models in animal breeding has gained a lot of interest due to their tremendous flexibility and their ability to capture patterns in large noisy datasets. Here, we present a general overview of a handful of machine learning algorithms and their application in genomic prediction to provide a meta-picture of their performance in genomic estimated breeding values estimation, genotype imputation, and feature selection. Finally, we discuss a potential adoption of machine learning models in genomic prediction in developing countries. The results of the reviewed studies showed that machine learning models have indeed performed well in fitting large noisy data sets and modeling minor nonadditive effects in some of the studies. However, sometimes conventional methods outperformed machine learning models, which confirms that there's no universal method for genomic prediction. In summary, machine learning models have great potential for extracting patterns from single nucleotide polymorphism datasets. Nonetheless, the level of their adoption in animal breeding is still low due to data limitations, complex genetic interactions, a lack of standardization and reproducibility, and the lack of interpretability of machine learning models when trained with biological data. Consequently, there is no remarkable outperformance of machine learning methods compared to traditional methods in genomic prediction. Therefore, more research should be conducted to discover new insights that could enhance livestock breeding programs.

Machine learning models for predicting hospital admission in pediatric emergency departments: A systematic review.

Enhancing wastewater treatment efficiency through machine learning-driven effluent quality prediction: A plant-level analysis

Laser-based metal additive manufacturing (MAM), particularly laser powder bed fusion (LPBF) and laser directed energy deposition (L-DED), is a transformative technology enabling the production of complex, high-performance metal components with precision and minimal waste. However, its wider adoption is hindered by challenges in ensuring repeatability and consistency due to the complex, dynamic nature of the process. Closed-loop systems with in-situ monitoring and control have gained attention for quality assurance, where machine learning (ML) models are crucial for correlating sensor data with process state diagnosis and facilitating control actions. This review adopts an ML perspective to elucidate the role of ML in closed-loop control systems. It first outlines sensor data types and preprocessing methods used as ML datasets, then discusses roles and applications of ML models for in-situ monitoring, highlighting limitations and potential solutions. An ML-based closed-loop control framework is also presented, with emphasis on the integration of ML in the control component. Finally, future development directions of advanced ML approaches are envisioned. This review provides new insights into enhancing the role of ML models in laser-based MAM closed-loop control systems, serving as a crucial aid in the development of intelligent control systems.