Optimized ensemble learning with multi-feature fusion for enhanced anti-inflammatory peptide prediction.

BackgroundSurgical site infection (SSI) is one of the most common types of health care–associated infections. It increases mortality, prolongs hospital length of stay, and raises health care costs. Many institutions developed risk assessment models for SSI to help surgeons preoperatively identify high-risk patients and guide clinical intervention. However, most of these models had low accuracies.ObjectiveWe aimed to provide a solution in the form of an Artificial intelligence–based Multimodal Risk Assessment Model for Surgical site infection (AMRAMS) for inpatients undergoing operations, using routinely collected clinical data. We internally and externally validated the discriminations of the models, which combined various machine learning and natural language processing techniques, and compared them with the National Nosocomial Infections Surveillance (NNIS) risk index.MethodsWe retrieved inpatient records between January 1, 2014, and June 30, 2019, from the electronic medical record (EMR) system of Rui Jin Hospital, Luwan Branch, Shanghai, China. We used data from before July 1, 2018, as the development set for internal validation and the remaining data as the test set for external validation. We included patient demographics, preoperative lab results, and free-text preoperative notes as our features. We used word-embedding techniques to encode text information, and we trained the LASSO (least absolute shrinkage and selection operator) model, random forest model, gradient boosting decision tree (GBDT) model, convolutional neural network (CNN) model, and self-attention network model using the combined data. Surgeons manually scored the NNIS risk index values.ResultsFor internal bootstrapping validation, CNN yielded the highest mean area under the receiver operating characteristic curve (AUROC) of 0.889 (95% CI 0.886-0.892), and the paired-sample t test revealed statistically significant advantages as compared with other models (P<.001). The self-attention network yielded the second-highest mean AUROC of 0.882 (95% CI 0.878-0.886), but the AUROC was only numerically higher than the AUROC of the third-best model, GBDT with text embeddings (mean AUROC 0.881, 95% CI 0.878-0.884, P=.47). The AUROCs of LASSO, random forest, and GBDT models using text embeddings were statistically higher than the AUROCs of models not using text embeddings (P<.001). For external validation, the self-attention network yielded the highest AUROC of 0.879. CNN was the second-best model (AUROC 0.878), and GBDT with text embeddings was the third-best model (AUROC 0.872). The NNIS risk index scored by surgeons had an AUROC of 0.651.ConclusionsOur AMRAMS based on EMR data and deep learning methods—CNN and self-attention network—had significant advantages in terms of accuracy compared with other conventional machine learning methods and the NNIS risk index. Moreover, the semantic embeddings of preoperative notes improved the model performance further. Our models could replace the NNIS risk index to provide personalized guidance for the preoperative intervention of SSIs. Through this case, we offered an easy-to-implement solution for building multimodal RAMs for other similar scenarios.

BackgroundPost-stroke depression (PSD) was one of the most prevalent and serious neuropsychiatric effects after stroke. Nevertheless, the association between liver function test indices and PSD remains elusive, and there is a lack of effective prediction tools. The purpose of this study was to explore the relationship between the liver function test indices and PSD, and construct a prediction model for PSD.MethodsAll patients were selected from seven medical institutions of Chongqing Medical University from 2015 to 2021. Variables including demographic characteristics and liver function test indices were collected from the hospital electronic medical record system. Univariate analysis, least absolute shrinkage and selection operator (LASSO) and logistic regression analysis were used to screen the predictors. Subsequently, logistic regression, random forest (RF), extreme gradient boosting (XGBoost), gradient boosting decision tree (GBDT), categorical boosting (CatBoost) and support vector machine (SVM) were adopted to build the prediction model. Furthermore, a series of evaluation indicators such as area under curve (AUC), sensitivity, specificity, F1 were used to assess the performance of the prediction model.ResultsA total of 464 PSD and 1621 stroke patients met the inclusion criteria. Six liver function test items, namely AST, ALT, TBA, TBil, TP, ALB/GLB, were closely associated with PSD, and included for the construction of the prediction model. In the test set, logistic regression model owns the AUC of 0.697. Compared with the other four machine learning models, the GBDT model has the best predictive performance (F1 = 0.498, AUC = 0.761) and was chosen to establish the prediction tool.ConclusionsThe prediction model constructed using these six predictors with GBDT algorithm displayed a promising prediction ability, which could be used for the participating hospital units or individuals by mobile phone or computer.

Accurate prediction of in-hospital mortality for patients with severe community-acquired pneumonia (SCAP) complicated by respiratory failure admitted to the intensive care unit (ICU) remains a critical challenge. This study aimed to develop and validate a machine learning (ML) model to predict this risk and compare its performance with conventional scoring systems. In this retrospective study, data from 164 patients with SCAP and respiratory failure admitted to the ICU between January 2017 and January 2024 were analyzed. Patients were randomly divided into a training set (n = 114) and a validation (test) set (n = 50). Forty-five clinical features collected at admission were used as candidate predictors. The Least Absolute Shrinkage and Selection Operator (LASSO) regression was employed for feature selection. Six ML models, including Gradient Boosting Decision Tree (GBDT), Random Forest (RF), eXtreme Gradient Boosting (XGBoost), Decision Tree(DT),Support Vector Machine (SVM), and Logistic Regression(LR), were constructed and evaluated.Use SHAP analysis to assess the contribution of each feature in a machine learning model. Construct a nomogram using the top six most influential features. The GBDT model demonstrated the best predictive performance, achieving an area under the receiver operating characteristic curve (AUC) of 0.83 (95% CI: 0.757-0.927) in the internal validation set, significantly outperforming the Acute Physiology and Chronic Health Evaluation II (APACHE-II, AUC = 0.70). Calibration curves demonstrated good agreement between predicted and observed mortality risks, particularly across the mid-probability range. Decision curve analysis indicated that the model provided a higher net benefit than "treat-all" and "treat-none" strategies across a broad range of threshold probabilities. SHapley Additive exPlanations (SHAP) analysis identified lactate, D-dimer, temperature, albumin, Prothrombin Time and Fraction of Inspired Oxygen as the six most influential predictors of in-hospital mortality. Based on these key predictors, we further developed a simplified nomogram to facilitate bedside risk estimation. The GBDT ML model, developed from routinely available clinical data, provides a highly accurate and clinically interpretable tool for predicting in-hospital mortality in SCAP patients with respiratory failure. It outperforms traditional severity scores and holds promise for assisting clinicians in risk stratification and early intervention.

Anti-tuberculosis drug-induced liver injury (ATLI) is the most harmful to anti-tuberculosis (TB) treatment. This study aims to construct and validate a binary ATLI risk prediction model based on clinical data through seven machine learning algorithms (logistic regression, decision tree, support vector machine, random forest, gradient boosting decision tree, extreme gradient boosting, and light gradient boosting machine [LightGBM]). A retrospective cohort of 2356 TB patients followed between January 2017 and December 2024 was used to develop and evaluate the prediction model. Random undersampling was performed to address class imbalance problem. Least absolute shrinkage and selection operator (LASSO) regression was used to select features and retained 27 of 31 original features. Seven ML algorithms were trained and the LightGBM model demonstrated optimal performance in testing set based on the area under the receiver operating characteristic curve (AUC), sensitivity, and specificity (AUC = 0.789, sensitivity = 0.734, and specificity = 0.706). The model exhibited optimal simplicity and stability when incorporating the 8-feature combination comprising baseline high-density lipoprotein cholesterol (HDLC), γ-glutamyl transpeptidase (GGT), triglycerides, total cholesterol (TCHOL), uric acid, total bilirubin (TBIL), globulin (GLB), and liver disease history (AUC = 0.764, sensitivity = 0.758, and specificity = 0.610), and Shapely additive explanations analysis also revealed that these variables were the most influential contributors. The optimal model maintained robust predictive ability in the external validation cohort (AUC = 0.721, sensitivity = 0.828, and specificity = 0.604). This study determined that the combination of baseline HDLC, GGT, triglycerides, total cholesterol (TCHOL), uric acid, TBIL, GLB, and liver disease history was an important predictor of ATLI through LightGBM model, which could help clinicians in the early identification of ATLI.

Repeat transurethral resection (ReTUR) is essential for reducing residual and recurrent non-muscle-invasive bladder cancer (NMIBC). Pathological upstaging after ReTUR significantly influences prognosis. This study aimed to develop an interpretable machine learning model using CT radiomics to predict the risk of pathological upstaging following ReTUR in NMIBC patients. We retrospectively analyzed 104 NMIBC patients who underwent ReTUR at the Second Affiliated Hospital of Nanchang University from March 2019 to July 2022. Data were split 7:3 into training and internal validation sets. An external validation set included 40 patients from two other hospitals. Radiomic features were extracted from preoperative CT scans. Least Absolute Shrinkage and Selection Operator (LASSO) and multivariate logistic regression were used to identify predictors of pathological upstaging. Four machine learning models, including Extreme Gradient Boosting (XGBoost), Gradient Boosting Decision Tree (GBDT), Random Forest (RF), and Linear Discriminant Analysis (LDA), were constructed and evaluated using AUC, accuracy, precision, F1 score, calibration curves, and decision curve analysis (DCA). The best model was interpreted via SHapley Additive exPlanations (SHAP) to identify key predictive features. umor grade (OR = 7.02, 95% CI: 1.17-42.21), tumor size (OR = 5.83, 95% CI: 1.21-28.15), and tumor number (OR = 6.83, 95% CI: 1.18-39.52) were independent risk factors. From 4,738 radiomic features, nine were selected. The XGBoost model outperformed others, with an AUC of 0.804 (95% CI: 0.756-0.862), accuracy of 77.4%, precision of 82.7%, and F1 score of 0.701 in internal validation. External validation confirmed its robustness. SHAP analysis highlighted Wavelet_LLH_firstorder_Maximum.1, Gradient_ngtdm_Complexity, and tumor grade as top predictors. The model showed good calibration and clinical utility on DCA. An interpretable CT radiomics-based machine learning model integrating clinical and imaging features was developed to accurately predict pathological upstaging risk after ReTUR in NMIBC patients. This tool may support clinical decision-making for individualized treatment after multicenter validation.

Undernutrition among children under the age of five is a major public health concern, especially in developing countries. This study aimed to use machine learning (ML) algorithms to predict undernutrition and identify its associated factors. Secondary data analysis of the 2017 Multiple Indicator Cluster Survey (MICS) was performed using R and Python. The main outcomes of interest were undernutrition (stunting: height-for-age (HAZ) < -2 SD; wasting: weight-for-height (WHZ) < -2 SD; and underweight: weight-for-age (WAZ) < -2 SD). Seven ML algorithms were trained and tested: linear discriminant analysis (LDA), logistic model, support vector machine (SVM), random forest (RF), least absolute shrinkage and selection operator (LASSO), ridge regression, and extreme gradient boosting (XGBoost). The ML models were evaluated using the accuracy, confusion matrix, and area under the curve (AUC) receiver operating characteristics (ROC). In total, 8564 children were included in the final analysis. The average age of the children was 926 days, and the majority were females. The weighted prevalence rates of stunting, wasting, and underweight were 17%, 7%, and 12%, respectively. The accuracies of all the ML models for wasting were (LDA: 84%; Logistic: 95%; SVM: 92%; RF: 94%; LASSO: 96%; Ridge: 84%, XGBoost: 98%), stunting (LDA: 86%; Logistic: 86%; SVM: 98%; RF: 88%; LASSO: 86%; Ridge: 86%, XGBoost: 98%), and for underweight were (LDA: 90%; Logistic: 92%; SVM: 98%; RF: 89%; LASSO: 92%; Ridge: 88%, XGBoost: 98%). The AUC values of the wasting models were (LDA: 99%; Logistic: 100%; SVM: 72%; RF: 94%; LASSO: 99%; Ridge: 59%, XGBoost: 100%), for stunting were (LDA: 89%; Logistic: 90%; SVM: 100%; RF: 92%; LASSO: 90%; Ridge: 89%, XGBoost: 100%), and for underweight were (LDA: 95%; Logistic: 96%; SVM: 100%; RF: 94%; LASSO: 96%; Ridge: 82%, XGBoost: 82%). Age, weight, length/height, sex, region of residence and ethnicity were important predictors of wasting, stunting and underweight. The XGBoost model was the best model for predicting wasting, stunting, and underweight. The findings showed that different ML algorithms could be useful for predicting undernutrition and identifying important predictors for targeted interventions among children under five years in Ghana.

The study investigates the predictive efficacy of various machine learningmet-hodologies, encompassing Random Forest (RF) regression, Gradient Boosting (GB), Xtreme Gradient Boosting (XGBoost), Support Vector Regression (SVR), Least Absolute Shrinkage and Selection Operator (LASSO) regression, and a deep learning technique, specifically Long Short-Term Memory (LSTM). The benchmark method employed is the autoregressive (AR) model of order 1. With a focus on forecasting money demand for the Indian economy, a crucial component for achieving the Cent­ral Bank of India's inflation targeting objective, a comprehensive monthly dataset from 1997 to 2021 is utilized.The obtained results underline the robust predictive capabilities of the employed models concerning both narrow and broad money demand forecasts. By em­ploying a range of evaluation metrics, the study rigorously compares the predictive performance of these models. Using the expanding window cross validation with time series split, the models are cross-validated to ensure accurate forecastsof monetary aggregates. Moreover, the Diebold – Mariano test is utilized to evaluate and compare the quality of forecasts.In particular, the research finds the superiority of LSTM and LASSO in predictive capabilities for narrow and broad money demand, respectively. These findings collectively contribute to enhancing the understanding of money demand prediction, thus facilitating informed decision-making within the realm of monetary policy.

ObjectivesNearly 20% of pregnancies in patients with SLE result in an adverse pregnancy outcome (APO). We previously developed an APO prediction model using logistic regression and data from Predictors of...

The deep convolutional neural network has been extensively applied for clinical computer-aided diagnosis. In this study, we combine deep learning feature extraction and eXtreme gradient boosting (XGBoost) classifier for predicting the risk of esophageal varices (EV). First, the quantitative deep learning features and radiomics features of the regions of interest which includes spleen, liver and esophageal are extracted and concatenated. Then, XGBoost and the Least Absolute Shrinkage and Selection Operator (LASSO) are applied for the optimal predictive features selection and prediction of EV risk. XGBoost is used to assess the significance of the extracted features and LASSO is used to select the distinctive features. Finally, random forest, XGBoost and support vector machine classification methods are applied for predicting the low-risk and high-risk of esophageal varices. We collected computed tomography images of cirrhotic patients in two hospitals as the independent training and validation sets. Experimental results show that the features of esophageal are more distinctive than that of other organs. Moreover, the combination of deep learning and radiomics features based on XGBoost algorithm has outperforming classification performance in predicting the severity of EV disease compared to existing approaches.KeywordsEsophageal varicesDeep learningRadiomicsXGBoost

Glass forming ability prediction of bulk metallic glasses based on fused strategy

Septic shock is a severe complication of acute pancreatitis (AP), often associated with poor prognosis. This study aims to analyze the clinical characteristics of patients with acute pancreatitis and develop an interpretable early prediction model for septic shock in these patients using machine learning (ML). The model is intended to assist emergency physicians in resource allocation and medical decision making. Data were collected from the MIMIC-IV 3.0 database. The dataset was divided into a training set and a test set in a 7:3 ratio. Feature selection was performed using LASSO (Least Absolute Shrinkage and Selection Operator) regression. Subsequently, 10 ML models were developed: Random Forest, Logistic Regression, Gradient Boosting Machine, Neural Network, Extreme Gradient Boosting (XGBoost), K-Nearest Neighbor, Adaptive Boosting, Light Gradient Boosting Machine, Category Boosting, and Support Vector Machine. To enhance and optimize model interpretability, Shapley Additive Explanations (SHAP) were employed. A total of 1032 patients with AP were included in this study, from which 31 variables were selected for model development. By comparing the area under the receiver operating characteristic curve and decision curve analysis results between the training and test sets, the XGBoost model demonstrated a significant advantage over other models. SHAP analysis revealed that white blood cell count, total bilirubin (bilirubin total), and bicarbonate (HCO3 -) levels were the three most critical risk factors for the development of septic shock in patients with AP. ML approaches exhibited promising performance in predicting septic shock in patients with AP. These models may aid in guiding treatment decisions for patients with AP in the emergency department.

Mild cognitive impairment (MCI) is a clinical condition characterized by a decline in cognitive ability and progression of cognitive impairment. It is often considered a transitional stage between normal aging and Alzheimer's disease (AD). This study aimed to compare deep learning (DL) and traditional machine learning (ML) methods in predicting MCI using plasma proteomic biomarkers. A total of 239 adults were selected from the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort along with a pool of 146 plasma proteomic biomarkers. We evaluated seven traditional ML models (support vector machines (SVMs), logistic regression (LR), naïve Bayes (NB), random forest (RF), k-nearest neighbor (KNN), gradient boosting machine (GBM), and extreme gradient boosting (XGBoost)) and six variations of a deep neural network (DNN) model-the DL model in the H2O package. Least Absolute Shrinkage and Selection Operator (LASSO) selected 35 proteomic biomarkers from the pool. Based on grid search, the DNN model with an activation function of "Rectifier With Dropout" with 2 layers and 32 of 35 selected proteomic biomarkers revealed the best model with the highest accuracy of 0.995 and an F1 Score of 0.996, while among seven traditional ML methods, XGBoost was the best with an accuracy of 0.986 and an F1 Score of 0.985. Several biomarkers were correlated with the APOE-ε4 genotype, polygenic hazard score (PHS), and three clinical cerebrospinal fluid biomarkers (Aβ42, tTau, and pTau). Bioinformatics analysis using Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) revealed several molecular functions and pathways associated with the selected biomarkers, including cytokine-cytokine receptor interaction, cholesterol metabolism, and regulation of lipid localization. The results showed that the DL model may represent a promising tool in the prediction of MCI. These plasma proteomic biomarkers may help with early diagnosis, prognostic risk stratification, and early treatment interventions for individuals at risk for MCI.

Ensuring fluent extracorporeal circulation and preventing circuit clotting are important for end-stage kidney disease (ESKD) patients undergoing continuous renal replacement therapy (CRRT). This study aimed to develop a predictive model using machine learning (ML) algorithms to evaluate clotting risk after initiating CRRT, enhancing treatment safety and effectiveness. This study involved 636 ESKD patients who underwent CRRT. Feature selection was conducted via the least absolute shrinkage and selection operator (LASSO) algorithm. ML algorithms, including support vector machine (SVM), extreme gradient boosting (XGBoost), random forest (RF), gradient boosting machine (GBM), decision tree, and logistic regression (LR), were applied to construct models through tenfold cross-validation. Model performance was assessed via the area under the receiver operating characteristic curve (AUC) and additional metrics. The Shapley additive explanation (SHAP) values quantify each feature’s contribution. This study included 199 patients with blood clots during extracorporeal circulation, corresponding to an incidence rate of 31.3%. The AUC values were 0.864 (SVM), 0.815 (XGBoost), 0.806 (GBM), 0.778 (RF), 0.732 (Decision Tree), and 0.717 (LR). The SVM exhibited the best performance. The initial dose of low-molecular-weight heparin (LMWH) was identified as the most significant factor influencing coagulation. ML serves as a reliable tool for predicting the risk of extracorporeal circuit clotting in ESKD patients undergoing CRRT. The SHAP method elucidates key risk factors, providing a basis for early clinical intervention.

Adverse drug events (ADEs) are a major threat to inpatients in the United States of America (USA). It is unknown how well machine learning (ML) is able to predict whether or not a patient will suffer from an ADE during hospital stay based on data available at hospital admission for emergency department patients of all ages (binary classification task). It is further unknownwhether ML is able to outperform logistic regression (LR) in doing so, and which variables are the most important predictors. In this study, 5 ML models- namely a random forest, gradient boosting machine (GBM), ridge regression, least absolute shrinkage and selection operator (LASSO) regression, and elastic net regression-as well asa LR were trained and tested for the prediction of inpatient ADEs identified using ICD-10-CM codes based on comprehensive previous work in a diverse population. In total, 210 181 observations from patients who were admitted to a large tertiary care hospital after emergency department stay between 2011 and 2019 were included. The area under the receiver operating characteristics curve (AUC) and AUC-precision-recall (AUC-PR) were used as primary performance indicators. Tree-based models performed best with respect to AUC and AUC-PR. The gradient boosting machine (GBM) reached an AUC of 0.747 (95% confidence interval (CI): 0.735 to 0.759) and an AUC-PR of 0.134 (95% CI: 0.131 to 0.137) on unforeseen test data, while the random forest reached an AUC of 0.743 (95% CI: 0.731 to 0.755) and an AUC-PR of 0.139 (95% CI: 0.135 to 0.142), respectively. ML statistically significantly outperformed LR both on AUC and AUC-PR. Nonetheless, overall, models did not differ much with respect to their performance. Most important predictors were admission type, temperature and chief complaint for the best performing model (GBM). The study demonstrated a first application of ML to predict inpatient ADEs based on ICD-10-CM codes, and a comparison with LR. Future research should address concerns arising from low precision and related problems.

Winter wheat (Triticum aestivum L.) is one of the most important cereal crops, supplying essential food for the world population. Because the United States is a major producer and exporter of wheat to the world market, accurate and timely forecasting of wheat yield in the United States (U.S.) is fundamental to national crop management as well as global food security. Previous studies mainly have focused on developing empirical models using only satellite remote sensing images, while other yield determinants have not yet been adequately explored. In addition, these models are based on traditional statistical regression algorithms, while more advanced machine learning approaches have not been explored. This study used advanced machine learning algorithms to establish within-season yield prediction models for winter wheat using multi-source data to address these issues. Specifically, yield driving factors were extracted from four different data sources, including satellite images, climate data, soil maps, and historical yield records. Subsequently, two linear regression methods, including ordinary least square (OLS) and least absolute shrinkage and selection operator (LASSO), and four well-known machine learning methods, including support vector machine (SVM), random forest (RF), Adaptive Boosting (AdaBoost), and deep neural network (DNN), were applied and compared for estimating the county-level winter wheat yield in the Conterminous United States (CONUS) within the growing season. Our models were trained on data from 2008 to 2016 and evaluated on data from 2017 and 2018, with the results demonstrating that the machine learning approaches performed better than the linear regression models, with the best performance being achieved using the AdaBoost model (R2 = 0.86, RMSE = 0.51 t/ha, MAE = 0.39 t/ha). Additionally, the results showed that combining data from multiple sources outperformed single source satellite data, with the highest accuracy being obtained when the four data sources were all considered in the model development. Finally, the prediction accuracy was also evaluated against timeliness within the growing season, with reliable predictions (R2 &gt; 0.84) being able to be achieved 2.5 months before the harvest when the multi-source data were combined.