A Multi-Agent Framework for Personalized Credit Recommendations Using Interpretable Machine Learning and Large Language Models

ObjectivePostoperative complications remain a major concern in laryngeal cancer surgery, often requiring invasive interventions or intensive care. This study aimed to develop and validate an interpretable machine learning (ML) model to preoperatively predict Clavien-Dindo Grade ≥ III complications and support risk-informed perioperative decision-making.MethodsWe conducted a retrospective study using a temporally split cohort of laryngeal cancer patients. Postoperative complications were graded using the Clavien-Dindo (CD) classification. Eight ML algorithms were trained and evaluated using receiver operating characteristic (ROC) curves, calibration plots, and decision curve analysis (DCA). Model interpretability was assessed using SHapley Additive exPlanations (SHAP). A web-based calculator was deployed for clinical use.ResultThe random forest (RF) model achieved the best performance, with an area under the curve (AUC) of 0.935 in the training set and 0.842 in the test set. The model demonstrated robust sensitivity and specificity for both surgical and medical complications. Calibration curves indicated strong agreement between predicted and actual outcomes. SHAP analysis identified eight key predictors—such as vocal cord mobility, tumor subsite, and nutritional status—that contributed most to risk estimation. A user-friendly web calculator was developed and is accessible at: https://qilushiny.shinyapps.io/qilupredicate/.ConclusionWe developed a clinically interpretable ML model that accurately predicts major postoperative complications in patients undergoing laryngeal cancer surgery. This tool provides individualized risk assessments that can guide surgical planning, optimize perioperative strategies, and enhance shared decision-making. Prospective multicenter validation is needed to confirm its utility in routine practice.Supplementary InformationThe online version contains supplementary material available at 10.1186/s12893-025-03213-z.

Pediatric adrenocortical tumors (pACTs) are rare and clinically heterogeneous. Existing risk stratification systems rely on fixed thresholds and linear assumptions, which may limit their prognostic accuracy-particularly for nonmetastatic, locally advanced cases. We aimed to develop an interpretable machine learning (ML) model for individualized survival prediction using only routine clinical features. We retrospectively analyzed 97 patients with pACT from the German Pediatric Oncology Hematology-Malignant Endocrine Tumors Registry (1997-2024). An Extreme Gradient Boosting Cox proportional hazards model was trained using 4 features-tumor volume, distant metastases, pathologic T stage, and resection status-identified via systematic feature evaluation across 11 737 model combinations. Performance was assessed using a stratified 80/20 train-test split, 500 bootstrap iterations, and Harrell's concordance index (C-index). SHapley Additive exPlanations (SHAP) were used for interpretability. The model achieved strong prognostic performance (test-set C-index: 0.925; bootstrap mean: 0.891, 95% confidence interval: 0.817-0.946). SHAP analysis confirmed the dominant influence of metastatic status, followed by tumor volume, T stage, and resection status. The model uncovered nonlinear and additive effects, including a SHAP- and bootstrap-guided tumor volume cut-off (190 mL, 95% confidence interval 127-910 mL) that only slightly differed from conventional thresholds. Stratification remained robust in subgroups, including nonmetastatic patients with advanced local disease. This interpretable ML model enables individualized survival prediction in pACT using only routine clinical data. It offers a clinically accessible and clinically meaningful complement to existing scoring systems, particularly in patients with ambiguous risk profiles who may benefit from more personalized management.

ObjectiveDistant organ metastasis remains the primary factor affecting long-term survival following radical surgery for colorectal cancer (CRC). This study aimed to develop and validate an interpretable machine learning (ML) model to predict the 5-year cumulative risk of distant metastasis after radical CRC surgery.MethodsA retrospective observational cohort study was conducted using clinical and follow-up data from 341 CRC patients who underwent radical surgery. The cohort was randomly divided into a training set n=239 and a validation set n=102 at a 7:3 ratio. Feature selection was performed using least absolute shrinkage and selection operator (LASSO) regression, identifying variables associated with the 5-year cumulative occurrence of metastasis. Prediction models were constructed using seven algorithms. Model performance was evaluated through multiple metrics: area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, F1 score, calibration plots, and decision curve analysis. The SHapley Additive exPlanations (SHAP) method was applied to improve model interpretability.ResultsLASSO combined with tenfold cross-validation selected 11 key features for model development. Among the models tested, the SVM model demonstrated superior performance, achieving a Brier score of 0.144 and an AUC of 0.865 in the validation set. Calibration and clinical decision curves confirmed the SVM model’s strong calibration and clinical applicability. The SHAP dependence plots and force analysis provided explanations at both feature and individual patient levels for the model’s 5-year risk predictions.ConclusionThis study established a high-accuracy and interpretable ML model capable of effectively predicting the 5-year cumulative risk of distant organ metastasis after radical colorectal cancer surgery, while further external validation is necessary to confirm its clinical utility.

Optimisation and interpretation of machine and deep learning models for improved water quality management in Lake Loktak

Interpretable vs. noninterpretable machine learning models for data-driven hydro-climatological process modeling

To develop an interpretable machine learning (ML) model for predicting surgical outcomes in renal hilar tumors and propose a hilar-specific anatomical nephrometry scoring system. A total of 414 patients with renal hilar tumors who underwent robot-assisted partial nephrectomy (RAPN) were included in this study, comprising 304 patients from the First Affiliated Hospital of Nanchang University and 110 patients from the Second Affiliated Hospital of Nanchang University, which served as the external validation cohort. To identify predictors of trifecta achievement, we used least absolute shrinkage and selection operator regression and the Boruta algorithm, followed by multivariate logistic regression to identify independent factors. Five ML models were developed and evaluated using receiver operating characteristic curves, calibration plots, decision curve analysis, and precision-recall curves. The generalizability of the model was further validated in external cohort. Finally, we used SHapley Additive exPlanations (SHAP) to interpret the contribution of each predictor and enhance the model's explainability. Furthermore, based on anatomical features identified through logistic regression, we developed a modified nephrometry scoring system and compared its risk stratification performance with the traditional R.E.N.A.L. (i.e., Radius, Exophytic or endophytic, Nearness, Anterior or posterior, and Location) scoring system. Among the 304 patients in the primary cohort, 168 achieved trifecta outcomes. Eight variables were incorporated into the predictive model, with logistic regression model ultimately being selected as the optimal predictive model. It showed robust predictive performance in internal and external validation. SHAP methods identified surgeon, classification of hilar tumor, and radius as the three most significant predictive variables. Compared with the traditional R.E.N.A.L. score, the modified R.E.N.A.L. score demonstrated superior stratification ability for operation time, change in serum creatinine, change in estimated glomerular filtration rate, and trifecta achievement. The interpretable ML model accurately predicts trifecta in RAPN for hilar tumors. The modified R.E.N.A.L. score provides refined anatomical stratification and facilitates individualized surgical planning.

ObjectiveThis study aimed to develop and validate interpretable machine learning (ML) models based on multi-dimensional fusion data for predicting positive surgical margins (PSM) in robot-assisted radical prostatectomy (RARP).MethodsPatients who underwent RARP at our institution between January 2016 and July 2025 were enrolled. Demographic, clinical, biopsy pathology data, and MRI-derived anatomical features (measured using ITK-SNAP on axial, sagittal, and coronal planes) were collected. Feature selection was performed using intraobserver and interobserver correlation coefficients (ICCs), low-variance filtering, univariable logistic regression, Spearman’s correlation analysis, the least absolute shrinkage and selection operator (LASSO) algorithm, and the Boruta algorithm. Six ML models were constructed, with performance evaluated using area under the curve (AUC), calibration curves, and decision curve analyses (DCA) to identify the optimal model. Five-fold and ten-fold cross-validation were used to assess the optimal model’s generalizability, and its interpretability was evaluated via Shapley Additive exPlanations (SHAP) analysis.ResultsA total of 347 patients were included, comprising a training set (n=193, January 2016–December 2024), validation set (n=84, January 2016–December 2024), and test set (n=70, January 2025–July 2025). From 164 initial features, 7 key features were retained through a four-step screening. The Random Forest (RF) model outperformed other models, achieving AUCs of 0.99 (95% CI: 0.97–1.00) in the training set, 0.88 (95% CI: 0.80–0.95) in the validation set, and 0.97 (95% CI: 0.94–1.00) in the test set. Calibration curve and decision curve analyses confirmed its strong clinical utility. Five-fold cross-validation for the RF model showed fold-specific AUCs of 0.82–0.92, with a mean AUC of 0.87 (95% CI: 0.84–0.90). Ten-fold cross-validation showed fold-specific AUCs of 0.80–0.99, with a mean AUC of 0.88 (95% CI: 0.83–0.93). SHAP analysis revealed five novel spatial anatomical features (such as Sagittal plane-posterior spatial anatomical structure index, Coronal plane-Left anatomical structure interval) were negatively associated with PSM risk, while the number of positive biopsy cores and clinical tumor stage were positively associations.ConclusionsMulti-dimensional fusion data combined with ML models improves PSM prediction accuracy in RARP. The RF model, with excellent performance and interpretability, shows promise for preoperative PSM risk stratification, facilitates optimized clinical decision-making, and supports personalized treatment discussions during preoperative planning, but requires prospective and external validation before clinical implementation.

BACKGROUND Acute kidney injury (AKI) is a common adverse outcome following nephrectomy. The progression from AKI to acute kidney disease (AKD) and subsequently to chronic kidney disease (CKD) remains a concern; yet, the predictive mechanisms for these transitions are not fully understood. Interpretable machine learning (ML) models offer insights into how clinical features influence long-term renal function outcomes after nephrectomy, providing a more precise framework for identifying patients at risk and supporting improved clinical decision-making processes. OBJECTIVE This study aimed to (1) evaluate postnephrectomy rates of AKI, AKD, and CKD, analyzing long-term renal outcomes along different trajectories; (2) interpret AKD and CKD models using Shapley Additive Explanations values and Local Interpretable Model-Agnostic Explanations algorithm; and (3) develop a web-based tool for estimating AKD or CKD risk after nephrectomy. METHODS We conducted a retrospective cohort study involving patients who underwent nephrectomy between July 2012 and June 2019. Patient data were randomly split into training, validation, and test sets, maintaining a ratio of 76.5:8.5:15. Eight ML algorithms were used to construct predictive models for postoperative AKD and CKD. The performance of the best-performing models was assessed using various metrics. We used various Shapley Additive Explanations plots and Local Interpretable Model-Agnostic Explanations bar plots to interpret the model and generated directed acyclic graphs to explore the potential causal relationships between features. Additionally, we developed a web-based prediction tool using the top 10 features for AKD prediction and the top 5 features for CKD prediction. RESULTS The study cohort comprised 1559 patients. Incidence rates for AKI, AKD, and CKD were 21.7% (n=330), 15.3% (n=238), and 10.6% (n=165), respectively. Among the evaluated ML models, the Light Gradient-Boosting Machine (LightGBM) model demonstrated superior performance, with an area under the receiver operating characteristic curve of 0.97 for AKD prediction and 0.96 for CKD prediction. Performance metrics and plots highlighted the model’s competence in discrimination, calibration, and clinical applicability. Operative duration, hemoglobin, blood loss, urine protein, and hematocrit were identified as the top 5 features associated with predicted AKD. Baseline estimated glomerular filtration rate, pathology, trajectories of renal function, age, and total bilirubin were the top 5 features associated with predicted CKD. Additionally, we developed a web application using the LightGBM model to estimate AKD and CKD risks. CONCLUSIONS An interpretable ML model effectively elucidated its decision-making process in identifying patients at risk of AKD and CKD following nephrectomy by enumerating critical features. The web-based calculator, found on the LightGBM model, can assist in formulating more personalized and evidence-based clinical strategies.

Integrated STEM projects and experiments promote interdisciplinary learning, enhance critical thinking, and prepare students for real-world problem-solving by bridging science, technology, engineering, and mathematics. While numerous research studies have explored the STEM education domain, few have focused on supporting educators in identifying and designing effective integrated STEM projects and experiments. This research addresses this gap by introducing a novel system that leverages machine learning (ML) and large language models (LLMs) to assist educators in classifying and creating integrated STEM projects.We created and labeled a dataset of 1,071 project descriptions in this research work, mapped to one or more STEM areas (Science, Technology, Engineering, Mathematics). The dataset was developed using manually curated records, harvesting online sources, and synthetic data generation. Natural Language Processing (NLP) techniques were applied to prepare project descriptions for analysis. Various ML models, including Random Forest, Support Vector Machines (SVM), Logistic Regression, and Naive Bayes, were used for multi-label classification. The Random Forest model achieved the best performance, with a Precision of 91.99%, Recall of 94.59%, F1 Score of 93.27%, and Hamming Loss of 6.74%.The system operates in two phases: In Phase 1, the instructor proposes a project title with a description, and in response, the ML model identifies one or more STEM areas as the most relevant. In Phase 2, ChatGPT, specifically GPT-4o, assists educators by defining experiment objectives, generating ideas, designing procedures, and suggesting tools and resources. This human-in-the-loop system enhances collaboration between educators, ML models, and LLMs, streamlining the design of effective integrated STEM projects.This work's implications extend to improving the accessibility and effectiveness of integrated STEM education by reducing the barriers educators face in designing interdisciplinary projects. It provides a scalable framework for integrating advanced AI techniques into educational practices and fostering classroom innovation.

Repeat transurethral resection (ReTUR) is essential for reducing residual and recurrent non-muscle-invasive bladder cancer (NMIBC). Pathological upstaging after ReTUR significantly influences prognosis. This study aimed to develop an interpretable machine learning model using CT radiomics to predict the risk of pathological upstaging following ReTUR in NMIBC patients. We retrospectively analyzed 104 NMIBC patients who underwent ReTUR at the Second Affiliated Hospital of Nanchang University from March 2019 to July 2022. Data were split 7:3 into training and internal validation sets. An external validation set included 40 patients from two other hospitals. Radiomic features were extracted from preoperative CT scans. Least Absolute Shrinkage and Selection Operator (LASSO) and multivariate logistic regression were used to identify predictors of pathological upstaging. Four machine learning models, including Extreme Gradient Boosting (XGBoost), Gradient Boosting Decision Tree (GBDT), Random Forest (RF), and Linear Discriminant Analysis (LDA), were constructed and evaluated using AUC, accuracy, precision, F1 score, calibration curves, and decision curve analysis (DCA). The best model was interpreted via SHapley Additive exPlanations (SHAP) to identify key predictive features. umor grade (OR = 7.02, 95% CI: 1.17-42.21), tumor size (OR = 5.83, 95% CI: 1.21-28.15), and tumor number (OR = 6.83, 95% CI: 1.18-39.52) were independent risk factors. From 4,738 radiomic features, nine were selected. The XGBoost model outperformed others, with an AUC of 0.804 (95% CI: 0.756-0.862), accuracy of 77.4%, precision of 82.7%, and F1 score of 0.701 in internal validation. External validation confirmed its robustness. SHAP analysis highlighted Wavelet_LLH_firstorder_Maximum.1, Gradient_ngtdm_Complexity, and tumor grade as top predictors. The model showed good calibration and clinical utility on DCA. An interpretable CT radiomics-based machine learning model integrating clinical and imaging features was developed to accurately predict pathological upstaging risk after ReTUR in NMIBC patients. This tool may support clinical decision-making for individualized treatment after multicenter validation.

Ovarian cancer (OC) is a deadly disease that affects a large number of women worldwide. Machine Learning (ML) models can help in the early detection of this disease, however, the use of these models may be limited by their lack of interpretability and the difficulty to evaluate their performance. In this work, five types of datasets were used, employing clinical features, different types of coding genomic features, and combining both. The use of interpretable ML (IML) models (one linear and one nonlinear model) provided us with better interpretability of the five feature sets. Following this study, nine binary classification models were compared, and the Accuracy, Recall, and Area Under the Curve were analyzed. The results showed that ML models employed the combination of clinical features and genomes with the coding of the position of genes in patients significantly improves the prediction. We demonstrated that the inclusion of different preprocessed patient data and especially through the information provided by IML models, can help clinicians to understand the disease better and make informed treatment decisions.

Chronic pain around the temporomandibular joint (TMJ) and masticatory muscles is a primary symptom of temporomandibular disorders (TMD). However, the clinical significance of magnetic resonance imaging (MRI) features in predicting TMD-related pain remains unclear. This study aimed to develop and interpret machine learning (ML) models based on MRI characteristics for predicting pain severity in patients with TMD. The present retrospective study included 584 patients with TMD between January 2022 and December 2024, yielding a total of 755 TMJ MRI data sets. Pain severity was classified using the visual analogue scale (VAS). Demographic variables (age, sex) and MRI features-including lesion side, disc position, disc morphology, disc signal, disc perforation, bilaminar zone tear, joint space, joint effusion, condylar movement, bony changes and morphology/signal of the lateral pterygoid muscle-were collected. Eleven ML models based on demographic and MRI features were developed: logistic regression (LR), support vector machine (SVM), random forest (RF), extreme gradient boosting (XGBoost), light gradient boosting machine (LightGBM), adaptive boosting (AdaBoost), gradient boosting classifier (GBC), bagging classifier (BC), extremely randomised trees (ETC), decision tree classifier (DTC) and multilayer perceptron (MLP). Model performance was evaluated using multiple metrics, including the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity and F1 score. Precision-recall (PR) curves and calibration curves were plotted to assess discrimination and model calibration. Decision curve analysis (DCA) was conducted to evaluate the clinical net benefit across a range of threshold probabilities. Model interpretability was enhanced using Shapley Additive Explanations (SHAP), which quantified the contribution of each feature to individual predictions. Feature selection was conducted based on mean SHAP values, and separate LightGBM models were constructed using the Top 3, 5, and 9 most important features, as well as the full-feature set, for performance comparison. The data set was randomly divided into a training set (n = 604) and a test set (n = 151). Among the 11 ML models, the LightGBM model demonstrated the best predictive performance, with an AUC of 0.899, and was therefore identified as the optimal model. SHAP analysis identified age, disc position and condylar movement as the top three contributing features. Feature selection analysis indicated that selecting the top nine SHAP-ranked variables led to the highest diagnostic performance, with an AUC of 0.829. This study developed an interpretable, high-performing MRI-based ML model incorporating SHAP analysis to integrate imaging and clinical features for objective pain assessment, which may help identify high-risk TMD patients and guide personalised treatment strategies.

Background Predicting the prognosis of patients with acute myocardial infarction (AMI) combined with diabetes mellitus (DM) is crucial due to high in-hospital mortality rates. This study aims to develop and validate a mortality risk prediction model for these patients by interpretable machine learning (ML) methods. Methods Data were sourced from the Medical Information Mart for Intensive Care IV (MIMIC-IV, version 2.2). Predictors were selected by Least absolute shrinkage and selection operator (LASSO) regression and checked for multicollinearity with Spearman’s correlation. Patients were randomly assigned to training and validation sets in an 8:2 ratio. Seven ML algorithms were used to construct models in the training set. Model performance was evaluated in the validation set using metrics such as area under the curve (AUC) with 95% confidence interval (CI), calibration curves, precision, recall, F1 score, accuracy, negative predictive value (NPV), and positive predictive value (PPV). The significance of differences in predictive performance among models was assessed utilising the permutation test, and 10-fold cross-validation further validated the model’s performance. SHapley Additive exPlanations (SHAP) and Local Interpretable Model-agnostic Explanations (LIME) were applied to interpret the models. Results The study included 2,828 patients with AMI combined with DM. Nineteen predictors were identified through LASSO regression and Spearman’s correlation. The Random Forest (RF) model was demonstrated the best performance, with an AUC of 0.823 (95% CI: 0.774–0.872), high precision (0.867), accuracy (0.873), and PPV (0.867). The RF model showed significant differences (p < 0.05) compared to the K-Nearest Neighbours and Decision Tree models. Calibration curves indicated that the RF model’s predicted risk aligned well with actual outcomes. 10-fold cross-validation confirmed the superior performance of RF model, with an average AUC of 0.828 (95% CI: 0.800–0.842). Significant Variables in RF model indicated that the top eight significant predictors were urine output, maximum anion gap, maximum urea nitrogen, age, minimum pH, maximum international normalised ratio (INR), mean respiratory rate, and mean systolic blood pressure. Conclusion This study demonstrates the potential of ML methods, particularly the RF model, in predicting in-hospital mortality risk for AMI patients with DM. The SHAP and LIME methods enhance the interpretability of ML models.

Global health is currently facing serious challenges due to the increasing number of chronic disease patients, such as those with heart failure, diabetes, and cancer. This issue arises from the limitations of electronic health record (EHR) systems, which are not yet fully capable of ensuring accurate clinical diagnoses because of potential data input errors and delays in symptom identification by medical personnel. In response to this issue, this paper focuses on the integration of medical tabular data with a classification approach based on classical machine learning (ML) and large language models (LLM) to improve the accuracy of patient diagnosis predictions. This paper aims to develop and compare the performance of various ML models, such as XGBoost, SVM, and logistic regression, as well as LLM models like Gemini, LLaMA, and Qwen in fine-tuning, few-shot, and zero-shot scenarios. The paper results show that the combination of Gemini and the few-shot approach (250 shots) achieved the highest accuracy of up to 99.8% in predicting heart failure risk. The main finding of this study is that the narrative text representation of tabular data processed with LLM significantly enhances contextual understanding and classification accuracy, making this approach highly potent for application in AI-based clinical decision-making.

In recent years, a significant amount of research has focused on analyzing the effectiveness of machine learning (ML) models for malware detection. These approaches have ranged from methods such as decision trees and clustering to more complex approaches like support vector machine (SVM) and deep neural networks. In particular, neural networks have proven to be very effective in detecting complex and advanced malware. This, however, comes with a caveat. Neural networks are notoriously complex. Therefore, the decisions that they make are often just accepted without questioning why the model made that specific decision. The black box characteristic of neural networks has challenged researchers to explore methods to explain black-box models such as SVM and neural networks and their decision-making process. Transparency and explainability give the experts and malware analysts assurance and trustworthiness about the ML models’ decisions. In addition, it helps in generating comprehensive reports that can be used to enhance cyber threat intelligence sharing. As such, this much needed analysis drives our work in this paper to explore the explainability and interpretability of ML models in the field of online malware detection. In this paper, we used the Shapley Additive exPlanations (SHAP) explainability technique to achieve efficient performance in interpreting the outcome of different ML models such as SVM Linear, SVM-RBF (Radial Basis Function), Random Forest (RF), Feed-Forward Neural Net (FFNN), and Convolutional Neural Network (CNN) models trained on an online malware dataset. To explain the output of these models, explainability techniques such as KernalSHAP, TreeSHAP, and DeepSHAP are applied to the obtained results.