Robust and Efficient Classification for Underground Metal Target Using Dimensionality Reduction and Machine Learning

Chronic hepatitis B (CHB) infection represents a significant global public health issue, often leading to hepatitis B virus (HBV)-related liver cirrhosis (HBV-LC) with poor prognoses. Early identification of HBV-LC risk is essential for timely intervention. This study develops and compares nine machine learning (ML) models to predict HBV-LC risk in CHB patients using routine clinical and laboratory data. A retrospective analysis was conducted involving 777 CHB patients, with 50.45% (392/777) progressing to HBV-LC. Admission data consisted of 52 clinical and laboratory variables, with missing values addressed using multiple imputation. Feature selection utilized Least Absolute Shrinkage and Selection Operator (LASSO) regression and the Boruta algorithm, identifying 24 key variables. The evaluated ML models included XGBoost, logistic regression (LR), LightGBM, random forest (RF), AdaBoost, Gaussian naive Bayes (GNB), multilayer perceptron (MLP), support vector machine (SVM), and k-nearest neighbors (KNN). The data set was partitioned into an 80% training set (n = 621) and a 20% independent testing set (n = 156). Cross-validation (CV) facilitated hyperparameter tuning and internal validation of the optimal model. Performance metrics included the area under the receiver operating characteristic curve (AUC), Brier score, accuracy, sensitivity, specificity, and F1 score. The RF model demonstrated superior performance, with AUCs of 0.992 (training) and 0.907 (validation), while the reconstructed model achieved AUCs of 0.944 (training) and 0.945 (validation), maintaining an AUC of 0.863 in the testing set. Calibration curves confirmed a strong alignment between observed and predicted probabilities. Decision curve analysis indicated that the RF model provided the highest net benefit across threshold probabilities. The SHAP algorithm identified RPR, PLT, HBV DNA, ALT, and TBA as critical predictors. This interpretable ML model enhances early HBV-LC prediction and supports clinical decision-making in resource-limited settings.

Undernutrition among children under the age of five is a major public health concern, especially in developing countries. This study aimed to use machine learning (ML) algorithms to predict undernutrition and identify its associated factors. Secondary data analysis of the 2017 Multiple Indicator Cluster Survey (MICS) was performed using R and Python. The main outcomes of interest were undernutrition (stunting: height-for-age (HAZ) < -2 SD; wasting: weight-for-height (WHZ) < -2 SD; and underweight: weight-for-age (WAZ) < -2 SD). Seven ML algorithms were trained and tested: linear discriminant analysis (LDA), logistic model, support vector machine (SVM), random forest (RF), least absolute shrinkage and selection operator (LASSO), ridge regression, and extreme gradient boosting (XGBoost). The ML models were evaluated using the accuracy, confusion matrix, and area under the curve (AUC) receiver operating characteristics (ROC). In total, 8564 children were included in the final analysis. The average age of the children was 926 days, and the majority were females. The weighted prevalence rates of stunting, wasting, and underweight were 17%, 7%, and 12%, respectively. The accuracies of all the ML models for wasting were (LDA: 84%; Logistic: 95%; SVM: 92%; RF: 94%; LASSO: 96%; Ridge: 84%, XGBoost: 98%), stunting (LDA: 86%; Logistic: 86%; SVM: 98%; RF: 88%; LASSO: 86%; Ridge: 86%, XGBoost: 98%), and for underweight were (LDA: 90%; Logistic: 92%; SVM: 98%; RF: 89%; LASSO: 92%; Ridge: 88%, XGBoost: 98%). The AUC values of the wasting models were (LDA: 99%; Logistic: 100%; SVM: 72%; RF: 94%; LASSO: 99%; Ridge: 59%, XGBoost: 100%), for stunting were (LDA: 89%; Logistic: 90%; SVM: 100%; RF: 92%; LASSO: 90%; Ridge: 89%, XGBoost: 100%), and for underweight were (LDA: 95%; Logistic: 96%; SVM: 100%; RF: 94%; LASSO: 96%; Ridge: 82%, XGBoost: 82%). Age, weight, length/height, sex, region of residence and ethnicity were important predictors of wasting, stunting and underweight. The XGBoost model was the best model for predicting wasting, stunting, and underweight. The findings showed that different ML algorithms could be useful for predicting undernutrition and identifying important predictors for targeted interventions among children under five years in Ghana.

Machine learning (ML) models are cost-effective tools that can establish a prognosis by considering clinical, genomic, and histological data from breast cancer patients. In this study, we evaluate the performance of 12 ML models in predicting the overall survival of breast cancer patients from “The Cancer Genome Atlas-Breast Cancer” database at 60 months of follow-up. The models evaluated were Logistic Regression (LR), Ridge Classifier (RC), Least Absolute Shrinkage and Selection Operator (LASSO), K-Nearest Neighbors (KNN), Naive Bayes (NB), Linear Discriminant Analysis (LDA), Decision Tree (DT), Multilayer Perceptron (MP), Stochastic Gradient Descent (SGD), Support Vector Machine (SVM), Random Forest (RF), and XGBoost (XGB). The most accurate models were NB (86.76%) and SGD (85.29%). The models with the highest sensitivity were SGD (93.75%), MP (91.67%), and NB (89.89%), while the models with the highest specificity were KNN (95.0%), DT (90.0%), and LASSO (85.0%). The models with the highest area under the ROC curve were LDA (90.83%), LASSO (90.1%), and LR (89.79%). The most relevant variables were “Previous Diagnosis of Cancer,” “Presence of Tumor,” “Ancillary Therapy,” and “Histology.” Our findings demonstrate that AI tools for predicting patient outcomes are a viable option when expensive prognostic genomic tools are not available. According to our results, NB and LASSO show promising performance in predicting the prognosis of breast cancer patients. Further studies with data from developing countries are needed to improve the performance of these tools.

The study aimed to develop and externally validate multiparametric MRI (mpMRI) radiomics-based interpretable machine learning (ML) model for preoperative differentiating between benign and malignant prostate masses. Patients who underwent mpMRI with suspected malignant prostate masses were retrospectively recruited from two independent hospitals between May 2016 and May 2023. The prostate mass regions in T2-weighted imaging (T2WI) and diffusion-weighted imaging (DWI) MRI images were segmented by ITK-SNAP. PyRadiomics was utilized to extract radiomic features. Inter- and intraobserver correlation analysis, t-test, Spearman correlation analysis, and the least absolute shrinkage and selection operator (LASSO) algorithm with a five-fold cross-validation were applied for feature selection. Five ML learning models were built using the chosen features. Model performance was evaluated with internal and external validation, using area under the curve (AUC), calibration curves, and decision curve analysis to select the optimal model. The interpretability of the most robust model was conducted via SHapley Additive exPlanation (SHAP). A total of 567 patients were enrolled, consisting of the training (n = 352), internal test (n = 152), and external test (n = 63) sets. In total, 2,632 radiomic features were extracted from regions of interest (ROIs) of T2WI and DWI images, which were reduced to 18 via LASSO. Five ML models were established, among which the random forest (RF) model presented the best predictive ability, with AUCs of 0.929 (95% confidential interval [CI]: 0.885-0.963) and 0.852 (95% CI: 0.758-0.934) in the internal and external test sets, respectively. The calibration and decision curve analyses confirmed the excellent clinical usefulness of the RF model. Besides, the contributing relations of the radiomic features were uncovered using SHAP. Radiomic features from mpMRI combined with machine learning facilitate accurate preoperative evaluation of the malignancy in prostate masses. SHAP can disclose the underlying prediction process of the ML model, which may promote its clinical applications.

The accurate preoperative histopathological grade diagnosis of adult gliomas is of great significance for the formulation of a surgical plan and the implementation of a subsequent treatment. The aim of this study is to establish a predictive model for classifying adult gliomas into grades 2-4 based on preoperative conventional multimodal MRI radiomics. Patients with pathologically confirmed gliomas at Huashan Hospital, Fudan University, between February 2017 and July 2019 were retrospectively analyzed. Two regions of interest (ROIs), called the maximum anomaly region (ROI1) and the tumor region (ROI2), were delineated on the patients' preoperative MRIs utilizing the tool ITK-SNAP, and Pyradiomics 3.0 was applied to execute feature extraction. Feature selection was performed utilizing a least absolute shrinkage and selection operator (LASSO) filter. Six classifiers, including Gaussian naive Bayes (GNB), random forest (RF), K-nearest neighbor (KNN), support vector machine (SVM) with a linear kernel, adaptive boosting (AB), and multilayer perceptron (MLP) were used to establish predictive models, and the predictive performance of the six classifiers was evaluated through five-fold cross-validation. The performance of the predictive models was evaluated using the AUC and other metrics. After that, the model with the best predictive performance was tested using the external data from The Cancer Imaging Archive (TCIA). According to the inclusion and exclusion criteria, 240 patients with gliomas were identified for inclusion in the study, including 106 grade 2, 68 grade 3, and 66 grade 4 gliomas. A total of 150 features was selected, and the MLP classifier had the best predictive performance among the six classifiers based on T2-FLAIR (mean AUC of 0.80 ± 0.07). The SVM classifier had the best predictive performance among the six classifiers based on DWI (mean AUC of 0.84 ± 0.05); the SVM classifier had the best predictive performance among the six classifiers based on CE-T1WI (mean AUC of 0.85 ± 0.06). Among the six classifiers, based on ROI1, the MLP classifier had the best prediction performance (mean AUC of 0.78 ± 0.07); among the six classifiers, based on ROI2, the SVM classifier had the best prediction performance (mean AUC of 0.82 ± 0.07). Among the six classifiers, based on the multimodal MRI of all the ROIs, the SVM classifier had the best prediction performance (average AUC of 0.85 ± 0.04). The SVM classifier, based on the multimodal MRI of all the ROIs, achieved an AUC of 0.81 using the external data from TCIA. The prediction model, based on preoperative conventional multimodal MRI radiomics, established in this study can conveniently, accurately, and noninvasively classify adult gliomas into grades 2-4, providing certain assistance for the precise diagnosis and treatment of patients and optimizing their clinical management.

Heart failure (HF) prediction is a challenging issue in medical informatics and is considered a deadliest disease worldwide. Recent research has been concentrated on features transformation and selection for improved HF prediction. In this study, we search optimal feature extraction algorithm by evaluating the performance of different feature extraction algorithms namely Principle Component Analysis (PCA), Sparse PCA, Kernel PCA and Incremental PCA. These algorithms are integrated with machine learning models to improve HF prediction. The performance of all these integrated models are evaluated by analyzing Cleveland heart failure database. Experimental results pointed out that Kernel PCA algorithm integrated with linear discriminant analysis model and Sparse PCA integrated with Gaussian Naive Bayes (GNB) model offers 91.11% of HF classification accuracy. Hence, based on the experimental results it is shown that Kernel PCA and Sparse PCA are suitable feature extraction methods for HF data.

Systematic comparison of unsupervised feature extraction methods for enhancing discrimination accuracy of brown rice flour adulteration in LIBS

To improve smoke detection accuracy, we combine local binary pattern (LBP) like features, kernel principal component analysis (KPCA), and Gaussian process regression (GPR) to propose a novel data processing pipeline for smoke detection. The data processing pipeline consists of three steps including original feature extraction, dimensionality reduction, and classification. We use LBP-like methods to extract original features. To obtain a more discriminant feature, KPCA is used to non-linearly map the original features into a discriminant feature space, where manifold structures are embedded. Finally, in order to improve generalization performance, we apply GPR to model classification as a Gaussian process by imposing Gaussian priors on both data and hyper-parameters. In addition, we can replace any steps of the pipeline by similar methods for further improvement or exploration, so the pipeline is flexible and extensible. Experimental results show that KPCA and GPR are truly able to improve the performance of smoke detection and texture classification, and our method obviously outperforms the same features with Support Vector Machine (SVM).

Systematic Review of Machine Learning in Diagnosis of Myeloproliferative Neoplasia

Sudden Sensorineural Hearing Loss (SSNHL) is routinely encountered in otolaryngology clinics. The prognosis of SSNHL varies dramatically and depends on multiple influence factors. This study aimed to develop an explainable Machine Learning (ML) model with easily accessible features to predict the prognosis of SSNHL. This bi-center retrospective study included 534 patients with SSNHL. We randomly split the data into training and validation sets. Univariate analysis and Least Absolute Shrinkage and Selection Operator (LASSO) regression were employed to select predominant features, including demographic, disease-specific characteristics, and laboratory items. We evaluated the performance of five ML models constructed with six crucial variables using the Area Under the receiver operating characteristic Curve (AUC), accuracy, specificity, sensitivity, and F1 scores. These models were further calibrated by calibration curve and Brier score. Clinical utility was evaluated by Decision Curve Analysis (DCA). The Shapley Additive Explanations (SHAP) method was applied to interpret feature contribution and explain the ML models. The Random Forest (RF) model reached the highest AUC of 0.998. Its accuracy, sensitivity, specificity, and F1 score were 0.981, 0.963, 0.989, and 0.967, respectively. DCA curve analysis revealed a comparable net benefit of the models. The SHAP method revealed that the primary features were degree of hearing loss, audiogram type, age, Mean Corpuscular Volume (MCV), onset to treatment, and serum Albumin (ALB) accordingly. The explainable ML model was superb in predicting hearing outcome and providing information on feature contributions. Clinicians can better understand the contributors to hearing recovery and guide aural rehabilitation using the SHAP method. Level 3.

This study focuses on using various machine learning (ML) models to evaluate the shear behaviors of ultra-high-performance concrete (UHPC) beams reinforced with glass fiber-reinforced polymer (GFRP) bars. The main objective of the study is to predict the shear strength of UHPC beams reinforced with GFRP bars using ML models. We use four different ML models: support vector machine (SVM), artificial neural network (ANN), random forest (R.F.), and extreme gradient boosting (XGBoost). The experimental database used in the study is acquired from various literature sources and comprises 54 test observations with 11 input features. These input features are likely parameters related to the composition, geometry, and properties of the UHPC beams and GFRP bars. To ensure the ML models' generalizability and scalability, random search methods are utilized to tune the hyperparameters of the algorithms. This tuning process helps improve the performance of the models when predicting the shear strength. The study uses the ACI318M-14 and Eurocode 2 standard building codes to predict the shear capacity behavior of GFRP bars-reinforced UHPC I-shaped beams. The ML models' predictions are compared to the results obtained from these building code standards. According to the findings, the XGBoost model demonstrates the highest predictive test performance among the investigated ML models. The study employs the SHAP (SHapley Additive exPlanations) analysis to assess the significance of each input parameter in the ML models' predictive capabilities. A Taylor diagram is used to statistically compare the accuracy of the ML models. This study concludes that ML models, particularly XGBoost, can effectively predict the shear capacity behavior of GFRP bars-reinforced UHPC I-shaped beams.

In the hot strip rolling (HSR) process, accurate prediction of bending force can improve the control accuracy of the strip crown and flatness, and further improve the strip shape quality. In this paper, six machine learning models, including Artificial Neural Network (ANN), Support Vector Machine (SVR), Classification and Regression Tree (CART), Bagging Regression Tree (BRT), Least Absolute Shrinkage and Selection operator (LASSO), and Gaussian Process Regression (GPR), were applied to predict the bending force in the HSR process. A comparative experiment was carried out based on a real-life dataset, and the prediction performance of the six models was analyzed from prediction accuracy, stability, and computational cost. The prediction performance of the six models was assessed using three evaluation metrics of root mean square error (RMSE), mean absolute error (MAE), and coefficient of determination (R2). The results show that the GPR model is considered as the optimal model for bending force prediction with the best prediction accuracy, better stability, and acceptable computational cost. The prediction accuracy and stability of CART and ANN are slightly lower than that of GPR. Although BRT also shows a good combination of prediction accuracy and computational cost, the stability of BRT is the worst in the six models. SVM not only has poor prediction accuracy, but also has the highest computational cost while LASSO showed the worst prediction accuracy.

Super Typhoon Rai damaged Siargao’s tourism industry. Despite the reconstruction projects, there was still evidence of limited resources, destructed infrastructures, and destroyed natural resources. Therefore, this study aimed to examine the significant factors influencing tourists’ intentions to revisit Siargao after Super Typhoon Rai using feature selection, logistic regression (LR), and an artificial neural network (ANN). It employed three feature-selection techniques, namely, the filter method’s permutation importance (PI), the wrapper method’s Recursive Feature Elimination (RFE), and the embedded method’s Least Absolute Shrinkage and Selection Operator (LASSO). Each feature-selection technique was integrated into LR and the ANN. LASSO-ANN, with a 97.8146% model accuracy, was found to be the best machine-learning algorithm. The LASSO model performed at its best with a 0.0007 LASSO alpha value, resulting in 35 subfeatures and 8 primary features. LASSO subsets underwent the ANN model procedure, and the optimal parameter combination was 70% training size, 30% testing size, 30 hidden-layer nodes, tanh hidden-layer activation, sigmoid output-layer activation, and Adam optimization. All eight features were found to be significant. Among them, hedonic motivation and awareness of Typhoon Rai’s impact were considered the top-tier post-typhoon tourism factors, as they maintained at least 97% prediction accuracy. The findings could be elaborated by combining feature-selection techniques, utilizing demographic characteristics, assessing Siargao’s tourism before the typhoon, and expanding the context and participant selection. Nevertheless, none of the existing studies explored the combination of feature selection, LR, and ANNs in a post-typhoon tourism context. These unique methods and significant findings represent the study’s novelty. Furthermore, practical contributions were provided through economic resolutions focusing on tourism activities and communication revamping by the government, media outlets, and transportation companies.

BackgroundThe in-hospital mortality of patients with ST-segment elevation myocardial infarction (STEMI) increases to more than 50% following a cardiogenic shock (CS) event. This study highlights the need to consider the risk of delayed calculation in developing in-hospital CS risk models. This report compared the performances of multiple machine learning models and established a late-CS risk nomogram for STEMI patients.MethodsThis study used logistic regression (LR) models, least absolute shrinkage and selection operator (LASSO), support vector regression (SVM), and tree-based ensemble machine learning models [light gradient boosting machine (LightGBM) and extreme gradient boosting (XGBoost)] to predict CS risk in STEMI patients. The models were developed based on 1,598 and 684 STEMI patients in the training and test datasets, respectively. The models were compared based on accuracy, the area under the curve (AUC), recall, precision, and Gini score, and the optimal model was used to develop a late CS risk nomogram. Discrimination, calibration, and the clinical usefulness of the predictive model were assessed using C-index, calibration plotd, and decision curve analyses.ResultsA total of 2282 STEMI patients recruited between January 1, 2016 and May 31, 2020, were included in the complete dataset. The linear models built using LASSO and LR showed the highest overall predictive power, with an average accuracy over 0.93 and an AUC above 0.82. With a C-index of 0.811 [95% confidence interval (CI): 0.769–0.853], the LASSO nomogram showed good differentiation and proper calibration. In internal validation tests, a high C-index value of 0.821 was achieved. Decision curve analysis (DCA) and clinical impact curve (CIC) examination showed that compared with the previous score-based models, the LASSO model showed superior clinical relevance.ConclusionsIn this study, five machine learning methods were developed for in-hospital CS prediction. The LASSO model showed the best predictive performance. This nomogram could provide an accurate prognostic prediction for CS risk in patients with STEMI.

Estimating whether to treat the rupture risk of small intracranial aneurysms (IAs) with size ≤ 7mm in diameter is difficult but crucial. We aimed to construct and externally validate a convenient machine learning (ML) model for assessing the rupture risk of small IAs. One thousand four patients with small IAs recruited from two hospitals were included in our retrospective research. The patients at hospital 1 were stratified into training (70%) and internal validation set (30%) randomly, and the patients at hospital 2 were used for external validation. We selected predictive features using the least absolute shrinkage and selection operator (LASSO) method and constructed five ML models applying diverse algorithms including random forest classifier (RFC), categorical boosting (CatBoost), support vector machine (SVM) with linear kernel, light gradient boosting machine (LightGBM), and extreme gradient boosting (XGBoost). The Shapley Additive Explanations (SHAP) analysis provided interpretation for the best ML model. The training, internal, and external validation cohorts included 658, 282, and 64 IAs, respectively. The best performance was presented by SVM as AUC of 0.817 in the internal [95% confidence interval (CI), 0.769-0.866] and 0.893 in the external (95% CI, 0.808-0.979) validation cohorts, which overperformed compared with the PHASES score significantly (all P < 0.001). SHAP analysis showed maximum size, location, and irregular shape were the top three important features to predict rupture. Our SVM model based on readily accessible features presented satisfying ability of discrimination in predicting the rupture IAs with small size. Morphological parameters made important contributions to prediction result.