OPTIMIZATION OF LUNG CANCER CLASSIFICATION METHOD USING EDA-BASED MACHINE LEARNING

Colorectal cancer (CRC) is a form of cancer that impacts both the rectum and colon. Typically, it begins with a small abnormal growth known as a polyp, which can either be non-cancerous or cancerous. Therefore, early detection of colorectal cancer as the second deadliest cancer after lung cancer, can be highly beneficial. Moreover, the standard treatment for locally advanced colorectal cancer, which is widely accepted around the world, is chemoradiotherapy. Then, in this study, seven artificial intelligence models including decision tree, K-nearest neighbors, Adaboost, random forest, Gradient Boosting, multi-layer perceptron, and convolutional neural network were implemented to detect patients responder and non-responder to radiochemotherapy. For finding the potential predictors (genes), three feature selection strategies were employed including mutual information, F-classif, and Chi-Square. Based on feature selection models, four different scenarios were developed and five, ten, twenty and thirty features selected for designing a more accurate classification paradigm. The results of this study confirm that random forest, Gradient Boosting, decision tree, and K-nearest neighbors provided more accurate results in terms of accuracy, by 93.8%. Moreover, Among the feature selection methods, mutual information and F-classif showed the best results, while Chi-Square produced the worst results. Therefore, the suggested artificial intelligence models can be successfully applied as a robust approach for classification of colorectal cancer response to radiochemotherapy for medical studies.

The prediction of wind energy generation is important to enhance the performance and dependability of renewable energy systems due to the rising demand for wind-generated electricity and advancements in wind energy technology competitiveness. This study leverages advanced machine learning (ML) and some other statistical and deep learning based time series forecasting models to enhance the accuracy of wind energy predictions. This comprehensive analysis includes nine ML models—Linear Regression, Random Forests (RF), Gradient Boosting Machines (GBM), Support Vector Machines (SVM), K-Nearest Neighbors (KNN), AdaBoost, XGBoost, Support Vector Regression (SVR), and Neural Networks—as well as Four time-series forecasting models—ARIMA, Temporal Convolutional Networks (TCNs), Long Short-Term Memory (LSTM) networks and GRU. Each ML model underwent rigorous cross-validation to ensure optimal performance. The assessment criteria utilized here comprised the Mean Squared Error (MSE), Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and the R² Score. It was found that among the nine ML models, Random Forests, GBM and KNN consistently provided superior accuracy and robustness, making them the top choices for wind energy prediction whereas the performance of linear regression, SVM and SVR were very poor for the considered dataset. From the experiment, Random Forest, GBM, and KNN showed the best performance with low MSE values of 0.77, 1.95, and 1.51 respectively, while other models had MSEs above 7.5, with AdaBoost reaching 30. Their RMSEs (0.88, 1.40, 1.23) and MAEs (0.093, 0.73, 0.10) also indicate strong predictive accuracy compared to the rest.In this paper, time series forecasting, TCNs, LSTM and GRU networks showed strong capabilities in capturing temporal dependencies and trends within the wind energy data. Visualization techniques were employed to compare model performances comprehensively, providing clear insights into their predictive power. Therefore, this present study offers a robust framework for researchers and practitioners aiming to leverage machine learning and time series forecasting in the realm of renewable energy prediction.

BackgroundNearly 20% of pregnancies in patients with Systemic lupus erythematosus (SLE) result in an adverse pregnancy outcome (APO); early identification of women with SLE who are at high risk of...

This study presents a comparative framework for evaluating the predictive performance of four machine learning models namely Gradient Boosting Machine (GBM), Random Decision Forest (RDF), Non-Parametric Regression (NP), and Decision Tree (TREE), in estimating the Unconfined Compressive Strength (UCS) of nano-doped fly ash reinforced clayey soil. The key innovation lies in combining ensemble learning with sensitivity, monotonicity, and SHAP (SHapley Additive exPlanations) analyses to enhance predictive accuracy and interpretability in geotechnical applications. Using a comprehensive dataset of key variables (Curing Days, Maximum Dry Density (MDD), Optimum Moisture Content (OMC), Fly Ash, Multi-Walled Carbon Nanotubes (MWCNT), and Sodium Hexametaphosphate (SHMP)) models were trained and validated using various statistical metrics (R², MAE, MSE etc.). GBM achieved the best performance (R²: 1.000, 0.955; MAE: 0.001, 0.022; MSE: 0.000, 0.001 in training and testing respectively), consistently outperforming RDF, NP, and TREE. Taylor diagrams, REC curves, and AOC analysis further confirmed GBM's superior generalization and minimal error rates. Sensitivity analysis identified Days (0.4556), MDD (0.2458), and SHMP (0.1558) as the most influential factors, trends that were corroborated by SHAP analysis. Monotonicity analysis validated positive relationships with Days (R² = 0.9845) and MDD (R² = 0.689), while OMC and SHMP showed inverse effects. These results establish GBM as a highly accurate and interpretable model for UCS prediction, offering a powerful tool for optimizing soil stabilization in construction and geotechnical engineering.

Amyloid-β(Aβ) PET positivity in patients with suspected cerebral amyloid angiopathy (CAA) MRI markers is predictive of a worse cognitive trajectory, and it provides insights into the underlying vascular pathology (CAA vs. hypertensive angiopathy) to facilitate prognostic prediction and appropriate treatment decisions. In this study, we applied two interpretable machine learning algorithms, gradient boosting machine (GBM) and random forest (RF), to predict Aβ PET positivity in patients with CAA MRI markers. In the GBM algorithm, the number of lobar cerebral microbleeds (CMBs), deep CMBs, lacunes, CMBs in dentate nuclei, and age were ranked as the most influential to predict Aβ positivity. In the RF algorithm, the absence of diabetes was additionally chosen. Cut-off values of the above variables predictive of Aβ positivity were as follows: (1) the number of lobar CMBs > 16.4(GBM)/14.3(RF), (2) no deep CMBs(GBM/RF), (3) the number of lacunes > 7.4(GBM/RF), (4) age > 74.3(GBM)/64(RF), (5) no CMBs in dentate nucleus(GBM/RF). The classification performances based on the area under the receiver operating characteristic curve were 0.83 in GBM and 0.80 in RF. Our study demonstrates the utility of interpretable machine learning in the clinical setting by quantifying the relative importance and cutoff values of predictive variables for Aβ positivity in patients with suspected CAA markers.

Maternal exposure to ambient PM10 during pregnancy increases the risk of congenital heart defects: Evidence from machine learning models

The prevalence of urinary tract infections (UTIs) is a significant concern, particularly among women. This study aims to adopt machine learning models for predicting UTIs using gradient boosting, support vector machine (SVM), and random forest algorithms. The dataset used was obtained from the Kaggle repository, consisting of UTI articles. The performance of the models was evaluated using metrics such as accuracy, precision, recall, and F1-score. The UTI dataset was preprocessed by removing irrelevant columns and handling missing values. The dataset was then divided into training and testing sets. The three models were trained using the training data. The results showed that both random forest and gradient boosting classification achieved an accuracy of 0.8750, while SVM achieved an accuracy of 0.8333. Precision values were 0.8000 for random forest, 1.0000 for SVM, and 0.9000 for gradient boosting. F1-scores were 0.8421 for both random forest and SVM, and 0.8571 for gradient boosting. Recall values were 0.8889 for both random forest and SVM, and 0.8182 for gradient boosting. Comparing the results with previous studies, the models showed competitive performance. The ROC curves were plotted to visualize the models' performance across different classification thresholds. In conclusion, the study demonstrates the effectiveness of gradient boosting, SVM, and random forest algorithms in predicting UTIs. The adopted models provide valuable insights for early detection and management of UTIs, contributing to improved healthcare outcomes.

BackgroundEarly recurrence in colorectal cancer liver metastases (CRLM) typically correlates with significantly worse survival outcomes. There is a strong demand for developing robust and interpretable approaches to assist clinicians in identifying patients at high risk of recurrence.MethodsIn this study, we utilized clinical CT images and associated clinical data from 197 CRLM patients, provided as DICOM images. A total of 993 radiomic features, including shape, texture, and first-order characteristics, were extracted. Eight machine learning models were trained and validated: Random Forest (RF), Multilayer Perceptron (MLP), K-nearest Neighbors (KNN), Extremely Randomized Trees (ET), AdaBoost, Decision Trees (DT), Gradient Boosting (GB), and Linear Discriminant Analysis (LDA).ResultsIn predicting tumor recurrence within one year, the ET model showed the best performance using only radiomic features, with an AUC of 0.9667. RF and GB also performed well, achieving AUCs of 0.9558 and 0.9227, respectively. When combining radiomic and clinical features, the performance of all models improved in terms of AUC. Specifically, the Random Forest (RF) model achieved the highest AUC of 0.9672, followed by Gradient Boosting (GB) with an AUC of 0.9646, and Extra Trees (ET) with an AUC of 0.9459.ConclusionWe developed a CT-based machine learning model, using the Random Forest algorithm, that combines clinical (e.g., age, carcinoembryonic antigen, bilobar disease) and radiomic features (e.g., selected features included texture-based metrics such as the 90th percentile of first-order statistics in the high–low–low (HLL) wavelet-decomposed image, and Run Entropy from the gray-level run length matrix (GLRLM) in the low–low–low (LLL) sub-band.) to predict early recurrence after hepatectomy in patients with colorectal liver metastasis (CRLM). This model has the potential to guide personalized postoperative surveillance. However, limitations such as the retrospective single-center design and relatively small sample size may affect the generalizability of the findings. Further validation in larger, multi-center cohorts is warranted to confirm its clinical utility.

Diagnosing a parasitic disease is a very difficult job in clinical practice. In this study, we constructed a machine learning model for diagnosis prediction using patient information. First, we diagnosed whether a patient has a parasitic disease. Next, we predicted the proper diagnosis method among the six types of diagnostic terms (biopsy, endoscopy, microscopy, molecular, radiology, and serology) if the patient has a parasitic disease. To make the datasets, we extracted patient information from PubMed abstracts from 1956 to 2019. We then used two datasets: the prediction for parasite-infected patient dataset (N = 8748) and the prediction for diagnosis method dataset (N = 3780). We then compared four machine learning models: support vector machine, random forest, multi-layered perceptron, and gradient boosting. To solve the data imbalance problem, the synthetic minority over-sampling technique and TomekLinks were used. In the parasite-infected patient dataset, the random forest, random forest with synthetic minority over-sampling technique, gradient boosting, gradient boosting with synthetic minority over-sampling technique, and gradient boosting with TomekLinks demonstrated the best performances (AUC: 79%). In predicting the diagnosis method dataset, gradient boosting with synthetic minority over-sampling technique was the best model (AUC: 87%). For the class prediction, gradient boosting demonstrated the best performances in biopsy (AUC: 88%). In endoscopy (AUC: 94%), molecular (AUC: 90%), and radiology (AUC: 88%), gradient boosting with synthetic minority over-sampling technique demonstrated the best performance. Random forest demonstrated the best performances in microscopy (AUC: 82%) and serology (AUC: 85%). We calculated feature importance using gradient boosting; age was the highest feature importance. In conclusion, this study demonstrated that gradient boosting with synthetic minority over-sampling technique can predict a parasitic disease and serve as a promising diagnosis tool for binary classification and multi-classification schemes.

Prediction of gully erosion susceptibility through the lens of the SHapley Additive exPlanations (SHAP) method using a stacking ensemble model.

Background/Objectives: Smartphone addiction (SA) and gaming addiction (GA) have become risk factors for individuals of all ages in recent years. Especially during adolescence, it has become very difficult for parents to control this situation. Physical activity and the effective use of free time are the most important factors in eliminating such addictions. This study aimed to test a new machine learning method by combining routine regression analysis with the gradient-boosting machine (GBM) and random forest (RF) methods to analyze the relationship between SA and GA with leisure time management (LTM) and the enjoyment of physical activity (EPA) among adolescents. Methods: This study presents the results obtained using our developed GBM + RF hybrid model, which incorporates LTM and EPA scores as inputs for predicting SA and GA, following the preprocessing of data collected from 1107 high school students aged 15-19 years. The results were compared with those obtained using routine regression results and the lasso, ElasticNet, RF, GBM, AdaBoost, bagging, support vector regression (SVR), K-nearest neighbors (KNN), multi-layer perceptron (MLP), and light gradient-boosting machine (LightGBM) models. In the GBM + RF model, probability scores obtained from GBM were used as input to RF to produce final predictions. The performance of the models was evaluated using the R2, mean absolute error (MAE), and mean squared error (MSE) metrics. Results: Classical regression analyses revealed a significant negative relationship between SA scores and both LTM and EPA scores. Specifically, as LTM and EPA scores increased, SA scores decreased significantly. In contrast, GA scores showed a significant negative relationship only with LTM scores, whereas EPA was not a significant determinant of GA. In contrast to the relatively low explanatory power of classical regression models, ML algorithms have demonstrated significantly higher prediction accuracy. The best performance for SA prediction was achieved using the Hybrid GBM + RF model (MAE = 0.095, MSE = 0.010, R2 = 0.9299), whereas the SVR model showed the weakest performance (MAE = 0.310, MSE = 0.096, R2 = 0.8615). Similarly, the Hybrid GBM + RF model also showed the highest performance for GA prediction (MAE = 0.090, MSE = 0.014, R2 = 0.9699). Conclusions: These findings demonstrate that classical regression analyses have limited explanatory power in capturing complex relationships between variables, whereas ML algorithms, particularly our GBM + RF hybrid model, offer more robust and accurate modeling capabilities for multifactorial cognitive and performance-related predictions.

In the rapidly evolving landscape of retail analytics, the accurate prediction of sales figures holds paramount importance for informed decision-making and operational optimization. Leveraging diverse machine learning methodologies, this study aims to enhance the precision of Walmart sales forecasting, utilizing a comprehensive dataset sourced from Kaggle. Exploratory data analysis reveals intricate patterns and temporal dependencies within the data, prompting the adoption of advanced predictive modeling techniques. Through the implementation of linear regression, ensemble methods such as Random Forest, Gradient Boosting Machines (GBM), eXtreme Gradient Boosting (XGBoost), and Light Gradient Boosting Machine (LightGBM), this research endeavors to identify the most effective approach for predicting Walmart sales. Comparative analysis of model performance showcases the superiority of advanced machine learning algorithms over traditional linear models. The results indicate that XGBoost emerges as the optimal predictor for sales forecasting, boasting the lowest Mean Absolute Error (MAE) of 1226.471, Root Mean Squared Error (RMSE) of 1700.981, and an exceptionally high R-squared value of 0.9999900, indicating near-perfect predictive accuracy. This model's performance significantly surpasses that of simpler models such as linear regression, which yielded an MAE of 35632.510 and an RMSE of 80153.858. Insights from bias and fairness measurements underscore the effectiveness of advanced models in mitigating bias and delivering equitable predictions across temporal segments. Our analysis revealed varying levels of bias across different models. Linear Regression, Multiple Regression, and GLM exhibited moderate bias, suggesting some systematic errors in predictions. Decision Tree showed slightly higher bias, while Random Forest demonstrated a unique scenario of negative bias, implying systematic underestimation of predictions. However, models like GBM, XGBoost, and LGB displayed biases closer to zero, indicating more accurate predictions with minimal systematic errors. Notably, the XGBoost model demonstrated the lowest bias, with an MAE of -7.548432 (Table 4), reflecting its superior ability to minimize prediction errors across different conditions. Additionally, fairness analysis revealed that XGBoost maintained robust performance in both holiday and non-holiday periods, with an MAE of 84273.385 for holidays and 1757.721 for non-holidays. Insights from the fairness measurements revealed that Linear Regression, Multiple Regression, and GLM showed consistent predictive performance across both subgroups. Meanwhile, Decision Tree performed similarly for holiday predictions but exhibited better accuracy for non-holiday sales, whereas, Random Forest, XGBoost, GBM, and LGB models displayed lower MAE values for the non-holiday subgroup, indicating potential fairness issues in predicting holiday sales. The study also highlights the importance of model selection and the impact of advanced machine learning techniques on achieving high predictive accuracy and fairness. Ensemble methods like Random Forest and GBM also showed strong performance, with Random Forest achieving an MAE of 12238.782 and an RMSE of 19814.965, and GBM achieving an MAE of 10839.822 and an RMSE of 1700.981. This research emphasizes the significance of leveraging sophisticated analytics tools to navigate the complexities of retail operations and drive strategic decision-making. By utilizing advanced machine learning models, retailers can achieve more accurate sales forecasts, ultimately leading to better inventory management and enhanced operational efficiency. The study reaffirms the transformative potential of data-driven approaches in driving business growth and innovation in the retail sector.

Alzheimer's dementia, a neurological disease that affects millions of people worldwide, is a huge public health problem. It is critical to develop accurate prediction models since early detection can lead to more effective management and treatment. In this work, we investigate a range of hybrid machine-learning approaches that include Random Forest (RF) and Decision Tree (DT) as distinct models. Tree Forest Hybrid (TFH), TFH + Gradient Boosting (GB), Multi-Model Voting Ensemble (MVE), Multi Classifier Ensemble (MCE), and Naïve Bayes + GB are some of the models we investigate utilizing demographic and clinical features from the “oasis_longitudinal.csv” dataset. A comparison of the accuracy of numerous models indicates that four notable models, TFH MCE, MVE, and RF, each obtained an accuracy of 86.67%. NB + GB model with an accuracy of 85.33%, while the TFH+GB and DT models achieved an accuracy of 84%. Following a closer evaluation of these models' Root Mean Square Error (RMSE) and cross-validation scores, ‘TFH’ emerged as the highest performer, highlighting the promise of hybrid machine learning for improving Alzheimer's disease prediction.

Voltage instability poses a significant challenge by limiting power system operation and transmission capacity. Rapid detection and effective corrective actions are essential to prevent voltage collapse. However, traditional methods for assessing voltage security margins are computationally intensive and often impractical for real-time applications. This study addresses voltage stability assessment in power systems using machine learning (ML) to overcome the computational limitations of traditional methods. By employing Linear Regression (LR), Random Forest (RF), Gradient Boosting (GB), and Support Vector Machine (SVM), we predict Fast Voltage Stability Indices (FVSI) at nominal load as well as under varying loads (10–150%) in 15 kV Ethiopian distribution networks: a 35-bus Bata feeder system and a 53-bus Papyrus feeder system. RF and GB models achieved superior accuracy with R² values of 0.999 and 0.9998 respectively, significantly outperforming LR and SVM which exhibited substantial deviations. The GB model achieves the highest accuracy, with RMSE values of 0.0002 (53-bus) and 2.419e-05 (35-bus), while RF yields RMSE values of 0.0039 (53-bus) and 0.00120 (35-bus), demonstrating strong predictive performance. The FVSI threshold analysis revealed critical stability limits, with values approaching 1.0 indicating proximity to voltage collapse. The analysis identified buses 36, 32, and 21 in the 53-bus system (FVSI values: 0.087, 0.082, and 0.080) and buses 27 and 16 in the 35-bus system (FVSI values: 0.085 and 0.082) as critical instability risk points requiring immediate monitoring. These findings underscore the efficacy of ensemble methods for rapid voltage stability assessment and emphasize the need for targeted interventions in high-risk areas to bolster grid resilience in Ethiopian distribution networks.

Influence of lunar phases and meteorological factors on rainfall in Karachi City, Pakistan