Predicting Breast Cancer: A Comparative Analysis of Machine Learning Algorithms

<p>Breast cancer is ranked as a significant cause of mortality among females globally. Its complex nature poses principal challenges for physicians and researchers for rapid diagnosis and prognosis. Hence, machine learning algorithms are employed to forecast and identify diseases. This study discusses the comparative analysis of seven machine learning models, e.g., logistic regression (LR), support vector machine (SVM), k-nearest neighbor classifier (KNN), decision tree classifier (DT), random forest classifier (RF), Naïve Bayes (NB), and artificial neural network (ANN) to predict breast cancer using Wisconsin breast cancer and breast cancer datasets. In the Wisconsin breast cancer dataset, KNN depicted 99% accuracy, followed by RF (98%), SVM (96%), NB (96%), LR (96%), ANN (93%), and DT (92%). On the contrary, in the breast cancer (BC) dataset, the highest accuracy was achieved by LR at 83%, and the lowest was achieved by DT (65%), which depicted that the numeric dataset WBC has better accuracy than the breast cancer dataset.</p>

Background: The merging of machine learning and deep learning approaches offers a viable route for improving breast cancer prediction in this era of advanced technology and data-driven healthcare. This study focused on the use of supervised machine learning and deep learning algorithms for breast cancer prediction using Wisconsin breast cancer dataset. Methods: The features from this dataset were computed from a digitized image of a fine needle aspirate (FNA) of a breast mass. Supervised machine learning algorithms, such as logistic regression, random forests, and support vector machines were compared with deep learning algorithms like convolutional and recurrent neural networks (RNN and CNN) for the prediction of breast cancer. The techniques combine clinical, genomic, and image-based data, that both aid in early diagnosis and individualized treatment suggestions. Results: The results of model comparison were very promising, with models obtaining excellent accuracy, sensitivity, and specificity in breast cancer diagnosis. The study used a pair plot and different classifiers with their accuracy scores on test dataset to determine which machine learning model was most suitable based on the relationship of variables represented in the plot. Support vector machine (SVM) has the highest accuracy of 98.8% and Artificial Neural Network (ANN) has lowest accuracy of 95.80% using confusion matrix and the accuracy metric. Conclusion: The study revealed that Support Vector Machine (SVM) has the highest prediction capability for Breast Cancer using Supervised Machine Learning and Deep Leaning. The new classifier performed better than the existing breast cancer prediction models in the literature.

The major consequence of breast cancer is death. It has been proven in many studies that machine learning techniques are more efficient in diagnosing breast cancer. These algorithms have also been used to estimate a person's likelihood of surviving breast cancer. In this study, we employed machine learning algorithms to predict breast cancer. A total of 569 breast cancer datasets were obtained from kaggle sites. Some of the machine learning algorithms that we use are K-Nearest Neighbor (KNN), besides Random Forest (RF), there is also Gradient Boosting (GB), then Gaussian Naive Bayes (GNB), Vector Support Machine (SVM), and then Logistic Regression (LR). Before algorithms were used to train and test breast cancer datasets, StandardScaler was leveraged to transform training datasets and test datasets for improved algorithm performance. As a result of this utilization, the performance measurement carried out succeeded in producing high accuracy. The highest results were obtained from the Logistic Regression algorithm with an accuracy value of 99%. The value of precison is 99% benign, and 100% malignant. The recall results are 100% benign, and 98% malignant. The F1-Score results show 99% benign, and 99% malignant. It is hoped that this research can help the medical party to determine the next step in dealing with breast cancer.

BackgroundTranscutaneous transhepatic gallbladder drainage (PTGBD) has shown significant efficacy in the treatment of elderly patients with acute cholecystitis. The goal of this study is to develop a machine learning-based web calculator aimed at predicting the optimal timing for cholecystectomy (LC) after PTGBD in elderly patients with acute cholecystitis (AC) to achieve precise personalized medicine.MethodsA retrospective analysis of 979 elderly patients with acute cholecystitis admitted to Jinzhou Central Hospital and the First Affiliated Hospital of Jinzhou Medical University from 2013 to 2024 was performed, and a total of 680 patients were included in the model development. Patients were divided into delayed (347 cases, surgery > 6 weeks post-PTGBD) and non-delayed (333 cases) groups based on the interval between PTGBD and LC. Minimal Absolute Contraction and Selection Operator (LASSO) and logistic analysis were used to determine the predictors of postponement of LC in elderly patients with AC after PTGBD. Next, we used eight ML algorithms, namely Logistic Regression (LR), Decision Tree (DT), Random Forest (RF), Extreme gradient boosting (XGB), Support Vector Machine (SVM), Multilayer Perceptron (MLP), K-nearest Neighbor (KNN), Gaussian Naive Bayes (GNB), to train and develop ML models using a 10x cross-validation method. The performance of the model was evaluated by a variety of indicators, including the area under the receiver operating characteristic curve (ROC), calibration curve, decision curve, PR curve, and confusion matrix. In addition, model interpretation is performed through Shapley Additive Interpretation (SHAP) analysis to clarify the importance of each feature of the model and its basis for decision-making. Finally, we chose to use the best model to develop a web-based calculator that could be used to predict the likelihood of delaying LC after PTGBD in elderly AC patients.ResultsIn multivariate logistic regression analysis, age, sex, gallbladder wall thickness, time between onset and PTGBD, white blood cell count (WBC), C-reactive protein (CRP), and neutrophil-to-lymphocyte ratio (NLR) were identified as independent predictors of delayed LC in elderly patients with AC after PTGBD. In the training set, the area under the receiver operating characteristic curve (AUC) values for these models ranged from 0.808 to 0.914, with the random forest (RF) model showing the highest AUC value. Through the evaluation of decision curve analysis (DCA), precision-recall (PR) curve and calibration curve, the RF model showed superior clinical decision support and prediction performance compared with the other seven models. Finally, we used the RF model to build an online network calculator, which aims to accurately assist doctors in making more informed and accurate clinical decisions and promote the wide application of the model in clinical practice (https://zw17786325639.shinyapps.io/Postpone/).ConclusionsThis study developed and validated an RF model network calculator based on clinical indicator information to assess the likelihood of delaying LC after PTGBD in elderly patients with acute cholecystitis. This tool is expected to assist physicians in making more appropriate clinical decisions for patients.

Cross-Site Scripting (XSS) attacks pose a significant cybersecurity threat by exploiting vulnerabilities in web applications to inject malicious scripts, enabling unauthorized access and execution of malicious code. Traditional XSS detection systems often struggle to identify increasingly complex XSS payloads. To address this issue, this research evaluated the efficacy of Machine Learning algorithms in detecting XSS threats within online web applications. The study conducts a comprehensive comparative analysis of XSS attack detection using four prominent Machine Learning algorithms, which consist of Extreme Gradient Boosting (XGBoost), Random Forest (RF), K-Nearest Neighbors (KNN), and Support Vector Machine (SVM). This research utilizes a comparative methodology to assess the selected Machine Learning algorithms by analyzing their performance metrics, including confusion matrix, 10-fold cross-validation, and assessment of training time to thoroughly evaluate the models. By exploring dataset characteristics and evaluating the performance metrics of each selected algorithm, the study determined the most robust Machine Learning solution for XSS detection. Results indicate that Random Forest is the top performer, achieving 99.93% accuracy and balanced metrics across all criteria evaluated. These findings will significantly enhance web application security by providing reliable defenses against evolving XSS threats.

At the moment, the most prevalent form of cancer diagnosed in women across the globe is breast cancer. It develops in the breast tissue and is one of the most frequent causes of women's death. This cancer can be cured if it is diagnosed at preliminary stage. Malignant and benign are two types of tumor found in case of breast cancer. Malignant tumors are deadly as their rate of growth is much higher than benign tumors. So, early identification of tumor type is pivotal for the appropriate treatment of a patient having breast cancer. In this work, Wisconsin Breast Cancer Dataset has been used which was collected from UCI repository. Our goal is to analyze the dataset and evaluate the performance of various machine learning algorithms for predicting breast cancer. Here, Support Vector Machine, Logistic Regression, K-Nearest Neighbors, Decision Tree, Naive Bayes and Random Forest classifiers have been implemented for classifying tumors into benign and malignant. The accuracy of each algorithm is calculated and compared to find the most suitable one. Based on the analysis, Random Forest and Support Vector Machine outperform other classifiers with accuracy of 96.5%. These classifiers can be used to build an automatic diagnostic system for preliminary diagnosis of breast cancer.

Abstract— Breast cancer remains one of the leading causes of mortality among women worldwide, making early and accurate diagnosis crucial for improving patient outcomes. Traditional machine learning models often struggle to maintain high classification accuracy due to data variability and the complex nature of tumor characteristics. This study proposes an adaptive voting ensemble learning algorithm to enhance breast cancer classification performance. The ensemble integrates multiple classifiers—such as Decision Trees, Support Vector Machines, and K-Nearest Neighbors—by assigning dynamic weights based on each model's real-time performance. The algorithm is evaluated using the Wisconsin Breast Cancer Dataset (WBCD), and its effectiveness is measured against individual classifiers using metrics like accuracy, precision, recall, and F1-score. Results demonstrate that the adaptive ensemble significantly outperforms standalone models, offering a more robust and reliable approach for breast cancer prediction. This method shows promise for application in clinical decision support systems, contributing to more accurate diagnostics and better treatment planning. Keywords- Breast Cancer Classification, Adaptive Voting, Ensemble Learning, Machine Learning, Wisconsin Breast Cancer Dataset (WBCD), Decision Tree, Support Vector Machine (SVM), K-Nearest Neighbors (KNN), Medical Diagnosis, Predictive Modeling

In this paper four machine learning algorithms are compared in order to predict if a cell nucleus is benign or malignant using the Breast Cancer Wisconsin (Diagnostic) Data Set. The algorithms are K-Nearest Neighbours, Classification and Regression Trees (CART), Naive Bayes and Support Vector Machines with Radial Basis Function Kernel. Data visualization and Pre-Processing using PCA will help in the understanding and the preparation of the dataset for the training phase while parameter tuning will determine the optimal parameter for every model using R as programming language. Also, 10-fold Cross Validation is used as a resampling method after comparing it with Bootstrapping, as it is the most efficient out of the two. In the end, our comparison shows that the machine learning model that marked the highest Accuracy is the one that is trained using K Nearest Neighbours. Nowadays, one of the most common forms of cancer among women is breast cancer with more than one million cases and nearly 600,000 deaths occurring worldwide annually [1]. It is the second leading cause of death among women and thus it must be detected at an early stage in order not to become fatal [2]. Thus, the importance of diagnosing if a biopsied cell is benign or malignant is vital. However, this process is quite complicated as it involves several stages of gathering and analysing samples with many variables, making the final diagnosis a demanding and timely procedure. The rapid growth of Artificial Intelligence and Machine learning and their implementation in Medicine give us a new perspective in the way we process and analyse medical data. Medical experts can use Data Mining techniques and improve their decision making by extracting useful information from massive amounts of data.

As the most prevalent cancer in women worldwide, breast cancer requires early detection to have the best possible treatment results. However, conventional screening techniques, like mammography and clinical examinations, can take time and effort. In this paper, we proposed a predictive model for the identification of breast cancer by combining state-of-the-art model BERT with machine learning approaches. Several machine learning algorithms, such as K-nearest neighbours, decision tree, random forest, neural network, and BERT, were tested on the Breast Cancer Wisconsin (Diagnostic) Dataset for early prediction of the diseases. The BERT model's accuracy was improved by using hyperparameter optimisation techniques. For the proposed work's evaluation, we used metrics like accuracy, F1-score, precision, and recall on the standard publically available datasets. With an accuracy of 0.98 across various splits and an area under the curve (AUC) of 0.98 in receiver operating characteristic (ROC) curves, our results show that BERT consistently works better than other models. These findings highlight the value of early and reliable identification in improving patient outcomes, highlighting the promise of machine learning algorithms, notably BERT, inaccurate breast cancer prediction.

Under-five mortality remains a global health challenge with the rates of 43 deaths per every 1000 live births in Tanzania and 37 deaths per every 1000 live births globally. Although child mortality has significantly declined in the last twenty years, the current rates are far from reaching the anticipated Sustainable Development Goal of atmost 25 deaths per 1000 live births in 2030. This study intended to find the best performing classifier of under-five mortality status by comparing ten supervised machine learning algorithms. These machine learning algorithms are Decision Trees, Random Forest, Support Vector Machines, SMOTE-Based Boosted Random Forest, XGBoost, LightGBM, CatBoost, Logistic Regression, K-Nearest Neighbors and Stacked Ensemble Methods. The class imbalance of the dataset detected in the pre-processing stage was addressed using weighted categorical cross-entropy and SMOTE with a 5-folds cross validation and data splitting ratio of 80% for training set and 20% for testing set. With 20 experiments for each of the nine algorithms, the average results were reported to ensure that the findings were not by chance. Further, the stacking ensemble model was developed integrating six of the best performing algorithms using an inclusion criterion of AUC > 0.97. The findings revealed that ensemble algorithm consistently outperformed the other nine algorithms by achieving 100%, 100%, 99.97% and 99.24% for AUC, Accuracy, F1-Score and MCC respectively. This implies that stacking ensemble can uncover more insights than the individual algorithms in predicting under-five mortality status. This study recommends designing policies on under-five mortality that integrate insights from the stacking ensemble algorithm which shows the highest predictive performance.

Close-range technologies capable of capturing forest ecosystems in three-dimensional space with great detail are revolutionising precision forestry research and practice, mainly by increasing the level of automation for data collection and processing. Furthermore, they provide options to measure some parameters directly, for example, volume or biomass. However, automatic tree species recognition still needs to be properly solved, which is a crucial and challenging task. A couple of approaches by different authors were done to overcome the challenge when data from close-range technologies are used. The authors mainly utilised 3D structures of whole trees or, in some cases, bark structures using point clouds. Or derived 2D blueprints of whole trees from point clouds to distinguish between tree species. In our approach, we are using images of bark. Usually, images are taken during the data acquisition by close-range technologies as a resource for photogrammetry or for colourising the point clouds in the case of terrestrial laser scanning, for example. Carpentier et al. (2018) did an experiment with 23 tree species in Canada and used convolutional neural networks to classify tree species with an accuracy of almost 94%. We focused on benchmarking multiple machine learning and deep learning algorithms in our experiment. Namely: Random forest; Decision tree; Support Vector Machine; Gradient boost; K-nearest Neighbors; Gaussian Naïve Bayes; Multilayer Perceptron; Convolutional neural networks.In our first experiment, we collected two datasets of bark images using Sony alfa 7 and Canon EOS 4000D. We have collected 1755 images in Slovakia (1369) and Czechia (386); both datasets contain four tree species. The four species from Slovak datasets are European beech, sessile oak, Norway spruce, and European silver fir. Czechia data consists of the species European beech, large-leaved linden, Norway maple, and Scots pine. However, the bark images from Slovakia are from managed forests, and there is a variety of markings on bark; for that, images are cropped to small regions excluding the markings.The most accurate results were achieved by CNN, which provides 94% accuracy on Slovak exact cropped dataset with a 50% dropout and 91% on an exact cropped dataset with a 50% dropout. When CNN is not considered, the most accurate algorithm was Multilayer perceptron with an accuracy of 92%.The following research will focus on implementing such tree species classification within the point cloud processing workflow when close-range technologies are used. Secondly, Carpentier et al. (2018) created Barknet 1.0, where they stored 23,000 high-resolution bark images of 23 tree species in Canada. Our next goal is to develop a database of tree species across Europe. To achieve such a challenging task, we will do it within the 3DForEcoTech COST Action, a European collaborative project focusing on close-range technologies and their implementation for precision forestry and forest ecology.ReferencesCarpentier, M., Giguere, P. and Gaudreault, J., 2018, October. Tree species identification from bark images using convolutional neural networks. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 1075-1081). IEEE.

ObjectiveThe aim of this study was to develop and validate a machine learning-based predictive model that predicts 90-day mortality in ICU trauma patients.MethodsData of patients with severe trauma were extracted from the Medical Information Mart for Intensive Care III (MIMIC-III) database. The performances of mortality prediction models generated using nine machine learning extreme gradient boosting (XGBoost), logistic regression, random forest, AdaBoost, multilayer perceptron (MLP) neural networks, support vector machine (SVM), light gradient boosting machine (GBM), k nearest neighbors (KNN) and gaussian naive bayes (GNB). The performance of the model was evaluated in terms of discrimination, calibration and clinical application.ResultsWe found that the accuracy, sensitivity, specificity, PPV, NPV and F1 score of our proposed XGBoost model were 82.8%, 79.7%, 77.6%, 51.2%, 91.5% and 0.624, respectively. Among the nine models, the XGBoost model performed best. Compared with traditional logistic regression, the calibration curves of the XGBoost model and decision curve analysis (DCA) performed well.ConclusionOur study shows that the XGBoost model outperforms other machine learning models in predicting 90-day mortality in trauma patients. It can be used to assist clinicians in the early identification of mortality risk factors and early intervention to reduce mortality.

ObjectiveEnhanced technology in computer and internet has driven scale and quality of data to be improved in various areas including healthcare sectors. Machine Learning (ML) has played a pivotal role in efficiently analyzing those big data, but a general misunderstanding of ML algorithms still exists in applying them (e.g., ML techniques can settle a problem of small sample size, or deep learning is the ML algorithm). This paper reviewed the research of diagnosing mental illness using ML algorithm and suggests how ML techniques can be employed and worked in practice.MethodsResearches about mental illness diagnostic using ML techniques were carefully reviewed. Five traditional ML algorithms-Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN)-frequently used for mental health area researches were systematically organized and summarized.ResultsBased on literature review, it turned out that Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN) were frequently employed in mental health area, but many researchers did not clarify the reason for using their ML algorithm though every ML algorithm has its own advantages. In addition, there were several studies to apply ML algorithms without fully understanding the data characteristics.ConclusionResearchers using ML algorithms should be aware of the properties of their ML algorithms and the limitation of the results they obtained under restricted data conditions. This paper provides useful information of the properties and limitation of each ML algorithm in the practice of mental health.

Introduction: Hematoma expansion (HE) is a known prognostic indicator of spontaneous intracerebral hemorrhage (sICH). Although several scores exist for prediction of HE, universal adoption has been limited due to their lack of sensitivity and specificity. As machine learning (ML) algorithms have shown promise in the stroke field, here we examine the predictive accuracy of several ML algorithms for HE in sICH patients. Methods: We retrospectively analyzed demographic, clinical data, and radiographic signs of patients with sICH in our 2-hospital database. A total of 61 clinical, imaging, and treatment variables were included in the study. Nine ML models were applied: Adaptive Boost (AdaBoost), Bernoulli Naïve Bayes (BNB), Decision Tree (DT), Gaussian Naïve Bayes (GNB), Logistic Regression (LR), Multi-Layer Perceptron (MLP), Multinomial Naïve Bayes models (MNB), Random Forest (RF), and Extreme Gradient Boosting (XGBoost). All models were trained to predict HE. Model accuracy was assessed using the area under characteristic curve (AUC). Results: Of the 301 patients with sICH, 63 developed HE (21.93%). Of the 9 models studied, MLP had the highest AUC score (0.93±0.042), followed by XGBoost (0.80±0.06). All models demonstrated moderate to high predictive accuracy (AUC 0.64-0.93) for HE. The top predictors in MLP were Baseline NIHSS score, HDL, aPPT, time from last known well to ER, initial hematoma volume, and island sign. MLP had moderate sensitivity of 0.46±0.17 and high specificity of 0.99±0.02. GNB, however, showed the highest sensitivity at 0.86±0.06 and a moderate specificity of 0.65±0.07. Five of the 9 models ranked time last known well to ER presentation as a predictor of HE. Conclusion: In our study, we found all ML models applied had moderate to high predictive accuracy for prediction of HE in sICH, with MLP having the highest accuracy of all models. Future studies examining the use of these algorithms are warranted.

Breast cancer remains a critical global health concern, requiring advanced and reliable diagnostic methods for early detection and effective intervention. This work introduces an integrated ensemble framework that combines multiple dimensionality reduction (DR) techniques, including Principal Component Analysis (PCA), Non-negative Matrix Factorization (NMF), and Singular Value Decomposition (SVD), with robust machine learning (ML) classifiers for improved breast cancer detection. The publicly available Wisconsin Breast Cancer Dataset (WBCD) was utilized, with rigorous data preprocessing performed to address missing values, anomalies, and class imbalance through stratified sampling and median imputation. To mitigate overfitting and underfitting, dimensionality reduction was coupled with cross-validation and ensemble strategies. The predictive performance of Logistic Regression (LR), Support Vector Machine (SVM), Random Forest (RF), Decision Tree (DT), and Multi-Layer Perceptron (MLP) was systematically evaluated. Experimental results show that SVM consistently achieves a maximum accuracy of 97.9 % across all applied DR techniques, while MLP and LR also reach 97.9 % accuracy with PCA and NMF, though MLP exhibits performance variability depending on the selected DR method. The findings provide practical guidance for healthcare practitioners and researchers, supporting the adoption of explainable and scalable AI-driven diagnostic tools. Limitations include the reliance on a single dataset and the need for further validation on larger and more diverse clinical cohorts. Future work will focus on enhancing model interpretability, external validation, and real-world deployment in resource-constrained settings.