Exploring Machine Learning Approaches for Predicting Lung Cancer: A Comparative Study

ObjectiveEnhanced technology in computer and internet has driven scale and quality of data to be improved in various areas including healthcare sectors. Machine Learning (ML) has played a pivotal role in efficiently analyzing those big data, but a general misunderstanding of ML algorithms still exists in applying them (e.g., ML techniques can settle a problem of small sample size, or deep learning is the ML algorithm). This paper reviewed the research of diagnosing mental illness using ML algorithm and suggests how ML techniques can be employed and worked in practice.MethodsResearches about mental illness diagnostic using ML techniques were carefully reviewed. Five traditional ML algorithms-Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN)-frequently used for mental health area researches were systematically organized and summarized.ResultsBased on literature review, it turned out that Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN) were frequently employed in mental health area, but many researchers did not clarify the reason for using their ML algorithm though every ML algorithm has its own advantages. In addition, there were several studies to apply ML algorithms without fully understanding the data characteristics.ConclusionResearchers using ML algorithms should be aware of the properties of their ML algorithms and the limitation of the results they obtained under restricted data conditions. This paper provides useful information of the properties and limitation of each ML algorithm in the practice of mental health.

Lung cancer is one of the three deadliest diseases in the world and has rapidly developed. Based on this, researchers conducted research to predict the factors that influence lung cancer. One method to identify this is using data mining methods and classification techniques. Researchers used several popular algorithms in classification to make comparisons of the most accurate algorithms for lung cancer classification. The algorithms used include K-Nearest Neighbor, Random Forest Classifier, Logistic Regression, Linear SVM, Naïve Bayes, Decision Tree, Random Forest, Gradient Boosting, Kernel SVM, and MLPClassifier. The researcher used this algorithm because, in the research that the researcher found on the Kaggle platform, he examined the comparison of the algorithm using the breast cancer dataset. In previous studies, their researchers used SVM, which obtained an accuracy of 96.47%, Neural Networks of 97.06%, and Naïve Bayes with an accuracy of 91.18% to study breast cancer. The difference from previous research is that this study uses several existing algorithms in Machine Learning such as K-Nearest Neighbor, Random Forest Classifier, Logistic Regression, Linear SVM, Naïve Bayes, Decision Tree, Random Forest, Gradient Boosting, Kernel SVM, and MLPClassifier. In addition, this research was conducted to see whether the results of the accuracy of the algorithm that the researchers carried out using the lung cancer dataset had different results. The results of this study found that the more accurate algorithms were Random Forest and Gradient Boosting with an accuracy value of 100%, whereas in previous studies, it was the same. Still, Gradient Boosting had a higher accuracy value than Random Forest. Then, based on the data used in this study, the most influencing factors in predicting a diagnosis of lung cancer are obesity and coughing up blood. The results of this study found that the more accurate algorithms were Random Forest and Gradient Boosting with an accuracy value of 100%, whereas in previous studies, it was the same. Still, Gradient Boosting had a higher accuracy value than Random Forest. Then, based on the data used in this study, the most influencing factors in predicting a diagnosis of lung cancer are obesity and coughing up blood. The results of this study found that the more accurate algorithms were Random Forest and Gradient Boosting with an accuracy value of 100%, whereas in previous studies, it was the same. Still, Gradient Boosting had a higher accuracy value than Random Forest. Then, based on the data used in this study, the most influencing factors in predicting a diagnosis of lung cancer are obesity and coughing up blood.

Diabetes Mellitus is a chronic disease that has a huge impact on human life. The changes in the body occur due to various factors such as age, Body Mass Index, glucose level, pregnancy, etc. The increase in the complexity of the problem has inspired many researchers to acquire more knowledge on Type-2 Diabetes Mellitus using Machine Learning Techniques. The algorithms such as Decision Tree (DT), K-Nearest Neighbour (KNN), Random Forest (RF), Naive Bayes (NB), Support Vector Machine (SVM), Gradient Boosting Machine (GBM), and Light Gradient Boosting Machine (LGBM) can be used. These classifiers are implemented to identify the best working model. A set of two or more classifiers can also be used as an ensemble model to determine performance in predicting Diabetes. The Pima Indian Dataset is extracted from the UCI Repository for the study. The performance metrics used for evaluation are accuracy score, five-fold cross-validation, precision, and Receiver operating characteristics curve. The proposed model is an ensemble model using LGBM, GBM, and RF Classifiers. The concepts of Bagging and Boosting are incorporated to reduce high variance and bias. A voting classifier can also be used to identify the result based on the probability of the output. The results obtained from the experimental analysis indicates that the accuracy obtained from the prediction ensemble-model provides better results than the Traditional Machine Learning model.

PurposeThis study aims to emphasize utilization of Predictive Six Sigma to achieve process improvements based on machine learning (ML) techniques embedded in define, measure, analyze, improve, control (DMAIC). With this aim, this study presents selection and utilization of ML techniques, including multiple linear regression (MLR), artificial neural network (ANN), random forests (RF), gradient boosting machines (GBM) and k-nearest neighbors (k-NN) in the analyze and improve phases of Six Sigma DMAIC.Design/methodology/approachA data set containing 320 observations with nine input and one output variables is used. To achieve the objective which was to decrease the number of fabric defects, five ML techniques were compared in terms of prediction performance and best tools were selected. Next, most important causes of defects were determined via these tools. Finally, parameter optimization was conducted for minimum number of defects.FindingsAmong five ML tools, ANN, GBM and RF are found to be the best predictors. Out of nine potential causes, “machine speed” and “fabric width” are determined as the most important variables by using these tools. Then, optimum values for “machine speed” and “fabric width” for fabric defect minimization are determined both via regression response optimizer and ANN surface optimization. Ultimately, average defect number was decreased from 13/roll to 3/roll, which is a considerable decrease attained through utilization of ML techniques in Six Sigma.Originality/valueAddressing an important gap in Six Sigma literature, in this study, certain ML techniques (i.e. MLR, ANN, RF, GBM and k-NN) are compared and the ones possessing best performances are used in the analyze and improve phases of Six Sigma DMAIC.

Given the exponential availability of data in health centers and the massive sensorization that is expected, there is an increasing need to manage and analyze these data in an effective way. For this purpose, data mining (DM) and machine learning (ML) techniques would be helpful. However, due to the specific characteristics of the field of healthcare, a suitable DM and ML methodology adapted to these particularities is required. The applied methodology must structure the different stages needed for data-driven healthcare, from the acquisition of raw data to decision-making by clinicians, considering the specific requirements of this field. In this paper, we focus on a case study of cervical assessment, where the goal is to predict the potential presence of cervical pain in patients affected with whiplash diseases, which is important for example in insurance-related investigations. By analyzing in detail this case study in a real scenario, we show how taking care of those particularities enables the generation of reliable predictive models in the field of healthcare. Using a database of 302 samples, we have generated several predictive models, including logistic regression, support vector machines, k-nearest neighbors, gradient boosting, decision trees, random forest, and neural network algorithms. The results show that it is possible to reliably predict the presence of cervical pain (accuracy, precision, and recall above 90%). We expect that the procedure proposed to apply ML techniques in the field of healthcare will help technologists, researchers, and clinicians to create more objective systems that provide support to objectify the diagnosis, improve test treatment efficacy, and save resources.

Background: Transitioning from metastatic castration-sensitive prostate cancer (mCSPC) to its resistant variant poses risks of intensified medication, toxic side effects, and financial burdens for men undergoing treatment. Our study proposes a multimodal approach that integrates clinical, pathological, and genomic features to optimize prediction of metastatic castration-resistant prostate cancer (mCRPC) events. By applying machine learning (MML) techniques to multimodal data, we aim to stratify these patients based on the risk of developing mCRPC, contributing to the development of safer and personalized treatment strategies. Methods: We analyzed a large cohort of patients with mCSPC (n=399) with a minimum of 36 month follow-up, annotated with clinical, pathological, and genomic features, encompassing relevant variables such as disease volume, PSA, metastases timing, variant classification, Grade Group, fraction of genome altered, MSI score, mutation counts, karyotypes, tumor mutational burden, and purity. Using a multimodal machine learning framework, we extracted informative features and employed eight distinct machine learning algorithms: K-Nearest Neighbor, Support Vector Machine, Decision Tree, and Logistic Regression, Support Vector Machine with RBF Kernel, Random Forest, and Gradient Boosting, in addition to a Deep Neural Networks architecture for building predictive models in supervised binary classification experiments. The models' performance was evaluated on separate training (80%) and testing sets (20%), and standard evaluation metrics, such as the area under the receiver operating characteristic curve (AUROC), and accuracy, were computed. Correlations were utilized to explore the relationships between features, and permutation analysis was employed to determine the importance of predictors. All raw data included in the analysis are available on cBioPortal database. The study is supported by the NIH-NCI-T32 for Next Generation Pathologists Program at our institution. Results: Of the 399 mCSPC patients, 56% developed castration resistance, 50% had Grade Group 5 disease, and 69% exhibited missense mutations. In a series of 8 experiments, the Support Vector Machine with RBF Kernel ensemble model and SVC exhibited the highest performance with an AUROC score of 0.77, while the remaining models tested in the study demonstrated AUROC scores ranging from 0.62 to 0.75. Notably, the fraction of altered genome emerged as the top-ranked predictor, displaying the highest importance score. Conclusions: Our study demonstrates the strong predictive performance of MML models in accurately identifying mCRPC events by leveraging routine clinical, pathological, and genomic data, offering valuable guidance for optimizing patient stratification and tailoring personalized therapeutic interventions. Citation Format: Mohammad K. Alexanderani, Francesca Khani, Matthew Greenblatt, Brian Robinson, Massimo Loda, Luigi Marchionni. Optimizing prediction of metastatic castration-resistant prostate cancer: Multimodal fusion of clinicopathological and genomic features with machine learning [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 7286.

Child mortality is a big problem around the world, especially in low- and middle-income nations where there are big differences in health care and social conditions. This investigation seeks to create a predictive model for child mortality and pinpoint the key factors that significantly contribute to it, employing machine learning (ML) methodologies. The dataset includes various features such as parental age, maternal education, birth weight, wealth index, and access to healthcare services. Thirteen machine learning classifiers were used, categorized into four model groups: Traditional Models (Logistic Regression, K-Nearest Neighbors, Support Vector Machine, Naive Bayes), Tree-Based Models (Decision Tree, Random Forest, Extra Trees), Boosting Models (AdaBoost, Gradient Boosting, XGBoost), and Ensemble Learning Models (Soft Voting, Hard Voting, Stacking). The efficacy of each model was assessed using classification metrics, including Accuracy, Precision, Recall, and F1-Score within a 10-fold cross-validation framework to guarantee robustness. Results indicate that ensemble models, particularly AdaBoost, achieved the highest predictive accuracy, with perfect scores across all metrics (1.00). XGBoost and Stacking also demonstrated strong and consistent performance. The findings indicate that ensemble learning methods are effective in predicting child mortality and can assist policymakers and healthcare planners in identifying high-risk populations and implementing targeted interventions to reduce child mortality.

In recent times, it has been observed that social media exerts a favorable influence on consumer purchasing behavior. Many organizations are adopting the utilization of social media platforms as a means to promote products and services. Hence, it is crucial for enterprises to understand the consumer buying behavior in order to thrive. This article presents a novel approach that combines the theory of planned behavior (TPB) with machine learning techniques to develop accurate predictive models for consumer purchase behavior. This study examines three distinct factors of the theory of planned behavior (attitude, social norm, and perceived behavioral control) that provide insights into the primary determinants influencing online purchasing behavior. A total of eight machine learning algorithms, namely K-nearest neighbor, Decision Tree, Random Forest, Logistic Regression, Naive Bayes, Support Vector Machine, AdaBoost, and Gradient Boosting, were utilized in order to forecast consumer purchasing behavior. Empirical findings indicate that gradient boosting demonstrates superior performance in predicting customer buying behavior, with an accuracy rate of 0.91 and a macro F1 score of 0.91. This holds true when all factors, namely attitude (ATTD), social norm (SN), and perceived behavioral control (PBC), are included in the analysis. Furthermore, we incorporated Explainable AI (XAI), specifically LIME (Local Interpretable Model-Agnostic Explanations), to elucidate how the best machine learning model (i.e. gradient boosting) makes its prediction. The findings indicate that LIME has demonstrated a high level of confidence in accurately predicting the influence of low and high behavior. The outcome presented in this article has several implications. For instance, this article presents a novel way to combine the theory of planned behavior with machine learning techniques in order to predict consumer purchase behavior. This integration allows for a comprehensive analysis of factors influencing online purchasing decisions. Also, the incorporation of Explainable AI enhances the transparency and interpretability of the model. This feature is valuable for organizations seeking insights into factors driving predictions and the reasons behind certain outcomes. Moreover, these observations have the potential to offer valuable insights for businesses in customizing their marketing strategies to align with these influential factors.

Diabetes is a major chronic syndrome caused by a series of metabolic abnormalities in which blood glucose levels are abnormally high for an indeterminate amount of time. It influences various organs in the human body, resulting in a variety of complex diseases such as stroke, renal disease, pulmonary embolism, eyesight, and so on. Diabetes Disorders (DD) are presently one of the healthcare top causes of mortality. Predictive analytics in the health care system is a huge obstacle, but if accurate early prediction is achieved, the potential risk and degree of diabetes may be significantly decreased. Machine learning (ML) techniques are now used to analyze medical datasets at an earlier stage of life in keeping people safe. In this research, we utilized several ML approaches notably Logistic Regression, Decision Tree (DT), XGBoost, Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Random Forest (RF) on PIMA Indian Diabetes Dataset in order to monitor and evaluate their performances in diabetes prediction. The performance of the various ML algorithms employed in this research suggests which algorithm is most suitable in diabetes prediction. It is observed that among all the models XGBoost had outperformed the other ML techniques with an accuracy of 80.73% while SVM was the second-best performing model with a classification accuracy of 80.21%. Thus, employing ML techniques, this study aims to assist doctors as well as clinicians in the early detection of diabetes.

Sub-Saharan Africa continues to shoulder the heaviest burden of malaria. The 2024 World Health Organisation (WHO) malaria report highlighted that Africa contributed an alarming 94% of the global cases and 95% of the deaths. In the WHO African region, progress towards elimination and management of malaria is hindered by weak health systems and a lack of traditional diagnostic methods such as microscopy and malaria Rapid Diagnostic Tests (mRDTs). The primary aim of this paper is to develop a machine learning (ML) ensemble model for malaria diagnosis using clinical and demographic data, tailored for resource-limited settings. A retrospective study was conducted using 637 patient records from Gutu Mission Hospital and Gweru Provincial Hospital in Zimbabwe. Clinical symptoms (fever, chills, abdominal pain, headache and diarrhea) and demographic features (age, gender, residence and travel history) were analysed. Data preprocessing included handling class imbalance using the Synthetic Minority Oversampling Technique (SMOTE) and feature selection using Recursive Feature Elimination (RFE). Seven individual ML models, including Logistic regression (LR), Random Forest (RF), Decision Trees (DT), Gradient Boosting (GB), K-Nearest Neighbour (KNN), Naive Bayes (NB) and XGBoost were trained and evaluated on the malaria dataset. The individual models were further combined to build, train and evaluate ensemble models such as Bagging, Stacking, Soft Voting and AdaBoost. Model performance was assessed using accuracy, precision, confusion matrices, recall, F1 score, and AUC-ROC metrics. Clinical symptoms (chills: p-value=0.001, fever: p=0.003, diarrhea: p=0.01, abdominal pain: p< 0.001) were statistically significant predictors of malaria. Of the demographic factors, only travel history (p=0.02) showed a significant association with malaria. Among the seven individual ML models, GB achieved the highest predictive performance (Accuracy =0.94), followed by RF (Accuracy =0.94) and XGBoost (Accuracy =0.93). The stacking ensemble model outperformed all individual ML models and other ensemble models (bagging, soft voting and AdaBoost), achieving accuracy =0.96, precision =0.95, recall =0.98, F1 score =0.96 and AUC-ROC =0.98. This study demonstrates that ML, particularly ensemble models, can be used to improve malaria diagnosis significantly. The integration of these models into a web-based application could provide a scalable and accessible diagnostic tool for healthcare workers in resource-limited settings.

Smart cities are centres of economic opulence and hope for standardized living. Understanding the shades of urban resilience and livability in smart city models is of paramount importance. This study presents a novel two-stage data-driven framework combining a multivariate metric-distance analysis with machine learning (ML) techniques for resilience and livability assessment of smart cities. A longitudinal dataset for 35 top-ranked European smart cities from 2015 till 2020 applied as the case study under the proposed framework. Initially, a metric distance-based weighting approach is used to weight the indicators and quantify the scores across each aspect under city resilience and urban livability. The key aspects under city resilience include social, economic, infrastructure and built environment and, institutional resilience, while under urban livability, the aspects include accessibility, community well-being, and economic vibrancy. Fuzzy c-means clustering as an unsupervised machine learning technique is used to sort smart cities based on the degree of performance. In addition, an intelligent approach is presented for the prediction of the degree of livability, resilience, and aggregate performance of smart cities based on various supervised ML techniques. Classification models such as Naïve Bayes, k-nearest neighbors (kNN), support vector machine (SVM), Classification and Regression Tree (CART) and, ensemble models including Random Forest (RF) and Gradient Boosting machine (GBM) were used. Three coefficients (accuracy, Cohen's Kappa (κ) and average area under the precision-recall curve (AUC-PR)) along with confusion matrix were used to appraise the performance of the classifier ML models. The results revealed GBM as the best classification and predictive model for the resilience, livability, and aggregate performance assessment. The study also revealed Copenhagen, Geneva, Stockholm, Munich, Helsinki, Vienna, London, Oslo, Zurich, and Amsterdam as the smart cities that co-create resilience and livability in their development model with superior performance.

Using speech data, it is difficult to learn through machine learning how to diagnose Parkinson's disease (PD) and evaluate the effects of treatment. For this issue, the article has developed a three-stage PD discovery method. The base classifiers used in the initial stage are logistic regression (LR), K-nearest neighbor (KNN), naive bayes (NB), support vector machine (SVC), and decision tree (DT). The second stage, or stack model, is a meta-model that combines all of the classifiers mentioned earlier. The third stage ensemble model consists of Bagging, AdaBoost, Random Forest (RF), and Gradient Boosting (GBC) components. The RF and GBC classifiers are utilized to estimate the most important features from the PD dataset. The models' validation has been evaluated using the confusion matrix and validation metrics like precision, recall, and F1 score. Out of all the ensemble models, the GBC—the third model—had the highest accuracy with testing data—97.43%. KNN from the base model and stacking from the meta-model, on the other hand, had the highest accuracy, with 94.87% each. Out of all the models mentioned in this manuscript, the GBC is the only ensemble model classifier with the highest accuracy. The proposed classifier appears to be an extremely useful model for the discovery of Parkinson's disease, as demonstrated by the exploratory findings and factual analyses.

The nuclear industry is exploring applications of machine learning, including autonomous control and management of reactors and nuclear power plant and their components. The accurate diagnosis and classification of motor bearing faults under diverse operating conditions remain a significant challenge due to the complex nature of signal patterns, overlapping features, and dynamic environments. This study presents a comprehensive comparative analysis of multiple machine learning algorithms, including Random Forest, Gradient Boosting Machine, Decision Tree, Support Vector Machine (SVM), and K-Nearest Neighbours (KNN), applied to the HUST bearing dataset. This work also underscores the importance of load-dependent analysis, as fault signatures in bearings vary significantly with operating conditions. Experimental results indicate that ensemble models, particularly Random Forest, deliver superior performance across both binary and multi-class classification tasks, achieving up to 99.70% accuracy for 7-class cases and 99.37% for 21-class scenarios. Performance metrics further highlight the Random Forest model’s robustness, achieving 99.37% precision, recall, and F1-score with 15 features, confirming its suitability for real-time predictive maintenance applications. This study emphasises the importance of appropriate segmentation strategies and model selection, offering a reliable and scalable framework for industrial fault diagnostics and condition monitoring systems.

Gender classification is one of the major challenges in the domain of speech analysis now-a-days. Identification of gender from acoustic properties of voice such as mean, median, and frequency, is of high importance. Machine learning is used to solve this problem because it gives promising results for classification techniques. There are several algorithms that can be used to predict the gender using acoustic properties. In this work, classifiers are evaluated using 6 different machine learning algorithms. These algorithms include K-Nearest Neighbor (KNN), Decision Tree (DT), Random Forest (RF), and Support Vector Machine (SVM), Support Vector Machine Using Poly kernel and Gradient Boosting (GB). For the same voice sample dataset, the accuracy, recall, precision and F1 Score are computed for all the above-mentioned classifiers. The accuracy obtained from KNN is 96.71, DT is 93.33%, Random Forest is 97.72%, SVM is 98.48%, SVM using Poly Kernel is 97.72%, Gradient Boosting is 96.96%. The predicted values of the considered evaluation metrices on test data for all above classifiers evidenced the supremacy of SVM classifier as it is best fitted model for gender identification of acoustic. SVM attained the accuracy of 98.48% which is the highest among all.

Harmful Algal Blooms (HABs), driven by environmental pollution, pose significant threats to water quality, public health, and aquatic ecosystems. This study aims to enhance the prediction of HABs in Lake Erie, part of the Great Lakes system, by utilizing ensemble machine learning (ML) models coupled with explainable artificial intelligence (XAI) for interpretability. Using water quality data from 2013 to 2020, various physical, chemical, and biological parameters were analyzed to predict chlorophyll-a (Chl-a) concentrations, a proxy for algal blooms. The study employed multiple ensemble ML models, including Random Forest (RF), Deep Forest (DF), Gradient Boosting (GB), and XGBoost, and compared their performance against individual models such as Support Vector Machine (SVM), Decision Tree (DT), and Multi-Layer Perceptron (MLP). The findings reveal that ensemble models, particularly XGBoost and Deep Forest (DF), achieve superior predictive accuracy with R² values of 0.8517 and 0.8544, respectively. The application of SHapley Additive exPlanations (SHAP) provided insights into the relative importance of input features, identifying Particulate Organic Nitrogen (PON), Particulate Organic Carbon (POC), and Total Phosphorus (TP) as critical factors influencing Chl-a concentrations. This research demonstrates the effectiveness of integrating ensemble ML models with XAI to improve HAB prediction accuracy and interpretability. The results support the development of proactive water quality management strategies and highlight the potential of advanced ML techniques in environmental monitoring.