A Dataset Centric Feature Selection and Stacked Model to Detect Breast Cancer

Background and aimsThe birth weight of a newborn is a crucial factor that affects their overall health and future well-being. Low birth weight (LBW) is a widespread global issue, which the World Health Organization defines as weighing less than 2,500 g. LBW can have severe negative consequences on an individual’s health, including neonatal mortality and various health concerns throughout their life. To address this problem, this study has been conducted using BDHS 2017–2018 data to uncover important aspects of LBW using a variety of machine learning (ML) approaches and to determine the best feature selection technique and best predictive ML model.MethodsTo pick out the key features, the Boruta algorithm and wrapper method were used. Logistic Regression (LR) used as traditional method and several machine learning classifiers were then used, including, DT (Decision Tree), SVM (Support Vector Machine), NB (Naïve Bayes), RF (Random Forest), XGBoost (eXtreme Gradient Boosting), and AdaBoost (Adaptive Boosting), to determine the best model for predicting LBW. The model’s performance was evaluated based on the specificity, sensitivity, accuracy, F1 score and AUC value.ResultsResult shows, Boruta algorithm identifies eleven significant features including respondent’s age, highest education level, educational attainment, wealth index, age at first birth, weight, height, BMI, age at first sexual intercourse, birth order number, and whether the child is a twin. Incorporating Boruta algorithm’s significant features, the performance of traditional LR and ML methods including DT, SVM, NB, RF, XGBoost, and AB were evaluated where LR, had a specificity, sensitivity, accuracy and F1 score of 0.85, 0.5, 85.15% and 0.915. While the ML methods DT, SVM, NB, RF, XGBoost, and AB model’s respective accuracy values were 85.35%, 85.15%, 84.54%, 81.18%, and 84.41%. Based on the specificity, sensitivity, accuracy, F1 score and AUC, RF (specificity = 0.99, sensitivity = 0.58, accuracy = 85.86%, F1 score = 0.9243, AUC = 0.549) outperformed the other methods. Both the classical (LR) and machine learning (ML) models’ performance has improved dramatically when important characteristics are extracted using the wrapper method. The LR method identified five significant features with a specificity, sensitivity, accuracy and F1 score of 0.87, 0.33, 87.12% and 0.9309. The region, whether the infant is a twin, and cesarean delivery were the three key features discovered by the DT and RF models, which were implemented using the wrapper technique. All three models had the identical F1 score of 0.9318. However, “child is twin” was recognized as a significant feature by the SVM, NB, and AB models, with an F1 score of 0.9315. Ultimately, with an F1 score of 0.9315, the XGBoost model recognized “child is twin” and “age at first sex” as relevant features. Random Forest again beat the other approaches in this instance.ConclusionsThe study reveals Wrapper method as the optimal feature selection technique. The ML method outperforms traditional methods, with Random Forest (RF) being the most effective predictive model for Low-Birth-Weight prediction. The study suggests that policymakers in Bangladesh can mitigate low birth weight newborns by considering identified risk factors.

Using speech data, it is difficult to learn through machine learning how to diagnose Parkinson's disease (PD) and evaluate the effects of treatment. For this issue, the article has developed a three-stage PD discovery method. The base classifiers used in the initial stage are logistic regression (LR), K-nearest neighbor (KNN), naive bayes (NB), support vector machine (SVC), and decision tree (DT). The second stage, or stack model, is a meta-model that combines all of the classifiers mentioned earlier. The third stage ensemble model consists of Bagging, AdaBoost, Random Forest (RF), and Gradient Boosting (GBC) components. The RF and GBC classifiers are utilized to estimate the most important features from the PD dataset. The models' validation has been evaluated using the confusion matrix and validation metrics like precision, recall, and F1 score. Out of all the ensemble models, the GBC—the third model—had the highest accuracy with testing data—97.43%. KNN from the base model and stacking from the meta-model, on the other hand, had the highest accuracy, with 94.87% each. Out of all the models mentioned in this manuscript, the GBC is the only ensemble model classifier with the highest accuracy. The proposed classifier appears to be an extremely useful model for the discovery of Parkinson's disease, as demonstrated by the exploratory findings and factual analyses.

A multi class random forest (MCRF) model for classification of small plant peptides

Indonesia holds vast tourism potential, including Nusa Penida, Bali, renowned for its natural beauty. However, the adoption of modern technology to support tourism promotion and management remains limited. This study aims to compare the performance of Support Vector Machine (SVM) with Radial Basis Function (RBF) kernel and Random Forest algorithms in classifying images of three main tourist attractions in Nusa Penida: Angel’s Billabong, Broken Beach, and Kelingking Beach. The dataset consists of 450 images processed using the Histogram of Oriented Gradients (HOG) method for feature extraction. Two data split scenarios (80:20 and 70:30) were applied to evaluate the algorithms based on accuracy, precision, recall, and F1-score metrics. The experimental results revealed that SVM with RBF kernel outperformed Random Forest in all scenarios, achieving the best results in the 70% training and 30% testing data split with an accuracy of 0.967, precision of 0.969, recall of 0.967, and F1-score of 0.967. While Random Forest demonstrated stable performance, it remained inferior to SVM with RBF kernel. This study concludes that SVM with RBF kernel is superior for image classification tasks, offering opportunities for implementing artificial intelligence technologies to advance the tourism sector in Indonesia.

Emotion recognition plays a pivotal role in advancing Human-Computer Interaction (HCI) by enabling systems to understand and respond to human emotional states. Among various modalities, Speech Emotion Recognition (SER) stands out as a non-invasive, cost-effective, and temporally efficient approach for detecting emotions. This study leverages the RAVDESS dataset, which provides high-quality audio recordings for emotion classification. The proposed methodology involves preprocessing audio signals to remove noise, extracting temporal and spectral features in both time and frequency domains, and implementing machine learning models for multi-class emotion classification. The study evaluates and compares the performance of several classification models, including Random Forest (RF), Multilayer Perceptron (MLP), Support Vector Machine (SVM), Convolutional Neural Networks (CNN), and Decision Trees (DT). Experimental results demonstrate promising accuracy levels, highlighting the potential of these machine learning techniques in SER. This research contributes to the integration of SER within Brain-Computer Interfaces (BCI) and other emotion-aware applications, paving the way for enhanced interactive systems. Keywords – Speech Emotion Recognition -Machine Learning - Random Forest -Multilayer Perceptron - Support Vector Machine - Convolutional Neural Networks - Decision Tree - RAVDESS Dataset

The look for methodologies that can make inferences from externally supplied data develop broad hypotheses that are subsequently used to create forecasts concerning future events is known as supervised machine learning (SML). This study examine machine learning (ML) classification strategies, compares supervised learning algorithms, and determines foremost efficient classification algorithm based on the data set, number of instances, and variables (features). ML with the Waikato Environment for Knowledge Analysis (WEKA) tool, 7 different machine learning algorithms were considered: Decision Table, Random Forest (RF), Naive Bayes (NB), support vector machine (SVM), neural networks (Perceptron), JRip, and Decision Tree (J48). Time it takes to make a design and be concise (accuracy) are factors on the one end, and the kappa statistic and Mean Absolute Error (MAE) are factors on the other. For supervised predictive machine learning to work, machine learning algorithms must be accurate, and error-free.KeywordsMachine learningMean absolute errorWEKADeep learning

(1) Background: Numerous variables could influence the risk of rectal cancer recurrence or metastasis, and machine learning (ML)-based algorithms can help us refine the risk stratification process of these patients and choose the best therapeutic approach. The aim of this study was to assess the predictive performance of 4 ML-based models for the prediction of local recurrence or distant metastasis in patients with locally advanced low rectal adenocarcinomas who underwent neoadjuvant chemoradiotherapy and surgical treatment; (2) Methods: Patients who were admitted at the first Oncologic Surgical Clinic from the Regional Institute of Oncology, Iasi, Romania were retrospectively included in this study between November 2019 and July 2023. Decision tree (DT), naïve Bayes (NB), support vector machine (SVM), and random forest (RF) were used to analyze imagistic, surgical, and pathological data retrieved from the medical files, and their predictive performance was assessed; (3) Results: The best predictive performance was achieved by RF when used to predict disease recurrence (accuracy: 90.85%) or distant metastasis (accuracy: 89.63%). RF was closely followed by SVM (accuracy for recurrence 87.8%; accuracy for metastasis: 87.2%) in terms of predictive performance. NB and DT achieved moderate predictive power for the evaluated outcomes; (4) Conclusions: Complex algorithms such as RF and SVM could be useful for improving the prediction of adverse oncological outcomes in patients with low rectal adenocarcinoma.

Objective: Using methylation characteristics of human genes to construct machine learning predictive models for screening cervical cancer and precancerous lesions. Methods: Human DNA methylation detection was performed on 224 cervical exfoliated cell specimens from the Cancer Hospital of the Chinese Academy of Medical Sciences, Tianjin Central Hospital of Gynecology Obstetrics, Xinmi Maternal and Child Health Hospital of Henan Province, West China Second Affiliated Hospital of Sichuan University, and Heping Hospital Affiliated to Changzhi Medical College collected during April 2014 and March 2015. The hypermethylated gene fragments related to cervical cancer were selected by high-density, high-association, and hypermethylated gene fragment screening and the LASSO regression algorithm. Taking cervical intraepithelial neoplasia grade 2 (CIN2) or more severe lesions as the research outcome, machine learning predictive models based on the random forest (RF), naive Bayes (NB), and support vector machine (SVM) algorithm, respectively, were constructed. A total of 144 outpatient specimens were used as the training set and 80 cervical exfoliated cell specimens from women participating in the cervical cancer screening program were used as the test set to verify the predictive models. Using histological diagnosis results as the gold standard, the detection efficacy for CIN2 or more severe lesions of the three machine learning predictive models were compared with that of the human papilloma virus (HPV) detection and cytological diagnosis. Results: In the training set of 144 cases, there were 34 cases of HPV positivity, with a positive rate of 23.61%. Cytologically, there were 37 cases diagnosed as no intraepithelial lesion or malignancy (NILM), and 107 cases diagnosed as atypical squamous cells of undetermined significance (ASC-US) or above. Histologically, there were 28 cases without cervical intraepithelial neoplasia or benign cervical lesions, 31 cases of CIN1, 18 cases of CIN2, 31 cases of CIN3, and 36 cases of squamous cell carcinoma. Seven hypermethylated gene fragments were selected from 45 genes, and three machine learning prediction models based on the RF, NB, and SVM algorithm, respectively, were constructed. In the validation set of 80 cases, there were 28 cases of HPV positivity, with a positive rate of 35.00%. Cytologically, there were 65 cases diagnosed as NILM and 15 cases as ASC-US or above. Histologically, there were 39 cases without cervical intraepithelial neoplasia or benign cervical lesions, 10 cases of CIN1, 10 cases of CIN2, 11 cases of CIN3, and 10 cases of squamous cell carcinoma. In the validation set, the area under the curve (AUC) values of the RF model, NB model, SVM model, HPV detection, and cytological diagnosis of CIN2 or above were 0.90, 0.88, 0.82, 0.68, and 0.45, respectively. The DeLong test showed that there was no statistically significant difference in the AUC values between the RF, NB, and SVM models (all P＞0.05), and the AUC values of the RF and NB models were higher than that of HPV detection (both P＜0.01), and the AUC values of the RF, NB, and SVM models were higher than that of cytological diagnosis (all P＜0.01). Compared with the NB model, the sensitivity of the RF model was similar (80.65% vs. 77.42%), but the specificity of the NB model was much higher than that of the RF model (93.88% vs. 73.47%). Conclusion: Among the machine learning prediction models for cervical cancer and precancerous lesions constructed based on human DNA methylation, the NB model has good predictive performance for CIN2 and above lesions, and may be used for screening of cervical cancer and precancerous lesions.

Parking space management has become a critical challenge in urban areas due to increasing vehicle numbers and limited parking infrastructure. This paper presents a comprehensive study of machine learning (ML) models in IoT‐enabled environments focusing on proposing an ML‐based model for predicting available parking space. The study evaluates the performance of various models including K‐nearest neighbors (KNNs), support vector machines (SVMs), random forest (RF), decision tree (DT), logistic regression (LR), and Naïve Bayes (NB) based on “precision, recall, accuracy, and F1‐score performance metrics”. The results obtained by implementing ML models on the data with 65% and 85% threshold values are compared to draw meaningful conclusions regarding their performance in predicting parking space availability. Among the evaluated models, random forest (RF) demonstrates superior performance with high precision, recall, accuracy, and F1‐score values. It showcases its effectiveness in accurately predicting parking space availability in the IoT‐enabled environment. On the other hand, models such as K‐nearest neighbors (KNNs), decision tree (DT), logistic regression (LR), and Naïve Bayes (NB) show relatively lower performance in complex parking scenarios. The paper concludes that the use of advanced predictive models, particularly random forest, significantly enhances the accuracy and reliability of IoT‐enabled parking management systems and also reduces the waiting time of the vehicles, leading to more efficient resource utilization, reduced traffic congestion in real‐time scenarios, and better user satisfaction in the IoT‐enabled environment.

Applying data mining techniques to classify patients with suspected hepatitis C virus infection

Machine learning (ML) is a subdivision of artificial intelligence in which the machine learns from machine-readable data and information. It uses data, learns the pattern and predicts the new outcomes. Its popularity is growing because it helps to understand the trend and provides a solution that can be either a model or a product. Applications of ML algorithms have increased drastically in G.I.S. and remote sensing in recent years. It has a broad range of applications, from developing energy-based models to assessing soil liquefaction to creating a relation between air quality and mortality. Here, in this paper, we discuss the most popular supervised ML models (classification and regression) in G.I.S. and remote sensing. The motivation for writing this paper is that ML models produce higher accuracy than traditional parametric classifiers, especially for complex data with many predictor variables. This paper provides a general overview of some popular supervised non-parametric ML models that can be used in most of the G.I.S. and remote sensing based projects. We discuss classification (Naïve Bayes (NB), Support Vector Machine (SVM), Random Forest (RF), Decision Trees (DT)) and regression models (Random Forest (RF), Support Vector Machine (SVM), Linear and Non-Linear) here. Therefore, the article can be a guide to those interested in using ML models in their G.I.S. and remote sensing based projects.

Background Malaria remains a major cause of illness and death among children under five in Nigeria, despite efforts to control transmission. Accurate and reliable prediction of malaria outbreaks is crucial for health authorities to take timely measures. This study aims to identify the most robust machine learning classification algorithms for predicting the status of malaria in children under five (0-59 months). Methods The 2021 Nigeria Malaria Indicator Survey (NMIS) included 10,655 children under five who were tested for malaria using the Rapid Diagnostic Test (RDT). Various machine learning models were explored, including Decision Trees, K-Nearest Neighbor, Naïve Bayes, Random Forest, Support Vector Machines, and Survey Logistic Regression, and their performance was evaluated through metrics such as accuracy, AUC, balanced accuracy, F1-Score, negative predictive value, precision, sensitivity, and specificity. Results Random Forest (RF) is the most robust and balanced classification model due to its superior accuracy (79%), precision (77%), recall (62%), F1-score (69%), and AUC (80%). Support Vector Machine (SVM) also demonstrated strong performance, particularly in accuracy (74%) and AUC (80%). Survey Logistic Regression (SLR) and Decision Tree (DT) offered moderate results but fell short compared to RF and SVM, indicating the need for further optimization. Naive Bayes (NB) and K-Nearest Neighbors (KNN) had limitations, making them less reliable for this task. Conclusion In conclusion, the study reveals that RF and SVM are the best classification models for predicting malaria status in children under five years old. RF is reliable and balanced, while SVM is preferred for recall. SLR and DT show potential but require optimization. NB and KNN have significant performance gaps, making them less suitable. These findings will help policymakers and malaria intervention programs address key factors, enabling more targeted public health interventions to reduce the malaria burden on young children and improve the well-being of vulnerable populations in Nigeria.

Machine learning (ML) models are cost-effective tools that can establish a prognosis by considering clinical, genomic, and histological data from breast cancer patients. In this study, we evaluate the performance of 12 ML models in predicting the overall survival of breast cancer patients from “The Cancer Genome Atlas-Breast Cancer” database at 60 months of follow-up. The models evaluated were Logistic Regression (LR), Ridge Classifier (RC), Least Absolute Shrinkage and Selection Operator (LASSO), K-Nearest Neighbors (KNN), Naive Bayes (NB), Linear Discriminant Analysis (LDA), Decision Tree (DT), Multilayer Perceptron (MP), Stochastic Gradient Descent (SGD), Support Vector Machine (SVM), Random Forest (RF), and XGBoost (XGB). The most accurate models were NB (86.76%) and SGD (85.29%). The models with the highest sensitivity were SGD (93.75%), MP (91.67%), and NB (89.89%), while the models with the highest specificity were KNN (95.0%), DT (90.0%), and LASSO (85.0%). The models with the highest area under the ROC curve were LDA (90.83%), LASSO (90.1%), and LR (89.79%). The most relevant variables were “Previous Diagnosis of Cancer,” “Presence of Tumor,” “Ancillary Therapy,” and “Histology.” Our findings demonstrate that AI tools for predicting patient outcomes are a viable option when expensive prognostic genomic tools are not available. According to our results, NB and LASSO show promising performance in predicting the prognosis of breast cancer patients. Further studies with data from developing countries are needed to improve the performance of these tools.

Background: Transitioning from metastatic castration-sensitive prostate cancer (mCSPC) to its resistant variant poses risks of intensified medication, toxic side effects, and financial burdens for men undergoing treatment. Our study proposes a multimodal approach that integrates clinical, pathological, and genomic features to optimize prediction of metastatic castration-resistant prostate cancer (mCRPC) events. By applying machine learning (MML) techniques to multimodal data, we aim to stratify these patients based on the risk of developing mCRPC, contributing to the development of safer and personalized treatment strategies. Methods: We analyzed a large cohort of patients with mCSPC (n=399) with a minimum of 36 month follow-up, annotated with clinical, pathological, and genomic features, encompassing relevant variables such as disease volume, PSA, metastases timing, variant classification, Grade Group, fraction of genome altered, MSI score, mutation counts, karyotypes, tumor mutational burden, and purity. Using a multimodal machine learning framework, we extracted informative features and employed eight distinct machine learning algorithms: K-Nearest Neighbor, Support Vector Machine, Decision Tree, and Logistic Regression, Support Vector Machine with RBF Kernel, Random Forest, and Gradient Boosting, in addition to a Deep Neural Networks architecture for building predictive models in supervised binary classification experiments. The models' performance was evaluated on separate training (80%) and testing sets (20%), and standard evaluation metrics, such as the area under the receiver operating characteristic curve (AUROC), and accuracy, were computed. Correlations were utilized to explore the relationships between features, and permutation analysis was employed to determine the importance of predictors. All raw data included in the analysis are available on cBioPortal database. The study is supported by the NIH-NCI-T32 for Next Generation Pathologists Program at our institution. Results: Of the 399 mCSPC patients, 56% developed castration resistance, 50% had Grade Group 5 disease, and 69% exhibited missense mutations. In a series of 8 experiments, the Support Vector Machine with RBF Kernel ensemble model and SVC exhibited the highest performance with an AUROC score of 0.77, while the remaining models tested in the study demonstrated AUROC scores ranging from 0.62 to 0.75. Notably, the fraction of altered genome emerged as the top-ranked predictor, displaying the highest importance score. Conclusions: Our study demonstrates the strong predictive performance of MML models in accurately identifying mCRPC events by leveraging routine clinical, pathological, and genomic data, offering valuable guidance for optimizing patient stratification and tailoring personalized therapeutic interventions. Citation Format: Mohammad K. Alexanderani, Francesca Khani, Matthew Greenblatt, Brian Robinson, Massimo Loda, Luigi Marchionni. Optimizing prediction of metastatic castration-resistant prostate cancer: Multimodal fusion of clinicopathological and genomic features with machine learning [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 7286.

Advancement in technology has helped people to live a long and better life. But the increased life expectancy has also elevated the risk of age related disorders, especially the neurodegenerative disorders. Alzheimer’s is one such neurodegenerative disorder, which is also the leading contributor towards dementia in elderly people. Despite of extensive research in this field, scientists have failed to find a cure for the disease till date. This makes early diagnosis of Alzheimer’s very crucial so as to delay its progression and improve the condition of the patient. Various techniques are being employed for diagnosing Alzheimer’s which include neuropsychological tests, medical imaging, blood based biomarkers, etc. Apart from this, various machine learning algorithms have been employed so far to diagnose Alzheimer’s in its early stages. In the current research, authors compared the performance of various machine learning techniques i.e., Linear Discriminant Analysis (LDA), K-Nearest Neighbour (KNN), Naïve Bayes (NB), Support Vector Machines (SVM), Decision Trees (DT), Random Forests (RF) and Multi Layer Perceptron (MLP) on Alzheimer’s dataset. This paper experimentally demonstrated that normalization exhibits a predominant role in enhancing the efficiency of some machine learning algorithms. Therefore it becomes imperative to choose the algorithms as per the available data. In this paper, the efficiency of the given machine learning methods was compared in terms of accuracy and f1-score. Naïve Bayes gave a better overall performance for both accuracy and f1-score and it also remained unaffected with the normalization of data along with LDA, DT and RF. Whereas KNN, SVM and MLP showed a drastic (17% to 86%) improvement in the performance when they are given normalized data as compared to un-normalized data from Alzheimer’s dataset.