Exploring sex classification from earprints - A comparison of supervised machine learning algorithms and conventional linear discriminant analysis.

Gesture recognition is a topic in computer science and language technology that aims to interpret human gestures with computer programs and many different algorithms. It can be seen as the way computers can understand human body language. Today, the main interaction tools between computers and humans are still the keyboard and mouse. Gesture recognition can be used as a tool for communication with the machine and interaction without any mechanical device such as a keyboard or mouse. In this paper, we present the results of a comparison of eight different machine learning (ML) classifiers in the task of human hand gesture recognition and classification to explore how to efficiently implement one or more tested ML algorithms on an 8-bit AVR microcontroller for on-line human gesture recognition with the intention to gesturally control the mobile robot. The 8-bit AVR microcontrollers are still widely used in the industry, but due to their lack of computational power and limited memory, it is a challenging task to efficiently implement ML algorithms on them for on-line classification. Gestures were recorded by using inertial sensors, gyroscopes, and accelerometers placed at the wrist and index finger. One thousand and eight hundred (1800) hand gestures were recorded and labelled. Six important features were defined for the identification of nine different hand gestures using eight different machine learning classifiers: Decision Tree (DT), Random Forests (RF), Logistic Regression (LR), Linear Discriminant Analysis (LDA), Support Vector Machine (SVM) with linear kernel, Naïve Bayes classifier (NB), K-Nearest Neighbours (KNN), and Stochastic Gradient Descent (SGD). All tested algorithms were ranged according to Precision, Recall, and F1-score (abb.: P-R-F1). The best algorithms were SVM (P-R-F1: 0.9865, 0.9861, and 0.0863), and RF (P-R-F1: 0.9863, 0.9861, and 0.0862), but their main disadvantage is their unusability for on-line implementations in 8-bit AVR microcontrollers, as proven in the paper. The next best algorithms have had only slightly poorer performance than SVM and RF: KNN (P-R-F1: 0.9835, 0.9833, and 0.9834) and LR (P-R-F1: 0.9810, 0.9810, and 0.9810). Regarding the implementation on 8-bit microcontrollers, KNN has proven to be inadequate, like SVM and RF. However, the analysis for LR has proved that this classifier could be efficiently implemented on targeted microcontrollers. Having in mind its high F1-score (comparable to SVM, RF, and KNN), this leads to the conclusion that the LR is the most suitable classifier among tested for on-line applications in resource-constrained environments, such as embedded devices based on 8-bit AVR microcontrollers, due to its lower computational complexity in comparison with other tested algorithms.

This study applies machine learning (ML) techniques to classify fertile [for porphyry Cu and (or) Au systems] and barren adakites using geochemical data from New Brunswick, Canada. It emphasizes that not all intrusive units, including adakites, are inherently fertile and should not be directly used as the heat source evidence layer in mineral prospectivity mapping without prior analysis. Adakites play a crucial role in mineral exploration by helping distinguish between fertile and barren intrusive units, which significantly influence ore-forming processes. A dataset of 99 fertile and 66 barren adakites was analyzed using seven ML models: support vector machine (SVM), neural network, random forest (RF), decision tree, AdaBoost, gradient boosting, and logistic regression. These models were applied to classify 829 adakite samples from around the world into fertile and barren categories, with performance evaluated using area under the curve (AUC), classification accuracy, F1 score, precision, recall, and Matthews correlation coefficient (MCC). SVM achieved the highest performance (AUC = 0.91), followed by gradient boosting (0.90) and RF (0.89). For model validation, 160 globally recognized fertile adakites were selected from the dataset based on well-documented fertility characteristics. Among the tested models, SVM demonstrated the highest classification accuracy (93.75%), underscoring its effectiveness in distinguishing fertile from barren adakites for mineral prospectivity mapping. Statistical analysis and feature selection identified middle rare earth elements (REEs), including Gd and Dy, with Hf, as key indicators of fertility. A comprehensive analysis of 1596 scatter plots, generated from 57 geochemical variables, was conducted using linear discriminant analysis (LDA) to determine the most effective variable pairs for distinguishing fertile and barren adakites. The most informative scatter plots featured element vs. element combinations (e.g., Ga vs. Dy, Ga vs. Gd, and Pr vs. Gd), followed by element vs. major oxide (e.g., Fe2O3T vs. Gd and Al2O3 vs. Hf) and ratio vs. element (e.g., La/Sm vs. Gd, Rb/Sr vs. Hf) plots, whereas major oxide vs. major oxide, ratio vs. ratio, and major oxide vs. ratio plots had limited discriminatory power.

Background and aimsThe birth weight of a newborn is a crucial factor that affects their overall health and future well-being. Low birth weight (LBW) is a widespread global issue, which the World Health Organization defines as weighing less than 2,500 g. LBW can have severe negative consequences on an individual’s health, including neonatal mortality and various health concerns throughout their life. To address this problem, this study has been conducted using BDHS 2017–2018 data to uncover important aspects of LBW using a variety of machine learning (ML) approaches and to determine the best feature selection technique and best predictive ML model.MethodsTo pick out the key features, the Boruta algorithm and wrapper method were used. Logistic Regression (LR) used as traditional method and several machine learning classifiers were then used, including, DT (Decision Tree), SVM (Support Vector Machine), NB (Naïve Bayes), RF (Random Forest), XGBoost (eXtreme Gradient Boosting), and AdaBoost (Adaptive Boosting), to determine the best model for predicting LBW. The model’s performance was evaluated based on the specificity, sensitivity, accuracy, F1 score and AUC value.ResultsResult shows, Boruta algorithm identifies eleven significant features including respondent’s age, highest education level, educational attainment, wealth index, age at first birth, weight, height, BMI, age at first sexual intercourse, birth order number, and whether the child is a twin. Incorporating Boruta algorithm’s significant features, the performance of traditional LR and ML methods including DT, SVM, NB, RF, XGBoost, and AB were evaluated where LR, had a specificity, sensitivity, accuracy and F1 score of 0.85, 0.5, 85.15% and 0.915. While the ML methods DT, SVM, NB, RF, XGBoost, and AB model’s respective accuracy values were 85.35%, 85.15%, 84.54%, 81.18%, and 84.41%. Based on the specificity, sensitivity, accuracy, F1 score and AUC, RF (specificity = 0.99, sensitivity = 0.58, accuracy = 85.86%, F1 score = 0.9243, AUC = 0.549) outperformed the other methods. Both the classical (LR) and machine learning (ML) models’ performance has improved dramatically when important characteristics are extracted using the wrapper method. The LR method identified five significant features with a specificity, sensitivity, accuracy and F1 score of 0.87, 0.33, 87.12% and 0.9309. The region, whether the infant is a twin, and cesarean delivery were the three key features discovered by the DT and RF models, which were implemented using the wrapper technique. All three models had the identical F1 score of 0.9318. However, “child is twin” was recognized as a significant feature by the SVM, NB, and AB models, with an F1 score of 0.9315. Ultimately, with an F1 score of 0.9315, the XGBoost model recognized “child is twin” and “age at first sex” as relevant features. Random Forest again beat the other approaches in this instance.ConclusionsThe study reveals Wrapper method as the optimal feature selection technique. The ML method outperforms traditional methods, with Random Forest (RF) being the most effective predictive model for Low-Birth-Weight prediction. The study suggests that policymakers in Bangladesh can mitigate low birth weight newborns by considering identified risk factors.

Sex and species estimation from skeletal remains is important in veterinary forensic medicine, comparative anatomy, and zooarchaeology. Radiographic osteometry has been studied in dogs and cats, but machine-learning approaches have not been well evaluated for this purpose. To assess the performance of machine-learning models and a multilayer perceptron for estimating sex and species from radiographic femoral measurements in dogs and cats. This retrospective study analyzed pelvic radiographs of 280 animals (140 dogs and 140 cats; 70 males and 70 females of each species) using 9 radiographic measurements. Random forest, decision tree, logistic regression, extra trees, linear discriminant analysis, quadratic discriminant analysis, and a multilayer perceptron were evaluated. Feature importance was explored with Shapley additive explanations. For sex classification, the extra trees classifier showed the highest accuracy in both dogs (0.79) and cats (0.75). For species classification, logistic regression, quadratic discriminant analysis, and decision tree each achieved an accuracy of 0.89, whereas the multilayer perceptron reached 0.93 after 500 and 1,000 training cycles. The most influential variables were femoral length for sex classification in cats, left intercondylar fossa width for sex classification in dogs, and inter-femoral-head distance for species classification. Radiographic femoral measurements permit moderate sex classification and high species classification in dogs and cats. These findings support the potential use of machine-learning analysis of femoral radiographs in veterinary forensic medicine and related morphometric fields.

In cognitive radio networks (CRNs), collaborative spectrum sensing has emerged as a promising technique for detecting primary user activity. However, the effectiveness of user cooperation is compromised by the presence of malicious users, specifically False Sensing Users (FSUs). FSUs undermine the effectiveness of collaborative sensing by providing misleading information to the fusion center (FC) in an attempt to selfishly access spectrum resources. Therefore, this study focuses on three types of FSUs that exhibit distinct attack patterns: No False Sensing (NFS, i.e., Always-No), Yes False Sensing (YFS), and Yes/No false sensing (YNFS) users. The FC collects reports from both FSUs and legitimate sensing users at varying time intervals. This study employs a denoising autoencoder (DAE) to enhance sensing reliability by mitigating the effects of abnormal sensing reports and noise disturbances at the FC. While current validation employs synthetic data that closely approximates theoretical CRN conditions, real-world RF validation represents an important direction for future work. The autoencoder produces cleaned soft energy data, which is fed into a machine learning (ML) classifier to estimate channel availability and accumulate global decisions. The present study assesses the effectiveness of various classification techniques, including decision trees (DT), k nearest neighbor (KNN), neural networks (NN), ensemble classification (EC), Gaussian naive Bayes (GNB), and random forest classifier (RFC), to classify channel states. Additionally, this paper aims to provide a comprehensive evaluation of these methods. The integration of DAE and EC yields high accuracy, F1 score, and Matthew’s Correlation Coefficient (MCC), leading to a reliable global decision at the FC with minimal sensing error.

The classification model in machine learning has been employed to address different problems. Machine Learning classification is an effective method to realize customer churn prediction. This article provides a comparative study of machine learning from the perspective of predicting customer churn. Customer churn is one of the obstacles hindering the development of companies. Through classification approaches based on machine learning, customer churn can be predicted precisely, thus providing decision-making capabilities to these companies. Customer churn prediction is a typical classification problem and can be addressed by the use of a decision tree or random forest model. In this paper, decision tree and random forest models are employed to predict customer churn, using sales data provided by a chemical company from 2012 to 2020. We analyze the underlying risk of customer churn and the customer churn factors, including the low-priced count (LC), total amount of money (TM), and creation time (CT). The prediction results of the two models are evaluated by calculating various metrics. The experimental results indicate that the low-priced count (LC) is the most essential factor for customer churn. The results of the comparison, considering the training error and generalization error including: confusion matrix, ROC curve, AUC, precision, recall, and F1 score, reveal that the random forest model has better prediction accuracy than the decision tree model.

In recent years, COVID-19 has been regarded as the most dangerous pandemic for several countries. On various social media platforms, such as Twitter, Facebook, and Instagram, a variety of rumours, hypes, and news are published. This might have a detrimental impact on people’s life. As a result, social media platforms have always had a difficult time authenticating this fake information. Different machine learning (ML) and deep learning (DL) classifiers were used in this work to categorize the continuing impacts of tweets and forecast their after-effects. Support vector machine (SVM), random forest (RF), decision tree (DT), and k-nearest neighbor (KNN) were used for classification, while AdaBoost and convolutional neural network (CNN) were utilized for future effects. The tweets dataset from Kaggle was used to train the SVM, RF, KNN, and DT models, which were then assessed on multiple evaluation criteria such as accuracy, precision, recall, and F1-score, using a 70 : 30 ratio. The CNN and AdaBoost, on the other hand, have been taught to detect the mean square error, root mean square error, and mean absolute error. With 0.74 and 0.73 percent score out of 1, respectively, RF and SVM exhibit the best accuracy in impact when classifying the outcomes on the obtained dataset. In terms of a regression problem, CNN beat the ADA Regressor across the board.

Machine learning (ML) models are cost-effective tools that can establish a prognosis by considering clinical, genomic, and histological data from breast cancer patients. In this study, we evaluate the performance of 12 ML models in predicting the overall survival of breast cancer patients from “The Cancer Genome Atlas-Breast Cancer” database at 60 months of follow-up. The models evaluated were Logistic Regression (LR), Ridge Classifier (RC), Least Absolute Shrinkage and Selection Operator (LASSO), K-Nearest Neighbors (KNN), Naive Bayes (NB), Linear Discriminant Analysis (LDA), Decision Tree (DT), Multilayer Perceptron (MP), Stochastic Gradient Descent (SGD), Support Vector Machine (SVM), Random Forest (RF), and XGBoost (XGB). The most accurate models were NB (86.76%) and SGD (85.29%). The models with the highest sensitivity were SGD (93.75%), MP (91.67%), and NB (89.89%), while the models with the highest specificity were KNN (95.0%), DT (90.0%), and LASSO (85.0%). The models with the highest area under the ROC curve were LDA (90.83%), LASSO (90.1%), and LR (89.79%). The most relevant variables were “Previous Diagnosis of Cancer,” “Presence of Tumor,” “Ancillary Therapy,” and “Histology.” Our findings demonstrate that AI tools for predicting patient outcomes are a viable option when expensive prognostic genomic tools are not available. According to our results, NB and LASSO show promising performance in predicting the prognosis of breast cancer patients. Further studies with data from developing countries are needed to improve the performance of these tools.

Social determinants of health (SDOH) play a critical role in the onset and progression of chronic kidney disease (CKD). Despite the well-established role of SDOH, previous studies have not fully incorporated these factors in predicting CKD in Type 2 diabetes patients. To bridge this gap, this study aimed to develop and evaluate the machine learning (ML) models that incorporate SDOH to enhance CKD risk prediction in Type 2 diabetes patients. Data were obtained from the 2023 Behavioral Risk Factor Surveillance System (BRFSS), a national survey that collects comprehensive health-related data from adults across the United States. Missing data were addressed using the K-nearest neighbor imputation method, and the Synthetic Minority Oversampling Technique (SMOTE) was applied to balance class distributions. Potential predictive features were selected using correlation coefficient analysis. The dataset was partitioned into training (80%) and testing (20%) subsets, with a 3-fold cross-validation strategy applied to the training data. Seven ML models were developed for CKD risk prediction, including logistic regression (LR), decision tree (DT), K-nearest neighbor (KNN), random forest (RF), eXtreme Gradient Boosting (XGBoost), and an artificial neural network (ANN). Model performance was evaluated using multiple metrics, including the area under the receiver operating characteristic curve (AUROC), precision, recall, F1 score, accuracy, and false positive rate. The study included 19,912 Type 2 diabetes patients (weighted sample size: 818,878), among whom 2,924 (weighted 13.92%) had CKD, and 16,988 (weighted 86.08%) did not. Over half of the CKD group (50.4%) were aged 65 or older. The proportion of female patients was higher in both groups, comprising 53.8% of the CKD group and 50.5% of the non-CKD group. Among the ML models evaluated, the RF model demonstrated the highest predictive performance for CKD, with an AUROC of 0.89 (95% CI: 0.88 - 0.90), followed by the DT model (0.84, 95% CI: 0.83 - 0.85) and XGBoost (0.83, 95% CI: 0.82 - 0.84). The RF model achieved an accuracy of 0.81 (95%CI: 0.81 - 0.81), a precision of 0.79 (95%CI: 0.79 - 0.79), a recall of 0.85 (95%CI: 0.85 - 0.85), and an F1 score of 0.82 (95%CI: 0.82 - 0.82). Additionally, the RF model exhibited strong calibration, reinforcing its reliability as a predictive tool for CKD risk in individuals with Type 2 diabetes. The study findings underscore the potential of ML models, particularly the RF model, in accurately predicting CKD among individuals with Type 2 diabetes. This approach not only enhances the precision of CKD prediction but also highlights the importance of addressing social and environmental disparities in disease prevention and management. Leveraging ML models with SDOH can lead to earlier interventions, more personalized treatment plans, and improved health outcomes for vulnerable populations. The online version contains supplementary material available at 10.1007/s40200-025-01621-9.

Given the demand for developing the efficient Machine Learning (ML) classification models for healthcare data, and the potentiality of Bio-Inspired Optimization (BIO) algorithms to tackle the problem of high dimensional data, we investigate the range of ML classification models trained with the optimal subset of features of PD data set for efficient PD classification. We used two BIO algorithms, Genetic Algorithm (GA) and Binary Particle Swarm Optimization (BPSO), to determine the optimal subset of features of PD data set. The data set chosen for investigation comprises 756 observations (rows or records) taken over 755 attributes (columns or dimensions or features) from 252 PD patients. We employed MaxAbsolute feature scaling method to normalize the data and one hold cross-validation method to avoid biased results. Accordingly, the data is split in to training and testing set in the ratio of 70% and 30%. Subsequently, we employed GA and BPSO algorithms separately on 11 ML classifiers (Logistic Regression (LR), linear Support Vector Machine (lSVM), radial basis function Support Vector Machine (rSVM), Gaussian Naïve Bayes (GNB), Gaussian Process Classifier (GPC), k-Nearest Neighbor (kNN), Decision Tree (DT), Random Forest (RF), Multilayer Perceptron (MLP), Ada Boost (AB) and Quadratic Discriminant Analysis (QDA)), to determine the optimal subset of features (reduction of dimensionality) contributing to the highest classification accuracy. Among all the bio-inspired ML classifiers employed: GA-inspired MLP produced the maximum dimensionality reduction of 52.32% by selecting only 359 features and delivering 85.1% of the classification accuracy; GA-inspired AB delivered the maximum classification accuracy of 90.7% producing the dimensionality reduction of 41.43% by selecting only 441 features; And, BPSO-inspired GNB produced the maximum dimensionality reduction of 47.14% by selecting 396 features and delivering the classification accuracy of 79.3%; BPSOMLP delivered the maximum classification accuracy of 89% and produced 46.48% of the dimensionality reduction by selecting only 403 features.

Due to the rapid growth of android applications and mobile users in this technological era, there is a large increase in cyber attacks through mobile phones. During Pandemic period, mobile malware attacks are one of the top most cyber attacks observed in android mobile users to steal the user personal credentials by intrusion of adware, spyware, banking malware, SMS malware, riskware, viruses, Trojan horse, worms, keylogger and many more. Machine learning methods are very useful and amicable to detect mobile malwares. Automation of the mobile malware detection is the need of the hour and it is imperative to identify the most suitable machine learning techniques. This book entitled “Dynamic Analysis based Mobile Malware Classification using Supervised Machine Learning Methods” investigates the evaluation of supervised machine learning algorithms that are applied to detect and classify the mobile malwares. A systematic method of evaluation of supervised machine learning model to detect the malware data points and to classify them into binary classification as malware or benign is essential. The purpose of evaluating the supervised machine learning algorithms is to identify the best supervised machine learning model for mobile malware detection with high efficacy rate.  All important performance measures like Precision, Recall, F1 score, R2 score, Mean Absolute Error, Mean Squared Error and Root Mean Squared Error are applied and the entire experiments are conducted using benchmark dataset taken from kaggle community. Nine Supervised Machine Learning methods such as Decision Tree, Random Forest, K-Nearest Neighbor, Support Vector Machine, Naïve Bayes, AdaBoost, Multi-layer Perceptron, Logistic Regression and Linear Discriminant Analysis are experimented and the results are discussed. +

This study aimed to investigate whether establishing a machine learning (ML) model based on contrast-enhanced cone-beam breast computed tomography (CE-CBBCT) radiomic features could predict human epidermal growth factor receptor 2-positive breast cancer (BC). Eighty-eight patients diagnosed with invasive BC who underwent preoperative CE-CBBCT were retrospectively enrolled. Patients were randomly assigned to the training and testing cohorts at a ratio of approximately 7:3. A total of 1046 quantitative radiomics features were extracted from the CE-CBBCT images using PyRadiomics. Z-score normalization was used to standardize the radiomics features, and Pearson correlation coefficient and one-way analysis of variance were used to explore the significant features. Six ML algorithms (support vector machine, random forest [RF], logistic regression, adaboost, linear discriminant analysis, and decision tree) were used to construct optimal predictive models. Receiver operating characteristic curves were constructed and the area under the curve (AUC) was calculated. Four top-performing radiomic models were selected to develop the 6 predictive features. The AUC values for support vector machine, linear discriminant analysis, RF, logistic regression, adaboost, and decision tree were 0.741, 0.753, 1.000, 0.752, 1.000, and 1.000, respectively, in the training cohort, and 0.700, 0.671, 0.806, 0.665, 0.706, and 0.712, respectively, in the testing cohort. Notably, the RF model exhibited the highest predictive ability with an AUC of 0.806 in the testing cohort. For the RF model, the DeLong test showed statistically significant differences in the AUC between the training and testing cohorts (Z = 2.105, P = .035). The ML model based on CE-CBBCT radiomics features showed promising predictive ability for human epidermal growth factor receptor 2-positive BC, with the RF model demonstrating the best diagnostic performance.

The healthcare industry struggles with diagnosing health disorders and finding the right treatment for diseases at an earlier stage. Many diseases can be detected early and treated well. Thyroid malfunction is one such disease. One of the most important organs in both men and women is the thyroid gland, a vascular gland. This gland secretes the hormones that help to control the body's metabolism. Hyperthyroidism and hypothyroidism are two types of thyroid ailments. Clinical examination and numerous blood tests are necessary for the traditional methods of detecting thyroid disorders. The main aim is to more precisely identify thyroid dysfunction at an early stage. This research makes a study of a variety of classification approaches, including Decision Tree (DT), Support Vector Machine (SVM), Random Forest (RF), Naive Bayes (NB), Logistic Regression (LR), Linear Discriminant Analysis (LDA), K Nearest Neighbour (KNN) and Multi-Layer Perceptron (MLP), to predict thyroid illness as early as possible. This study majorly focuses on the performance metric accuracy observed from various Machine Learning (ML) classification Algorithms.

Heart attacks are one of the foremost causes of death in the world. While doctors can carry out multiple tests to diagnose it, it may go undetected for a long time which can prove fatal. However, it is possible to predict the potential risk of a heart attack using Machine Learning (ML) algorithms. This is done using patients' historical data and has found some success in the literature. However, not all features are equally important in such data which may result in low accuracy of prediction. In this study, we use feature selection techniques to select a subset of features with contribution to improve upon the prediction accuracy of ML models. Inforation theory based models are used for feature selection in combination with popular ML classifiers including Random forest (RF), Decision Trees (DTs), Logistic Regression (LR), k-nearest neighbors (kNN), Gradient Boosting, Bagging, Ensemble, Neural Network (NN) and Support Vector Machines (SVM). The model is tested the real-world and publicly available Framingham dataset. Results show that the proposed approach improves the prediction of heart disease compared to baseline models.

Mental health remains one of the most challenging public health concerns in the world, particularly in a developing country like Bangladesh. The objective of this study is to determine the key determinants of depression among ever-married women in Bangladesh. This study used 19,987 ever-married women aged 15-49 years in Bangladesh, from the 2022 Bangladesh Demographic and Health Survey (BDHS). The key features selection was selected by using Boruta algorithm. Total seven machine learning approaches, including Extreme Gradient Boosting (XGBoost), Random Forest (RF), Decision Tree (DT), Support Vector Machine (SVM), Logistic Regression (LR), K-Nearest Neighbour’s (KNN), and Neural Network (NN) were evaluated for predictive performance. All models were highly tuned with 5-fold cross-validation and tested on several complementary predictions including accuracy, precision, recall, F1 score, Matthews Correlation Coefficient (MCC), Cohen's Kappa, and Area Under the Receiver Operating Characteristic Curve (AUROC). The top-performing algorithm was observed XGBoost approach with the highest AUROC of 0.799, indicating strong discriminatory power between non-depressed and depressed women. Results from XGBoost approach revealed that anxiety, currently working, age group 45-49 years, internet user, menstruated last 6 weeks, pressure to pregnant, power of decision making etc. are most important determinants of the depression of married women in Bangladesh. International Journal of Statistical Sciences, Vol. 25(2), November, 2025, pp 33-46