An unsupervised cluster-based feature grouping model for early diabetes detection

Diabetes is a major chronic syndrome caused by a series of metabolic abnormalities in which blood glucose levels are abnormally high for an indeterminate amount of time. It influences various organs in the human body, resulting in a variety of complex diseases such as stroke, renal disease, pulmonary embolism, eyesight, and so on. Diabetes Disorders (DD) are presently one of the healthcare top causes of mortality. Predictive analytics in the health care system is a huge obstacle, but if accurate early prediction is achieved, the potential risk and degree of diabetes may be significantly decreased. Machine learning (ML) techniques are now used to analyze medical datasets at an earlier stage of life in keeping people safe. In this research, we utilized several ML approaches notably Logistic Regression, Decision Tree (DT), XGBoost, Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Random Forest (RF) on PIMA Indian Diabetes Dataset in order to monitor and evaluate their performances in diabetes prediction. The performance of the various ML algorithms employed in this research suggests which algorithm is most suitable in diabetes prediction. It is observed that among all the models XGBoost had outperformed the other ML techniques with an accuracy of 80.73% while SVM was the second-best performing model with a classification accuracy of 80.21%. Thus, employing ML techniques, this study aims to assist doctors as well as clinicians in the early detection of diabetes.

Graduation rates indicate school success. Predicting student graduation helps schools identify students in danger of dropping out and intervene early to enhance academic performance. It can also assist policymakers create graduation and dropout prevention initiatives. However, based on a literature search, predicting student graduation rates from admission test scores is difficult. School grades are a better predictor of timely tertiary graduation than acceptance test scores because college success requires cognitive abilities and self-regulation competencies, which are better indexed by school grades. Self-efficacy, school academic culture, and future expectations can also affect student graduation rates. Finally, the selective admissions modality needs to be refined. This study aims to (1) predict private high school graduation with eight algorithms: Random tree, Naïve Bayes Multinomial, Support Vector Machine (SVM), Random forest (RF), K-Nearest Neighbor, Ada Boost, Multilayer perceptron, Logistic regression, and (2) compare the performance of the eight algorithms. According to research, the Random tree, Naïve Bayes Multinomial, Random forest (RF), and Ada boost algorithms all perform at 99.49% for the first aim. For the second objective, the Random Tree approach outperforms other algorithms in Accuracy (99.49%), Precision (100%), F-Measure (99.74%), and consumption time (0 seconds). Therefore, the Random tree algorithm outperforms others. This research contributes in two ways: scientifically by testing eight algorithms—Random tree, Naïve Bayes Multinomial, Support Vector Machine (SVM), Random forest (RF), K-Nearest Neighbor, Ada Boost, Multilayer perceptron, and Logistic regression—to predict private high school graduation, and secondly by recommending school administrators to develop a selective enrollment model.

Diabetes mellitus remains a major global health issue, particularly in the United States, where complications from persistent hyperglycemia contribute to severe health outcomes. Although prior research has improved diabetes prediction models, there is still a need for more accurate and efficient machine learning approaches to support early diagnosis and timely intervention. This study explores early diabetes detection using machine learning techniques applied to electronic health records. Four supervised algorithms—Random Forest, Gradient Boosting, Support Vector Classifier (SVC), and K-Nearest Neighbors (KNN) were compared to identifying the most relevant predictive features and determining which model performs best across training, testing, and validation phases. Among the evaluated models, Random Forest and Gradient Boosting demonstrated the strongest and most consistent results, achieving training accuracy of approximately 82.5% and test accuracy around 82.2%. Although the KNN model showed high sensitivity (98.54%) and specificity (93.63%) in a separate assessment, its test accuracy in this study was slightly lower at 77.9%. The SVC model reached a test accuracy of 76.7%. Validation outcomes further confirmed the stability and generalizability of the Random Forest and Gradient Boosting models when applied to unseen data. Overall, the results indicate that ensemble methods deliver more accurate and reliable predictions for diabetes diagnosis compared to KNN and SVC, making them more suitable for clinical settings. While KNN performed well under certain conditions, ensemble techniques provided better generalization. Future work should expand the feature set and apply thorough hyperparameter optimization to improve predictive performance and enable more effective early detection and management of diabetes.

Oesophagectomy is an operation with a high risk of postoperative complications. The aim of this single-centre retrospective study was to apply machine-learning methods to predict complications (Clavien-Dindo grade IIIa or higher) and specific adverse events. Patients with resectable adenocarcinoma or squamous cell carcinoma of the oesophagus and gastro-oesophageal junction who underwent Ivor Lewis oesophagectomy between 2016 and 2021 were included. The tested algorithms were logistic regression after recursive feature elimination, random forest, k-nearest neighbour, support vector machine, and neural network. The algorithms were also compared with a current risk score (the Cologne risk score). 457 patients had Clavien-Dindo grade IIIa or higher complications (52.9 per cent) versus 407 patients with Clavien-Dindo grade 0, I, or II complications (47.1 per cent). After 3-fold imputation and 3-fold cross-validation, the overall accuracies were: logistic regression after recursive feature elimination, 0.528; random forest, 0.535; k-nearest neighbour, 0.491; support vector machine, 0.511; neural network, 0.688; and Cologne risk score, 0.510. For medical complications, the results were: logistic regression after recursive feature elimination, 0.688; random forest, 0.664; k-nearest neighbour, 0.673; support vector machine, 0.681; neural network, 0.692; and Cologne risk score, 0.650. For surgical complications, the results were: logistic regression after recursive feature elimination, 0.621; random forest, 0.617; k-nearest neighbour, 0.620; support vector machine, 0.634; neural network, 0.667; and Cologne risk score, 0.624. The calculated area under the curve of the neural network was 0.672 for Clavien-Dindo grade IIIa or higher, 0.695 for medical complications, and 0.653 for surgical complications. The neural network scored the highest accuracies compared with all of the other models for the prediction of postoperative complications after oesophagectomy.

Gesture recognition is a topic in computer science and language technology that aims to interpret human gestures with computer programs and many different algorithms. It can be seen as the way computers can understand human body language. Today, the main interaction tools between computers and humans are still the keyboard and mouse. Gesture recognition can be used as a tool for communication with the machine and interaction without any mechanical device such as a keyboard or mouse. In this paper, we present the results of a comparison of eight different machine learning (ML) classifiers in the task of human hand gesture recognition and classification to explore how to efficiently implement one or more tested ML algorithms on an 8-bit AVR microcontroller for on-line human gesture recognition with the intention to gesturally control the mobile robot. The 8-bit AVR microcontrollers are still widely used in the industry, but due to their lack of computational power and limited memory, it is a challenging task to efficiently implement ML algorithms on them for on-line classification. Gestures were recorded by using inertial sensors, gyroscopes, and accelerometers placed at the wrist and index finger. One thousand and eight hundred (1800) hand gestures were recorded and labelled. Six important features were defined for the identification of nine different hand gestures using eight different machine learning classifiers: Decision Tree (DT), Random Forests (RF), Logistic Regression (LR), Linear Discriminant Analysis (LDA), Support Vector Machine (SVM) with linear kernel, Naïve Bayes classifier (NB), K-Nearest Neighbours (KNN), and Stochastic Gradient Descent (SGD). All tested algorithms were ranged according to Precision, Recall, and F1-score (abb.: P-R-F1). The best algorithms were SVM (P-R-F1: 0.9865, 0.9861, and 0.0863), and RF (P-R-F1: 0.9863, 0.9861, and 0.0862), but their main disadvantage is their unusability for on-line implementations in 8-bit AVR microcontrollers, as proven in the paper. The next best algorithms have had only slightly poorer performance than SVM and RF: KNN (P-R-F1: 0.9835, 0.9833, and 0.9834) and LR (P-R-F1: 0.9810, 0.9810, and 0.9810). Regarding the implementation on 8-bit microcontrollers, KNN has proven to be inadequate, like SVM and RF. However, the analysis for LR has proved that this classifier could be efficiently implemented on targeted microcontrollers. Having in mind its high F1-score (comparable to SVM, RF, and KNN), this leads to the conclusion that the LR is the most suitable classifier among tested for on-line applications in resource-constrained environments, such as embedded devices based on 8-bit AVR microcontrollers, due to its lower computational complexity in comparison with other tested algorithms.

Cardiovascular disease remains the most significant contributor to global mortality, highlighting the importance of early and precise risk assessment within preventive healthcare frameworks. Alongside the rapid growth of clinical data availability, machine learning approaches have increasingly been adopted to assist medical decision-making, particularly for interpreting complex and high-dimensional health information. This research investigates the predictive capability of six supervised machine learning models in determining the likelihood of cardiovascular disease incidence: Logistic Regression, Support Vector Machine, k-Nearest Neighbors, Decision Tree, Random Forest, and Gradient Boosting. The Cleveland Heart Disease dataset from the UCI Machine Learning Repository served as the study's foundation. It includes 303 patient samples with a total of 76 recorded attributes. From this dataset, 14 clinically significant variables frequently reported in previous studies were selected for analysis. Considering the relatively small dataset size and the possibility of redundant or low-impact features, a feature selection approach was implemented to improve model robustness, minimize overfitting, and enhance interpretability. The data preparation process involved cleaning, normalization, feature selection, and division into datasets for testing and training. Metrics like accuracy, precision, recall, and F1-score were used to evaluate the model. The results of the experiment show that Random Forest and Logistic Regression models produced the highest predictive performance, followed by k-Nearest Neighbours and Support Vector Machine. These results indicate that supervised machine learning techniques, when supported by appropriate feature selection methods, are effective as decision-support tools for the early detection of cardiovascular disease.

In recent times, there have been increased rates at which researchers are searching for advanced ways of carrying out land-use land-cover (LULC) mapping, especially in developing countries. Four machine-learning algorithms, namely Random Forest (RF), Support Vector Machine (SVM), K-Nearest Neighbour (K-NN), and Gaussian Mixture Models (GMM) were examined. This study also attempted to validate the various models using the index-based validation method. Accuracy assessment was performed by using the Kappa coefficient. The results of the LULC showed that RF classified 23% of the study area as bare land, SVM has 24% of the study area classified as bare land, K-NN also allotted 24% to bare land, while that of GMM classifier was 30%. The overall accuracy of RF, SVM, K-NN and GMM were 0.9840, 0.9780, 0.9641 and 0.9421 respectively. The Kappa Coefficient of the various classifiers were RF (0.9695), SVM (0.9580), K-NN (0.9319) and GMM (0.8916). This study showed that though all the algorithms performed relatively very well, RF performed better than the other classifiers. It suffices to state that, there is a need for further studies since other extraneous environmental variables may be underpinning these conclusions.

Diabetes is a chronic metabolic disorder caused by excessive blood sugar levels, which leads to severe damage to other organs. Type 2 diabetes is, more often than others, a long-term metabolic disorder in which the body resists insulin or does not produce enough of it. Early diabetes detection with fewer features reduces patient burden, and machine learning makes the process more time-efficient. This study proposes three machine learning approaches that achieve both high performance and effective feature reduction using the Early Stage Diabetes Risk Prediction dataset. Multiple research works have been published. However, they have struggled to achieve efficient feature reduction while maintaining high accuracy and have not provided detailed explanations of the models' nature or misclassifications. This research resolves the issues by showing outstanding performance, including a remarkable feature reduction. Three different swarm-based metaheuristic algorithms: Fox Optimizer, Honey Badger Algorithm, and Tuna Swarm Optimization, have been used, wrapped with a Random Forest Classifier. SHAP, as an explainable AI, is used to present the model's nature and feature importance, including individual predictions. FOX_RF, HBA_RF, and TSO_RF have gained an Accuracy of 99.36%, 99.36%, and 100% without cross-validation. However, TSO_RF has achieved the highest mean 10-fold cross-validation accuracy of 98.14%, F-score of 98.47%, and 98.54% of Precision using only 14 features out of 16. And, FOX_RF has achieved the highest mean Precision of 98,43%. HBA_RF has shown the highest number of feature reduction by selecting 10 features out of 16, maintaining a moderate performance. SHAP has confirmed that Polyuria, Polydipsia, and Gender are the most impacted features for diabetes prediction. SHAP-based individual prediction analysis has revealed that even small changes in these features can influence the model's decisions. This research analyzes the Early Stage Diabetes Risk Prediction dataset, which includes 520 individuals with 16 predictors and one target class, where TSO_RF has outperformed other models by achieving 100% and 98.14% of Accuracy, respectively, without cross-validation and using cross-validation.

Background: Electricity has long been regarded as a catalyst for enhancing economy growth in developing countries. The availability of electricity can drive a country’s growth by allowing firms to take advantage of it to increase its productivity enhancing technologies, the bulk of which are reliant on electricity. Objective: In view of the above, this study aims to model the willingness to pay of electricity supply to consumers in southwestern states of Nigeria using machine learning approach. Methods: The study was conducted in six southwestern states in Nigeria. This data contain information which was obtained through longitudinal survey using a google form questionnaire. The data contains the category of the respondents, type of commercial activity, average daily electricity supplied, willingness to pay of electricity supply per month and so on. K-Nearest Neighbors (KNN), Random Forest, Support Vector Machine (SVM), Decision Tree and Boosting Classification models were considered. Results: Among the models considered, KNN, SVM and Boosting classification models perform better in classifying whether a consumer is willing to pay for electricity consumption or not. Conclusion: The information obtained from this research can be used to produce insight into electricity production in the states.

Diabetes Mellitus (DM) is a chronic disease that affects millions of people around the world, primarily in developing countries. Diabetes has also been found to be a recurrent and genetic and hereditary disease ravaging lives from one generation to another. Hence, early detection of diabetes is critical to avoiding complications and lowering healthcare costs. This review article aims to compare previous works that used various machine learning models in predicting Diabetes Mellitus (DM) in Nigeria, a developing country. The models' accuracy, precision, and recall, as well as their advantages and limitations, are all discussed. The difficulties encountered in applying machine learning models for DM prediction in Nigeria, as well as potential solutions, are also discussed. The article emphasizes the importance of ongoing research in this area as well as the advantages of using K-Nearest Neighbor (KNN) and Support Vector Machine (SVM) models to improve early detection and management of diabetes in developing countries.

Sepsis is a leading cause of mortality in the intensive care unit. Early prediction of sepsis can reduce the overall mortality rate and cost of sepsis treatment. Some studies have predicted mortality and development of sepsis using machine learning models. However, there is a gap between the creation of different machine learning algorithms and their implementation in clinical practice.This study utilized data from the Medical Information Mart for Intensive Care III. We established and compared the gradient boosting decision tree (GBDT), logistic regression (LR), k-nearest neighbor (KNN), random forest (RF), and support vector machine (SVM).A total of 3937 sepsis patients were included, with 34.3% mortality in the Medical Information Mart for Intensive Care III group. In our comparison of 5 machine learning models (GBDT, LR, KNN, RF, and SVM), the GBDT model showed the best performance with the highest area under the receiver operating characteristic curve (0.992), recall (94.8%), accuracy (95.4%), and F1 score (0.933). The RF, SVM, and KNN models showed better performance (area under the receiver operating characteristic curve: 0.980, 0.898, and 0.877, respectively) than the LR (0.876).The GBDT model showed better performance than other machine learning models (LR, KNN, RF, and SVM) in predicting the mortality of patients with sepsis in the intensive care unit. This could be used to develop a clinical decision support system in the future.

BackgroundEmotion prediction is a method that recognizes the human emotion derived from the subject’s psychological data. The problem in question is the limited use of heart rate (HR) as the prediction feature through the use of common classifiers such as Support Vector Machine (SVM), K-Nearest Neighbor (KNN) and Random Forest (RF) in emotion prediction. This paper aims to investigate whether HR signals can be utilized to classify four-class emotions using the emotion model from Russell’s in a virtual reality (VR) environment using machine learning.MethodAn experiment was conducted using the Empatica E4 wristband to acquire the participant’s HR, a VR headset as the display device for participants to view the 360° emotional videos, and the Empatica E4 real-time application was used during the experiment to extract and process the participant's recorded heart rate.FindingsFor intra-subject classification, all three classifiers SVM, KNN, and RF achieved 100% as the highest accuracy while inter-subject classification achieved 46.7% for SVM, 42.9% for KNN and 43.3% for RF.ConclusionThe results demonstrate the potential of SVM, KNN and RF classifiers to classify HR as a feature to be used in emotion prediction in four distinct emotion classes in a virtual reality environment. The potential applications include interactive gaming, affective entertainment, and VR health rehabilitation.

This study evaluates the performance of four machine learning models: Support Vector Machine (SVM), Random Forest, K-Nearest Neighbors (KNN), and Naive Bayes in analyzing visitor reviews of the Lokawisata Baturaden tourist attraction. Using 5-fold cross-validation, the study aims to determine which machine learning model best suits sentiment analysis on the Baturaden review data. This study was conducted through several stages, including data preprocessing, feature extraction, and the data training process. Case folding, text cleaning, tokenization, stopword removal, and stemming were performed during the data preprocessing stage. The feature extraction method used was TF-IDF. SMOTE was applied to increase data variation and address the data imbalance in the dataset. The results show that SVM provides the best performance with an accuracy of 0.937, an F1-score of 0.937, a precision of 0.943, and a recall of 0.937. Random Forest also performs well with an accuracy of 0.918 and an F1-score of 0.918, though slightly below SVM. KNN shows the lowest performance with an accuracy of 0.651 and an F1-score of 0.544, while Naive Bayes performs adequately with an accuracy of 0.845 and an F1-score of 0.841. Based on this evaluation, SVM is recommended as the best model for sentiment analysis of reviews, followed by Random Forest as a good alternative. The KNN model is not recommended due to its lower performance, while Naive Bayes can be considered for its speed and simplicity, although its results are not as good as SVM and Random Forest. These conclusions guide the selection of the optimal model to enhance understanding and visitor experience at the Baturaden tourist attraction.

Single-cell RNA-seq overcomes the shortcomings of conventional transcriptome sequencing technology and could provide a powerful tool for distinguishing the transcriptome characteristics of various cell types in biological tissues, and comprehensively revealing the heterogeneity of gene expression between cells. Many Intelligent Computing methods have been presented to infer gene regulatory network (GRN) with single-cell RNA-seq data. In this paper, we investigate the performances of seven classifiers including support vector machine (SVM), random forest (RF), Naive Bayesian (NB), GBDT, logical regression (LR), decision tree (DT) and K-Nearest Neighbor (KNN) for solving the binary classification problems of GRN inference with single-cell RNA-seq data (Single_cell_GRN). In SVM, three different kernel functions (linear, polynomial and radial basis function) are utilized, respectively. Three real single-cell RNA-seq datasets from mouse and human are utilized. The experiment results prove that in most cases supervised learning methods (SVM, RF, NB, GBDT, LR, DT and KNN) perform better than unsupervised learning method (GENIE3) in terms of AUC. SVM, RF and KNN have the better performances than other four classifiers. In SVM, linear and polynomial kernels are more fit to model single-cell RNA-seq data.

Diabetes is a widespread chronic disease that impacts millions of individuals around the globe. Recent advances in artificial intelligence have highlighted the potential of machine learning (ML) and deep learning (DL) techniques for the early detection of diabetes, offering improvements in both diagnostic precision and efficiency. This research introduces an innovative stacked ensemble learning framework that integrates various ML and DL algorithms to boost predictive accuracy. The approach begins by utilizing individual models—such as one-dimensional convolutional neural networks (1D-CNN), long short-term memory (LSTM) networks, random forest (RF), logistic regression (LR), and support vector machines (SVM), each selected for its distinct strengths in prediction. These models are then strategically combined through a stacked ensemble method to capitalize on their complementary capabilities and enhance overall performance. The proposed ensemble model achieves a prediction precision of 0.95, a recall of 0.68, an F1-score of 0.79, and an ROC-AUC of 0.97, demonstrating its effectiveness in early diabetes detection. This integrated approach ensures not only high predictive accuracy but also robustness against variations in patient data, ultimately facilitating timely intervention and improved healthcare outcomes.