Environmental Factors Prediction in Preterm Birth Using Comparison between Logistic Regression and Decision Tree Methods:  An Exploratory Analysis

A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees

ObjectiveThis study aimed to systematically identify risk factors for urinary catheter-related hematuria in patients with acute myocardial infarction (AMI). By integrating logistic regression and decision tree models, we sought to develop actionable strategies for risk stratification and complication prevention.MethodsA retrospective analysis of 209 AMI patients was conducted to evaluate predictors of hematuria, including demographics, coagulation indices (INR, platelets), and procedural variables. Logistic regression and decision tree (CART algorithm) models were employed to identify risk factors and their interactions. Model performance was assessed using ROC-AUC, sensitivity, and specificity.ResultsThe incidence of catheter-related hematuria was 32.5%. Both models identified persistent agitation during catheter indwelling and PLT ≤ 246 as common predictors. The logistic regression model specifically identified Gender (OR = 0.202), patient awareness of catheter purpose and precautions (OR = 0.470), and emergency catheter placement (OR = 2.257) as significant factors. The decision tree model uniquely identified INR > 0.955 and repeated complaints of urethral pain as predictors.ConclusionHematuria in AMI patients results from coagulation dysfunction, procedural trauma, and behavioral factors. The combined use of logistic regression and decision trees enhances risk stratification. Clinical strategies should prioritize gentle catheterization, dynamic coagulation monitoring, and patient education to reduce complications.

Aim: The aim of the work is to evaluate the accuracy and precision in predicting heart disease using Support Vector Machine (SVM), Random forest (RF), Logistic Regression (LR), Decision Tree (DT) Classification algorithms. Materials and Methods: Classification algorithm is appealed on a heart dataset which consists of 180 records. A framework for heart disease prediction in the medical sector comparing Random forest, Logistic Regression, Decision Tree and SVM classifiers has been proposed and developed. The sample size was calculated as 55 in each group using G power 80%. Sample size was calculated using clincalc analysis, with alpha and beta values 0.05 and 0.5, 95% confidence, pretest power 80% and enrolment ratio 1. Results: The Novel Random Forest Algorithm (92.13%), Support Vector Machine (62.51%), Logistic Regression (84.89%), Decision Tree (86.25%) classifiers produce respectively. SVM, RF exists a statistically significant difference between the two groups (p=0.001,p=.004;p<0.05).LR, RF exists a statistically insignificant difference between the two groups (p=.103, P=.080;p>0.05) both with confidence interval 95%. Hence Random forest is better than SVM, RF, DT classifiers. Conclusion: The results show that the performance of RF is better when compared with SVM, LR and DT in terms of both precision and accuracy.

Cognitive science is a technology which focuses on analyzing the human brain using the application of DM. The databases are utilized to gather and store the large volume of data. The authenticated information is extracted using measures. This research work is based on detecting the sarcasm from the text data. This research work introduces a scheme to detect sarcasm based on PCA algorithm, K-means algorithm, and ensemble classification. The four ensemble classifiers are designed with the objective of detecting the sarcasm. The first ensemble classification algorithm (SKD) is the combination of SVM, KNN, and decision tree. In the second ensemble classifier (SLD), SVM, logistic regression, and decision tree classifiers are combined for the sarcasm detection. In the third ensemble model (MLD), MLP, logistic regression, and decision tree are combined, and the last one (SLM) is the combination of MLP, logistic regression, and SVM. The proposed model is implemented in Python and tested on five datasets of different sizes. The performance of the models is tested with regard to various metrics.

The growth and development of children under five (toddlers) affect their health conditions. Each region uniquely identifies the main factors influencing the toddler's health condition. The status of toddlers is generally categorized into two classes, namely normal and abnormal, so it is often found that the condition of toddler status is in the form of multi-response variables. Combining the two binary classes' response variables will form a multiclass response variable requiring different model development techniques and performance measurements. This study aims to determine the main factors that affect toddlers' health conditions in Malang, Indonesia, build multiclass logistic regression and decision tree classification models, and measure the model's performance. The Chi-square test selected predictor features as the input of multiclass logistic regression and decision tree models. From the feature selection, four main factors influence the status of toddlers' health conditions in Malang: the mother's history of diabetes before pregnancy, the father's blood pressure, psychological condition, and drinking water quality. The decision tree model performs better than the logistic regression model on the various performance measures used.

Early identification of patients with bipolar disorder during their first depressive episode is beneficial to the outcome of the disorder and treatment, but traditionally this has been a great challenge to clinicians. Recently, brain-derived neurotrophic factor (BDNF) has been suggested to be involved in the pathophysiology of bipolar disorder and major depressive disorder (MDD), but it is not clear whether BDNF levels can be used to predict bipolar disorder among patients in their first major depressive episode. To explore whether BDNF levels can differentiate between MDD and bipolar disorder in the first depressive episode. A total of 203 patients with a first major depressive episode as well as 167 healthy controls were recruited. After 3 years of bi-annual follow-up, 164 patients with a major depressive episode completed the study, and of these, 21 were identified as having bipolar disorder and 143 patients were diagnosed as having MDD. BDNF gene expression and plasma levels at baseline were compared among the bipolar disorder, MDD and healthy control groups. Logistic regression and decision tree methods were applied to determine the best model for predicting bipolar disorder at the first depressive episode. At baseline, patients in the bipolar disorder and MDD groups showed lower BDNF mRNA levels (P<0.001 and P = 0.02 respectively) and plasma levels (P = 0.002 and P = 0.01 respectively) compared with healthy controls. Similarly, BDNF levels in the bipolar disorder group were lower than those in the MDD group. These results showed that the best model for predicting bipolar disorder during a first depressive episode was a combination of BDNF mRNA levels with plasma BDNF levels (receiver operating characteristics (ROC) = 0.80, logistic regression; ROC = 0.84, decision tree). Our findings suggest that BDNF levels may serve as a potential differential diagnostic biomarker for bipolar disorder in a patient's first depressive episode.

In recent years, the prevalence of hand-foot-mouth disease (HFMD) in China and some other countries has caused worldwide concern. Mild cases tend to recover within a week, while severe cases may progress rapidly and tend to have bad outcome. Since there is no vaccine for HFMD and anti-inflammatory treatment is not ideal. In this study, we aimed to establish a valid forecasting model for severe HFMD using common laboratory parameters. Retrospectively, 77 severe HFMD cases from Zhengzhou Children's hospital in the peaking period between years 2013 to 2015 were collected, with 77 mild HFMD cases in the same area. The study recorded common laboratory parameters to assist in establishment of the severe HFMD model. After screening the important variables using Mann-Whitney U test, the study also matched the logistic regression (LR), discriminant analysis (DA), and decision tree (DT) to make a comparison. Compared with that of the mild group, serum levels of WBC, PLT, PCT, MCV, MCH, LCR, SCR, LCC, GLO, CK-MB, K, S100, and B in the severe group were higher (p < 0.05), while MCR, EOR, BASOR, SCC, MCC, EO, BASO, NA, CL, T, Th, and Th/Ts were lower (p < 0.05). Five indicators including MCR, LCC, Th, CK-MB, and CL were screened out by LR and the same for DA, and five variables including EO, LCC, CL, GLO, and MCC screened out by DT. The area under the curve (AUC) of LR, DA, and DT was 0.805, 0.779 and 0.864, respectively. The findings were that common laboratory indexes were effectively used to distinguish the mild HFMD cases and severe HFMD cases by LR, DA, and DT, and DT had the best classification effect with an AUC of 0.864.

A form of cancer known as lung cancer usually appears in the cells that line the lungs' air passages. It is the primary cause of cancer-related deaths in both genders. Lung adenocarcinoma (LUAD) and squamous cell carcinoma (LUSC) are two separate types of non-small cell lung cancer (NSCLC). Recognition of the differentially expressed genes (DEGs) is necessary to distinguish between healthy and diseased states molecularly. Biomedical books and microarray investigations are two common places to find details concerning gene expression variations. A gene is said to be highly expressed if there is a significant statistical distinction or change in reading counts or expression level indices between two different experimental conditions. A good gene expression strategy leads to a good gene silencing strategy, which subsequently slows or stops the cancer progression. In this paper, we present a robust analysis of the mRNA data from the LUAD data to find the most differentially expressed genes. Then we employ several machine learning techniques to categorize the samples into the five stages of lung cancer. We investigated four distinct models; including linear regression, logistic regression, RANSAC regression, and decision trees. The models achieved 100%, 91%, 98%, and 100% accuracies for 12 differential expression genes using linear regression, logistic regression, RANSAC regression, and decision trees respectively. The logistic regression and decision trees achieved 100% and 98% accuracies for 5665 differential expression genes. The proposed models achieved the highest accuracies in comparison with the state-of-the-art models.KeywordsGene expressionDEGsLUADLung cancerClassificationMachine learningDecision treeRANSACLogistic regressionLinear regression

Farmers’ physical labor and debt are reduced as a result of agricultural automation, which emphasizes efficient and effective use of various machines in farming operations with the purpose of reducing physical labor and debt. It is a revolutionary idea in agriculture to create custom hiring centers, which are intended to make it easier for like-minded farmers to embrace technology/machinery for enhanced resource management practices. The study in question examines the significance of tool renting and sharing in the workplace. Rental and sharing equipment are two approaches that might be used to enable farmers to borrow equipment at a cheaper cost than they would otherwise have to pay for it. The following is a manual pilot study of 562 farmers in India to address the numerous challenges farmers face when looking for tools and equipment, as well as to determine their strong interest in the process of renting and sharing equipment. The study was conducted to address the numerous challenges farmers face when looking for tools and equipment and to determine their strong interest in the process of renting and sharing equipment. Farmers are divided into three groups according to the results of this poll: small, moderate, and large. Training and testing splits were used on the same data set in order to get a better understanding of the target variables. The data set for the survey was standardized in order to remove ambiguity. In this research, three different machine learning models were utilized: nearest neighbors, logistic regression, and decision trees. K-nearest neighbors was the most often used model, followed by logistic regression and decision trees. In order to get the best possible result, a comparison of the aforementioned algorithm models was carried out, which revealed that the decision tree is the better model among the others in this regard. Because the decision tree model is completely reliant on a large number of input factors, such as the kind of crop, the time/month of harvest, and the type of equipment necessary for the crops, it has the potential to have a social and economic impact on farmers and their livelihoods.

474: Prospective investigation of second trimester thrombin activation and preterm birth

Purpose This study aims to develop and validate a machine learning-based risk prediction model for 1-year cardiac mortality in acute myocardial infarction (AMI) patients, utilizing a multidimensional dataset that integrates traditional risk factors, environmental determinants, and angiographic findings. Methods Data was sourced from a multicenter prospective cohort study (NCT 03297164) along with electronic medical records from a large tertiary hospital, covering the period from January 1, 2017, to July 28, 2022. The patient population from the tertiary hospital constituted the derivation cohort, while patients from other participating centers served as the external validation cohort. Six machine learning algorithms — logistic regression, XGBoost, LightGBM (LGBM), Gradient Boosting, random forest, and decision tree — were applied, with feature selection performed using the SelectFromModel method. The best-performing model underwent both internal and external validation, with its predictive performance compared to the GRACE score. Result The derivation cohort was divided into training and testing cohorts. In the training cohort, six machine learning algorithms were employed to screen variables and construct models using five-fold cross-validation (Figure 2A). All models achieved an area under the receiver operating characteristic curve (AUC) &amp;gt; 0.8 (Figure 2B). Delong's test revealed no significant differences in AUC among the algorithms. Considering other evaluation metrics and brier score, the LGBM (AUC 0.85) model was selected, incorporating the following variables: age, body mass index, smoking history, temperature, PM2.5, Gensini score, weighted diffuse lesion value, left ventricular end-diastolic diameter, ejection fraction, serum creatinine, cardiac troponin I, glucose, low-density lipoprotein cholesterol, B-type natriuretic peptide, and D-dimmer. External validation of the LGBM model yielded an AUC of 0.80, while the GRACE score achieved AUCs of 0.73 and 0.74 in internal testing and external validation, respectively (Figure 2C). Predicted LGBM scores in the training cohort were stratified into ten groups by decile. Patients were categorized into low-, intermediate-, and high-risk groups based on the actual incidence of cardiac death (Figure 2D). Using these cut-off values, risk stratification was applied to both the internal testing cohort and the external validation cohort, and the actual event rates were calculated (Figure E). Logistic and Cox regression analyses demonstrated significant differences between risk groups (P &amp;lt; 0.001, Figures F-I), with the LGBM-based stratification outperforming that based on the GRACE score. Conclusion Based on recent large-scale multicenter cohort data and incorporating environmental factors along with angiographic findings, this study developed and validated a novel prediction model for 1-year cardiac death in AMI patients, which demonstrated superior performance compared to the GRACE score.Flow chart Main Findings

In recent studies, researchers have focused on using various modalities to recognize emotions for different applications. A major challenge is identifying emotions correctly with only electrocardiograms (ECG) as the modality. The main objective is to reduce costs by using single-modality ECG signals to predict human emotional states. This paper presents an emotion recognition approach utilizing the heart rate variability features obtained from ECG with feature selection techniques (exhaustive feature selection (EFS) and Pearson’s correlation) to train the classification models. Seven machine learning (ML) models: multi-layer perceptrons (MLP), Support Vector Machine (SVM), Decision Tree (DT), Gradient Boosting Decision Tree (GBDT), Logistic Regression, Adaboost and Extra Tree classifier are used to classify emotional state. Two public datasets, DREAMER and SWELL are used for evaluation. The results show that no particular ML works best for all data. For DREAMER with EFS, the best models to predict valence, arousal, and dominance are Extra Tree (74.6%), MLP and DT (74.6%), and GBDT and DT (69.8%), respectively. Extra tree with Pearson’s correlation are the best method for the ECG SWELL dataset and provide 100% accuracy. The usage of Extra tree classifier and feature selection technique contributes to the improvement of the model accuracy. Moreover, the Friedman test proved that ET is as good as other classification models for predicting human emotional state and ranks highest. Doi: 10.28991/ESJ-2023-07-01-011 Full Text: PDF

This research aims to analyze and compare supervised learning classification methods using a case study of accreditation data for private higher education institutions within the LLDikti Region III contained in BAN-PT. In addition, this research also uses Weka machine learning software in its calculations. The initial step taken is to prepare the software used for supervised learning analysis, then pre-processing the data, namely labeling data that has a categorical data type, after that determining data for testing data. The next step is to test each classification method. The methods used for comparison are logistic regression, K-nearest neighbor, naive bayes, super vector machine, and random forest. Based on the calculation results, the Kappa Statistic and Root mean squared error values obtained are 1 and 0 for the logistic regression method, 0.979 and 0.0061 for the K-nearest neighbor method, 1 and 0.2222 for the super vector machine method, 0.969 and 0.0341 for the naive bayes method, 1 and 0 for the decision tree method, and 0.5776 and 0.1949 for the random forest method, respectively. The logistic regression and decision tree methods in this study get Kappa Statistic and Root mean squared error values of 1 and 0 respectively so that they are said to be good and acceptable, thus the two classification methods are the most appropriate methods and are considered to have the highest accuracy.

Aim: This study aims to identify key predictors of type 2 diabetes mellitus (T2DM) by applying mathematical and machine learning techniques to clinical health data collected in North Macedonia. Method: Data were collected from 723 clinical records at the Clinical Hospital “Mother Teresa” in Skopje over 9 months, including patient demographics, BMI, lipid profile, HbA1c, and hypertension status. A hybrid analytical framework was developed, integrating exploratory data analysis, statistical correlation testing, and supervised machine learning algorithms—specifically logistic regression, k-nearest neighbors (KNN), and decision tree classifiers. Model performance was evaluated using accuracy, precision, recall, F1-score, and ROC curves. Results: The results revealed statistically significant associations between elevated HbA1c, high BMI, and diabetes diagnosis. Logistic regression achieved the highest performance with 80% accuracy and an AUC of 0.85. Across models, HbA1c, age, and BMI consistently emerged as the most influential predictors of T2DM. Hypertension and abnormal lipid risk were also positively associated with diabetes outcomes. Conclusions: This research confirms that machine learning models—especially logistic regression—can effectively predict diabetes risk using a small set of metabolic and anthropometric indicators. The integration of statistical analysis and ML techniques enhances the ability to detect early warning signs of T2DM and provides a foundation for future clinical decision-support tools.

To identify correlates of the incidence of cognitive impairment among older Chinese populations through the use of logistic regression analysis-based decision tree approaches. Correlates of cognitive impairment among older Chinese adults were identified through logistic regression analyses, with significant variables subsequently being incorporated into a decision tree analysis, with the CHAID method being employed for pre-pruning. The risk score derived from the combination of logistic regression and decision tree analyses (0.237) was lower than that derived from a decision tree analysis alone (0.389). The primary factors related cognitive impairment in this patient population included age, gender, residence status, physical health status, and caring for grandchildren. A combination of logistic regression and decision tree analyses can lower predicted risk scores, enabling the subdivision of populations with different characteristics and providing intuitive and specific insight regarding the effects of individual variables on predictive analyses. Overall, these results suggest that older adults in rural areas of China should be the focus of further cognitive impairment screening and interventions, particularly for older women.