Machine Learning and Artificial Neural Network for Predicting Heart Failure Risk

BackgroundAcute kidney injury (AKI) is the most common and serious complication of sepsis, accompanied by high mortality and disease burden. The early prediction of AKI is critical for timely intervention and ultimately improves prognosis. This study aims to establish and validate predictive models based on novel machine learning (ML) algorithms for AKI in critically ill patients with sepsis.MethodsData of patients with sepsis were extracted from the Medical Information Mart for Intensive Care III (MIMIC- III) database. Feature selection was performed using a Boruta algorithm. ML algorithms such as logistic regression (LR), k-nearest neighbors (KNN), support vector machine (SVM), decision tree, random forest, Extreme Gradient Boosting (XGBoost), and artificial neural network (ANN) were applied for model construction by utilizing tenfold cross-validation. The performances of these models were assessed in terms of discrimination, calibration, and clinical application. Moreover, the discrimination of ML-based models was compared with those of Sequential Organ Failure Assessment (SOFA) and the customized Simplified Acute Physiology Score (SAPS) II model.ResultsA total of 3176 critically ill patients with sepsis were included for analysis, of which 2397 cases (75.5%) developed AKI during hospitalization. A total of 36 variables were selected for model construction. The models of LR, KNN, SVM, decision tree, random forest, ANN, XGBoost, SOFA and SAPS II score were established and obtained area under the receiver operating characteristic curves of 0.7365, 0.6637, 0.7353, 0.7492, 0.7787, 0.7547, 0.821, 0.6457 and 0.7015, respectively. The XGBoost model had the best predictive performance in terms of discrimination, calibration, and clinical application among all models.ConclusionThe ML models can be reliable tools for predicting AKI in septic patients. The XGBoost model has the best predictive performance, which can be used to assist clinicians in identifying high-risk patients and implementing early interventions to reduce mortality.

Background and aimsThe birth weight of a newborn is a crucial factor that affects their overall health and future well-being. Low birth weight (LBW) is a widespread global issue, which the World Health Organization defines as weighing less than 2,500 g. LBW can have severe negative consequences on an individual’s health, including neonatal mortality and various health concerns throughout their life. To address this problem, this study has been conducted using BDHS 2017–2018 data to uncover important aspects of LBW using a variety of machine learning (ML) approaches and to determine the best feature selection technique and best predictive ML model.MethodsTo pick out the key features, the Boruta algorithm and wrapper method were used. Logistic Regression (LR) used as traditional method and several machine learning classifiers were then used, including, DT (Decision Tree), SVM (Support Vector Machine), NB (Naïve Bayes), RF (Random Forest), XGBoost (eXtreme Gradient Boosting), and AdaBoost (Adaptive Boosting), to determine the best model for predicting LBW. The model’s performance was evaluated based on the specificity, sensitivity, accuracy, F1 score and AUC value.ResultsResult shows, Boruta algorithm identifies eleven significant features including respondent’s age, highest education level, educational attainment, wealth index, age at first birth, weight, height, BMI, age at first sexual intercourse, birth order number, and whether the child is a twin. Incorporating Boruta algorithm’s significant features, the performance of traditional LR and ML methods including DT, SVM, NB, RF, XGBoost, and AB were evaluated where LR, had a specificity, sensitivity, accuracy and F1 score of 0.85, 0.5, 85.15% and 0.915. While the ML methods DT, SVM, NB, RF, XGBoost, and AB model’s respective accuracy values were 85.35%, 85.15%, 84.54%, 81.18%, and 84.41%. Based on the specificity, sensitivity, accuracy, F1 score and AUC, RF (specificity = 0.99, sensitivity = 0.58, accuracy = 85.86%, F1 score = 0.9243, AUC = 0.549) outperformed the other methods. Both the classical (LR) and machine learning (ML) models’ performance has improved dramatically when important characteristics are extracted using the wrapper method. The LR method identified five significant features with a specificity, sensitivity, accuracy and F1 score of 0.87, 0.33, 87.12% and 0.9309. The region, whether the infant is a twin, and cesarean delivery were the three key features discovered by the DT and RF models, which were implemented using the wrapper technique. All three models had the identical F1 score of 0.9318. However, “child is twin” was recognized as a significant feature by the SVM, NB, and AB models, with an F1 score of 0.9315. Ultimately, with an F1 score of 0.9315, the XGBoost model recognized “child is twin” and “age at first sex” as relevant features. Random Forest again beat the other approaches in this instance.ConclusionsThe study reveals Wrapper method as the optimal feature selection technique. The ML method outperforms traditional methods, with Random Forest (RF) being the most effective predictive model for Low-Birth-Weight prediction. The study suggests that policymakers in Bangladesh can mitigate low birth weight newborns by considering identified risk factors.

Application of supervised machine learning algorithms in the classification of sagittal gait patterns of cerebral palsy children with spastic diplegia

Heart disease is a leading cause of death worldwide, and early detection is crucial for improving patient outcomes. Machine learning classifiers have shown promise in predicting heart disease using patient-specific factors such as demographic information, medical history, and lifestyle habits. In this paper, we aimed to evaluate the performance of machine learning classifiers in predicting heart disease using a combination of 5 different datasets such as Cleveland, Hungarian, Switzerland, Long Beach VA, and StatLog (Heart) Datasets available on IEEE data port. The two significant challenges are addressed in this work: 1) predicting heart failure using machine-learning models without eliminating any clinical features, which increases the risk of overfitting and can result in poor performance metrics, and 2) we propose a model that will provide remarkable accuracy regardless of the type of data, to offer model generalizability. Machine-learning algorithms such as logistic regression, decision trees, random forests, support vector machine, extreme gradient boosting, extra-tree, and K-nearest neighbor are applied for heart disease prediction. In addition, ensemble approaches such as majority voting, boosting, bagging, and stacking are employed. The performance of the classifiers is evaluated using performance metrics such as accuracy, precision, recall, and F1-score. The results showed that the ensemble approach of stacking outperformed individual models, with an accuracy of 93.67%.

The nature of stock market movement has always been ambiguous for investors because of various influential factors. This study aims to significantly reduce the risk of trend prediction with machine learning and deep learning algorithms. Four stock market groups, namely diversified financials, petroleum, non-metallic minerals and basic metals from Tehran stock exchange, are chosen for experimental evaluations. This study compares nine machine learning models (Decision Tree, Random Forest, Adaptive Boosting (Adaboost), eXtreme Gradient Boosting (XGBoost), Support Vector Classifier (SVC), Naïve Bayes, K-Nearest Neighbors (KNN), Logistic Regression and Artificial Neural Network (ANN)) and two powerful deep learning methods (Recurrent Neural Network (RNN) and Long short-term memory (LSTM). Ten technical indicators from ten years of historical data are our input values, and two ways are supposed for employing them. Firstly, calculating the indicators by stock trading values as continues data, and secondly converting indicators to binary data before using. Each prediction model is evaluated by three metrics based on the input ways. The evaluation results indicate that for the continues data, RNN and LSTM outperform other prediction models with a considerable difference. Also, results show that in the binary data evaluation, those deep learning methods are the best; however, the difference becomes less because of the noticeable improvement of models’ performance in the second way.

In this modern era, people are working hard to meet their physical needs and non-effective their ability to spend time for themselves which leads to physical stress and mental disorder. Many reports state that heart failure is caused by many diseases that we ignore and chronic diseases as well as the global epidemic of the Coronavirus. Heart failure does not mean that it will stop at any moment but rather that the heart is not working as it should. Heart failure, also known as congestive heart failure, is a condition that develops when your heart does not pump enough blood for your body’s needs. This paper aims to predict if someone is at high risk of being diagnosed as a heart patient using different machine learning methods. We have collected datasets to analyze data and mining using 7 algorithms of machine learning to predict whether the patient suffers from heart failure or not. This paper used a dataset retrieved from kaggle repository, which consists of 12 attributes (Features). This work is implemented using K-Nearest Neighbors (KNN), Naïve Bayes (NB), Logistic Regression (LR), Support Vector Machine (SVM), Random Forest (RF), Decision Tree (TD) and Neural Network (NN) algorithms. Results showed that Logistic Regression, Support Vector Machine and Neural Network respectively gave the best result with an accuracy of up to 94.57%.

Optimizing machine learning methods for groundwater quality prediction: Case study in District Bagh, Azad Kashmir, Pakistan.

The book titled "Prediction of Stock Market Index Movements with Machine Learning" focuses on the performance of machine learning methods in forecasting the future movements of stock market indexes and identifying the most advantageous methods that can be used across different stock exchanges. In this context, applications have been conducted on both developed and emerging market stock exchanges. The stock market indexes of developed countries such as NYSE 100, NIKKEI 225, FTSE 100, CAC 40, DAX 30, FTSE MIB, TSX; and the stock market indexes of emerging countries such as SSE, BOVESPA, RTS, NIFTY 50, IDX, IPC, and BIST 100 were selected. The movement directions of these stock market indexes were predicted using decision trees, random forests, k-nearest neighbors, naive Bayes, logistic regression, support vector machines, and artificial neural networks methods. Daily dataset from 01.01.2012 to 31.12.2021, along with technical indicators, were used as input data for analysis. According to the results obtained, it was determined that artificial neural networks were the most effective method during the examined period. Alongside artificial neural networks, logistic regression and support vector machines methods were found to predict the movement direction of all indexes with an accuracy of over 70%. Additionally, it was noted that while artificial neural networks were identified as the best method, they did not necessarily achieve the highest accuracy for all indexes. In this context, it was established that the performance of the examined methods varied among countries and indexes but did not differ based on the development levels of the countries. As a conclusion, artificial neural networks, logistic regression, and support vector machines methods are recommended as the most advantageous approaches for predicting stock market index movements.

The coronavirus is considered this century's most disruptive catastrophe and global concern. This disease has prompted extreme social, psychological and economic impacts affecting millions of people around the globe. COVID-19 is transmitted from one infected person's body to another through respiratory droplets. This virus proliferates when people breathe in air-contaminated space with droplets and microscopic airborne particles. This research aims to analyze automatic COVID-19 detection using machine learning techniques to build an intelligent web application. The dataset has been preprocessed by dropping null values, feature engineering, and synthetic oversampling (SMOTE) techniques. Next, we trained and evaluated different classifiers, i.e., logistic regression, random forest, decision tree, k-nearest neighbor, support vector machine (SVM), ensemble models (adaptive boosting and extreme gradient boosting) and deep learning (artificial neural network, convolutional neural network and long short-term memory) techniques. Explainable AI with the LIME framework has been applied to interpret the prediction results. The hybrid CNN-LSTM algorithm with the SMOTE approach performed better than the other models on the employed open-source dataset obtained from the Israeli Ministry of Health website, with 96.34% accuracy and a 0.98 F1 score. Finally, this model was chosen to deploy the proposed prediction system to a website, where users may acquire an instantaneous COVID-19 prognosis based on their symptoms.

Crime and violation are the threat to justice and meant to be controlled. Accurate crime prediction and future forecasting trends can assist to enhance metropolitan safety computationally. The limited ability of humans to process complex information from big data hinders the early and accurate prediction and forecasting of crime. The accurate estimation of the crime rate, types and hot spots from past patterns creates many computational challenges and opportunities. Despite considerable research efforts, yet there is a need to have a better predictive algorithm, which direct police patrols toward criminal activities. Previous studies are lacking to achieve crime forecasting and prediction accuracy based on learning models. Therefore, this study applied different machine learning algorithms, namely, the logistic regression, support vector machine (SVM), Naïve Bayes, k-nearest neighbors (KNN), decision tree, multilayer perceptron (MLP), random forest, and eXtreme Gradient Boosting (XGBoost), and time series analysis by long-short term memory (LSTM) and autoregressive integrated moving average (ARIMA) model to better fit the crime data. The performance of LSTM for time series analysis was reasonably adequate in order of magnitude of root mean square error (RMSE) and mean absolute error (MAE), on both data sets. Exploratory data analysis predicts more than 35 crime types and suggests a yearly decline in Chicago crime rate, and a slight increase in Los Angeles crime rate; with fewer crimes occurred in February as compared to other months. The overall crime rate in Chicago will continue to increase moderately in the future, with a probable decline in future years. The Los Angeles crime rate and crimes sharply declined, as suggested by the ARIMA model. Moreover, crime forecasting results were further identified in the main regions for both cities. Overall, these results provide early identification of crime, hot spots with higher crime rate, and future trends with improved predictive accuracy than with other methods and are useful for directing police practice and strategies.

Gesture recognition is a topic in computer science and language technology that aims to interpret human gestures with computer programs and many different algorithms. It can be seen as the way computers can understand human body language. Today, the main interaction tools between computers and humans are still the keyboard and mouse. Gesture recognition can be used as a tool for communication with the machine and interaction without any mechanical device such as a keyboard or mouse. In this paper, we present the results of a comparison of eight different machine learning (ML) classifiers in the task of human hand gesture recognition and classification to explore how to efficiently implement one or more tested ML algorithms on an 8-bit AVR microcontroller for on-line human gesture recognition with the intention to gesturally control the mobile robot. The 8-bit AVR microcontrollers are still widely used in the industry, but due to their lack of computational power and limited memory, it is a challenging task to efficiently implement ML algorithms on them for on-line classification. Gestures were recorded by using inertial sensors, gyroscopes, and accelerometers placed at the wrist and index finger. One thousand and eight hundred (1800) hand gestures were recorded and labelled. Six important features were defined for the identification of nine different hand gestures using eight different machine learning classifiers: Decision Tree (DT), Random Forests (RF), Logistic Regression (LR), Linear Discriminant Analysis (LDA), Support Vector Machine (SVM) with linear kernel, Naïve Bayes classifier (NB), K-Nearest Neighbours (KNN), and Stochastic Gradient Descent (SGD). All tested algorithms were ranged according to Precision, Recall, and F1-score (abb.: P-R-F1). The best algorithms were SVM (P-R-F1: 0.9865, 0.9861, and 0.0863), and RF (P-R-F1: 0.9863, 0.9861, and 0.0862), but their main disadvantage is their unusability for on-line implementations in 8-bit AVR microcontrollers, as proven in the paper. The next best algorithms have had only slightly poorer performance than SVM and RF: KNN (P-R-F1: 0.9835, 0.9833, and 0.9834) and LR (P-R-F1: 0.9810, 0.9810, and 0.9810). Regarding the implementation on 8-bit microcontrollers, KNN has proven to be inadequate, like SVM and RF. However, the analysis for LR has proved that this classifier could be efficiently implemented on targeted microcontrollers. Having in mind its high F1-score (comparable to SVM, RF, and KNN), this leads to the conclusion that the LR is the most suitable classifier among tested for on-line applications in resource-constrained environments, such as embedded devices based on 8-bit AVR microcontrollers, due to its lower computational complexity in comparison with other tested algorithms.

Diabetes mellitus is a chronic metabolic disorder that has become a major global health concern due to its increasing prevalence and severe long-term complications. Early prediction and diagnosis of diabetes play a crucial role in preventing disease progression and improving patient outcomes. In recent years, machine learning (ML) techniques have been widely applied to diabetes prediction using clinical and demographic data. This study presents a comprehensive analysis of existing machine learning models used for diabetic prediction. Commonly employed algorithms such as Logistic Regression, Decision Tree, Random Forest, Support Vector Machine, K-Nearest Neighbours, Naïve Bayes, and Artificial Neural Networks are examined based on their prediction accuracy, sensitivity, specificity, interpretability, and computational complexity. Publicly available datasets, particularly the Pima Indians Diabetes Dataset, are frequently used for model evaluation. The analysis highlights that ensemble models like Random Forest and Gradient Boosting generally outperform traditional classifiers in terms of accuracy, while simpler models such as Logistic Regression offer better interpretability for clinical decision-making. However, challenges such as data imbalance, overfitting, lack of explainability, and limited real-world clinical validation remain significant. This analytical study provides insights into the strengths and limitations of existing machine learning approaches and identifies research gaps to guide the development of more robust, interpretable, and clinically applicable diabetes prediction systems.

Prediction of fracture toughness of concrete using the machine learning approach

Background: Heart diseases continue to be among the primary causes of morbidity and mortality worldwide, highlighting the need for novel diagnostic methods to accurately, early, and economically predict and diagnose heart diseases. Current physical explores upon expert knowledge, possibly missing intricate and non-linear associations between heart disease risk factors. This is where machine learning (ML)methods emerge as promising alternatives for prediction and diagnosis of heart diseases by emphasizing data availability. Methods: This paper attempts to find out how six popular machine learning algorithms namely, Logistic Regression (LR), Support Vector Machine (SVM), Random Forest (RF), Gradient Boosting (GB), K-Nearest Neighbors (KNN), and eXtreme Gradient Boosting (XGB) perform on a publicly available heart disease dataset collected from Kaggle. For better performance and to make them comparable to each other, basic preprocessing techniques have also been implemented. The performance of all these algorithms will be measured by their respective definitions of accuracy, precision, recall, and F1 score. Result: With an F1-score of 98.52%, Random Forest and XGBoost surpassed other models, yielding a superior accuracy in predictions, measuring 98.53%. The models recorded a perfect level of precision, 100%, coupled with high values of recall, exceeding 97%. Gradient Boosting recorded impressive results, receiving an accuracy score of 93.17%. Conclusion: The research findings revealed that the Random Forest and XGBoost models are very effective in the prediction and diagnosis of heart disease. These two models have the capacity to support a clinical decision. Novelty: That is to say, the novelty of this research is that it evaluates multiple machine learning models with comparison to each other. The role of machine learning in enhancing cardiovascular disease diagnosis as well as decision support systems in healthcare and educating and aware the people about heart care and health.

Background: Ventilator weaning is one of the most significant challenges in the intensive care unit (ICU). Approximately 30% of patients fail to wean, resulting in prolonged use of ventilators and increased mortality. There are numerous high-performance prediction models available today, but they require a large number of parameters to predict and are thus impractical in clinical practice. Objectives: This study aims to create an artificial intelligence (AI) model for predicting weaning time and to identify the most simplified key predictors that will allow the model to achieve adequate accuracy with as few parameters as possible. Methods: This is a retrospective study of to-be-weaned patients (n = 1439) hospitalized in the cardiac ICU of Cheng Hsin General Hospital’s Department of Cardiac Surgery from November 2018 to August 2020. The patients were divided into two groups based on whether they could be weaned within 24 h (i.e., “patients weaned within 24 h” (n = 1042) and “patients not weaned within 24 h” (n = 397)). Twenty-eight variables were collected including demographic characteristics, arterial blood gas readings, and ventilation set parameters. We created a prediction model using logistic regression and compared it to other machine learning techniques such as decision tree, random forest, support vector machine (SVM), extreme gradient boosting, and artificial neural network. Forward, backward, and stepwise selection methods were used to identify significant variables, and the receiver operating characteristic curve was used to assess the accuracy of each AI model. Results: The SVM [receiver operating characteristic curve (ROC-AUC) = 88%], logistic regression (ROC-AUC = 86%), and XGBoost (ROC-AUC = 85%) models outperformed the other five machine learning models in predicting weaning time. The accuracies in predicting patient weaning within 24 h using seven variables (i.e., expiratory minute ventilation, expiratory tidal volume, ventilation rate set, heart rate, peak pressure, pH, and age) were close to those using 28 variables. Conclusions: The model developed in this research successfully predicted the weaning success of ICU patients using a few and easily accessible parameters such as age. Therefore, it can be used in clinical practice to identify difficult-to-wean patients to improve their treatment.