Predicting Diabetes Using Diabetes Datasets and Machine Learning Algorithms: Comparison and Analysis

Machine learning algorithms are designed to identify efficiently and to predict accurately patterns within multivariate data. They provide analysts computational tools to aid predictive modelling and the interpretation of interactions between data and the phenomena under investigation. The analysis of large volumes of disparate multivariate geospatial data using machine learning algorithms therefore offers great promise to industry and research in the geosciences. Geoscience data are frequently characterised by a restriction in the number and distribution of direct observations, irreducible noise in these data and a high degree of intraclass variability and interclass similarity. The choice of machine learning algorithm, or algorithms and the details of how algorithms are applied must therefore be appropriate to the context of geoscience data. With this knowledge, I aim to employ machine learning as a means of understanding the spatial distribution of complex geological phenomena. I conduct a rigorous and comprehensive comparison of machine learning algorithms, representing the five general machine learning strategies, for supervised lithology classification applications. I also develop and test a novel method for obtaining robust estimates of the uncertainty associated with machine learning algorithm categorical predictions. The insights gained from these experiments leads to the further development and comparison of new methods for the incorporation of spatial-contextual information into machine learning supervised classifiers. In using machine learning algorithms for geoscience applications, I have developed bestpractice methodologies that address the challenges facing geoscientists for geospatial supervised classification. Guidelines are established that detail the preparation and integration of disparate spatial data, the optimisation of trained classifiers for a given application and the robust statistical and spatial evaluation of outputs. I demonstrate, through a case study in a region that is prospective for economic mineralisation, the combination of supervised and unsupervised machine learning algorithms for the critical appraisal of pre-existing geological maps and formulation of meaningful interpretations of geological phenomena. The experiments conducted as part of my research confirm the efficacy of machine learning algorithms to generate accurate geological maps representing a variety of terranes. I identify and explore key aspects of the spatial and statistical istributions of geoscience data that affect machine learning algorithm performance. My research clearly identifies Random Forests‚Äöv묢 as a good first-choice algorithm for the prediction of classes representing lithologies using commonly available multivariate geological and geophysical data. Furthermore, Random Forests prediction uncertainty is shown to be closely related to ambiguous and/or erroneous classifications and, thus provides a practical means of indicating variable levels of confidence. Spatial-contextual information is best incorporated into machine learning supervised classifiers via the pre-processing of input variables and/or the post-regularisation of classifications. My findings indicate that a trade-off between optimal predictive models and interpretable explanatory models exists, whereby, intuitively interpretable models are not necessarily the most accurate. The practical application of machine learning algorithms requires the implementation of three key stages: (1) data pre-processing; (2) algorithm training; and (3) prediction evaluation. This methodology provides the foundation for generating accurate and geologically meaningful predictions with minimal user intervention and assists in the formulation of robust interpretations of complex geological phenomena. For example, classifications obtained by Random Forests are useful for critically appraising interpreted geological maps. Clusters produced by Self-Organising Maps indicate the presence of discrete, spatially contiguous and geologically significant sub-classes within individual lithological units, which represent regions of contrasting primary composition and alteration styles. My results may be widely applied to a broad range of practical geoscience challenges such as ore deposit targeting, geo-hazard risk assessment, engineering and construction projects, hydrological and environmental modelling and ecological studies. The applications of machine learning algorithms detailed in this thesis align well with state-of-the-art Big Data online infrastructure and virtual laboratories currently emerging in Australia.

Healthcare information systems typically collect, store and manage various kinds of data such as illness details, clinical history, essential body parameters, health insurance plans, and other related data towards enabling data processing and analytics to arrive at better decision making with all the clarity and alacrity. To reduce the mortality rate due to heart diseases, it is essential to predict the presence of disease in its budding stage itself. Manual extraction of the useful knowledge from historical data is practically tedious and time-consuming. Machine learning (ML) algorithms are being used to detect and predict something useful out of both historical and current data. Despite the applicability of machine learning algorithms for prediction, the accuracy of prediction is significantly influenced by features used for prediction. Moreover, to meet the needs of evolving data sizes, suitable technologies for data storage also become essential. Based on these two aspects, a comparative analysis has been performed for feature selection using four filter methods, namely, correlation measure, information gain, gain ratio and relief. Further, a scalable architecture using Hadoop framework has been proposed to enable the machine learning algorithms to handle larger datasets while performing prediction task. The impact of the proposed architecture on the performance of machine learning algorithm has been evaluated with benchmark dataset and found to have improved scalability and accuracy.

The detection and identification of Distributed Denial-of-Service (DDoS) attacks remains a challenge in cloud/edge/fog computing environments. It usually requires network middleboxes, such as deep packet inspectors (DPI), for detection task mostly. But clouds and fogs have native powerful telemetry systems that are not yet fully exploited for DDoS detection; and provide so much information that could aid attack identification tasks as well. Machine Learning (ML) algorithms can help one diving into the richness of cloud’s native data collection services, which have a multitude of metrics from both physical and virtual hosts. This paper evaluates the use of ML algorithms over datasets collected from a experimental testbed based on OpenStack. Controlled attack scenarios were used to investigate the ability of ML for tasks such as detecting and identifying SYN_Flood and GET_Flood DDoS attacks mixed, in different proportions, with legitimate clients. kNN and Random Forest ML algorithms were trained and tested, and for evaluation the metrics accuracy, recall, precision, and F1-score were used. Our experiments presented about 87% of accuracy in the detection of SYN_Flood and GET_Flood DDoS attacks, whereas Snort IDS mostly fails to detect the latter attack by processing the corresponding packet traces. Also, the detection of PING_Flood DDoS attack was tested without training as an initial evaluation towards the generalization of the proposal.

ObjectiveEnhanced technology in computer and internet has driven scale and quality of data to be improved in various areas including healthcare sectors. Machine Learning (ML) has played a pivotal role in efficiently analyzing those big data, but a general misunderstanding of ML algorithms still exists in applying them (e.g., ML techniques can settle a problem of small sample size, or deep learning is the ML algorithm). This paper reviewed the research of diagnosing mental illness using ML algorithm and suggests how ML techniques can be employed and worked in practice.MethodsResearches about mental illness diagnostic using ML techniques were carefully reviewed. Five traditional ML algorithms-Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN)-frequently used for mental health area researches were systematically organized and summarized.ResultsBased on literature review, it turned out that Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN) were frequently employed in mental health area, but many researchers did not clarify the reason for using their ML algorithm though every ML algorithm has its own advantages. In addition, there were several studies to apply ML algorithms without fully understanding the data characteristics.ConclusionResearchers using ML algorithms should be aware of the properties of their ML algorithms and the limitation of the results they obtained under restricted data conditions. This paper provides useful information of the properties and limitation of each ML algorithm in the practice of mental health.

Racial and Ethnic Disparities in Predictive Accuracy of Machine Learning Algorithms Developed Using a National Database for 30-Day Complications Following Total Joint Arthroplasty

Background: Endovascular treatment (EVT) is effective for stroke patients with a large vessel occlusion (LVO) of the anterior circulation. To further improve personalized stroke care, it is essential to accurately predict outcome after EVT. Machine learning might outperform classical prediction methods as it is capable of addressing complex interactions and non-linear relations between variables.Methods: We included patients from the Multicenter Randomized Clinical Trial of Endovascular Treatment for Acute Ischemic Stroke in the Netherlands (MR CLEAN) Registry, an observational cohort of LVO patients treated with EVT. We applied the following machine learning algorithms: Random Forests, Support Vector Machine, Neural Network, and Super Learner and compared their predictive value with classic logistic regression models using various variable selection methodologies. Outcome variables were good reperfusion (post-mTICI ≥ 2b) and functional independence (modified Rankin Scale ≤2) at 3 months using (1) only baseline variables and (2) baseline and treatment variables. Area under the ROC-curves (AUC) and difference of mean AUC between the models were assessed.Results: We included 1,383 EVT patients, with good reperfusion in 531 (38%) and functional independence in 525 (38%) patients. Machine learning and logistic regression models all performed poorly in predicting good reperfusion (range mean AUC: 0.53–0.57), and moderately in predicting 3-months functional independence (range mean AUC: 0.77–0.79) using only baseline variables. All models performed well in predicting 3-months functional independence using both baseline and treatment variables (range mean AUC: 0.88–0.91) with a negligible difference of mean AUC (0.01; 95%CI: 0.00–0.01) between best performing machine learning algorithm (Random Forests) and best performing logistic regression model (based on prior knowledge).Conclusion: In patients with LVO machine learning algorithms did not outperform logistic regression models in predicting reperfusion and 3-months functional independence after endovascular treatment. For all models at time of admission radiological outcome was more difficult to predict than clinical outcome.

Background: In this study, we aimed to establish an efficient and accurate machine -learning model for evaluating tobacco quality based on its chemical composition. To achieve this, we gathered a dataset comprising 188 tobacco samples taken from the production area of Sichuan, China in 2021. Four machine learning algorithms—Random Forest (RF), Support Vector Machine (SVM), K-Nearest Neighbors (KNN), and Gradient Boosting Classifier (GBC)—were used to establish a predictive model for assessing tobacco quality. The study focused on comparing the predictive performance of these models and exploring the upper limit of prediction accuracy using genetic algorithm (GA) hyperparameter optimization. Additionally, the SHAP value model interpretation framework was introduced to provide a comprehensive global interpretation and conduct feature dependency analysis. Results: The results showed that model accuracy ranked as RF>GBC> KNN>SVM, with the GA-RF machine learning model achieving a prediction accuracy of 86.8%. SHAP values identified seven important characteristic indexes affecting Sichuan tobacco leaf quality, highlighting RF as the optimal classifier for predicting flue-cured tobacco quality in Sichuan Province. Conclusions: The GA-RF model constructed in this study effectively identifies Sichuan tobacco leaf quality. These findings offer novel insights and data support for the application of machine learning algorithms in tobacco fields and tobacco leaf quality evaluation.

In Mild Cognitive Impairment (MCI), identifying a high risk of conversion to Alzheimer’s Disease Dementia (AD) is a primary goal for patient management. Machine Learning (ML) algorithms are widely employed to pursue data-driven diagnostic and prognostic goals. An agreement on the stability of these algorithms –when applied to different biomarkers and other conditions– is far from being reached. In this study, we compared the different prognostic performances of three supervised ML algorithms fed with multimodal biomarkers of MCI subjects obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. Random Forest, Gradient Boosting, and eXtreme Gradient Boosting algorithms predict MCI conversion to AD. They can also be simultaneously employed –with the voting procedure– to improve predictivity. AD prediction accuracy is influenced by the nature of the data (i.e., neuropsychological test scores, cerebrospinal fluid AD-related proteins and APOE ε4, cerebral structural MRI (sMRI) data). In our study, independent of the applied ML algorithms, sMRI data showed the lowest accuracy (0.79) compared to other classes. Multimodal data were helpful in the algorithms’ performances by combining clinical and biological measures. Accordingly, using the three ML algorithms, the highest accuracy (0.90) was reached by employing neuropsychological and AD-related biomarkers. Finally, the feature selection procedure indicated that the most critical variables in the respective classes were the ADAS-Cog-13 scale, the medial temporal lobe and hippocampus atrophy, and the ratio between phosphorylated Tau and Aβ42 proteins. In conclusion, our data support the notion that using multiple ML algorithms and multimodal biomarkers helps make more accurate and solid predictions.

<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Contribution:</i> This article presents evidence that electrical engineering, computer science, and data science students, participating in introduction to machine learning (ML) courses, fail to interpret the performance of ML algorithms correctly, since they fail to consider the application domain. This phenomenon is referred to as the domain neglect bias and is discussed in this article from the cognitive psychology perspective. <p xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <i>Background:</i> ML algorithms are common components in electrical engineering, computer science, and data science curricula. Learning ML is challenging not only due to its complex mathematical and algorithmic aspects, but also due to: 1) the complexity of using these algorithms in the context of real-life situations correctly and 2) the comprehension of related social and ethical issues. <p xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <i>Research Question:</i> To what extent do students fail to correctly interpret the performance of ML algorithms due to the domain neglect bias and how can this bias be explained? <p xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <i>Methodology:</i> A questionnaire containing two questions was designed, in which the participants were asked to compare the performance of ML algorithms in the contexts of different application domains. The questions were designed to trigger the domain neglect bias which in turn, allowed quantification of its prevalence. <p xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <i>Findings:</i> One third of the students failed to recognize the outperforming ML algorithm due to the domain neglect bias. Educators should note this bias and develop new pedagogical methods for teaching ML performance in order to mitigate the bias.

In this chapter, a brief overview of the role and applications of machine learning (ML) algorithms in future wireless cellular networks is presented, more specifically, in the context of self-organizing networks (SONs). SON is a promising and innovative concept, in which future networks are expected to analyze and use historical data in order to improve and adapt themselves to the network conditions. For this to be possible, however, algorithms that are capable of extracting patterns from data and learn from previous actions are necessary. This chapter highlights the utilization and possible applications of ML algorithms in future cellular networks. A brief introduction of ML and SON is presented, followed by an analysis of current state of the art solutions involving ML in SON. Lastly, guidelines on the utilization of intelligent algorithms in SON and future research trends in the area are highlighted and conclusions are drawn.

Machine learning approach in non-intrusive monitoring of tool wear evolution in massive CFRP automatic drilling processes in the aircraft industry

Accurate and reliable lithological mapping through satellite-borne remote sensing data and image classification approaches has a critical role since it can automatically and promptly identify lithological units over large areas. Most available Pixel-Object Based comparative classification studies have been applied to land use land cover (LULC) studies; however, this research aims to evaluate and compare the performance of these digital classification methods in the field of geological mapping in semi-arid areas, by integrating spectral bands and neo-bands, particularly the Minimum noise fraction (MNF) and the principal component analysis (PCA), of Sentinel-2A satellite imagery, to map the southern of Skhour Rehamna which is located at the western Moroccan Meseta. The analysis results from two different methods, namely, pixel-based image analysis (PBIA) with k-nearest neighbour (K-NN) and Random Forest (RF) machine learning algorithms (MLAs), and Geographic Object-Based Image Analysis (GEOBIA) were assessed and compared. PBIA method involved selection of training areas whether it was k-NN or RF MLAs, and produced lithological maps that exhibit “salt and pepper” effects as well as problems associated to delineating accurate lithological boundaries, while GEOBIA approach involved multi-resolution segmentation step where scale, shape and compactness parameters should be adjusted as accurate as possible, in order to segment the image into homogeneous and meaningful regions so that the resulted samples were classified using Standard Nearest Neighbour algorithm. Therefore, the resulting lithological maps were assessed by comparing both techniques using confusion matrix, overall accuracy (OA) and Kappa coefficient (K). The results show that the GEOBIA approach had higher overall agreement (83.46% OA and 0.76 K) than RF (81.92% OA and 0.72 K) and k-NN (80.79% OA and 0.70 K) PBIA approaches. Overall, the results clearly indicate the potential of GEOBIA technique for lithological mapping applications to produce more realistic maps.

The success of blockchain projects depends, to a large extent, on the developer's involvement. Source code-commit privilege to the project is typically restricted to a few developers known as committers. Project leaders continuously search for new committers to evolve into a high-quality blockchain. However, promoting developers into committers is risky, mainly when the promoted committers exhibit low involvement behaviour. Hence, the committer assessment process is critical to the successful evolution of blockchain projects. The phenomenon of developer induction as code committers has previously been explored in the literature. However, previous studies employed objective measures such as the number of bugs report and code patches to appraise the developers activities for promotion purposes. Although these approaches are significant, behavioural tendencies influencing developers' activities are ignored. There have, however, been comparatively few investigations on a subjective measure that evaluate developers' perception of their activities for promotion purposes. This study aims to appraise blockchain developers' perceptions for predicting future committers in blockchain projects. In this study, 173 blockchain developers’ perceptions were gathered. The study employed hybrid analyses such as Structural Equation Modelling (SEM) to first analyse the survey data and Machine Learning (ML) algorithms to predict future committers. The performance of various ML algorithms was evaluated compared to classification performance indicators such as the F1 score, accuracy, precision, and AUC. In addition, the study also investigates the most important factors that predict future committers. The results indicate that XGBoost algorithm achieves the best performance with an accuracy of 0.94. Moreover, the most important factors in predicting future committers in a blockchain project are project desertion, developer involvement, decision-right delegation and system integration.

PurposeThere are no previous studies developing machine learning algorithms in the classification of lumbar sympathetic blocks (LSBs) performance using infrared thermography data. The objective was to assess the performance of different machine learning algorithms to classify LSBs carried out in patients diagnosed with lower limbs Complex Regional Pain Syndrome as successful or failed based on the evaluation of thermal predictors. Methods66 LSBs previously performed and classified by the medical team were evaluated in 24 patients. 11 regions of interest on each plantar foot were selected within the thermal images acquired in the clinical setting. From every region of interest, different thermal predictors were extracted and analysed in three different moments (minutes 4, 5, and 6) along with the baseline time (just after the injection of a local anaesthetic around the sympathetic ganglia). Among them, the thermal variation of the ipsilateral foot and the thermal asymmetry variation between feet at each minute assessed and the starting time for each region of interest, were fed into 4 different machine learning classifiers: an Artificial Neuronal Network, K-Nearest Neighbours, Random Forest, and a Support Vector Machine. ResultsAll classifiers presented an accuracy and specificity higher than 70%, sensitivity higher than 67%, and AUC higher than 0.73, and the Artificial Neuronal Network classifier performed the best with a maximum accuracy of 88%, sensitivity of 100%, specificity of 84% and AUC of 0.92, using 3 predictors. ConclusionThese results suggest thermal data retrieved from plantar feet combined with a machine learning-based methodology can be an effective tool to automatically classify LSBs performance.

The objective of this study is to evaluate and compare the performance of different machine learning (ML) algorithms, viz., multi-layer perceptron (MLP), random forest (RF), extra trees regressor (ETR), CatBoost, and gradient boost (GB), considering the impact of variation in sample sizes for theprediction of soil nutrients. In this context, this study evaluates the impact of sample size on the prediction performance of five ML algorithms for mapping 14 soil properties, including key soil physico-chemical properties (soil organic carbon, pH, and electrical conductivity), and multiple macro (available nitrogen, phosphorus, potassium, calcium, magnesium, and sulfur) and micronutrients (available iron, manganese, copper, zinc, and boron) at a geographical extent of 8303 km2 located in eastern India. A total of 1024 surface soil samples were collected, of which 800 were used for model training, while the remaining 224 were reserved for independent validation (IV) of the resultant maps. The original training data set (800 samples) was reduced by random selection into six different sample sizes, i.e., 800, 400, 200, 100, 50, and 25. An exhaustive set of 574 environmental variables, derived from digital terrain derivatives and Sentinel-2 satellite imagery, was used as predictors. Popular statistical indicators, such as Lin's concordance correlation coefficient (CCC) and root mean squared error (RMSE) were employed to evaluate the predictive capability of the algorithms under different sample size scenarios. The results showed that prediction accuracy and reliability of prediction performance across multiple target variables improved with sample size. However, beyond a certain point, improvement in predictive performance became substantially negligible compared to the efforts in additional sampling. All the ML algorithms performed well (mean IV-CCC varied between 0.26 and 0.64 for different soil properties) to increase insample size, except MLP, which exhibited a poorer prediction performance(mean IV-CCC varied between 0.14 and 0.29 for different soil properties). Micronutrients in general responded well to the increase in sample sizes. The uncertainty analysis revealed that increasing sample size generally reduced prediction uncertainty, though the extent varied by soil property and ML algorithm. Concisely, the results presented herein showed an effective manner of selecting an appropriate sample size and a suitable ML algorithm to predict multiple soil nutrients accurately, which would be recommended to achieve optimal accuracy for a project.