GlycoDetect a Diabetic Prediction Model using ML

Text mining is a special case of data mining which explore unstructured or semi-structured text documents, to establish valuable patterns and rules that indicate trends and significant features about specific topics. Text mining has been in pattern recognition, predictive studies, sentiment analysis and statistical theories in many areas of research, medicine, financial analysis, social life analysis, and business intelligence. Text mining uses concept of natural language processing and machine learning. Machine learning algorithms have been used and reported to give great results, but their performance of machine learning algorithms is affected by factors such as dataset domain, number of classes, length of the corpus, and feature selection techniques used. Redundant attribute affects the performance of the classification algorithm, but this can be reduced by using different feature selection techniques and dimensionality reduction techniques. Feature selection is a data preprocessing step that chooses a subset of input variable while eliminating features with little or no predictive information. Feature selection techniques are Information gain, Term Frequency, Term Frequency-Inverse document frequency, Mutual Information, and Chi-Square, which can use a filters, wrappers, or embedded approaches. To get the most value from machine learning, pairing the best algorithms with the right tools and processes is necessary. Little research has been done on the effect of feature selection techniques on classification accuracy for pairing of these algorithms with the best feature selection techniques for optimal results. In this research, a text classification experiment was conducted using incident management dataset, where incidents were classified into their resolver groups. Support vector machine (SVM), K-Nearest Neighbors (KNN), Naïve Bayes (NB) and Decision tree (DT) machine learning algorithms were examined. Filtering approach was used on the feature selection techniques, with different ranking indices applied for optimal feature set and classification accuracy results analyzed. The classification accuracy results obtained using TF were, 88% for SVM, 70% for NB, 79% for Decision tree, and KNN had 55%, while Boolean registered 90%, 83%, 82% and 75%, for SVM, NB, DT, and KNN respectively. TF-IDF, had 91%, 83%, 76%, and 56% for SVM, NB, DT, and KNN respectively. The results showed that algorithm performance is affected by feature selection technique applied. SVM performed best, followed by DT, KNN and finally NB. In conclusion, presence of noisy data leads to poor learning performance and increases the computational time. The classifiers performed differently depending on the feature selection technique applied. For optimal results, the classifier that performed best together with the feature selection technique with the best feature subset should be applied for all types of data for accurate classification performance. Keywords: Text Classification, Supervised Machine Learning, Feature Selection DOI : 10.7176/JIEA/9-3-06 Publication date :May 31 st 2019

Background and aimsThe birth weight of a newborn is a crucial factor that affects their overall health and future well-being. Low birth weight (LBW) is a widespread global issue, which the World Health Organization defines as weighing less than 2,500 g. LBW can have severe negative consequences on an individual’s health, including neonatal mortality and various health concerns throughout their life. To address this problem, this study has been conducted using BDHS 2017–2018 data to uncover important aspects of LBW using a variety of machine learning (ML) approaches and to determine the best feature selection technique and best predictive ML model.MethodsTo pick out the key features, the Boruta algorithm and wrapper method were used. Logistic Regression (LR) used as traditional method and several machine learning classifiers were then used, including, DT (Decision Tree), SVM (Support Vector Machine), NB (Naïve Bayes), RF (Random Forest), XGBoost (eXtreme Gradient Boosting), and AdaBoost (Adaptive Boosting), to determine the best model for predicting LBW. The model’s performance was evaluated based on the specificity, sensitivity, accuracy, F1 score and AUC value.ResultsResult shows, Boruta algorithm identifies eleven significant features including respondent’s age, highest education level, educational attainment, wealth index, age at first birth, weight, height, BMI, age at first sexual intercourse, birth order number, and whether the child is a twin. Incorporating Boruta algorithm’s significant features, the performance of traditional LR and ML methods including DT, SVM, NB, RF, XGBoost, and AB were evaluated where LR, had a specificity, sensitivity, accuracy and F1 score of 0.85, 0.5, 85.15% and 0.915. While the ML methods DT, SVM, NB, RF, XGBoost, and AB model’s respective accuracy values were 85.35%, 85.15%, 84.54%, 81.18%, and 84.41%. Based on the specificity, sensitivity, accuracy, F1 score and AUC, RF (specificity = 0.99, sensitivity = 0.58, accuracy = 85.86%, F1 score = 0.9243, AUC = 0.549) outperformed the other methods. Both the classical (LR) and machine learning (ML) models’ performance has improved dramatically when important characteristics are extracted using the wrapper method. The LR method identified five significant features with a specificity, sensitivity, accuracy and F1 score of 0.87, 0.33, 87.12% and 0.9309. The region, whether the infant is a twin, and cesarean delivery were the three key features discovered by the DT and RF models, which were implemented using the wrapper technique. All three models had the identical F1 score of 0.9318. However, “child is twin” was recognized as a significant feature by the SVM, NB, and AB models, with an F1 score of 0.9315. Ultimately, with an F1 score of 0.9315, the XGBoost model recognized “child is twin” and “age at first sex” as relevant features. Random Forest again beat the other approaches in this instance.ConclusionsThe study reveals Wrapper method as the optimal feature selection technique. The ML method outperforms traditional methods, with Random Forest (RF) being the most effective predictive model for Low-Birth-Weight prediction. The study suggests that policymakers in Bangladesh can mitigate low birth weight newborns by considering identified risk factors.

Innovative strategies are necessary to enhance prostate cancer diagnosis whilst reducing unnecessary and invasive repeat biopsies. This study aimed to determine the significant parameters affecting repeat prostate biopsy outcomes and develop an optimal machine learning algorithm for predicting positive repeat prostate biopsy results. We analysed data from 174 men who underwent repeated prostate biopsies between January 2008 and December 2022. Systematic multiple-core, ultrasound-targeted prostate biopsies were performed, each two samples from prostatic transitional zone and peripheral zone were obtained bilaterally. Clinical characteristics were collected, including patients' age, initial prostate volume, prostate-specific antigen (PSA) level, free PSA (fPSA)/PSA ratio, biopsy core numbers, pathological result; The time interval between first and latest prostate biopsy; Latest PSA level, fPSA/PSA ratio, biopsy core numbers; And final pathological diagnosis. Six feature selection methods, namely, variable ranking, correlation matrix, random forest regression, recursive feature elimination, cross-validation and forward selection, were employed to identify key influencing factors for repeat biopsy outcomes. Subsequently, the performance of seven machine learning algorithms, namely, multivariable logistic regression (LR), K-nearest neighbour search (KNN), support vector classification (SVC), decision tree (DT), random forest classifier (RF), naïve Bayes classifier (NBC) and gradient booster tree (GB), was assessed based on accuracy, misclassification, recall, specificity, precision and receiver operating characteristic (ROC) area under the curve (AUC). About 70% of patients were used as the training dataset, meanwhile remaining 30% as validation dataset. 52 were ultimately diagnosed with prostate cancer following the final pathological examination. The remaining 122 patients were negative. Amongst six feature selection methods, the variable ranking emerged as the most effective method for identifying the essential factors influencing repeat biopsy results. Amongst the machine learning algorithms, SVC demonstrated superior accuracy (0.7365), low recall rate (0.2500) and low misclassification rate (0.2093) for both patients with cancer and healthy individuals. Meanwhile, the ROC curve of SVC showed a relatively high AUC (0.6871). We developed an SVC-based machine learning algorithm for predicting positive repeat prostate biopsy results. Our analysis revealed that initial and latest prostate volumes, initial and latest PSA levels, latest fPSA/PSA ratio and age are significant factors for this model.

Utilisation of machine learning algorithms to predict relapse risk following allogeneic stem cell transplantation (alloSCT) for patients with myeloid malignancies

The problem persists despite the heavy consequences of jail and the death penalty imposed on those found guilty of selling drugs. This situation creates an alarm among academics and managers who work in practice. Hotbeds for drug dealers are on the rise, and their financial impact on the global economy is moving forward. Drug peddlers distract society by warping peace, justice, and order and threaten the Sustainable Development Goals (SDGs). This study evaluated secondary data containing qualities and suspect drug groups to determine whether machine learning techniques could predict the suspect drug group. We developed a prediction model using nine machine learning algorithms: AdaBoost (AB), naïve Bayes (NB), logistic regression (LR), K nearest neighbour (KNN), random forest (RF), decision tree (DT), neural network (NN), CN2 and support vector machine (SVM). The study utilized Orange data mining software to obtain a more accurate perspective on the data. Predictive accuracy was determined using 5-fold stratified cross-validation. Friedman’s test was conducted, and the results showed that the performance of each algorithm was significantly different. Also, the study compared the models and compiled the results. The results reveal that the random forest has the highest accuracy compared to the others. This prediction model implies that high accuracy can help the government make informed decisions by accurately identifying and classifying suspected individuals and offenders. This prediction will help the government refer suspected individuals and offenders who meet the qualifications for specific drug law sections, like prosecution or rehabilitation, to those sections with a faster and more accurate rate. The outcome of this study should be helpful to law enforcement agents, analysts, and other drug practitioners who may find machine learning tools dependable to detect and classify drug offenders.KeywordsDrug groupClassificationMachine learningOffendersDrug peddling

Rainfall prediction is the highest research priority in flood-prone areas across the world. This work assesses the abilities of the Decision Tree (DT), Distributed Decision Tree (DDT), Naïve Bayes (NB), Random Forest (RF), Support Vector Machine (SVM), K Nearest Neighbour (KNN), and Fuzzy Logic Decision Tree (FDTs) machine learning algorithms for the rainfall prediction across the Kashmir province of the Union Territory of Jammu & Kashmir. On application of Machine learning algorithms on geographical datasets gave performance accuracy varying from (78.61–81.53)%. Further again machine learning algorithms were reapplied on the dataset without season variable yet again performance ranged in between (77.5–81)%. Vigorous analysis has established that these machine learning models are robust and our study has established that the dataset reaches performance stagnation and thus resulting in performance capping. The stagnation is irrespective of the choice of algorithm and the performance shall not improvise beyond a specific value irrespective of the choice of the machine learning algorithm.KeywordsDecision treeGeographical dataRandom forestNaïve BayesDistribute decision tree

Introduction: Since the delay or mistake in the diagnosis of mood disorders due to the similarity of their symptoms hinders effective treatment, this study aimed to accurately diagnose mood disorders including psychosis, autism, personality disorder, bipolar, depression, and schizophrenia, through modeling and analyzing patients' data . Method : Data collected in this applied developmental research included 996 records with 130 features obtained by interviewing and completing questionnaires in a mental hospital in the city of Sari, Iran in 2021. After preprocessing, the number of features was reduced to 91, and then through Principal Component Analysis (PCA) reduced to 35 factors. Modeling was done in Python software with K -Nearest Neighbor (KNN), Naive Bayes (NB), Decision Tree (DT), Random Forest (RF), Logistic Regression (LR), and Support Vector Machine (SVM) algorithms. The models were evaluated to select algorithms with higher accuracy. Particle Swarm Optimization (PSO) and Genetic Algorithm (GA) were applied to determine the optimal parameters of the selected algorithms . Results: Among the machine learning algorithms, random forest with 91% accuracy and support vector machine with 90% accuracy showed better performance. The genetic algorithms did not make any notable increase in prediction accuracy. Whereas considering N=30, T=150, W=0.9, c1=2, and c2=2 in the particle swarm optimization algorithm increased the prediction accuracy up to 3.3 %. Conclusion : With less classification error compared to similar studies, the PSO -SVM model designed in this study can be used in patient data monitoring with acceptable accuracy and can be used in intelligent systems in psychiatric centers.

Pneumonia is one of the common diseases amongst children in Bangladesh. Many children die from pneumonia in Bangladesh. Pneumonia is an infection that infects the air sacs in one or both lungs. In Bangladesh, nearly 50,000 children die of pneumonia every year. For diseases forecasting, Machine learning algorithms are popular and used extensively. Machine Learning allows us to fulfill such a task with much consequence. We established our dataset from the particular obtainable from our survey. For prognosticating pneumonia, we employed six traditional Machine Learning algorithms. They are K- Nearest Neighbor (KNN), Naive Bayes classifier, Decision Tree, Support Vector Machine (SVM), Neural Network algorithm, and Random Forest. For implementing these algorithms, we applied Scikit-leam, Pandas, NumPy, and for visualizing our data, we have used Matplotlib and seaborn. By proper interpretation, we considered the best performing algorithm for the prediction of pneumonia. We have measured to classify whether pneumonia declines under pneumonia (Positive) and pneumonia (Negative) class. Among all the algorithms, we have chosen the best algorithm which is provided us best accuracy and F1-score. By the best accomplishing algorithm, our model can predict pneumonia quite well.

Background: Osteoporosis is a systemic skeletal disorder marked by reduced bone density and microarchitectural deterioration, leading to increased fracture risk. While the dual-energy X-ray absorptiometry (DEXA) scan is the World Health Organization (WHO)-recommended diagnostic standard, its limitations necessitate alternative methods. Emerging magnetic resonance imaging (MRI) techniques, radiomics, and machine learning promise to enhance osteoporosis diagnosis through detailed analysis of lumbar MRI apparent diffusion coefficient (ADC) maps, potentially revolutionizing early detection and treatment strategies. Objectives: In this study, we are going to evaluate the performance of machine learning (ML) models using radiomics features of lumbar MRI ADC map for osteoporosis detection, and to identify significant features and their diagnostic thresholds. Specific performance metrics such as accuracy, sensitivity, specificity, and Area Under the receiver operating characteristic (ROC) Curve (AUC) were assessed. Patients and Methods: This retrospective study employed a cross-sectional design, with a total of 140 cases, including 21 with osteoporosis. The study's inclusion criteria consisted of concurrent lumbar MRI and DEXA within a year, while exclusion criteria included infectious or neoplastic lumbar lesions, fractures, instrumentation, significant osteodegenerative changes, cases where the first four lumbar vertebrae were not included in the imaging field, and absence of diffusion-weighted imaging. Manual segmentation of lumbar vertebrae from ADC maps was performed to create a comprehensive dataset, comprising 5,580 radiomics features per case. Subsequently, the top five features selected by fast correlation-based filter (FCBF) were used to test the performance of seven Machine Learning algorithms (k-Nearest neighbors, decision tree, random forest, logistic regression, support vector machine, naive bayes, and neural network). Statistical tests and ROC curve analysis were conducted to determine the significance and thresholds of these features. Results: The study included 140 cases, with 132 females (94.3%) and 8 males (5.7%), and a mean age of 65.32 ± 8.50 years. The mean BMI was 31.43 ± 5.53 kg/m² for females and 26 ± 3.59 kg/m² for males. In terms of demographic differences, no significant age difference was found between the osteoporotic and non-osteoporotic groups (P = 0.889). However, the osteoporotic group had significantly lower mean body weight (64.90 ± 10.13 kg vs. 74.68 ± 13.94 kg, P = 0.003) and BMI (27.40 ± 4.38 kg/m² vs. 31.77 ± 5.52 kg/m², P = 0.001) compared to the non-osteoporotic group. The median interval between DEXA and lumbar MRI was 1 month (range 0.1 - 11.87 months). The Neural Network model demonstrated the highest performance with an AUC of 0.616 and a classification accuracy of 0.764 using all features. The Naive Bayes model, using the top five features selected by FCBF, showed the highest performance with an AUC of 0.913, accuracy of 0.907, sensitivity of 0.667, and specificity of 0.95. All ML models’ performance were elevated by feature selection. Independent t-tests and Mann-Whitney U tests identified 521 and 670 significant features, respectively (P < 0.05). ROC analysis revealed 58 features with AUC values above 0.70. Conclusion: This study's findings suggest that ML models, particularly the Naive Bayes algorithm, can effectively use lumbar ADC map radiomics to diagnose osteoporosis. These findings could enhance early detection and treatment strategies, potentially improving patient outcomes and reducing the burden of osteoporotic fractures. This study also established threshold values for significant features.

Several billion people worldwide are afflicted by chronic kidney disease (CKD), a common and possibly fatal ailment. For efficient management and treatment of CKD, an early and precise diagnosis is essential. Machine learning (ML) algorithms have recently demonstrated promising results in a number of medical fields. This work uses a big dataset of clinical, demographic, and laboratory data gathered from a large cohort of CKD patients to provide a machine learning method to CKD diagnosis. To ensure the dependability and robustness of the ML models, the dataset handle values that are missing, outliers, and class imbalances during preprocessing. Numerous machine learning techniques encompass k -nearest neighbors (KNN), Random Forest, logistic regression, support vector machines (SVM), Naive Bayes classifiers, and feed -forward neural networks. Cross -validation technique is applied to train and test feed forward neural networks. Model performance is evaluated by estimating the accuracy of the model, with the Random Forest machine learning model achieving the highest accuracy. With the use of perceptron, we suggested a combined model that combines random forest with logistic regression which has the best accuracy; as a result, we hypothesized that more complicated clinical data may be used with this technology to diagnose disorders.

Background: Cardiovascular diseases belong to the top three leading causes of mortality in the Philippines with 17.8 % of the total deaths. Lifestyle-related habits such as alcohol consumption, smoking, poor diet and nutrition, high sedentary behavior, overweight, and obesity have been increasingly implicated in the high rates of heart disease among Filipinos leading to a significant burden to the country's healthcare system. The objective of this study was to predict the presence of heart disease using various machine learning algorithms (support vector machine, naïve Bayes, random forest, logistic regression, decision tree, and adaptive boosting) evaluated on an anonymized publicly available cardiovascular disease dataset. Methodology: Various machine learning algorithms were applied on an anonymized publicly available cardiovascular dataset from a machine learning data repository (IEEE Dataport). A web-based application system named Heart Alert was developed based on the best machine learning model that would predict the risk of developing heart disease. An assessment of the effects of different optimization techniques as to the imputation methods (mean, median, mode, and multiple imputation by chained equations) and as to the feature selection method (recursive feature elimination) on the classification performance of the machine learning algorithms was made. All simulation experiments were implemented via Python 3.8 and its machine learning libraries (Scikit-learn, Keras, Tensorflow, Pandas, Matplotlib, Seaborn, NumPy). Results: The support vector machine without imputation and feature selection obtained the highest performance metrics (90.2% accuracy, 87.7% sensitivity, 93.6% specificity, 94.9% precision, 91.2% F1-score and an area under the receiver operating characteristic curve of 0.902) and was used to implement the heart disease prediction system (Heart Alert). Following very closely were random forest with mean or median imputation and logistic regression with mode imputation, all having no feature selection which also performed well. Conclusion: The performance of the best four machine learning models suggests that for this dataset, imputation technique for missing values may or may not be done. Likewise, recursive feature elimination for feature selection may not apply as all variables seem to be important in heart disease prediction. An early accurate diagnosis leading to prompt intervention efforts is very crucial as it improves the patient's quality of life and diminishes the risk of developing cardiac events.

ABSTRACTObjectiveIn spinal surgery, precise identification of high‐speed bur milling states is crucial for patient safety. This study investigates whether integrating tactile and auditory perception can enhance the accuracy of milling state detection in robot‐assisted cervical laminectomy.MethodsBased on the mathematical and physical model of vibration and sound in high‐speed bur milling bone, the feasibility of employing vibration and sound characteristics to identify the milling states of high‐speed bur is studied systematically. Cervical laminectomy was performed on the cervical spine of the sheep. During the signal acquisition process, acceleration sensors and microphones were installed to collect vibration and sound signals, respectively. Seven milling states were set up in the experiment: (1) Milling depths of cortical bone (CTB): 0.5, 1.0, and 1.5 mm; (2) Milling depths of milling of cancellous bone (CCB): 0.5, 1.0, and 1.5 mm; (3) Boundary conditions: high‐speed bur idling or complete penetration of bone (PT). The milling speed was set at 0.5 mm/s, the milling angle was 45°, and the bur diameter was 4 mm. The vibration or sound was extracted by Fast Fourier Transform (FFT) in the frequency domain of the first nine harmonics to generate the feature vector in 9 dimensions (9‐D) space. These vibration and sound features were combined to form an 18‐D multi‐perception spatial vector for subsequent analysis, including five machine learning algorithms: Support Vector Machine (SVM), K Nearest Neighbors (KNN), Naive Bayes (NB), Linear Discriminant Analysis (LDA), and Decision Tree (DT), and deep learning models: Long Short‐Term Memory networks (LSTM).ResultsBased on the 18‐D features of tactile and auditory multisensory fusion, the LSTM model is trained using 6600 sets of high‐speed bur milling data. In order to achieve the best performance, a layer‐by‐layer parameter optimization strategy was used to determine the optimal parameter configuration, and finally, a single‐layer LSTM with 12 memory units was constructed. In terms of accuracy and stability, the model is significantly superior to the machine learning algorithms (SVM, KNN, NB, LDA, and DT), and the accuracy of LSTM is 99.32% in the milling states identification of cervical lamina milling with high‐speed bur.ConclusionThrough theoretical analysis and experimental verification, the study built a multi‐perception fusion framework based on tactile and auditory perception and accurately identified the cervical vertebra milling states through the LSTM model, which can provide perception means for operational spinal surgery robots in the future.

Obesity is one of the fastest-growing health risks today, especially in countries like India, where lifestyle changes and poor physical activity are becoming common. Obesity causes diseases such as diabetes, heart disease, and high blood pressure. Regular health check-ups sometimes miss early symptoms. There is a need for smarter, continuous monitoring systems. This work proposes a health monitoring solution that uses Wireless Body Area Networks (WBANs) with machine learning (ML) techniques to identify obesity levels and detect irregular health patterns. A Real-world obesity dataset was used, containing personal and habit features like age, weight, height, food habits, physical activity, and family history. These were used to imitate data that wearable sensors may collect. Several ML models were trained and tested-including Support Vector Machine (SVM), K- Nearest Neighbours (KNN). Decision Tree (DT), Random Forest (RF), Logistic Regression (LR), and XGBoost - as well as a hybrid SVM+KNN model. The models were evaluated using various performance metrics. Among them, XGBoost gave the best overall accuracy of around 96%, followed by Random Forest and SVM. The hybrid model offered stable and reliable results in borderline cases. By integrating wearable sensors along with ML algorithms, the proposed system supports the detection of obesity-related risks beforehand and provides continuous health status, especially useful in remote and mobile healthcare settings.

Internet reviews may affect a customer’s selection, and they can assess a product by correlating it to other brands. If the reviews are authentic, the customer may only pick a product that fulfils their demands. If the reviews, on the other hand, are phoney, the buyer is duped. It is vital to obtain the identification of fake consumer opinions in order to address this issue. To evaluate if a review is fraudulent or not, the actions of reviewers are extracted based on a semantic analysis of his review content. In this study, a data set for a mixed product was retrieved from the web, along with reviews and other information about the reviewers, to identify false reviewers using four algorithms: Support Vector Machine, Logistic Regression, K-Nearest Neighbour and Decision Tree. The accuracy rate along with precision rate of the aforementioned four methods are used to validate the significance of the features on the choice. Experiments were carried out on a large number of reviews gathered from the internet, demonstrating the efficacy of the proposed method.KeywordsSupport Vector Machine (SVM)Decision Tree (DT)Logistic Regression (LR)K- Nearest Neighbour (KNN)

In the past two decades, several screening instruments were developed to detect toddlers who may be autistic both in clinical and unselected samples. Among others, the Quantitative CHecklist for Autism in Toddlers (Q-CHAT) is a quantitative and normally distributed measure of autistic traits that demonstrates good psychometric properties in different settings and cultures. Recently, machine learning (ML) has been applied to behavioral science to improve the classification performance of autism screening and diagnostic tools, but mainly in children, adolescents, and adults. In this study, we used ML to investigate the accuracy and reliability of the Q-CHAT in discriminating young autistic children from those without. Five different ML algorithms (random forest (RF), naïve Bayes (NB), support vector machine (SVM), logistic regression (LR), and K-nearest neighbors (KNN)) were applied to investigate the complete set of Q-CHAT items. Our results showed that ML achieved an overall accuracy of 90%, and the SVM was the most effective, being able to classify autism with 95% accuracy. Furthermore, using the SVM–recursive feature elimination (RFE) approach, we selected a subset of 14 items ensuring 91% accuracy, while 83% accuracy was obtained from the 3 best discriminating items in common to ours and the previously reported Q-CHAT-10. This evidence confirms the high performance and cross-cultural validity of the Q-CHAT, and supports the application of ML to create shorter and faster versions of the instrument, maintaining high classification accuracy, to be used as a quick, easy, and high-performance tool in primary-care settings.