Hybrid Approach for Phishing Website Detection Using Classification Algorithms

Background and aimsThe birth weight of a newborn is a crucial factor that affects their overall health and future well-being. Low birth weight (LBW) is a widespread global issue, which the World Health Organization defines as weighing less than 2,500 g. LBW can have severe negative consequences on an individual’s health, including neonatal mortality and various health concerns throughout their life. To address this problem, this study has been conducted using BDHS 2017–2018 data to uncover important aspects of LBW using a variety of machine learning (ML) approaches and to determine the best feature selection technique and best predictive ML model.MethodsTo pick out the key features, the Boruta algorithm and wrapper method were used. Logistic Regression (LR) used as traditional method and several machine learning classifiers were then used, including, DT (Decision Tree), SVM (Support Vector Machine), NB (Naïve Bayes), RF (Random Forest), XGBoost (eXtreme Gradient Boosting), and AdaBoost (Adaptive Boosting), to determine the best model for predicting LBW. The model’s performance was evaluated based on the specificity, sensitivity, accuracy, F1 score and AUC value.ResultsResult shows, Boruta algorithm identifies eleven significant features including respondent’s age, highest education level, educational attainment, wealth index, age at first birth, weight, height, BMI, age at first sexual intercourse, birth order number, and whether the child is a twin. Incorporating Boruta algorithm’s significant features, the performance of traditional LR and ML methods including DT, SVM, NB, RF, XGBoost, and AB were evaluated where LR, had a specificity, sensitivity, accuracy and F1 score of 0.85, 0.5, 85.15% and 0.915. While the ML methods DT, SVM, NB, RF, XGBoost, and AB model’s respective accuracy values were 85.35%, 85.15%, 84.54%, 81.18%, and 84.41%. Based on the specificity, sensitivity, accuracy, F1 score and AUC, RF (specificity = 0.99, sensitivity = 0.58, accuracy = 85.86%, F1 score = 0.9243, AUC = 0.549) outperformed the other methods. Both the classical (LR) and machine learning (ML) models’ performance has improved dramatically when important characteristics are extracted using the wrapper method. The LR method identified five significant features with a specificity, sensitivity, accuracy and F1 score of 0.87, 0.33, 87.12% and 0.9309. The region, whether the infant is a twin, and cesarean delivery were the three key features discovered by the DT and RF models, which were implemented using the wrapper technique. All three models had the identical F1 score of 0.9318. However, “child is twin” was recognized as a significant feature by the SVM, NB, and AB models, with an F1 score of 0.9315. Ultimately, with an F1 score of 0.9315, the XGBoost model recognized “child is twin” and “age at first sex” as relevant features. Random Forest again beat the other approaches in this instance.ConclusionsThe study reveals Wrapper method as the optimal feature selection technique. The ML method outperforms traditional methods, with Random Forest (RF) being the most effective predictive model for Low-Birth-Weight prediction. The study suggests that policymakers in Bangladesh can mitigate low birth weight newborns by considering identified risk factors.

Single-cell RNA-seq overcomes the shortcomings of conventional transcriptome sequencing technology and could provide a powerful tool for distinguishing the transcriptome characteristics of various cell types in biological tissues, and comprehensively revealing the heterogeneity of gene expression between cells. Many Intelligent Computing methods have been presented to infer gene regulatory network (GRN) with single-cell RNA-seq data. In this paper, we investigate the performances of seven classifiers including support vector machine (SVM), random forest (RF), Naive Bayesian (NB), GBDT, logical regression (LR), decision tree (DT) and K-Nearest Neighbor (KNN) for solving the binary classification problems of GRN inference with single-cell RNA-seq data (Single_cell_GRN). In SVM, three different kernel functions (linear, polynomial and radial basis function) are utilized, respectively. Three real single-cell RNA-seq datasets from mouse and human are utilized. The experiment results prove that in most cases supervised learning methods (SVM, RF, NB, GBDT, LR, DT and KNN) perform better than unsupervised learning method (GENIE3) in terms of AUC. SVM, RF and KNN have the better performances than other four classifiers. In SVM, linear and polynomial kernels are more fit to model single-cell RNA-seq data.

Online games are hazardous to one's health and well-being. Addiction to video games has now become a concern to Bangladeshi youth. Our lives are negatively impacted by online gaming. We must keep an eye on our country's youth to ensure that they do not become addicted to any kind of internet gaming. We must refrain from playing games in order to avoid being hooked on them. Machine learning will be used to forecast the likelihood of becoming addicted to video games. We begin by reviewing relevant studies, journals, and internet publications, and then we speak with online gaming addictions. We discovered certain common elements that are linked to gaming addiction and Lemmen’s gaming addiction scale to measure the whether a person is addicted or not. Then, based on those criteria, such as age, gender, mental pressure, and so on, we collect data. We gather information from both addicts and nonaddicts. There are two possible outcomes: We processed all of the data once it was collected and developed a processed dataset. On our processed dataset, we used machine learning techniques. In different predictions and detection systems, machine learning, artificial intelligence and deep learning are applied. KNN (K-Nearest Neighbor), LR (Logistic Regression), Support Vector Machine (SVM), Gaussian Naive Bayes (GNB), Random Forest (RF), Adaptive Boosting (ADA Boosting), Decision Tree (DT), XGBOOST and Gradient Boosting (GB) classifier are some of the methods we utilize. Adaptive Boosting outperformed the other nine methods in our study. All the nine classifiers predict with high accuracy and among them, Adaptive Boosting (ADA Boosting) gives the maximum accuracy which is 93.00%.

Female Genital mutilation (FGM) has been associated with numerous negative health effects like sexual dysfunction, chronic pain, infections, infertility, and an increased risk of maternal mortality. To date, no recognized studies in sub-Saharan Africa (SSA) have combined machine learning (ML) models with nationally representative Demographic and Health Survey (DHS) data to classify FGM. Therefore, this study aims to identify the most effective ML model for classifying FGM in SSA. ML offers the significant advantage of handling extremely large and complex datasets with numerous variables and interactions, providing more accurate classifications than conventional statistical methods. This study used secondary data from the DHS collected between 2015 and 2023 in 11 SSA countries. The DHS employs a cross-sectional study design. A total of 62,249 women who had at least one daughter were included in the analysis. Seven classification algorithms, including Logistic Regression, Decision Tree, Random Forest (RF), Support Vector Machine (SVM), K-Nearest Neighbors (KNN), XGBoost (XGB), and Naive Bayes (NB), were used to classify FGM. The RF classifier yielded the highest performance, achieving 0.85 accuracy, 0.83 precision, 0.88 recall, 0.85 F1 score, and 0.93 AUC. Random Forest (Brier score = 0.1319) and Decision Tree (0.1328) showed best calibration. The SHAP plots provide a comprehensive interpretation of the features influencing the model's classification of whether a mother reports that at least one daughter has undergone FGM. The bar plot shows the global importance of each feature, with opinion on FGM (+ 0.14), country of residence (+ 0.13), respondent's circumcision status (+ 0.11), and religious justification for FGM (+ 0.07) contributing the most on average to the classification of FGM. This study applied seven machine ML techniques to classify FGM in SSA, with the Random Forest classifier demonstrating the best performance. SHAP interpretability findings indicated that maternal opinion on FGM, country of residence, religious justifications for FGM, and the respondent's circumcision status contributed most, on average, to the classification of FGM. These results suggest that education and advocacy efforts aimed at mothers particularly those who have had FGM themselves or who believe that the practice is justified by religion should be given top priority in interventions. Implementing community engagement initiatives that challenge accepted conventions and ideas around FGM may be particularly beneficial, especially when these practices are rooted in religious or cultural justifications.

Background Malaria remains a major cause of illness and death among children under five in Nigeria, despite efforts to control transmission. Accurate and reliable prediction of malaria outbreaks is crucial for health authorities to take timely measures. This study aims to identify the most robust machine learning classification algorithms for predicting the status of malaria in children under five (0-59 months). Methods The 2021 Nigeria Malaria Indicator Survey (NMIS) included 10,655 children under five who were tested for malaria using the Rapid Diagnostic Test (RDT). Various machine learning models were explored, including Decision Trees, K-Nearest Neighbor, Naïve Bayes, Random Forest, Support Vector Machines, and Survey Logistic Regression, and their performance was evaluated through metrics such as accuracy, AUC, balanced accuracy, F1-Score, negative predictive value, precision, sensitivity, and specificity. Results Random Forest (RF) is the most robust and balanced classification model due to its superior accuracy (79%), precision (77%), recall (62%), F1-score (69%), and AUC (80%). Support Vector Machine (SVM) also demonstrated strong performance, particularly in accuracy (74%) and AUC (80%). Survey Logistic Regression (SLR) and Decision Tree (DT) offered moderate results but fell short compared to RF and SVM, indicating the need for further optimization. Naive Bayes (NB) and K-Nearest Neighbors (KNN) had limitations, making them less reliable for this task. Conclusion In conclusion, the study reveals that RF and SVM are the best classification models for predicting malaria status in children under five years old. RF is reliable and balanced, while SVM is preferred for recall. SLR and DT show potential but require optimization. NB and KNN have significant performance gaps, making them less suitable. These findings will help policymakers and malaria intervention programs address key factors, enabling more targeted public health interventions to reduce the malaria burden on young children and improve the well-being of vulnerable populations in Nigeria.

Parking space management has become a critical challenge in urban areas due to increasing vehicle numbers and limited parking infrastructure. This paper presents a comprehensive study of machine learning (ML) models in IoT‐enabled environments focusing on proposing an ML‐based model for predicting available parking space. The study evaluates the performance of various models including K‐nearest neighbors (KNNs), support vector machines (SVMs), random forest (RF), decision tree (DT), logistic regression (LR), and Naïve Bayes (NB) based on “precision, recall, accuracy, and F1‐score performance metrics”. The results obtained by implementing ML models on the data with 65% and 85% threshold values are compared to draw meaningful conclusions regarding their performance in predicting parking space availability. Among the evaluated models, random forest (RF) demonstrates superior performance with high precision, recall, accuracy, and F1‐score values. It showcases its effectiveness in accurately predicting parking space availability in the IoT‐enabled environment. On the other hand, models such as K‐nearest neighbors (KNNs), decision tree (DT), logistic regression (LR), and Naïve Bayes (NB) show relatively lower performance in complex parking scenarios. The paper concludes that the use of advanced predictive models, particularly random forest, significantly enhances the accuracy and reliability of IoT‐enabled parking management systems and also reduces the waiting time of the vehicles, leading to more efficient resource utilization, reduced traffic congestion in real‐time scenarios, and better user satisfaction in the IoT‐enabled environment.

Depression is an extremely serious illness of humans which causes constant mood swings and feelings of sadness. Nowadays, it is considered to be a deadly disorder in the world. At present, everyone from young to old is suffering from depression but most of them do not have the right idea about their mental state. Everyone needs to have a proper idea about their mental state. We will detect depression through a machine learning-based detection approach. Talking with psychologists and depressed people, we find some factors that are related to becoming depressed, and depending on those factors, information is collected from both depressed and non-depressed people. After applying preprocessing techniques, a processed dataset was created finally. Then, feature selection techniques were used. We applied eight machine learning algorithms and two feature selection methods to our dataset. We used k-nearest neighbor (k-NN), decision tree (DT), linear discriminant analysis (LDA), adaptive boosting (AB), support vector machine (SVM), naive Bayes (NB), random forest (RF), and logistic regression (LR) classifier. In our work, the RF classifier gave the best performance based on accuracy and the accuracy of the RF classifier was 96.00%.KeywordsMachine learningFeature selectionRandom forestSelectKBestDetectionDepression

Applying data mining techniques to classify patients with suspected hepatitis C virus infection

This study’s main purpose is to provide helpful information using blood samples from COVID-19 patients as a non-medical approach for helping healthcare systems during the pandemic. Also, this paper aims to evaluate machine learning algorithms for predicting the survival or death of COVID-19 patients. We use a blood sample dataset of 306 infected patients in Wuhan, China, compiled by Tangji Hospital. The dataset consists of blood’s clinical indicators and information about whether patients are recovering or not. The used methods include K-nearest neighbor (KNN), decision tree (DT), logistic regression (LR), support vector machine (SVM), random forest (RF), stochastic gradient descent (SGD), bagging classifier (BC), and adaptive boosting (AdaBoost). We compare the performance of machine learning algorithms using statistical hypothesis testing. The results show that the most critical feature is age, and there is a high correlation between LD and CRP, and leukocytes and CRP. Furthermore, RF, SVM, DT, AdaBoost, DT, and KNN outperform other machine learning algorithms in predicting the survival or death of COVID-19 patients.

Text mining is a special case of data mining which explore unstructured or semi-structured text documents, to establish valuable patterns and rules that indicate trends and significant features about specific topics. Text mining has been in pattern recognition, predictive studies, sentiment analysis and statistical theories in many areas of research, medicine, financial analysis, social life analysis, and business intelligence. Text mining uses concept of natural language processing and machine learning. Machine learning algorithms have been used and reported to give great results, but their performance of machine learning algorithms is affected by factors such as dataset domain, number of classes, length of the corpus, and feature selection techniques used. Redundant attribute affects the performance of the classification algorithm, but this can be reduced by using different feature selection techniques and dimensionality reduction techniques. Feature selection is a data preprocessing step that chooses a subset of input variable while eliminating features with little or no predictive information. Feature selection techniques are Information gain, Term Frequency, Term Frequency-Inverse document frequency, Mutual Information, and Chi-Square, which can use a filters, wrappers, or embedded approaches. To get the most value from machine learning, pairing the best algorithms with the right tools and processes is necessary. Little research has been done on the effect of feature selection techniques on classification accuracy for pairing of these algorithms with the best feature selection techniques for optimal results. In this research, a text classification experiment was conducted using incident management dataset, where incidents were classified into their resolver groups. Support vector machine (SVM), K-Nearest Neighbors (KNN), Naïve Bayes (NB) and Decision tree (DT) machine learning algorithms were examined. Filtering approach was used on the feature selection techniques, with different ranking indices applied for optimal feature set and classification accuracy results analyzed. The classification accuracy results obtained using TF were, 88% for SVM, 70% for NB, 79% for Decision tree, and KNN had 55%, while Boolean registered 90%, 83%, 82% and 75%, for SVM, NB, DT, and KNN respectively. TF-IDF, had 91%, 83%, 76%, and 56% for SVM, NB, DT, and KNN respectively. The results showed that algorithm performance is affected by feature selection technique applied. SVM performed best, followed by DT, KNN and finally NB. In conclusion, presence of noisy data leads to poor learning performance and increases the computational time. The classifiers performed differently depending on the feature selection technique applied. For optimal results, the classifier that performed best together with the feature selection technique with the best feature subset should be applied for all types of data for accurate classification performance. Keywords: Text Classification, Supervised Machine Learning, Feature Selection DOI : 10.7176/JIEA/9-3-06 Publication date :May 31 st 2019

This study aims to analyze the performance of machine learning models for detecting Internet of Things malware utilizing a recent IoT dataset. Experiments on the IoT dataset were conducted with nine well-known machine learning techniques, consisting of Logistic Regression (LR), Naive Bayes (NB), Decision Tree (DT), k-Nearest Neighbors (KNN), Support Vector Machines (SVM), Neural Networks (NN), Random Forest (RF), Bagging (BG), and Stacking (ST). The results show that the proposed model attains 100% accuracy in detecting IoT malware for DT, SVM, RF, BG; about 99.9% percent for LR, NB, KNN, NN; and only 28.16% for ST classifier. This study also shows higher performance than other proposed machine learning models evaluated on the same dataset. Therefore, the results of this study can help both the researchers and application developers in designing and building intelligent malware detection systems for IoT devices.

The flow of traffic analysis can be helpful for to improving the traffic quality and protect it from the conditions to cause danger, risk, or injury. Our goal is about reducing the accidents risk which involves designing the roads and principles. The previous road designing patterns of highly accidental risk. Especially some of the circumstances of accidents may be related to the driver such as driver fault, health problems, or also vehicles such as brake failure, steering, or the road itself such as poor sidewalks, and lack of road equipment, and safety measures. In this paper, we talk about some of the best road designing techniques in the world. ‘Double crossover diamond interchange (DCD)’, is a true way to go more people reduce the vehicle striking violently against another. One more design is that a ‘roundabout’, is a circular common intersection where the vehicles can travel anticlockwise around that center part. In This Modern roundabout, there is no need for traffic signals or speed breakers. When the vehicles enter the roundabout zone, if traffic is there in the roundabout, then go to the circulating roadway area and go to their desired street. Find the exact models to predict the deaths and severe injuries caused by road accidents. This analysis needs to classify the various models of machine learning and data science algorithms for instance Linear Regression, Decision Tree, Random Forest (RF), and Naive Bayes Classification and Support Vector Machine (SVM). The decision tree algorithm has a root node and contain child nodes. But Random Forest is having multiple decision trees. Random Forest has the best performance with 79% accuracy then decision tree with 70% accuracy, SVM with 75%, Logic Regression with 72%, and Naive Bayes with 73% accuracy.

Machine learning (ML) models are cost-effective tools that can establish a prognosis by considering clinical, genomic, and histological data from breast cancer patients. In this study, we evaluate the performance of 12 ML models in predicting the overall survival of breast cancer patients from “The Cancer Genome Atlas-Breast Cancer” database at 60 months of follow-up. The models evaluated were Logistic Regression (LR), Ridge Classifier (RC), Least Absolute Shrinkage and Selection Operator (LASSO), K-Nearest Neighbors (KNN), Naive Bayes (NB), Linear Discriminant Analysis (LDA), Decision Tree (DT), Multilayer Perceptron (MP), Stochastic Gradient Descent (SGD), Support Vector Machine (SVM), Random Forest (RF), and XGBoost (XGB). The most accurate models were NB (86.76%) and SGD (85.29%). The models with the highest sensitivity were SGD (93.75%), MP (91.67%), and NB (89.89%), while the models with the highest specificity were KNN (95.0%), DT (90.0%), and LASSO (85.0%). The models with the highest area under the ROC curve were LDA (90.83%), LASSO (90.1%), and LR (89.79%). The most relevant variables were “Previous Diagnosis of Cancer,” “Presence of Tumor,” “Ancillary Therapy,” and “Histology.” Our findings demonstrate that AI tools for predicting patient outcomes are a viable option when expensive prognostic genomic tools are not available. According to our results, NB and LASSO show promising performance in predicting the prognosis of breast cancer patients. Further studies with data from developing countries are needed to improve the performance of these tools.

Advancement in technology has helped people to live a long and better life. But the increased life expectancy has also elevated the risk of age related disorders, especially the neurodegenerative disorders. Alzheimer’s is one such neurodegenerative disorder, which is also the leading contributor towards dementia in elderly people. Despite of extensive research in this field, scientists have failed to find a cure for the disease till date. This makes early diagnosis of Alzheimer’s very crucial so as to delay its progression and improve the condition of the patient. Various techniques are being employed for diagnosing Alzheimer’s which include neuropsychological tests, medical imaging, blood based biomarkers, etc. Apart from this, various machine learning algorithms have been employed so far to diagnose Alzheimer’s in its early stages. In the current research, authors compared the performance of various machine learning techniques i.e., Linear Discriminant Analysis (LDA), K-Nearest Neighbour (KNN), Naïve Bayes (NB), Support Vector Machines (SVM), Decision Trees (DT), Random Forests (RF) and Multi Layer Perceptron (MLP) on Alzheimer’s dataset. This paper experimentally demonstrated that normalization exhibits a predominant role in enhancing the efficiency of some machine learning algorithms. Therefore it becomes imperative to choose the algorithms as per the available data. In this paper, the efficiency of the given machine learning methods was compared in terms of accuracy and f1-score. Naïve Bayes gave a better overall performance for both accuracy and f1-score and it also remained unaffected with the normalization of data along with LDA, DT and RF. Whereas KNN, SVM and MLP showed a drastic (17% to 86%) improvement in the performance when they are given normalized data as compared to un-normalized data from Alzheimer’s dataset.

Aim: The aim of the work is to evaluate the accuracy and precision in predicting heart disease using Support Vector Machine (SVM), Random forest (RF), Logistic Regression (LR), Decision Tree (DT) Classification algorithms. Materials and Methods: Classification algorithm is appealed on a heart dataset which consists of 180 records. A framework for heart disease prediction in the medical sector comparing Random forest, Logistic Regression, Decision Tree and SVM classifiers has been proposed and developed. The sample size was calculated as 55 in each group using G power 80%. Sample size was calculated using clincalc analysis, with alpha and beta values 0.05 and 0.5, 95% confidence, pretest power 80% and enrolment ratio 1. Results: The Novel Random Forest Algorithm (92.13%), Support Vector Machine (62.51%), Logistic Regression (84.89%), Decision Tree (86.25%) classifiers produce respectively. SVM, RF exists a statistically significant difference between the two groups (p=0.001,p=.004;p<0.05).LR, RF exists a statistically insignificant difference between the two groups (p=.103, P=.080;p>0.05) both with confidence interval 95%. Hence Random forest is better than SVM, RF, DT classifiers. Conclusion: The results show that the performance of RF is better when compared with SVM, LR and DT in terms of both precision and accuracy.