Machine Learning-Driven Malware Detection: Integrating PCA and PSO for Efficient Classification

Introduction: Since the delay or mistake in the diagnosis of mood disorders due to the similarity of their symptoms hinders effective treatment, this study aimed to accurately diagnose mood disorders including psychosis, autism, personality disorder, bipolar, depression, and schizophrenia, through modeling and analyzing patients' data . Method : Data collected in this applied developmental research included 996 records with 130 features obtained by interviewing and completing questionnaires in a mental hospital in the city of Sari, Iran in 2021. After preprocessing, the number of features was reduced to 91, and then through Principal Component Analysis (PCA) reduced to 35 factors. Modeling was done in Python software with K -Nearest Neighbor (KNN), Naive Bayes (NB), Decision Tree (DT), Random Forest (RF), Logistic Regression (LR), and Support Vector Machine (SVM) algorithms. The models were evaluated to select algorithms with higher accuracy. Particle Swarm Optimization (PSO) and Genetic Algorithm (GA) were applied to determine the optimal parameters of the selected algorithms . Results: Among the machine learning algorithms, random forest with 91% accuracy and support vector machine with 90% accuracy showed better performance. The genetic algorithms did not make any notable increase in prediction accuracy. Whereas considering N=30, T=150, W=0.9, c1=2, and c2=2 in the particle swarm optimization algorithm increased the prediction accuracy up to 3.3 %. Conclusion : With less classification error compared to similar studies, the PSO -SVM model designed in this study can be used in patient data monitoring with acceptable accuracy and can be used in intelligent systems in psychiatric centers.

Palm Vein Identification (PVI) is a modern biometric security technique used for enhancing security and
\nauthentication systems. The key characteristics of palm vein patterns include its uniqueness to each individual, its
\nunforgettability, non-intrusiveness and its ability for disallowing unauthorized persons. However, the extracted
\nfeatures from the palm vein patterns are huge with high redundancy. In this paper, we propose a combined model of
\ntwo-Dimensional Discrete Wavelet Transform, Principal Component Analysis (PCA), and Particle Swarm
\nOptimization (PSO) (2D-DWTPP) that feeds wrapper model with an optimal subset of features to enhance the
\nprediction accuracy of -palm vein patterns. The 2D-DWT extract features from palm vein images, using the PCA to
\nreduce the redundancy in palm vein features. The system has been trained to select high recognition features based on
\nthe wrapper model. The proposed system uses four classifiers as an objective function to determine PVI which include
\nSupport Vector Machine (SVM), K Nearest Neighbor (KNN), Decision Tree (DT) and Naïve Bayes (NB). The
\nempirical results proved that the proposed model has the best results with SVM. Moreover, our proposed 2D-DWTPP
\nmodel has been evaluated and the results show remarkable efficiency in comparison with AlexNet and other classifiers
\nwithout feature selection. Experimentally, the proposed model has better accuracy as reflected by 98.65% whereas
\nAlexNet has 63.5% accuracy and the classifier without feature selection process has 78.79% accuracy.

This project focuses on using machine learning to predict a patient’s risk of developing diabetes based on a test. This database, compiled by the National Institute of Diabetes and Digestive and Kidney Diseases, contains health indicators for Pima Indian patients. The project involves several key steps: initial data, selecting a feature, selecting a model, updating the hyperparameter, and deploying it via the Flask web application. In the data preprocessing phase, feature scaling and normalization are used to standardize the dataset, while missing values and outliers are handled to ensure data integrity. Feature selection uses correlation matrix and recursive feature elimination (RFE) to reduce dimensionality and improve model efficiency. To ensure the model is optimized for latent data, the dataset is split into two parts: 66% for training and 34% for testing. Various machine learning algorithms are evaluated, including logistic regression, naive Bayes, K-nearest neighbours, decision trees, and support vector classifiers. Logistic regression was selected as the final model due to its accuracy on the test data (80.53%). The model uses grid search for hyperparameter tuning to improve its performance. The training model is embedded in the Flask web application, allowing users to access health metrics and get real-time estimates of blood pressure. The system is designed to be user-friendly and scalable, providing a practical tool for early diagnosis of diabetes. All methods ensure that the model is accurate, reliable, and capable of making real-world predictions. Keywords: prediction, diabetes, glucoses, insulin, machine learning, logistic regression, naive bayes, k- nearest neighbours, decision tree, support vector classifier.

Feature extraction for machine learning-based intrusion detection in IoT networks

Farmers’ physical labor and debt are reduced as a result of agricultural automation, which emphasizes efficient and effective use of various machines in farming operations with the purpose of reducing physical labor and debt. It is a revolutionary idea in agriculture to create custom hiring centers, which are intended to make it easier for like-minded farmers to embrace technology/machinery for enhanced resource management practices. The study in question examines the significance of tool renting and sharing in the workplace. Rental and sharing equipment are two approaches that might be used to enable farmers to borrow equipment at a cheaper cost than they would otherwise have to pay for it. The following is a manual pilot study of 562 farmers in India to address the numerous challenges farmers face when looking for tools and equipment, as well as to determine their strong interest in the process of renting and sharing equipment. The study was conducted to address the numerous challenges farmers face when looking for tools and equipment and to determine their strong interest in the process of renting and sharing equipment. Farmers are divided into three groups according to the results of this poll: small, moderate, and large. Training and testing splits were used on the same data set in order to get a better understanding of the target variables. The data set for the survey was standardized in order to remove ambiguity. In this research, three different machine learning models were utilized: nearest neighbors, logistic regression, and decision trees. K-nearest neighbors was the most often used model, followed by logistic regression and decision trees. In order to get the best possible result, a comparison of the aforementioned algorithm models was carried out, which revealed that the decision tree is the better model among the others in this regard. Because the decision tree model is completely reliant on a large number of input factors, such as the kind of crop, the time/month of harvest, and the type of equipment necessary for the crops, it has the potential to have a social and economic impact on farmers and their livelihoods.

Researchers have extensively employed machine learning (ML) approaches to establish forecasting systems in numerous domains like software faults, spam identification, disease foresting, and fraud recognition. The detection of individuals susceptible to heart disease (HD) could assist medical practitioners in their verdict concerning treatments and management. This study, therefore, is projected to examine the discriminative power of numerous prognosticators in the research to intensify the efficiency of HD discovery through their warning signs. A dimensionality reduction method called principal component analysis (PCA) and three machine learning (ML) classifiers which are Naïve Bayes (NB), random forest (RF), and support vector machine (SVM) are employed in the study. The three ML classifiers were implemented with PCA DR. The techniques’ performance was evaluated on a dataset attained from National Health Service (NHS) database. The system was evaluated using confusion matrix measures for instance, accuracy, precision, specificity, f1-score, detection rate, and false-positive rate (FPR). A comparative analysis was conducted between the three ML classifiers with PCA DR. It was concluded that the classifiers.KeywordsMachine learningPCASupport vector machineRandom forestNaïve Bayes

Churn prediction in telecom using Random Forest and PSO based data balancing in combination with various feature selection strategies

(1) Objective: To evaluate the performance of ultrasound-based radiomics in the preoperative prediction of human epidermal growth factor receptor 2-positive (HER2+) and HER2− breast carcinoma. (2) Methods: Ultrasound images from 309 patients (86 HER2+ cases and 223 HER2− cases) were retrospectively analyzed, of which 216 patients belonged to the training set and 93 patients assigned to the time-independent validation set. The region of interest of the tumors was delineated, and the radiomics features were extracted. Radiomics features underwent dimensionality reduction analyses using the intra-class correlation coefficient (ICC), Mann–Whitney U test, and the least absolute shrinkage and selection operator (LASSO) algorithm. The radiomics score (Rad-score) for each patient was calculated through a linear combination of the nonzero coefficient features. The support vector machine (SVM), K nearest neighbors (KNN), logistic regression (LR), decision tree (DT), random forest (RF), naive Bayes (NB) and XGBoost (XGB) machine learning classifiers were trained to establish prediction models based on the Rad-score. A clinical model based on significant clinical features was also established. In addition, the logistic regression method was used to integrate Rad-score and clinical features to generate the nomogram model. The leave-one-out cross validation (LOOCV) method was used to validate the reliability and stability of the model. (3) Results: Among the seven classifier models, the LR achieved the best performance in the validation set, with an area under the receiver operating characteristic curve (AUC) of 0.786, and was obtained as the Rad-score model, while the RF performed the worst. Tumor size showed a statistical difference between the HER2+ and HER2− groups (p = 0.028). The nomogram model had a slightly higher AUC than the Rad-score model (AUC, 0.788 vs. 0.786), but no statistical difference (Delong test, p = 0.919). The LOOCV method yielded a high median AUC of 0.790 in the validation set. (4) Conclusion: The Rad-score model performs best among the seven classifiers. The nomogram model based on Rad-score and tumor size has slightly better predictive performance than the Rad-score model, and it has the potential to be utilized as a routine modality for preoperatively determining HER2 status in BC patients non-invasively.

Background and aimsThe birth weight of a newborn is a crucial factor that affects their overall health and future well-being. Low birth weight (LBW) is a widespread global issue, which the World Health Organization defines as weighing less than 2,500 g. LBW can have severe negative consequences on an individual’s health, including neonatal mortality and various health concerns throughout their life. To address this problem, this study has been conducted using BDHS 2017–2018 data to uncover important aspects of LBW using a variety of machine learning (ML) approaches and to determine the best feature selection technique and best predictive ML model.MethodsTo pick out the key features, the Boruta algorithm and wrapper method were used. Logistic Regression (LR) used as traditional method and several machine learning classifiers were then used, including, DT (Decision Tree), SVM (Support Vector Machine), NB (Naïve Bayes), RF (Random Forest), XGBoost (eXtreme Gradient Boosting), and AdaBoost (Adaptive Boosting), to determine the best model for predicting LBW. The model’s performance was evaluated based on the specificity, sensitivity, accuracy, F1 score and AUC value.ResultsResult shows, Boruta algorithm identifies eleven significant features including respondent’s age, highest education level, educational attainment, wealth index, age at first birth, weight, height, BMI, age at first sexual intercourse, birth order number, and whether the child is a twin. Incorporating Boruta algorithm’s significant features, the performance of traditional LR and ML methods including DT, SVM, NB, RF, XGBoost, and AB were evaluated where LR, had a specificity, sensitivity, accuracy and F1 score of 0.85, 0.5, 85.15% and 0.915. While the ML methods DT, SVM, NB, RF, XGBoost, and AB model’s respective accuracy values were 85.35%, 85.15%, 84.54%, 81.18%, and 84.41%. Based on the specificity, sensitivity, accuracy, F1 score and AUC, RF (specificity = 0.99, sensitivity = 0.58, accuracy = 85.86%, F1 score = 0.9243, AUC = 0.549) outperformed the other methods. Both the classical (LR) and machine learning (ML) models’ performance has improved dramatically when important characteristics are extracted using the wrapper method. The LR method identified five significant features with a specificity, sensitivity, accuracy and F1 score of 0.87, 0.33, 87.12% and 0.9309. The region, whether the infant is a twin, and cesarean delivery were the three key features discovered by the DT and RF models, which were implemented using the wrapper technique. All three models had the identical F1 score of 0.9318. However, “child is twin” was recognized as a significant feature by the SVM, NB, and AB models, with an F1 score of 0.9315. Ultimately, with an F1 score of 0.9315, the XGBoost model recognized “child is twin” and “age at first sex” as relevant features. Random Forest again beat the other approaches in this instance.ConclusionsThe study reveals Wrapper method as the optimal feature selection technique. The ML method outperforms traditional methods, with Random Forest (RF) being the most effective predictive model for Low-Birth-Weight prediction. The study suggests that policymakers in Bangladesh can mitigate low birth weight newborns by considering identified risk factors.

Gesture recognition is a topic in computer science and language technology that aims to interpret human gestures with computer programs and many different algorithms. It can be seen as the way computers can understand human body language. Today, the main interaction tools between computers and humans are still the keyboard and mouse. Gesture recognition can be used as a tool for communication with the machine and interaction without any mechanical device such as a keyboard or mouse. In this paper, we present the results of a comparison of eight different machine learning (ML) classifiers in the task of human hand gesture recognition and classification to explore how to efficiently implement one or more tested ML algorithms on an 8-bit AVR microcontroller for on-line human gesture recognition with the intention to gesturally control the mobile robot. The 8-bit AVR microcontrollers are still widely used in the industry, but due to their lack of computational power and limited memory, it is a challenging task to efficiently implement ML algorithms on them for on-line classification. Gestures were recorded by using inertial sensors, gyroscopes, and accelerometers placed at the wrist and index finger. One thousand and eight hundred (1800) hand gestures were recorded and labelled. Six important features were defined for the identification of nine different hand gestures using eight different machine learning classifiers: Decision Tree (DT), Random Forests (RF), Logistic Regression (LR), Linear Discriminant Analysis (LDA), Support Vector Machine (SVM) with linear kernel, Naïve Bayes classifier (NB), K-Nearest Neighbours (KNN), and Stochastic Gradient Descent (SGD). All tested algorithms were ranged according to Precision, Recall, and F1-score (abb.: P-R-F1). The best algorithms were SVM (P-R-F1: 0.9865, 0.9861, and 0.0863), and RF (P-R-F1: 0.9863, 0.9861, and 0.0862), but their main disadvantage is their unusability for on-line implementations in 8-bit AVR microcontrollers, as proven in the paper. The next best algorithms have had only slightly poorer performance than SVM and RF: KNN (P-R-F1: 0.9835, 0.9833, and 0.9834) and LR (P-R-F1: 0.9810, 0.9810, and 0.9810). Regarding the implementation on 8-bit microcontrollers, KNN has proven to be inadequate, like SVM and RF. However, the analysis for LR has proved that this classifier could be efficiently implemented on targeted microcontrollers. Having in mind its high F1-score (comparable to SVM, RF, and KNN), this leads to the conclusion that the LR is the most suitable classifier among tested for on-line applications in resource-constrained environments, such as embedded devices based on 8-bit AVR microcontrollers, due to its lower computational complexity in comparison with other tested algorithms.

Social media are the influential Internet community for general netizens to disseminate information, views, and opinions extensively. Recently, the research on Sentiment analysis has intensified due to the vast amount of data obtained from these numerous social networking platforms. During this COVID-19 pandemic, one of the great social networking sites viz. Twitter has experienced a significant increase in online posts and reviews concerning COVID-19 related tweets. In the view of Twitter, the spread of news concerning coronavirus variants has impacted many aspects of the public by providing messages around different issues and opinions to its potential users. In this study, we have used Twitter as a source of data for searching the index keywords and hashtag versions for the terms like “Pandemic”, “Coronavirus”, “COVID-19”, “SARS-CoV-2”, and “Omicron”, and we have examined the psychological and emotional impact it had on the public. This paper provides analytical information about people’s perceptions of coronavirus (tweets were collected from March 2020 to December 2021). With those tweets, sentiment analysis was performed using the TextBlob text processing python module to acquire the people’s subjective data (opinions and feelings) polarity concerning the effects of coronavirus. Furthermore, for effective text classification, we have applied classification methodologies like Support Vector Machine (SVM), K Nearest Neighbor (KNN), Logistic Regression (LR), and Decision Tree (DT). The SVM concerning feature extraction produced the results with 99.49% accuracy. This study assists the government organizations in attaining COVID-19 insights by implying public mental health sentiments in social networks.

ObjectiveThis study aimed to systematically identify risk factors for urinary catheter-related hematuria in patients with acute myocardial infarction (AMI). By integrating logistic regression and decision tree models, we sought to develop actionable strategies for risk stratification and complication prevention.MethodsA retrospective analysis of 209 AMI patients was conducted to evaluate predictors of hematuria, including demographics, coagulation indices (INR, platelets), and procedural variables. Logistic regression and decision tree (CART algorithm) models were employed to identify risk factors and their interactions. Model performance was assessed using ROC-AUC, sensitivity, and specificity.ResultsThe incidence of catheter-related hematuria was 32.5%. Both models identified persistent agitation during catheter indwelling and PLT ≤ 246 as common predictors. The logistic regression model specifically identified Gender (OR = 0.202), patient awareness of catheter purpose and precautions (OR = 0.470), and emergency catheter placement (OR = 2.257) as significant factors. The decision tree model uniquely identified INR > 0.955 and repeated complaints of urethral pain as predictors.ConclusionHematuria in AMI patients results from coagulation dysfunction, procedural trauma, and behavioral factors. The combined use of logistic regression and decision trees enhances risk stratification. Clinical strategies should prioritize gentle catheterization, dynamic coagulation monitoring, and patient education to reduce complications.

Malware Detection using conventional methods is incompetent to detect new and generic malware. For the investigation of a variety of malware, there were no ready-made machine learning datasets available for malware detection. So we generated our dataset by downloading a variety of malware files from the world's famous malware projects. By performing unstructured data collection from the downloaded APK files and feature mining process the final dataset was generated with 16300 records and a total of 215 features. There was a need to evaluate the performance of the generated dataset with supervised machine learning classifiers. So in this paper, we propose a malware detection approach using different supervised machine learning classifiers. Here supervised algorithms, Feature Reduction Techniques, and Ensembling techniques are used to evaluate the performance of the generated dataset. Machine Learning classifiers are evaluated on the evaluation parameters like AUC, FPR, TPR, Cohen Kappa Score, Precision, and Accuracy. We also represented the results of classifiers using Bar plots of Accuracy and plotting the ROC curve. From the results of machine learning classifiers, the performance of the CatBoost Classifier is highest with Accuracy 93.15% having a value of ROC curve as 0.91 and Cohen Kappa Score as 81.56%.

A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees

Falls are one of the most serious dangers for elderly people who live alone at home. It has become a widespread issue all across the world. Reliable fall detection systems can help to mitigate the negative consequences of accidentally falling. Several techniques for automatically falling detection machines have been suggested in the past. The existing technologies are classified into three types of fall detectors: wearable sensor-based, ambient device-based, and computer vision-based approaches. This paper focuses on a dataset comprising signals from wearable sensors, ambient sensors, and vision devices. We propose a novel feature subset selection to reduce the number of effective input attributes based on a hybridized metaheuristic - an Adaptive Particle Swarm and Grey Wolf Optimization (APGWO). Classification results use various machine learning classifiers such as Logistic Regression (LR), K-Nearest Neighbor, Support Vector Machine (SVM), Decision Tree (DT), Naive Bayes (NB), Random Forest (RF), and Multilayer Perceptron (MLP), show that the proposed approach is highly effective. Classification accuracy and F1 score can reach as high as 99% and 96%, respectively.