Effective Features Selection and Machine Learning Classifiers for Improved Wireless Intrusion Detection

In cybersecurity, machine learning approaches can predict and detect threats before they result in major security incidents. The design and perform ance of an effective machine learning based Intrusion Detection System (IDS) depends upon the selected attributes and the classifier model. This paper considers multi-class classification for the Aegean Wi-Fi Intrusion Dataset (AWID) where classes represent 17 types of the IEEE 802.11 MAC Layer attacks. The proposed work extracts four attribute sets of 32, 10, 7 and 5 attributes, resp ectfully. The classifiers achieved high accuracy with minimum false positive rates, and the presented work outperforms previous related work in terms of number of classes, attributes and accuracy. The proposed work achieved maximum accuracy of 99.64% for Random Forest with supply test and 99.99% usi ng the 10-fold cross validation approach for Random Forest and J48.

Machine learning (ML) and deep learning (DL) are used in numerous fields, particularly to develop effective intrusion detection systems (IDS). Existing wireless network IDS, which rely on a single ML algorithm and have limitations. These include a high rate of false positives, difficulties in recognizing distinct attack patterns, and a high acquisition cost for annotated training datasets. However, hostile threats are always evolving, networks need a smart security solution. In comparison to other ML approaches, DL algorithms are more successful in intrusion detection. This paper presents a DL based ensemble model that combines Multi-verse through Chaotic Atom Search Optimization (MCA) for preprocessing, which eliminates unsolicited/recurrent information in the dataset. The process of optimized feature selection uses Principal Component Analysis (PCA), Chaotic Manta-ray Foraging Optimizations (CMFO), and a grounded grouping method to partition the optimized feature dataset into k-diverse clusters. The recommended model then stacks Support Vector Machine (SVM) as the ensemble model’s meta-learner classifier, pre-training the hybrid DL prototypes using the optimized feature dataset cluster. The CNN-LSTM and CNN-GRU models, which integrate Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM), and Gated Recurrent Unit (GRU), are the hybrid DL prototype’s key components. The suggested model’s performance has been enhanced and compared to six ML techniques: NB, SVM, J48, RF, MLP, and kNN models, utilizing measures such as accuracy, precision, recall, and F-measure. The public can access the Aegean Wi-Fi Intrusion Dataset (AWID) which is used for evaluating the recommended model and is outperformed the contemporary models in the literature.

Novel Artificial Immune Networks-based optimization of shallow machine learning (ML) classifiers

Wireless sensor technology has become popular due to its unique features and is advancing every day. This paper describes a set of metrics that are relevant to wireless sensor networks intrusion detection system and can be used for its evaluation. The metrics set will help designers in designing efficient intrusion detection systems for wireless sensor network that are more sensitive to attacks by intruders. The metrics discussed in this paper are general characteristics that are relevant to wireless sensor networks intrusion detection system and only the common ones are discussed. The proposed metrics set will help an administrator of a network to choose the best wireless sensor networks intrusion detection system from a set of IDS systems or to optimize a configuration of a certain wireless intrusion detection system for a given network with a particular topology, sensor nodes capabilities and anticipated types of attack.

The COVID-19 pandemic, starting in Wuhan, China in December 2019, led to widespread health and economic challenges, causing millions of deaths globally. Beyond physical health, it triggered a mental health crisis, especially during lockdowns. To understand and address this, a study collected data using 90 features during the lockdown period. Machine learning (ML) was employed to detect key features impacting mental health crises. Three ML algorithms—random forest, random tree, and multilayer perceptron—were chosen. Random forest, known for robustness, achieved 97.58% accuracy. Random tree, a supervised algorithm with decision trees, yielded 93.24% accuracy. Multilayer perceptron (MLP), an artificial neural network, achieved 94.20% accuracy by learning nonlinear relationships. A 10-fold cross-validation method was used to evaluate these ML models, enhancing performance by reducing bias and overfitting. It involves dividing data into ten subsets, training on nine, and evaluating the remaining, repeating this ten times to estimate true performance on unseen data.

Efficient water quality prediction models based on machine learning algorithms for Nainital Lake, Uttarakhand

With the advent of 5G and the era of Big Data, the rapid development of medical information technology around the world, the massive application of electronic medical records and cases, and the digitization of medical equipment and instruments, a large amount of data has accumulated in the database system of hospitals, which includes clinical diagnosis data and hospital management data. This study aimed to examine the classification effects of different machine learning algorithms on medical datasets so as to better explore the value of machine learning methods in aiding medical diagnosis. The classification datasets of four different medical fields in the University of California Irvine machine learning database were used as the research object. Also, six categories of classification models based on the Bayesian theorem idea, integrated learning idea, and rule-based and tree-based idea were constructed using the Weka platform. The between-group experiments showed that the Random Forest algorithm achieved the best results on the Indian liver disease patient dataset (ILPD), delivery cardiotocography (CADG), and lymphatic tractography (LYMP) datasets, followed by Bagging and partition and regression tree. In the within-group algorithm comparison experiments, the Bagging algorithm achieved better results than other algorithms based on the integration idea for 11 metrics on all datasets, mainly focusing on 2 binary datasets. Logit Boost had only 7 metrics with significant performance, and the best algorithm was Rotation Forest, with 28 metrics achieving optimal values. Among the algorithms based on tree ideas, the logistic model tree algorithm achieved optimal results on all metrics on the mammographic dataset (MAGR). The classification performance of BFTree, J48, and Random Tree was poor on each dataset. The best algorithm was Random Forest on the ILPD, CADG, and LYMP datasets with 27 metrics reaching the optimum. Machine learning algorithms have good application value in disease prediction and can provide a reference basis for disease diagnosis.

Despite the promise for performance and accuracy improvements of quantum inspired (QI) algorithms over classical machine learning (ML) algorithms, such gains have not been realized in practice. The quantum inspired algorithms can theoretically achieve significant speed up based on sampling assumptions and have thus far failed to outperform the existing classical ML models in practical applications. The speedup of quantum machine learning (QML) algorithms assume the access to data in quantum random access memory (QRAM) which is a strong assumption with current quantum architectures. QI algorithms assume sample and query (SQ) access to input vector and norms of matrices using a dynamic data structure. We explore the components of these models and the assumptions in this paper by surveying the recent works in QML and QI Machine learning (QIML) algorithms. We limit our study to QML and QIML models on achieving a speed up over classical ML techniques rather than individual proofs of these algorithms. This study highlights the assumptions being made that are currently not practical for QML and QIML algorithms in achieving performance advantage over classical ML algorithms.

In the realm of software development, detecting code smells is a critical task for ensuring good code quality. God class code smell specifically has a specific nature associated with a great deal of subjectivity due to the levels of coupling and cohesion associated to it. Automated techniques for code smell detection aim to resolve this subjectivity. Machine learning techniques have shown promising results that tend to improve accuracy and reduce the bias associated with other techniques for God class identification. This is due to their pattern recognition capabilities making them more objective in identifying patterns that indicate code smells. However, current results need to be further improved in terms of both accuracy and generalizability. The challenge in the use of machine learning is not only in selecting the most appropriate technique but also lies in effectively representing source code as input patterns fed to Machine Learning (ML) classifier(s). Code representation plays a pivotal role in encoding source code for ML algorithms. This study aims improving the accuracy and generalizability of God class code smell detection via exploring the effect of using various code representation techniques, namely, tree-based, metric-based, code embedding, and token-based code representation techniques on the ML detection results. The study is conducted on the MLCQ dataset, and applies various ML algorithms (specifically: Logistic Regression, Random Forest, SVM, Decision Tree, Naive Bayes, Gradient Boosting, XGBoost). The evaluation results show how different code representation techniques influence ML detection outcomes and the comparative performance of ML algorithms. The study findings reveal that the F1-score achieved outperforms prior studies on the MLCQ dataset, indicating the effectiveness of the proposed approach. The presented results reveal how the code representation technique used makes a significant impact on the ML classifier results. This paves the way for developing intelligent IDE plugins for just in time God Class code smell detection among other code smells.

Raman spectroscopy (RS) is a promising tool for cancer diagnosis. In particular, in the last years several studies have demonstrated how the diagnostic performances of RS can be significantly improved by employing machine learning (ML) algorithms for the interpretation of Raman-based data. Recently, it has been demonstrated that RS can perform an accurate classification of chondrosarcoma tissues. Chondrosarcoma is a cancer of bones, that can occur in the soft tissues near the bones. It is normally characterized by three different malignant degrees and a benign counterpart, knows as enchondroma. In line with these findings, in this paper, we exploited ML algorithms to distinguish, as well as possible, between the three grades of chondrosarcoma and to distinguish between chondrosarcoma and enchondroma. We obtained a high level of accuracy of classification by analyzing a dataset composed of a relatively small number of Raman spectra, collected in a previous study by one of the authors of this paper. Such spectra were acquired from micrometric tissue sections with a confocal Raman microscope. We tested the classification performances of a support vector machine (SVM) and a random forest classifier (RFC), as representatives of ML algorithms, and two versions of the multi-layer perceptron (MLPC) as representatives of deep learning (DL). These models, especially RFC and MLPC, showed excellent classification performances, with accuracy reaching 99.7%. This outcome makes the aforementioned models a promising route for future improvements of diagnostic devices focused on detecting cancerous bone tissues. Alongside the diagnostic purpose, the aforementioned approach allowed us to identify characteristic molecules, i.e., amino acids, nucleic acids, and bioapatites, relevant for obtaining the final diagnostic response, through the use of a tool named by us Raman Band Identification (RBI). The method to evaluate RBI is the most important contribution of this paper, because RBI could represent a relevant parameter for the identification of biochemical processes on the basis of the tumor progression and associated malignant degree. In turn, the spectral bands highlighted by RBI could provide precious indicators in an attempt to restrict the spectral acquisition to specific Raman bands. This last objective could help to reduce the amount of experimental data needed to obtain an accurate final grading outcome, with a consequent reduction in the computational cost.

to predict vestibular schwannoma (VS) response to radiosurgery by applying machine learning (ML) algorithms on radiomic features extracted from pre-treatment magnetic resonance (MR) images. patients with VS treated with radiosurgery in two Centers from 2004 to 2016 were retrospectively evaluated. Brain T1-weighted contrast-enhanced MR images were acquired before and at 24 and 36 months after treatment. Clinical and treatment data were collected contextually. Treatment responses were assessed considering the VS volume variation based on pre- and post-radiosurgery MR images at both time points. Tumors were semi-automatically segmented and radiomic features were extracted. Four ML algorithms (Random Forest, Support Vector Machine, Neural Network, and extreme Gradient Boosting) were trained and tested for treatment response (i.e., increased or non-increased tumor volume) using nested cross-validation. For training, feature selection was performed using the Least Absolute Shrinkage and Selection Operator, and the selected features were used as input to separately build the four ML classification algorithms. To overcome class imbalance during training, Synthetic Minority Oversampling Technique was used. Finally, trained models were tested on the corresponding held out set of patients to evaluate balanced accuracy, sensitivity, and specificity. 108 patients treated with Cyberknife® were retrieved; an increased tumor volume was observed at 24 months in 12 patients, and at 36 months in another group of 12 patients. The Neural Network was the best predictive algorithm for response at 24 (balanced accuracy 73% ± 18%, specificity 85% ± 12%, sensitivity 60% ± 42%) and 36 months (balanced accuracy 65% ± 12%, specificity 83% ± 9%, sensitivity 47% ± 27%). radiomics may predict VS response to radiosurgery avoiding long-term follow-up as well as unnecessary treatment.

BackgroundGiven the increasing healthcare costs, there is an interest in developing machine learning (ML) prediction models for estimating hospitalization charges. We use ML algorithms to predict hospitalization charges for patients undergoing transfemoral transcatheter aortic valve replacement (TF-TAVR) utilizing the National Inpatient Sample (NIS) database.MethodsPatients who underwent TF-TAVR from 2012 to 2016 were included in the study. The primary outcome was total hospitalization charges. Study dataset was divided into 80% training and 20% testing sets. We used following ML regression algorithms: random forest, gradient boosting, k-nearest neighbors (KNN), multi-layer perceptron and linear regression. ML algorithms were built for for 3 stages: Stage 1, including variables that were known pre-procedurally (prior to TF-TAVR); Stage 2, including variables that were known post-procedurally; Stage 3, including length of stay (LOS) in addition to the stage 2 variables.ResultsA total of 18,793 hospitalization for TF-TAVR were analyzed. The mean and median adjusted hospitalization charges were $220,725.2 ($137,675.1) and $187,212.0 ($137,971.0–264,824.8) respectively. Random forest regression algorithm outperformed other ML algorithms at all stages with higher R2 score and lower mean absolute error (MAE), root mean squared area (RMSE) and root mean squared logarithmic error (RMSLE) (Stage 1: MAE 79,979.11, R2 0.157; Stage 2: MAE 76,200.09, R2 0.256; Stage 3: MAE 69,350.09, R2 0.453). LOS was the most important predictor of hospitalization charges.ConclusionsWe built ML algorithms that predict hospitalization charges with good accuracy in patients undergoing TF-TAVR at different stages of hospitalization and that can be used by healthcare providers to better understand the drivers of charges.

Use of machine learning (ML) and data mining (DM) algorithms has surfaced more often in the recent years for disease risk prediction problems in the healthcare communities. Several traditional feature selection models are combined with the DM and ML algorithms to improve accuracy of the disease risk prediction. In this study, a new Bio-inspired Ensemble Feature Selection (BEFS) model is introduced which is applied with the DM and ML algorithms. In the BEFS model, the most relevant and highly contributing features in the prediction are determined with a bio-inspired algorithm i.e., genetic algorithm, and an ensemble algorithm i.e., random forest algorithm. These important features obtained from the proposed model are then combined in various combinations and applied with the DM and ML algorithms, here logistic regression (LR) and random forest (RF), and the results obtained are promising. The experiment is executed using the famous ML language R. To accomplish this objective, the Breast Cancer Wisconsin (Diagnostic) dataset of UCI (University of California, Irvine) ML repository is utilized. In the experimental outcomes, the highest accuracy attained with the BEFS model is 96.49%, the AUC (Area Under Curve) achieved is 96%, and the sensitivity is 98.11%. These results, which greatly improve the disease risk prediction, are higher than several other existing works, while utilizing only six most relevant features out of the thirty two features of the dataset.

The objective of this study is to evaluate and compare the performance of different machine learning (ML) algorithms, viz., multi-layer perceptron (MLP), random forest (RF), extra trees regressor (ETR), CatBoost, and gradient boost (GB), considering the impact of variation in sample sizes for theprediction of soil nutrients. In this context, this study evaluates the impact of sample size on the prediction performance of five ML algorithms for mapping 14 soil properties, including key soil physico-chemical properties (soil organic carbon, pH, and electrical conductivity), and multiple macro (available nitrogen, phosphorus, potassium, calcium, magnesium, and sulfur) and micronutrients (available iron, manganese, copper, zinc, and boron) at a geographical extent of 8303 km2 located in eastern India. A total of 1024 surface soil samples were collected, of which 800 were used for model training, while the remaining 224 were reserved for independent validation (IV) of the resultant maps. The original training data set (800 samples) was reduced by random selection into six different sample sizes, i.e., 800, 400, 200, 100, 50, and 25. An exhaustive set of 574 environmental variables, derived from digital terrain derivatives and Sentinel-2 satellite imagery, was used as predictors. Popular statistical indicators, such as Lin's concordance correlation coefficient (CCC) and root mean squared error (RMSE) were employed to evaluate the predictive capability of the algorithms under different sample size scenarios. The results showed that prediction accuracy and reliability of prediction performance across multiple target variables improved with sample size. However, beyond a certain point, improvement in predictive performance became substantially negligible compared to the efforts in additional sampling. All the ML algorithms performed well (mean IV-CCC varied between 0.26 and 0.64 for different soil properties) to increase insample size, except MLP, which exhibited a poorer prediction performance(mean IV-CCC varied between 0.14 and 0.29 for different soil properties). Micronutrients in general responded well to the increase in sample sizes. The uncertainty analysis revealed that increasing sample size generally reduced prediction uncertainty, though the extent varied by soil property and ML algorithm. Concisely, the results presented herein showed an effective manner of selecting an appropriate sample size and a suitable ML algorithm to predict multiple soil nutrients accurately, which would be recommended to achieve optimal accuracy for a project.

Machine learning methods, including Deep learnings are popular for data processing. Deep learning methods have shown great promise in applied in natural language processing (NLP) tasks. Text classification is a supervised machine learning task that involves labelled documents to train classifier. Previous works involving machine learning and deep learning methods for text classification have been tested with relatively small- sized data instances. In this paper, we compared the performance of the machine leaning and deep learning algorithms in text classification task. This paper also studied, explored and compared the scalability of these methods with respect to bigger data instances. We used support vector machines (SVM), Logistic regression, Random forest and Naive Bayes Machine leaning algorithms and convolutional neural network (CNN) deep learning method. The task involved a multi-class classification problem involving six (6) classes consisting of six thousand (6,000) data instances with an average of 20 sentences in each data instance. The CNN deep leaning algorithm outperformed all the machine learning algorithms, achieving an accuracy of over 85%. This is because the filter weights are leaning are updated in backward propagation in each epoch, hence, this result in better result compared to the traditional methods.