Machine Learning and Deep Learning Approaches for Intrusion Detection: A Comparative Study

Deep learning (DL) is now generally acknowledged as the benchmark and evolution in machine learning (ML) fields. Further more, it has steadily suited the most extensively in computational techniques for ML, delivering excellent outcomes in several challenging intellectual works that have equal or still outperformed human ability. DL has the advantage of learning from enormous amounts of data. Here, the DL approach has been applied to classify thunderstorms and non-thunderstorms with a meteorological dataset. Daily observational hourly data sets from 2016 to 2021 have been used to classify the incidence of thunderstorms and non-thunderstorms. Three DL approaches are used: Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), and Long Short-Term Memory (LSTM) to classify thunderstorm incidences. These DL techniques are compared with conventional ML techniques, showing that DL approaches outperformed ML. The CNN method provides the highest performance with 92.01% accuracy among all DL and ML approaches.

Deep learning (also known as deep structured learning, hierarchical learning, or deep machine learning) is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and nonlinear transformations. Deep learning has been characterized as a class of machine learning algorithms with the following characteristics [257]: • They use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised). • They are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher-level features are derived from lower-level features to form a hierarchical representation. • They are part of the broader machine learning field of learning representations of data. • They learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts. These definitions have in common: multiple layers of nonlinear processing units and the supervised or unsupervised learning of feature representations in each layer, with the layers forming a hierarchy from low-level to high-level features. Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks (DBN), and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition, and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. In this chapter we start in Section 7.1 with an introduction, giving a brief history of this field, the relevant literature, and its applications. Then we study some basic concepts of deep learning such as convolutional neural networks, recurrent neural networks, backpropagation algorithm, restricted Boltzmann machines, and deep learning networks in Section 7.2. Then we illustrate three examples for Apache Spark implementation for mobile big data (MBD), user moving pattern extraction, and combination with nonparametric Bayesian learning, respectively, in Sections 7.3 through 7.5. Finally, we have summary in Section 7.6.

Parkinson’s disease (PD) is a progressive neurodegenerative disorder characterized by motor and non-motor symptoms, among which vocal impairment is one of the earliest and most prevalent. In recent years, voice analysis supported by machine learning (ML) and deep learning (DL) has emerged as a promising non-invasive method for early PD detection. We conducted a systematic review searching PubMed, Scopus, IEEE Xplore, and Web of Science databases for studies published between 2020 and September 2025. A total of 69 studies met the inclusion criteria and were analyzed in terms of dataset characteristics, speech tasks, feature extraction techniques, model architectures, validation strategies, and performance outcomes. Classical ML models such as Support Vector Machines (SVMs) and Random Forests (RFs) achieved high accuracy on small, homogeneous datasets, while DL architectures, particularly Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Transformer-based foundation models, demonstrated greater robustness and scalability across languages and recording conditions. Despite these advances, persistent challenges such as dataset heterogeneity, class imbalance, and inconsistent validation practices continue to hinder reproducibility and clinical translation. Overall, the field is transitioning from handcrafted feature-based pipelines toward self-supervised, representation-learning frameworks that promise improved generalizability. Future progress will depend on the development of large, multilingual, and openly accessible datasets, standardized evaluation protocols, and interpretable AI frameworks to ensure clinically reliable and equitable voice-based PD diagnostics.

Background: The merging of machine learning and deep learning approaches offers a viable route for improving breast cancer prediction in this era of advanced technology and data-driven healthcare. This study focused on the use of supervised machine learning and deep learning algorithms for breast cancer prediction using Wisconsin breast cancer dataset. Methods: The features from this dataset were computed from a digitized image of a fine needle aspirate (FNA) of a breast mass. Supervised machine learning algorithms, such as logistic regression, random forests, and support vector machines were compared with deep learning algorithms like convolutional and recurrent neural networks (RNN and CNN) for the prediction of breast cancer. The techniques combine clinical, genomic, and image-based data, that both aid in early diagnosis and individualized treatment suggestions. Results: The results of model comparison were very promising, with models obtaining excellent accuracy, sensitivity, and specificity in breast cancer diagnosis. The study used a pair plot and different classifiers with their accuracy scores on test dataset to determine which machine learning model was most suitable based on the relationship of variables represented in the plot. Support vector machine (SVM) has the highest accuracy of 98.8% and Artificial Neural Network (ANN) has lowest accuracy of 95.80% using confusion matrix and the accuracy metric. Conclusion: The study revealed that Support Vector Machine (SVM) has the highest prediction capability for Breast Cancer using Supervised Machine Learning and Deep Leaning. The new classifier performed better than the existing breast cancer prediction models in the literature.

This study investigates the feasibility of using tear sample analysis, based on protein corona formation on gold nanoparticles combined with electrospray ionization mass spectrometry (ESI-MS) and machine learning techniques, as a non-invasive approach for the detection of choroidal melanoma. The aim is to assess whether protein-nanoparticle interactions can support early and reliable identification of this ocular condition. Tear samples were collected using Schirmer strips from six healthy individuals and six patients diagnosed with choroidal melanoma, with subsequent augmentation to 18 samples per group. Gold nanoparticles (AuNPs, ~ 20 nm) were synthesized via citrate reduction and incubated with tear samples to form protein coronas, which were analyzed using ESI-MS. Eight statistical and entropy-based features (mean, variance, skewness, kurtosis, Shannon entropy, approximate entropy, sample entropy, and permutation entropy) were extracted from spectral data. Additionally, Continuous Wavelet Transform (CWT) with Mexican hat wavelet was applied to convert mass spectrometry data into 128 × 128 RGB images for deep learning analysis. Classification was performed using traditional machine learning models (Random Forest, Support Vector Machine, Decision Tree, Deep Neural Network) and transfer learning with pre-trained CNNs (VGG16, ResNet50, Xception), evaluated through 5-fold cross-validation. Significant differences in spectral intensity parameters were observed between healthy individuals and choroidal melanoma patients (p < 0.001), with notably lower Mean_Intensity values in cancer patients (56.41 ± 46.06 vs. 111.02 ± 10.01, Cohen’s d = 1.64). While m/z parameters showed moderate differences that didn’t reach statistical significance (p = 0.082), entropy-based features demonstrated strong discriminative power. Among traditional machine learning models, Random Forest achieved the highest accuracy (0.959 ± 0.003) and ROC AUC (0.993 ± 0.000) with remarkable computational efficiency (3.90 s per fold). For deep learning approaches using CWT-generated images, VGG16 demonstrated superior performance (Accuracy: 0.976 ± 0.008, ROC AUC: 0.997 ± 0.002) despite requiring significantly higher computational resources (1349.52 s per fold). This study demonstrates that tear sample analysis using protein corona formation on gold nanoparticles with ESI-MS and advanced machine learning techniques offers a promising non-invasive approach for choroidal melanoma detection with performance metrics that compare favorably to existing methods. The significant differences in spectral intensity parameters between groups suggest distinctive proteomic signatures that can be leveraged for diagnostic purposes. While both traditional machine learning and deep learning approaches achieved exceptional performance, each offers distinct advantages in terms of computational efficiency and feature extraction capabilities.

The prediction of student performance is a critical area in educational data mining, providing invaluable insights for early interventions and personalized learning strategies. This chapter explores the application of machine learning and deep learning algorithms in predicting academic success, focusing on the enhancement of traditional predictive models through advanced computational techniques. A comprehensive review of widely-used models such as decision trees, support vector machines, k-nearest neighbors, and random forests is presented, highlighting their strengths and limitations in handling educational data. In addition, the chapter delves into deep learning approaches, such as artificial neural networks, convolutional neural networks, recurrent neural networks, and long short-term memory networks, which have shown promising results in capturing complex patterns and temporal dependencies in student performance data. The chapter emphasizes the importance of high-quality data preprocessing, including data cleaning, feature selection, and imputation, as essential steps for enhancing model accuracy. Evaluation metrics such as accuracy, precision, recall, F1-score, and ROC-AUC curve analysis are discussed to ensure robust model validation, especially in the presence of class imbalance. Further, challenges like model overfitting and strategies to prevent it, including regularization, cross-validation, and early stopping, are explored. The integration of machine learning and deep learning in education holds transformative potential for improving academic outcomes, providing a framework for data-driven decisions and timely interventions. This chapter serves as a critical resource for researchers and practitioners aiming to leverage AI for enhanced student performance prediction.

An increase in life expectancy is leading to an aging society, where gradual degradation in physical/cognitive health could result in fall injuries, cardiovascular, neurological/psychological problems, or a sedentary lifestyle. Sensor-based human activity recognition (HAR) is found to be a potential assistive technology in this context to improve the quality of life of an aging society. This chapter presents the state of the art and future trends of Internet of Things (IoT)-enabled sensor data-based Human Activity Recognition (HAR) systems, where machine learning (ML)/deep learning (DL) is used to classify human actions in the context of healthcare applications. In particular, the impact of IoT on the healthcare industry is so immense that a dedicated specialization, termed as Internet of Healthcare Things (IoHT), has emerged. Smart healthcare systems are equipped with different categories of sensors (wearable, wireless, and ambient). The huge amount of sensor data acquired by IoHT sensors allows for performing accurate HAR. The HAR involves detection/classification problems, e.g. fall detection and seizer detection, where ML is used extensively, at its heart. A lot of ML/DL techniques are being used in HAR including support vector machine (SVM), artificial neural network (ANN), recurrent neural network (RNN), convolutional neural network (CNN), deep neural network (DNN), long short-term memory (LSTM), etc. However, there are a few special aspects of HAR sensor data that make it difficult to handle. Involved research is still being pursued across the globe to solve these problems.KeywordsIoTIoHTHealth careHARSensorMachine learning (ML)Deep learning (DL)

Deep learning (DL) has shown explosive growth in its application to bioinformatics and has demonstrated thrillingly promising power to mine the complex relationship hidden in large-scale biological and biomedical data. A number of comprehensive reviews have been published on such applications, ranging from high-level reviews with future perspectives to those mainly serving as tutorials. These reviews have provided an excellent introduction to and guideline for applications of DL in bioinformatics, covering multiple types of machine learning (ML) problems, different DL architectures, and ranges of biological/biomedical problems. However, most of these reviews have focused on previous research, whereas current trends in the principled DL field and perspectives on their future developments and potential new applications to biology and biomedicine are still scarce. We will focus on modern DL, the ongoing trends and future directions of the principled DL field, and postulate new and major applications in bioinformatics.

BackgroundDespite the high commercial fisheries value and ecological importance as prey item for higher marine predators, very limited taxonomic work has been done on cephalopods in Malaysia. Due to the soft-bodied nature of cephalopods, the identification of cephalopod species based on the beak hard parts can be more reliable and useful than conventional body morphology. Since the traditional method for species classification was time-consuming, this study aimed to develop an automated identification model that can identify cephalopod species based on beak images.MethodsA total of 174 samples of seven cephalopod species were collected from the west coast of Peninsular Malaysia. Both upper and lower beaks were extracted from the samples and the left lateral views of upper and lower beak images were acquired. Three types of traditional morphometric features were extracted namely grey histogram of oriented gradient (HOG), colour HOG, and morphological shape descriptor (MSD). In addition, deep features were extracted by using three pre-trained convolutional neural networks (CNN) models which are VGG19, InceptionV3, and Resnet50. Eight machine learning approaches were used in the classification step and compared for model performance.ResultsThe results showed that the Artificial Neural Network (ANN) model achieved the best testing accuracy of 91.14%, using the deep features extracted from the VGG19 model from lower beak images. The results indicated that the deep features were more accurate than the traditional features in highlighting morphometric differences from the beak images of cephalopod species. In addition, the use of lower beaks of cephalopod species provided better results compared to the upper beaks, suggesting that the lower beaks possess more significant morphological differences between the studied cephalopod species. Future works should include more cephalopod species and sample size to enhance the identification accuracy and comprehensiveness of the developed model.

The increasing complexity of urban transportation systems and the growing volume of vehicles have made traffic congestion a persistent challenge in modern cities. Efficient traffic flow prediction is essential for mitigating congestion, improving road safety, optimizing traffic signal control, and enhancing overall transportation efficiency. In recent years, artificial intelligence (AI) has emerged as a transformative tool in the field of traffic management, offering sophisticated algorithms capable of modeling, analyzing, and predicting complex traffic patterns with high accuracy. The application of AI in traffic flow prediction leverages vast amounts of real-time and historical data to generate precise forecasts, supporting data-driven decision-making by urban planners and traffic control authorities. The prediction of traffic flow involves analyzing time-series data that exhibit nonlinear, dynamic, and often stochastic behavior. Traditional statistical models, such as autoregressive integrated moving average (ARIMA), have proven to be limited in handling the high dimensionality and variability inherent in traffic systems. In contrast, AI algorithms possess the capacity to learn and adapt from complex data inputs without the need for explicit programming, making them particularly suitable for traffic-related applications. AI algorithms used in traffic flow prediction can be broadly categorized into machine learning (ML) and deep learning (DL) approaches. Machine learning algorithms such as k-nearest neighbors (KNN), support vector machines (SVM), decision trees, and random forests have demonstrated effectiveness in short-term traffic prediction tasks. These algorithms are capable of identifying hidden patterns in traffic data and adjusting to changes in traffic behavior over time. Ensemble methods, which combine the strengths of multiple learning models, further enhance prediction accuracy and robustness. Deep learning algorithms, a subfield of AI inspired by the human brain’s neural architecture, have shown exceptional performance in capturing spatial-temporal dependencies in traffic data. Recurrent neural networks (RNNs), particularly long short-term memory (LSTM) networks and gated recurrent units (GRUs), are widely used for their ability to process sequential data and retain information over extended time intervals. Convolutional neural networks (CNNs) are employed to extract spatial features from traffic sensor data or road network imagery. Hybrid models that integrate CNNs with RNNs have achieved high levels of predictive precision by simultaneously learning spatial and temporal correlations. In addition to supervised learning methods, unsupervised and reinforcement learning techniques are also applied in traffic flow prediction. Clustering algorithms, such as k-means and DBSCAN, assist in identifying traffic patterns, while reinforcement learning models optimize adaptive traffic signal control systems by learning optimal actions through environmental interaction. This study explores the different types of AI algorithms used in traffic flow prediction, examining their theoretical foundations, structural differences, and practical applications. It aims to evaluate the comparative advantages of various algorithms in addressing the challenges of real-time traffic prediction in increasingly complex transportation networks.

The explosive growth of the Internet has led to an unprecedented increase in available information, creating a major challenge in identifying content that aligns with user interests. Recommendation systems (RS) address this challenge by providing personalized content recommendations based on user behavior and preferences. This article systematically reviews the evolution of recommendation systems with a focus on the methodologies of machine learning (ML) and deep learning (DL). It highlights core technologies in ML-based RS, such as content-based recommendation, collaborative filtering (CF), and hybrid filtering (HF). The article evaluates the effectiveness of various DL models, including autoencoders (AE), convolutional neural networks (CNN), and recurrent neural networks (RNN). The review also addresses key challenges faced by RS, such as cold start issues and the need for improved model transparency and interpretability. DL methods are shown to significantly enhance recommendation accuracy by leveraging complex patterns in large-scale data, to improve the user experience. Future research directions include refining data preprocessing, enhancing feature engineering, compressing and accelerating DL models, and improving interpretability through advanced mechanisms. This study provides valuable insights and references for researchers aiming to advance recommendation system design and performance optimization.

Chemical heuristics have been fundamental to the advancement of chemistry and materials science. These heuristics are typically established by scientists using knowledge and creativity to extract patterns from limited datasets. Machine learning offers opportunities to perfect this approach using computers and larger datasets. Here, we discuss the relationships between traditional heuristics and machine learning approaches. We show how traditional rules can be challenged by large-scale statistical assessment and how traditional concepts commonly used as features are feeding the machine learning techniques. We stress the waste involved in relearning chemical rules and the challenges in terms of data size requirements for purely data-driven approaches. Our view is that heuristic and machine learning approaches are at their best when they work together.

Human brain neuron activities are incredibly significant nowadays. Neuronal behavior is assessed by analyzing signal data such as extracellular recording, which can offer scientists valuable information about diseases and neuron activities. One of the difficulties researchers confront while evaluating these signals is the existence of large volumes of spike data. Spikes are significant components of signal data that can happen as a consequence of vital biomarkers or physical issues such as electrode movements. Hence, distinguishing types of spikes is essential. From this spot, the spike classification concept commences. Previously, researchers classified spikes manually. The manual classification was not precise enough, as it involved extensive analysis. Consequently, Artificial Intelligence (AI) was introduced into neuroscience to assist clinicians in classifying spikes correctly. Recognizing noises from spikes produced by neural activity causes the spike classification task to bear a significant demand. Classifying spikes accurately and quickly reveals the role of AI in the scope of spike classification. This review provides an in‐depth discussion of the importance and use of AI in spike classification. This work organizes materials in the spike classification field for future studies and fully describes how spikes are recognized. Therefore, the existing datasets are described first. The topic of spike classification is then separated into three major components: preprocessing, classification, and evaluation. Each of these sections introduces existing methods and determines their importance. Having been summarized and compared, more efficient algorithms are highlighted. The primary goal of this work is to provide a perspective on spike classification for future research, as well as a thorough grasp of the methodologies and issues involved. In this work, numerous studies were extracted from various databases. The PRISMA‐related research guidelines were then used to choose papers. Then, research studies based on spike classification using machine learning and deep learning approaches with effective preprocessing were selected. Although there are research papers on spike sorting using the keyword spike, the primary focus of this study is on spike classification. Finally, 47 papers were selected for in‐depth review. First, useful information on the datasets for these papers is supplied. In addition, preprocessing approaches, classification methods, and ultimate performance are investigated in each of these studies. The material is then summarized. Furthermore, the fundamental concerns regarding spike classification raised in the opening of this paper are thoroughly addressed throughout the review. Our reviewing outcomes illustrate that support vector machine and clustering‐based algorithms drastically influence machine learning methods in terms of high accuracy and many uses. Moreover, convolutional neural networks, spiky neural networks, and attention‐based techniques can classify spikes with considerable functionality among deep learning methods. Various preprocessing and classification techniques have been used practically to classify extracted signal data from patients in medical institutions. Our review emphasizes the importance of classifying spikes in neuroscience applications with machine learning and deep learning models. This can provide precious insights and hands‐on solutions for using AI to classify real‐world medical data. This article is categorized under: Technologies &gt; Artificial Intelligence Technologies &gt; Machine Learning Algorithmic Development &gt; Biological Data Mining

Malware is one of the most significant threats in today’s computing world since the number of websites distributing malware is increasing at a rapid rate. Malware analysis and prevention methods are increasingly becoming necessary for computer systems connected to the Internet. This software exploits the system’s vulnerabilities to steal valuable information without the user’s knowledge, and stealthily send it to remote servers controlled by attackers. Traditionally, anti-malware products use signatures for detecting known malware. However, the signature-based method does not scale in detecting obfuscated and packed malware. Considering that the cause of a problem is often best understood by studying the structural aspects of a program like the mnemonics, instruction opcode, API Call, etc. In this paper, we investigate the relevance of the features of unpacked malicious and benign executables like mnemonics, instruction opcodes, and API to identify a feature that classifies the executable. Prominent features are extracted using Minimum Redundancy and Maximum Relevance (mRMR) and Analysis of Variance (ANOVA). Experiments were conducted on four datasets using machine learning and deep learning approaches such as Support Vector Machine (SVM), Naïve Bayes, J48, Random Forest (RF), and XGBoost. In addition, we also evaluate the performance of the collection of deep neural networks like Deep Dense network, One-Dimensional Convolutional Neural Network (1D-CNN), and CNN-LSTM in classifying unknown samples, and we observed promising results using APIs and system calls. On combining APIs/system calls with static features, a marginal performance improvement was attained comparing models trained only on dynamic features. Moreover, to improve accuracy, we implemented our solution using distinct deep learning methods and demonstrated a fine-tuned deep neural network that resulted in an F1-score of 99.1% and 98.48% on Dataset-2 and Dataset-3, respectively.

This article explains how deep learning and machine learning techniques are being utilized to replace humans in a variety of activities, like item classification and sound addition. It emphasizes handwritten text recognition (HTR), which involves computers interpreting handwritten content from sources like paper documents and touchscreens. For recognizing handwritten digits, the study analyzes three algorithms: support vector machines (SVM), multilayer perception (MLP), and convolutional neural networks (CNN). This comparison aims to evaluate the correctness and execution times of different approaches. The evaluation is based on parameters like the dataset used, the number of epochs, algorithm complexity, accuracy, and hardware specifications. The study compares the effectiveness of CNN, Multilayer Perception (MLP), and Support Vector Machines using handwritten digits from the MNIST dataset. It evaluates these algorithms based on criteria such as runtime, complexity, rate of precision, the count of epochs, and the quantity of hidden layers specifically within deep learning techniques. SVM had the highest training data accuracy, but CNN outperformed others on the test dataset. The article’s primary goal is to identify the most precise model for recognizing handwritten digits. It achieves this by assessing the performance of different algorithms and comparing them based on various characteristics.