Statistical Feature Engineering for Robot Failure Detection: A Comparative Study of Machine Learning and Deep Learning Classifiers.

Mild cognitive impairment (MCI) is a clinical condition characterized by a decline in cognitive ability and progression of cognitive impairment. It is often considered a transitional stage between normal aging and Alzheimer's disease (AD). This study aimed to compare deep learning (DL) and traditional machine learning (ML) methods in predicting MCI using plasma proteomic biomarkers. A total of 239 adults were selected from the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort along with a pool of 146 plasma proteomic biomarkers. We evaluated seven traditional ML models (support vector machines (SVMs), logistic regression (LR), naïve Bayes (NB), random forest (RF), k-nearest neighbor (KNN), gradient boosting machine (GBM), and extreme gradient boosting (XGBoost)) and six variations of a deep neural network (DNN) model-the DL model in the H2O package. Least Absolute Shrinkage and Selection Operator (LASSO) selected 35 proteomic biomarkers from the pool. Based on grid search, the DNN model with an activation function of "Rectifier With Dropout" with 2 layers and 32 of 35 selected proteomic biomarkers revealed the best model with the highest accuracy of 0.995 and an F1 Score of 0.996, while among seven traditional ML methods, XGBoost was the best with an accuracy of 0.986 and an F1 Score of 0.985. Several biomarkers were correlated with the APOE-ε4 genotype, polygenic hazard score (PHS), and three clinical cerebrospinal fluid biomarkers (Aβ42, tTau, and pTau). Bioinformatics analysis using Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) revealed several molecular functions and pathways associated with the selected biomarkers, including cytokine-cytokine receptor interaction, cholesterol metabolism, and regulation of lipid localization. The results showed that the DL model may represent a promising tool in the prediction of MCI. These plasma proteomic biomarkers may help with early diagnosis, prognostic risk stratification, and early treatment interventions for individuals at risk for MCI.

Deep learning (DL) and machine learning (ML) methods have recently contributed to the advancement of models in the various aspects of prediction, planning, and uncertainty analysis of smart cities and urban development. This paper presents the state of the art of DL and ML methods used in this realm. Through a novel taxonomy, the advances in model development and new application domains in urban sustainability and smart cities are presented. Findings reveal that five DL and ML methods have been most applied to address the different aspects of smart cities. These are artificial neural networks; support vector machines; decision trees; ensembles, Bayesians, hybrids, and neuro-fuzzy; and deep learning. It is also disclosed that energy, health, and urban transport are the main domains of smart cities that DL and ML methods contributed in to address their problems.

Cardiovascular diseases (CVDs) remain a leading cause of global mortality, underscoring the urgent need for early and accurate diagnosis. Electrocardiograms (ECGs) are a widely used, noninvasive tool for detecting cardiac abnormalities, but manual interpretation can be time- consuming and prone to error. This study explores advanced machine learning (ML) and deep learning (DL) methods to improve the detection of CVDs from ECG images, leveraging their ability to analyze complex patterns with high precision. Models such as Convolutional Neural Networks (CNNs), Vision Transformers (ViTs), and ensemble frameworks are utilized, alongside traditional ML models like XGBoost, CatBoost, and LightGBM. The performance of these models is evaluated based on precision, recall, F1-score, and accuracy. Results show that DL models, particularly an ensemble of CNN and ViT, achieve superior accuracy , outperforming standalone ML methods. Furthermore, an ensemble of XGBoost, CatBoost, and LightGBM achieves competitive results, while Optuna-tuned XGBoost further enhances ML performance. The findings highlight the potential of combining ML and DL techniques for robust and reliable CVD detection in ECG images. This research demonstrates the promise of AI-driven solutions in advancing medical diagnostics and supports the integration of automated systems for early detection of cardiovascular diseases.

Domain name generation algorithm (DGA) classification is an essential but challenging problem. Both feature-extracting machine learning (ML) methods and deep learning (DL) models such as convolutional neural networks and long short-term memory have been developed. However, the performance of these approaches varies with different types of DGAs. Most features in the ML methods can characterize random-looking DGAs better than word-looking DGAs. To improve the classification performance on word-looking DGAs, subword tokenization is employed for the DL models. Our experimental results proved that the subword tokenization can provide excellent classification performance on the word-looking DGAs. We then propose an integrated scheme that chooses an appropriate method for DGA classification depending on the nature of the DGAs. Results show that the integrated scheme outperformed existing ML and DL methods, and also the subword DL methods.

Short-term solar radiation forecasting using hybrid deep residual learning and gated LSTM recurrent network with differential covariance matrix adaptation evolution strategy

In the era of artificial intelligence, machine learning methods are successfully used in various fields. Machine learning has attracted extensive attention from investors in the financial market, especially in stock price prediction. However, one argument for the machine learning methods used in stock price prediction is that they are black-box models which are difficult to interpret. In this paper, we focus on the future stock price prediction with the historical stock price by machine learning and deep learning methods, such as support vector machine (SVM), random forest (RF), Bayesian classifier (BC), decision tree (DT), multilayer perceptron (MLP), convolutional neural network (CNN), bi-directional long-short term memory (BiLSTM), the embedded CNN, and the embedded BiLSTM. Firstly, we manually design several financial time series where the future price correlates with the historical stock prices in pre-designed modes, namely the curve-shape-feature (CSF) and the non-curve-shape-feature (NCSF) modes. In the CSF mode, the future prices can be extracted from the curve shapes of the historical stock prices. Conversely, in the NCSF mode, they can’t. Secondly, we apply various algorithms to those pre-designed and real financial time series. We find that the existing machine learning and deep learning algorithms fail in stock price prediction because in the real financial time series, less information of future prices is contained in the CSF mode, and perhaps more information is contained in the NCSF. Various machine learning and deep learning algorithms are good at handling the CSF in historical data, which are successfully applied in image recognition and natural language processing. However, they are inappropriate for stock price prediction on account of the NCSF. Therefore, accurate stock price prediction is the key to successful investment, and new machine learning algorithms handling the NCSF series are needed.

The purpose of the study was to train and compare machine learning (ML) and deep learning (DL) models for long-term forecasting of minimum daily temperatures (frosts) - a key agrometeorological risk affecting crop productivity. The study was based on data from weather stations in St. Petersburg and the Leningrad region. To predict the year ahead, which aligns with the needs of operational agricultural production planning (sowing dates, harvest timing, protective measures), 8 methods were used: ForecasterAutoreg, Random Forest, Support Vector Regression (SVR), XGBoost, Convolutional Neural Network (CNN), SimpleRNN, Gated Recurrent Unit (GRU) and Long Short-Term Memory (LSTM). The analysis was carried out on two datasets: for the periods 1936-2024 and 1881-1995. The quality of the models was assessed using the metrics MAE, MSE, RMSE, R2 and adjusted R2. The LSTM model showed the most accurate results on the main dataset (1936-2024): MAE 2.9, MSE 14.661, R2 0.789. The SVR method (MAE 3.461, R2 0.775) demonstrated the best metrics based on archived data (1881-1995). It has been established that DL models (LSTM, GRU, CNN) generally outperform classical ML methods based on modern data. The LSTM method is recognized as the most effective for integration into precision farming systems and agricultural monitoring in the region for the advance planning of agrotechnological measures to protect crops from frost, optimization of crop rotation systems, and minimization of crop loss risks.

The uncertain yield of crops is one of the major problems the agricultural sector faces today, especially in India. The objective of this paper is to provide an accurate and reliable prediction of crop yield. This will help farmers make decisions that can make their farming more efficient and profitable. We propose a novel deep learning model - an ensemble neural network model using Long Short-Term Memory (LSTMs) and one-dimensional Convolutional Neural Networks (CNNs). We used crop data for over 30 crops from 1997-2015 of all Indian districts. Our model substantially outperforms all other models (Linear Regression, Random Forest, extreme Gradient Boosting (XGB) Regressor, Feed-forward Neural Network (FFNN)) that were tested on accuracy in predicting crop yields. We achieve a correlation coefficient value of over 0.90 and 0.92 for our model for train and test datasets.Our model has several advantages compared to other models. Firstly, it is able to capture the time dependency on temperature and rainfall. Secondly, it is able to work on a large and diverse dataset, unlike most models which only perform well in small regions. Lastly, it is able to use several diverse features - geographical, social, and economic to make a prediction.

Excessive withdrawal of groundwater for agricultural irrigation can cause seawater intrusion into coastal aquifers. Such a case will in turn results in deterioration of irrigation water quality. Determination of irrigation water quality with traditional methods is a time-consuming and costly process. However, machine learning algorithms can be useful tools for modeling and estimating groundwater quality used for irrigation water purposes. In this study, TDS, PS, SAR, and Cl parameters of groundwater were estimated with models based on EC and pH variables. For this purpose, prediction performances of two different deep learning methods (convolutional neural network (CNN) and deep neural network (DNN)) and two different classical machine learning (Random Forest (RF) and extreme gradient boosting (XGBoost)) methods were compared. In addition, predictive uncertainty of the models was determined by quantile regression (QR) analysis. Performance criteria and results of uncertainty analysis revealed that CNN (in testing phase, NSE = 0.95 for TDS, NSE = 0.96 for PS, NSE = 0.67 for SAR and NSE = 0.93 for CI) and DNN (in testing phase, NSE = 0.91 for TDS, NSE = 0.91 for PS, NSE = 0.57 for SAR and NSE = 0.94 for Cl) models had quite a close performance in estimation of TDS, PS, SAR, and Cl parameters and higher than the other two classical machine learning methods. As a result, the CNN model can be considered the best performing model in estimating all quality parameters due to the highest NSE and lowest RMSE values. In addition, the Taylor diagram showed that the values estimated using the CNN model had the highest correlation with the measured data. It was determined that the model with the lowest uncertainty based on the PICP statistics was DNN, followed by the CNN model. However, the CNN model has predicted outliers more accurately. Present findings proved that deep learning models could offer efficient tools for predicting irrigation water quality parameters.

<p class="0abstract">The research aimed to conduct an extensive study of machine learning and deep learning methods in cybersecurity. To accomplish the objectives, the research carried out a qualitative study based on secondary data collection to review the available studies and literature. The research has examined three machine learning methods and three deep learning methods to study the most popular techniques used in cybersecurity. During the research, the working mechanism of each method was studied along with their strengths and weaknesses. Also, a comparative discussion has been made to examine the most effective method for cybersecurity. Limitations in the current literature were also identified, and future direction is also given to target and develop the weak areas of machine learning and deep learning methods.<em> </em><strong></strong></p>

Technological advances in artificial intelligence have enabled scientists to obtain significant data in different application areas. Pattern recognition tasks can now be effectively performed on large datasets using artificial intelligence algorithms, particularly machine learning and deep learning techniques. In the context of epilepsy a neurological disorder electroencephalogram (EEG) signals are widely utilized to gather information about the brain’s electrical activity. In this study, the performance of five machine learning algorithms and one deep learning model was evaluated for the classification of epileptic seizures versus normal conditions using EEG signals obtained from individuals diagnosed with epilepsy. The machine learning techniques employed included K-Nearest Neighbors (KNN), Support Vector Machines (SVM), Adaptive Boosting (AdaBoost), Gaussian Naive Bayes (GNB), and Random Forest (RF), while the deep learning approach was based on a one-dimensional Convolutional Neural Network (1D-CNN). The dataset used for model training and evaluation was the publicly available University of Bonn EEG dataset. Among the machine learning methods, the Random Forest classifier achieved the highest performance, with an accuracy of 0.96, recall of 0.89, precision of 0.91, and an F1-score of 0.90. The 1D-CNN model demonstrated comparable results, achieving an accuracy of 0.96, recall of 0.87, precision of 0.93, and an F1-score of 0.90. These findings indicate that while the deep learning model provided a marginal improvement in precision over the best-performing machine learning algorithm, both approaches yielded similarly high classification performance in the detection of epileptic seizures from EEG data.

Mountain lakes are one of the critical indicators of climate change and are also responsible for glacier hazards. Mapping glacial lakes is essential for monitoring them and forecasting glacier-related hazards. Remote sensing images play a crucial role in achieving this by enabling accurate and effective mapping of glacial lakes. This review paper provides a comprehensive analysis of traditional pixel-based and object-based methods, along with machine learning and deep learning methods for glacial lake mapping, complemented by a brief summary of available datasets. Deep learning models offer superior accuracy compared to conventional pixel-based, object-based, and machine learning methods. While other natural resource mapping studies have successfully employed advanced deep learning models such as Swin Transformer, Hybrid CNN-ViT, and HRNet with novel backbone architectures, glacial lake mapping has predominantly relied on a limited number of deep learning models. Therefore, this review recommends to use these models for glacial lake mapping in the future.

A method to determine the presence of hard X-ray emission processes from a dense plasma focus (205 J, 22 kV, 6.5 mbar H 2) using Ultra High Frequency (UHF) measurements and deep learning techniques is presented. Simultaneously, the electromagnetic UHF radiation emitted from the plasma focus was measured with a Vivaldi UHF antenna, while the hard X-ray emission was measured with a scintillator-photomultiplier system. A classification algorithm based on deep learning methods, using two-dimensional convolutional layers, was implemented to predict the hard X-ray signal standard deviation value using only the antenna signal measurement. Two independent datasets, consisting of 999 and 1761 data pairs each, were used in the analysis. Different realizations of the training/validation process using a deep learning model, obtained overall better results in comparison to other machine learning methods like $k$ -neighbors, decision trees, gradient boost, and random forest. The results of the deep learning algorithm, and even its comparison with other machine learning methods, indicate that a relationship between the electromagnetic UHF radiation and hard X-ray emission can be established, enabling the indirect detection of hard X-ray pulses only using the UHF antenna signal. This indirect detection presents the opportunity to have a simple and low-cost diagnostic, compared to the methods currently used to characterize the pulses of X-rays emitted from plasma focus discharges.

Background Artificial intelligence (AI) has revolutionized diagnostic radiology by improving accuracy, efficiency, and clinical decision-making. While numerous systematic reviews and meta-analyses have evaluated the performance of AI-based techniques, particularly traditional machine learning (ML) and deep learning (DL) models, a comprehensive synthesis of this evidence is lacking. An umbrella review is necessary to integrate and compare findings across various imaging applications, offering the highest level of evidence to inform clinical practice and policy. Objective This umbrella review aims to compare the diagnostic performance of traditional machine learning and deep learning methods in radiology by synthesizing evidence from existing systematic reviews and meta-analyses. Methods A systematic literature search was conducted in PubMed, Scopus, Web of Science, and Cochrane Library for systematic reviews and meta-analyses published between 2018 and 2024. Only peer-reviewed reviews evaluating diagnostic applications of AI in radiology were included. Methodological quality was assessed using the AMSTAR 2 tool, and risk of bias was evaluated using ROBIS. Results Seven systematic reviews and meta-analyses were included. Across multiple imaging domains—such as breast cancer screening, spinal stenosis, and tumor grading—deep learning consistently outperformed traditional ML in diagnostic accuracy and sensitivity. Evidence quality was rated moderate to high, though variability in reporting and a lack of external validation were noted. Explainability features in DL models were underutilized and poorly evaluated. Conclusion This umbrella review confirms the superior diagnostic performance of deep learning methods over traditional ML in radiology. Future research should prioritize model transparency, real-world validation, and standardization in clinical implementation.

Machine Learning (ML) technologies have been widely used for blind signal classification problem (Modulation Classification) to automatically identify the modulation schemes of Radio Frequency (RF) signal from complex- valued IQ (In-phase Quadrature) samples. Traditional ML methods usually have two stages where the first stage is to manually extract the features of the IQ symbols by subject matter experts and the second stage is to feed the features to an ML algorithm (e.g., a support vector machine) to develop the classifier. The state- of-art technology is to apply Deep Learning (DL) technologies such as Convolutional Neural Network (CNN) or Recurrent Neural Network (RNN) directly to the complex-value IQ symbols to train a multi-class classifier. In this effort we are focused on the modulation and coding rate classification problems for multi-carrier Orthogonal Frequency-Division Multiplexing (OFDM) signals. The generated OFDM data set consists of over 480k instances across four different modulations and three different coding rates which include BPSK + 1=2, BPSK+3=4, QPSK+1=2, QPSK+3=4, QAM16+1=2, QAM16+3=4, QAM64+2=3 and QAM64+3=4. Deep Learning (DL) models can successfully catch the features of OFDM modulations and identify the modulation scheme from the baseband IQ symbols. Four DL models including Residual Neural Network 34(Resnet34), Resnet18, Squeezenet and Long Short-Term Memory (LSTM) trained over the data set can achieve over 94% overall accuracy for signals across 􀀀10dB to 10dB with step size of 4dB. Among them, Squeezenet and LSTM models have much smaller model sizes which can be easily loaded in resource-limited edge computing platforms. To the best of our knowledge, coding rate classification of OFDM signals has not been studied in previous works. Therefore, three different DL models including a single-stage coding rate classifier, a combination of modulation and coding rate classifier, and a two-stage coding rate classifier are developed to identify the coding rate. However, coding rates can only be identified for low-order modulation schemes BPSK and QPSK but not for high-order modulation schemes QAM16 and QAM64. Further investigation is needed to understand the coding rate classification for high-order QAM signals.