An analysis of machine learning models for sentiment analysis of Tamil code-mixed data

Intrusion detection plays a critical role in safeguarding computer networks from malicious activities and unauthorized access. Traditional machine learning (ML) models have been widely employed for intrusion detection, but their effectiveness can be limited due to the complex and evolving nature of network attacks. An efficient Convolutional Neural Network (CNN) that utilizes one-dimensional convolutions, batch normalization, and max pooling layers is designed to capture the attack patterns in network traffic data. By leveraging the inherent feature extraction capabilities of CNNs, the proposed architecture demonstrates improved performance in identifying network intrusions compared to traditional ML models. The effectiveness of the novel CNN architecture is evaluated by conducted comprehensive experiments on two benchmark intrusion detection datasets. The designed CNN performance was compared with four other ML models such as logistic regression, k-nearest neighbors, decision trees, and random forest. The experimental results revealed that the proposed CNN architecture outperformed the traditional ML models with highest accuracy of 97.68% and 97.39% and highest F1-score of 97.68% and 97.40% for. UNSW-NB15 and CICIDS2017 datasets, respectively. The proposed CNN architecture serves as a promising alternative to traditional ML models, offering improved performance in identifying and mitigating network attacks.

Accurate rainfall forecasting is crucial in activities such as agricultural planning, water resource management, and flood preparedness, so failure to accurately forecast rainfall might undermine these activities. This study aimed to improve the accuracy of daily rainfall prediction in Hai district, Kilimanjaro region, Tanzania, a region characterised by a bimodal rainfall pattern, by comparing rainfall prediction accuracies of Traditional Machine Learning (TML) and Deep Learning (DL) models. The 25-year daily rainfall dataset for Hai district was first pre-processed by cleaning, normalisation, and splitting into training (first 60%), validation (next 20%), and test (last 20%) sets. TML models (K-Nearest Neighbours (KNN) through its variant KNN Regressor and Support Vector Machine (SVM) through its variant Support Vector Regressor (SVR)) were developed, trained, and their performances compared with developed and trained DL models (Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRU)). Each model’s test performance was evaluated using the Root Mean Squared Error (RMSE) metric. The findings revealed that the DL models, LSTM and GRU, achieved test RMSE scores of 6.35 mm and 6.49 mm, respectively, while the TML models, KNN and SVM, achieved test RMSE scores of 6.61 mm and 10.42 mm, respectively. The study demonstrated that DL models are more effective for accurate rainfall forecasting than TML models in regions with complex rainfall patterns. The insights gained will guide the development of more reliable, location-specific weather prediction systems, ultimately supporting informed decision-making in agriculture, environmental management, and flood risk reduction in Tanzania and other regions facing similar climatic challenges

This study addresses the accuracy challenges in e-commerce sentiment classification and thus provides valuable insight for businesses to enrich strategies toward the interpretation of customer feedback and improvement of product development. This article elaborately contrasts long short-term memory (LSTM)-based models with traditional machine learning models, like support vector machines (SVM), random forest, and Naive Bayes classifiers. The authors have used a large dataset of customer reviews from famous e-commerce websites, pre-processed for noise reduction and standardization of the input. Our LSTM models were implemented using state-of-the-art deep learning frameworks, with special consideration while performing hyperparameter tuning. The results showed that the bidirectional LSTM model had the best performance of 92.1% in accuracy, 91.8% in precision, 92.0% in recall, and an F1-score of 91.9%. In comparison, traditional machine learning approaches gave accuracies: 86.5% for SVM, 85.1% for random forest, and 82% for Naive Bayes. Hyperparameter tuning returned the best configurations for the LSTM models: 128 LSTM units, a dropout of 0.3, with learning rates 0.001 for LSTM and 0.0001 for bidirectional LSTM. These optimizations contributed hugely to the performance improvements observed in these models. Error analysis gave insights into the challenges that the models faced. Sarcasm and irony accounted for 22% of the classification errors, while mixed sentiment accounted for 18%, and implicit accounted for 15%. To sum up, this research has shown the efficiency of LSTM models on e-commerce user review sentiment analysis, especially bidirectional LSTM. These models show a much better result in sentiment classification compared to traditional machine learning techniques, which proves them to have huge potential for improving the accuracy of the task in real-world applications.

Sensor based human activity recognition has obtained more attentions due to its low-cost, low-data throughput, and immunity to environmental effects. However, traditional work in this field mainly focuses on the recognition of simple and small volume human activities. This work targets complicated, correlated and larger size of human activity recognition. In this paper, a multi-layer hybrid deep learning model is built with convolutional neural networks (CNN) and long short-term memory (LSTM). The multi-layer architecture improves the learning and exploration capacity of local features and temporal dependencies, and the hybrid architecture enriches the diversity for data fusion. In addition, Bayesian optimization is applied to the hybrid model to get the optimal parameters and best performance. The experimental results demonstrate the effectiveness of the proposed model with a recognition rate of 89% for 27 correlated activities. Its performance is better than traditional machine learning and other hybrid deep learning models.

Graph theory provides a robust framework for modelling complex relationships in medical data, enhancing classification accuracy through relational learning. Unlike traditional machine learning (ML) models that treat data points independently, graph-based approaches support structural dependencies to improve feature representation. This study explores the application of Graph Attention Networks (GAT), GraphSAGE, Graph Convolutional Network(GCN) and Graph Isomorphism Network (GIN) for breast cancer classification, employing k-nearest neighbor (KNN) graphs to construct a structured dataset where nodes represent patients and edges capture feature similarities. The effectiveness of the graph-based approaches is evaluated against traditional ML classifiers, including Decision Trees, Random Forest, LightGBM, and XGBoost. Experimental results indicate that GCN, GIN, GAT and GraphSAGE are beat conventional methods, with GCN, GAT and GraphSAGE achieved 100% test-accuracy and with GIN achieved 99.42%, to confirm the percentage of accuracy, authors conducted extensive experiments, including robustness testing by reducing KNN connections, introducing noise, and shuffling train-test splits. Results demonstrate that graph-based models are significantly best than traditional ML models, and these graph-based models maintain same classification accuracy while maintaining stability under robustness tests. The findings confirm that graph-based learning provides a scalable, interpretable, and highly accurate alternative for medical classification tasks, proving its effectiveness in distinguishing between benign and malignant tumors.

Smart objects have grown in popularity and acceptance over the past period due to their decreasing size, greater intelligence, and lower costs. The Internet of Things (IoT) connects physical devices, including actuators, sensors, and cameras, to a network via the Internet. The widespread use of IoT devices has led to an exponential rise in network traffic volume and complexity, creating new challenges for real-time network security and threat detection. This study attempts to design an intrusion detection system which is scalable and capable of handling the vast number and variety of IoT traffic. It is based on improving the scalability and precision of the detection of threats by employing machine learning (ML) and deep learning (DL) techniques and hybrid model. The model is trained and tested on the CIC IoT DIAD 2024 dataset, a large high-volume dataset consisting of diversified IoT traffic, benign and malicious activity. It includes extensive data preprocessing, feature selection, and training of various models. Features were selected using an Analysis of Variance (ANOVA)–based feature selection technique to reduce computational overhead and time complexity while mitigating the curse of dimensionality and enhancing model accuracy. The resulting optimal feature subset was then used to train and evaluate several classifiers, including Decision Trees, K-Nearest Neighbors (KNN), Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM) networks, and a hybrid CNN–LSTM model. The models are compared using typical measures of performance such as accuracy, precision, recall, F1-score, and confusion matrix. The results indicate that hybrid deep learning models specifically the CNN-LSTM outperformed the other models in recognizing binary attacks achieving the highest performance with accuracy of 94.08% followed by CNN and LSTM with accuracies of 93.37% and 93.24% respectively. In contrast, the traditional machine learning model, Decision trees demonstrated superior performance in multi-class classification, achieving an accuracy of 98.25% defeating KNN (90%) as well as the hybrid deep learning model (CNN-LSTM – 88.30%). This, work paves the foundation for the implementation of scalable intrusion detection models in real IoT infrastructures. The future of the work is to integrate the developed models using massive data streaming infrastructures in support of real-time intrusion detection in large-scale, dynamic IoT infrastructures.

Physics-supervised ensemble learning model for predicting failure modes of reinforced concrete columns

Cardiac arrhythmias are the leading cause of death and pose a huge health and economic burden globally. Electrocardiography (ECG) is an effective technique for the diagnosis of cardiovascular diseases because of its noninvasive and cost-effective advantages. However, traditional ECG analysis relies heavily on the clinical experience of physicians, which can be challenging and time-consuming to produce valid diagnostic results. This work proposes a new hybrid deep learning model that combines convolutional neural network (CNN) and bidirectional gated recurrent unit (BiGRU) with multi-head attention (CBGM model). Specifically, the model consists of seven convolutional layers with varying filter sizes (4, 16, 32, and 64) and three pooling layers, respectively, while the BiGRU module includes two layers with 64 units each followed by multi-head attention (8-heads). The combination of CNN and BiGRU effectively captures spatio-temporal features of ECG signals, with multi-head attention comprehensively extracted global correlations among multiple segments of ECG signals. The validation in the MIT-BIH arrhythmia database achieved an accuracy of 99.41%, a precision of 99.15%, a specificity of 99.68%, and an F1-Score of 99.21%, indicating its robust performance across different evaluation metrics. Additionally, the model’s performance was evaluated on the PTB Diagnostic ECG Database, where it achieved an accuracy of 98.82%, demonstrating its generalization capability. Comparative analysis against previous methods revealed that our proposed CBGM model exhibits more higher performance in automatic classification of arrhythmia and can be helpful for assisting clinicians by enabling real-time detection of cardiac arrhythmias during routine ECG screenings.

The Turkish Music Emotion Dataset in the CL database is a dataset for music emotion classification, which contains many music samples and their corresponding emotion labels. This paper presents a comparative analysis of the performance of the traditional random forest machine learning model and the XGBoost model on the given dataset. The findings indicate that the traditional random forest machine learning model outperforms the XGBoost model in terms of accuracy, accuracy, and recall rate. The traditional random forest machine learning model achieves an accuracy of 80.8%, whereas the XGBoost model achieves an accuracy of 75%. The recall rate of the traditional random forest machine learning model is 80.8%, whereas the recall rate of the XGBoost model is 77.2%. The traditional random forest machine learning model achieved an F1 score of 80.5%, whereas the XGBoost model attained an F1 score of 75.3%. The comprehensive evaluation of the XGBoost model outperforms the traditional random forest machine learning model. Generally, the traditional random forest machine learning model demonstrates strong performance in the domain of music emotion classification. It exhibits favorable qualities such as robustness and interpretability, and possesses the ability to effectively handle noise and missing data. The XGBoost model, on the other hand, can be trained and predicted quickly, with high accuracy and generalization ability. Therefore, in practical application, it is necessary to select the appropriate model according to the specific situation, and optimize and adjust it to obtain the best classification effect.

Growth in system complexity increases the need for automated techniques dedicated to different log analysis tasks such as Log-based Anomaly Detection (LAD). The latter has been widely addressed in the literature, mostly by means of a variety of deep learning techniques. However, despite their many advantages, that focus on deep learning techniques is somewhat arbitrary as traditional Machine Learning (ML) techniques may perform well in many cases, depending on the context and datasets. In the same vein, semi-supervised techniques deserve the same attention as supervised techniques since the former have clear practical advantages. Further, current evaluations mostly rely on the assessment of detection accuracy. However, this is not enough to decide whether or not a specific ML technique is suitable to address the LAD problem in a given context. Other aspects to consider include training and prediction times as well as the sensitivity to hyperparameter tuning, which in practice matters to engineers. In this paper, we present a comprehensive empirical study, in which we evaluate a wide array of supervised and semi-supervised, traditional and deep ML techniques w.r.t. four evaluation criteria: detection accuracy, time performance, sensitivity of detection accuracy and time performance to hyperparameter tuning. Our goal is to provide much stronger and comprehensive evidence regarding the relative advantages and drawbacks of alternative techniques for LAD. The experimental results show that supervised traditional and deep ML techniques fare similarly in terms of their detection accuracy and prediction time on most of the benchmark datasets considered in our study. Moreover, overall, sensitivity analysis to hyperparameter tuning with respect to detection accuracy shows that supervised traditional ML techniques are less sensitive than deep learning techniques. Further, semi-supervised techniques yield significantly worse detection accuracy than supervised techniques.

The online spread of fake news on various platforms has emerged as a significant concern, posing threats to public opinion, political stability, and the dissemination of reliable information. Researchers have turned to advanced technologies, including machine learning (ML) and deep learning (DL) techniques, to detect and classify fake news to address this issue. This research study explores fake news classification using diverse ML and DL approaches. We utilized a well-known “Fake News” dataset sourced from Kaggle, encompassing a labelled news collection. We implemented diverse ML models, including multinomial naïve bayes (MNB), gaussian naïve bayes (GNB), Bernoulli naïve Bayes (BNB), logistic regression (LR), and passive aggressive classifier (PAC). Additionally, we explored DL models, such as long short-term memory (LSTM), convolutional neural networks (CNN), and CNN-LSTM. We compared the performance of these models based on key evaluation metrics, such as accuracy, precision, recall, and the F1 score. Additionally, we conducted cross-validation and hyperparameter tuning to ensure optimal performance. The results provide valuable insights into the strengths and weaknesses of each model in classifying fake news. We observed that DL models, particularly LSTM and CNN-LSTM, showed better performance compared to traditional ML models. These models achieved higher accuracy and demonstrated robustness in classification tasks. These findings emphasize the potential of DL models to tackle the spread of fake news effectively and highlight the importance of utilizing advanced techniques to address this challenging problem.

Communication-based train control (CBTC) systems are automated train control systems based on continuous and bidirectional train-ground communication. As one of the critical subsystems of the safety-demanding CBTC systems, the Data Communication System (DCS) is physically exposed to the environment. DCS faults may lead to delayed trains, stranded passengers, suspension of service, or even catastrophic losses of lives or assets. Therefore, it is quite desirable to identify the DCS faults and accordingly take effective maintenance measures. Most fault classification works are based on traditional Machine Learning (ML) techniques, such as Decision Tree (DT) and Bayesian Network. A substantial amount of fault information can be lost when we manually extract features from the system logs. This paper proposes a Deep Hybrid Learning (DHL) method to identify the DCS faults. A pre-trained Chinese Bidi-rectional Encoder Representation from Transformers (BERT) Deep Learning (DL) model is used to extract fault features from raw text logs automatically, and several traditional ML models are used to classify the system faults by the extracted features. Our study highlights the advantages of the DHL model in DCS fault diagnosis tasks. The intense simulation results illustrate that the proposed DHL model achieves substantial accuracy compared with traditional ML algorithms.

Stock price prediction remains a complex yet crucial task in financial markets, requiring robust methodologies to capture intricate dependencies in stock price movements. This study proposes the Hybrid Deep Learning for Stock Market Prediction (HDL-SMP) model, integrating Convolutional Neural Networks (CNNs), Bidirectional Long Short-Term Memory (BiLSTM), and an Attention Mechanism to enhance predictive accuracy. The model processes three key data sources: historical stock prices, technical indicators, and sentiment analysis scores from financial news and social media. The CNN layer extracts spatial patterns in price movements, while the BiLSTM layer learns long-term dependencies and captures both past and future trends. The Attention layer assigns dynamic weights to features based on their significance, optimizing prediction outcomes. Experimental evaluations on benchmark stock market datasets demonstrate the superiority of HDL-SMP over traditional machine learning models and existing deep learning architectures. The model achieves higher prediction accuracy, lower error rates, and improved robustness against market volatility. A comparative analysis with Support Vector Regression (SVR), CNN-BiLSTM, and other hybrid deep learning models confirms the effectiveness of HDL-SMP in financial forecasting. These findings highlight the potential of deep learning-based models in stock market prediction, aiding investors and financial analysts in making informed decisions.

Monitoring systems are becoming more crucial for city security, specifically to address any kind of violence. Manual detection of violence through video surveillance requires well-trained human resources. However, accuracy and speed are compromised in the case of manual approach. The lack of human resources and their limited ability to interpret violence from a video is the major concern of this approach. Thus, automatic violence detection is required to take timely actions. Most of the existing work for violence detection have used either traditional Machine Learning (ML) based approach or a combination of Convolution Neural Network (CNN) and Long Short Term Memory (LSTM) network for incorporating Spatio-temporal relations. However, video clips contain an extensive number of frames which contain unnecessary and redundant information. Elimination of such frames increases the efficiency and accuracy of the system. Thus, an Efficient ConvLSTM based Violence Detection System (ECLVDS) model is proposed to address this issue. The proposed model uses a clustering-based keyframe extraction technique to eliminate redundant and useless frames. Moreover, the proposed model uses a ConvLSTM model instead of a simple LSTM because the ConvLSTM network extracts better spatiotemporal correlation than the normal LSTM model. The proposed model is evaluated with the widely used benchmark Hockey Fight Dataset and achieved an accuracy of 98.90%, which is comparatively better than some of the existing models.

Water quality prediction (WQP) plays an essential role in water quality management for aquaculture to make aquaculture production profitable and sustainable. In this work, we propose hybrid deep learning (DL) models, convolutional neural network (CNN) with the long short-term memory (LSTM) and gated recurrent unit (GRU) for aquaculture WQP. CNN can effectively fetch the aquaculture water quality characteristics, whereas GRU and LSTM can learn long-term dependencies in the time series data. We conduct experiments using the two different water quality datasets and present an extensive study on the impact of hyperparameters on the performance of the proposed hybrid DL models. Furthermore, the performance of hybrid CNN-LSTM and CNN-GRU models are compared with different baseline LSTM, GRU and CNN DL models and also with attention-based LSTM and attention-based GRU DL models. The results show that the hybrid CNN-LSTM outperformed all other models in terms of prediction accuracy and computation time.