Using AraGPT and ensemble deep learning model for sentiment analysis on Arabic imbalanced dataset

Sentiment Analysis of Self Driving Car Dataset: A comparative study of Deep Learning approaches

Small and Medium-sized Enterprises (SMEs) in Sri Lanka are increasingly turning to social media to gain insights into consumer preferences; however, they frequently lack sophisticated analytical tools to derive actionable insights. This research introduces a hybrid deep learning framework aimed at sentiment and emotion analysis specifically for the Sri Lankan cake sector. Customer reviews and social media comments were gathered and processed through various methods including text cleaning, emoji translation, stopword elimination, tokenization, and sequence padding. Several deep learning models— Convolutional Neural Networks (CNN), Bidirectional Long Short-Term Memory (BiLSTM), and Gated Recurrent Units (GRU) were assessed, along with hybrid models that combined CNN and BiLSTM with GPT-2 embeddings. The CNN+GPT-2 model achieved the highest accuracy in sentiment classification at 96.14%, while BiLSTM performed best in emotion classification with an accuracy of 91.57%. In terms of trend forecasting, Long Short-Term Memory (LSTM) outshone both SARIMA and Prophet, yielding the lowest error metrics and the most reliable sentiment predictions. These results underscore the potential of hybrid deep learning and transformer-based models to effectively capture complex consumer sentiments and provide SMEs with practical, AI-driven insights. This study is among the first to implement such hybrid NLP models within a localized Sri Lankan context, presenting a scalable approach for business intelligence and informed decision-making.

Radiologists often face challenges in differentiating benign from malignant sacral bone lesions due to their similar imaging characteristics. This study aimed to develop an ensemble deep learning (DL) model that can preoperatively distinguish between benign and malignant sacral tumors using noncontrast computed tomography images. Preoperative sacral CT scans from 569 patients with confirmed sacral lesions were analyzed. Data from Center 1 were utilized in model development and internal test via fivefold cross-validation, and those from Centers 2 and 3 were employed in external test. Various ensemble models combining human-readable interpretation and DL were developed. The diagnostic performance of the models and radiologists was assessed using metrics such as precision, recall, accuracy, area under the curve (AUC), F1 score, and confusion matrix. Furthermore, the clinical benefits derived from radiologists' interpretations and supported by the DL model were evaluated. The ensemble model, which integrates 3D-DenseNet121 with human interpretation, exhibited the most robust performance. The ensemble model demonstrated high performance on the internal and external test sets and achieved AUCs of 0.9139 and 0.8713, F1 scores of 0.9054 and 0.8571, precision of 0.9041 and 0.8824, recall of 0.9136 and 0.8333, and accuracy of 0.8630 and 0.8182, respectively. Across the external test cohort, all radiologists experienced improvements in AUC, accuracy, sensitivity, and specificity. Notably, junior radiologists demonstrated significant improvements compared with senior radiologists. The potential clinical application of the DL model lies in its capacity to considerably enhance the diagnostic efficiency of radiologists. This study presents the first ensemble deep learning model integrating 3D-DenseNet121 with radiologists' interpretation for preoperative differentiation of sacral tumors on noncontrast CT that improved diagnostic performance across all experience levels, particularly for junior radiologists. First artificial intelligence-radiologist ensemble for noncontrast computed tomography (NCCT)-based sacral tumor classification. Boosts all radiologists' performance, with the greatest gains for juniors, potentially reducing referrals. Enables reliable NCCT diagnosis, overcoming contrast/magnetic resonance imaging dependency in musculoskeletal oncology.

Accurate rainfall forecasting is crucial in activities such as agricultural planning, water resource management, and flood preparedness, so failure to accurately forecast rainfall might undermine these activities. This study aimed to improve the accuracy of daily rainfall prediction in Hai district, Kilimanjaro region, Tanzania, a region characterised by a bimodal rainfall pattern, by comparing rainfall prediction accuracies of Traditional Machine Learning (TML) and Deep Learning (DL) models. The 25-year daily rainfall dataset for Hai district was first pre-processed by cleaning, normalisation, and splitting into training (first 60%), validation (next 20%), and test (last 20%) sets. TML models (K-Nearest Neighbours (KNN) through its variant KNN Regressor and Support Vector Machine (SVM) through its variant Support Vector Regressor (SVR)) were developed, trained, and their performances compared with developed and trained DL models (Long Short-Term Memory (LSTM) and Gated Recurrent Units (GRU)). Each model’s test performance was evaluated using the Root Mean Squared Error (RMSE) metric. The findings revealed that the DL models, LSTM and GRU, achieved test RMSE scores of 6.35 mm and 6.49 mm, respectively, while the TML models, KNN and SVM, achieved test RMSE scores of 6.61 mm and 10.42 mm, respectively. The study demonstrated that DL models are more effective for accurate rainfall forecasting than TML models in regions with complex rainfall patterns. The insights gained will guide the development of more reliable, location-specific weather prediction systems, ultimately supporting informed decision-making in agriculture, environmental management, and flood risk reduction in Tanzania and other regions facing similar climatic challenges

Parts of Speech (pos) tagging corresponds to techniques of tagging accurate pos tags of each word of a sentence. It is a pivotal and indispensable part of sentiment analysis, synthesizing text to speech, analyzing textual data and many more Natural Language Processing (NLP) tasks. Though there are many researches done in the field of languages like English, Chinese etc., it is still comparatively unexplored for Bangla. An excellent pos tagger in Bangla language can accelerate NLP of Bangla textual data. In this study, we have developed a novel hybrid Deep Learning (DL) model with two parallel input networks with Convolutional Neural Network (CNN), and Bidirectional Long Short Term Memory (BiLSTM), and an output network of CNN. CNN works well regarding the local dependencies of words in sentences, and BiLSTM works well with the global dependencies of words regarding the context in a sentence. No other work has been done with local features of textual data along with long term word dependencies in Bangla pos tagging studies. The model can work with any external Word Embeddings. In this study, it is implemented with both Embedding Layer and Word2Vec layer. In the evaluation process, Mathews Correlation Coefficient (MCC), Precision-Recall curve are used along with accuracy and F1-score due to the dataset's imbalanced characteristic. Our proposed model accompanied by Word2Vec layer has outperformed Vanilla Recurrent Neural Network (RNN), Gated Recurrent Units (GRU), Long Short Term Memory (LSTM), BiLSTM networks, and also one recent study using the same dataset with the highest accuracy of 0.974, F1-score of 0.883, and MCC value of 0.936.

The climate crisis has sparked a global shift toward renewable energy sources, increasing the demand for models that provide accurate risk assessment and forecasting to support informed investment decisions. The novelty of this study is to analyze renewable energy investments through three methodological approaches: risk assessment, deep learning-based volatility forecasting, and renewable energy demand forecasting. First, risk profiles of two renewable energy stocks (NextEra Energy and Iberdrola) and two traditional energy stocks (ExxonMobil and Chevron) are evaluated for the time period 2020 to 2024. Second, deep learning (DL) models such as recurrent neural network (RNN), long short-term memory (LSTM), gated recurrent unit (GRU), bidirectional long short-term memory (BiLSTM), bidirectional gated recurrent unit (BiGRU) are employed, and it is shown that renewable energy stocks have more stable performance across all DL models, with BiLSTM revealed as the most robust architecture. Third, UK liquid biofuel consumption trends are analyzed using multiple forecasting methods, including Mean, Naïve, Seasonal Naïve, Drift, and machine learning models. It is shown that the neural network autoregressive (NNAR) model has the highest forecast accuracy, and among the combined forecast models, constrained least squares achieved the highest forecast accuracy. The results indicate that renewable energy produces lower risk exposure and more stable returns, and improves predictability despite short-term volatility.

The aim of this study was to distinguish canine lymphoma from other diseases,particularly reactive lymphoid hyperplasia (RLH), based on fine needle aspiration (FNA)images. We developed four deep learning models based on Vision Transformer (ViT) andInception-v3, which were pre-trained image classification models. The two models out offour were ViT and Inception-v3, and the remained were the two types of combination, i.e.,ensemble learning models, of ViT and Inception-v3; the mean of class probabilities of ViTand Inception-v3 (Ensemble model A; MEAN) and the maximum probabilities of ViT andInception-v3 (Ensemble model B; MAX). A total of 2,290 FNA images of canine lymphoma and871 FNA images of RLH were analyzed. The FNA images were obtained from the twenty-fiveslides of fourteen lymphoma cases and eight slides of seven RLH cases in two hospitals.Three types of training and test datasets were prepared from the above image datasets forfair evaluation of the models. Three deep learning-based image classification models(Inception-v3 and the two ensemble models) attained high performance of >80% accuracy,recall and area under the curve (AUC) values for all three datasets. ViT did not archivehigh performance, except the precision (>0.85). This study is an example of showingpotentials of deep learning models through image classification problem in caninelymphoma.

Development of the GLASS 250-m leaf area index product (version 6) from MODIS data using the bidirectional LSTM deep learning model

Although deep learning models are widely used in text sentiment analysis, it is a challenging task to extract richer semantic features to improve model performance in corpora with weak label characteristics. This study crawls the agricultural product review of Jingdong e-commerce as a corpus, and proposes a deep learning method based on the characteristics of the corpus for sentiment analysis. The method first uses frequent item mining to construct a sentiment dictionary, and converts weakly labeled data into high-quality corpus through sentiment value calculation. Secondly, Convolutional Neural Network (CNN) and Bidirectional Long Short Term Memory (BiLSTM) are combined in the sentiment analysis model, and the word vectors trained by Glove and Word2vec are imported into the multi-channel neural network, so that the model can learn local and global semantic features in parallel, and embed the attention mechanism in the channel. The experimental results show that the performance of the model considering the characteristics of the corpus is significantly improved, and the MAtt-CNN-BiLSTM model constructed in this paper has the best performance in the experiments under the three datasets.

Emotion recognition (ER) is crucial for understanding human behaviours, social interactions, and psychological well-being. Electroencephalography (EEG) has emerged as a promising tool for capturing the neural correlates of emotions. This work is a systematic review of articles in ER using EEG signals. A total of 120 articles from 1041 articles were selected based on PRISMA guidelines using defined inclusion and exclusion criteria, published between 2018 and 2024. This article aims to provide an in-depth understanding of the current landscape of ER from EEG signals utilizing deep learning (DL). This review offers valuable guidance for researchers and practitioners seeking more refined and reliable emotion classification systems. To explore the effectiveness of DL models in EEG-based ER, several potential DL models, such as convolutional neural network, long short-term memory (LSTM), gated recurrent unit (GRU), hybrid bidirectional LSTM (BiLSTM), bidirectional GRU, and advanced DL models such as convolutional recurrent neural network and EEG-Conformer models are applied to two popular datasets, SEED and GAMEEMO, respectively, to depict the full process of ER. Additionally, the performance of DL models is also compared with the performance of basic machine learning (ML) models such as SVM, k-nearest neighbors, logistic regression, and boosting algorithms such as AdaBoost, XGBoost and LightGBM. Through extensive experiments and performance evaluations, the performance of different models when applied to the datasets mentioned above is compared. The accuracy, precision, recall, and F1-scores are analysed to determine the most effective model for EEG-based ER. The findings of this study demonstrate that the performance of hybrid DL models is more efficacious than that of ML models. The best-performing model (BiLSTM) classified the emotions, with an accuracy of 90.54% when applied to the GAMEEMO dataset. This research contributes to the growing body of literature on ER and provides insights into the feasibility of using EEG signals to understand emotional states, and presents a structured roadmap for future exploration. The findings can aid in the development of more accurate and reliable ER systems, which can have wide-ranging applications in psychology, social sciences, and human-computer interactions.

An ensemble deep learning model for exhaust emissions prediction of heavy oil-fired boiler combustion

This study examines the efficacy of three distinct machine learning models for sentiment analysis: Bidirectional Long Short-Term Memory (Bi-LSTM), Long Short-Term Memory (LSTM), and Logistic Regression. One of the most important tasks in natural language processing is sentiment analysis, which entails categorizing reviews as positive or negative. Fifty thousand sentiment-labeled movie reviews make up the dataset. To determine the most precise and effective technique for sentiment categorization, we put these models into practice and evaluated their respective performances. The highest accuracy of 89.42% is achieved by Logistic Regression, with precision of 88.35%, recall of 91.01%, and F1-score of 89.66%. The LSTM model, well-known for capturing temporal dependencies in text, obtained an accuracy of 86.23%, precision of 89.60%, recall of 82.22%, and an F1-score of 85.75%. The Bi-LSTM model, which processes input sequences in both forward and backward directions to better capture context, demonstrated accuracy of 87.65%, precision of 88.67%, recall of 86.54%, and an F1-score of 87.60%. The results show that although Logistic Regression performs better in accuracy, the Bi-LSTM model offers a substantial trade-off between precision and recall, making it a viable option for sentiment analysis applications. Despite its minor accuracy lag, the LSTM model provides important insights into the sequential relationships of the text data.

Chronic kidney disease (CKD) involves numerous variables, but only a few significantly impact the classification task. The statistically equivalent signature (SES) method, inspired by constraint-based learning of Bayesian networks, is employed to identify essential features in CKD. Unlike conventional feature selection methods, which typically focus on a single set of features with the highest predictive potential, the SES method can identify multiple predictive feature subsets with similar performance. However, most feature selection (FS) classifiers perform suboptimally with strongly correlated data. The FS approach faces challenges in identifying crucial features and selecting the most effective classifier, particularly in high-dimensional data. This study proposes using the Least Absolute Shrinkage and Selection Operator (LASSO) in conjunction with the SES method for feature selection in CKD identification. Following this, an ensemble deep-learning model combining long short-term memory (LSTM) and gated recurrent unit (GRU) networks is proposed for CKD classification. The features selected by the hybrid feature selection method are fed into the ensemble deep-learning model. The model’s performance is evaluated using accuracy, precision, recall, and F1 score metrics. The experimental results are compared with individual classifiers, including decision tree (DT), Random Forest (RF), logistic regression (LR), and support vector machine (SVM). The findings indicate a 2% improvement in classification accuracy when using the proposed hybrid feature selection method combined with the LSTM and GRU ensemble deep-learning model. Further analysis reveals that certain features, such as HEMO, POT, bacteria, and coronary artery disease, contribute minimally to the classification task. Future research could explore additional feature selection methods, including dynamic feature selection that adapts to evolving datasets and incorporates clinical knowledge to enhance CKD classification accuracy further.

<span lang="EN-US">In the realm of natural language processing (NLP), a diverse array of language models has emerged, catering to a wide spectrum of tasks, ranging from speaker recognition and auto-correction to sentiment analysis and stock prediction. The significance of language models in enabling the execution of these NLP tasks cannot be overstated. This study proposes an approach to enhance accuracy by leveraging a hybrid language model, combining the strengths of long short-term memory (LSTM) and gated recurrent unit (GRU). LSTM excels in preserving long-term dependencies in data, while GRU's simpler gating mechanism expedites the training process. The research endeavors to evaluate four variations of this hybrid model: LSTM, GRU, <a name="_Hlk158992630"></a>bidirectional long short-term memory (Bi-LSTM), and a combination of LSTM with GRU. These models are subjected to rigorous testing on two distinct datasets: one focused on IBM stock price prediction, and the other on Jigsaw toxic comment classification (sentiment analysis). This work represents a significant stride towards democratizing NLP capabilities, ensuring that even in resource-constrained settings, NLP models can exhibit improved performance. The anticipated implications of these findings span a wide spectrum of real-world applications and hold the potential to stimulate further research in the field of NLP. </span>

Water quality prediction (WQP) plays an essential role in water quality management for aquaculture to make aquaculture production profitable and sustainable. In this work, we propose hybrid deep learning (DL) models, convolutional neural network (CNN) with the long short-term memory (LSTM) and gated recurrent unit (GRU) for aquaculture WQP. CNN can effectively fetch the aquaculture water quality characteristics, whereas GRU and LSTM can learn long-term dependencies in the time series data. We conduct experiments using the two different water quality datasets and present an extensive study on the impact of hyperparameters on the performance of the proposed hybrid DL models. Furthermore, the performance of hybrid CNN-LSTM and CNN-GRU models are compared with different baseline LSTM, GRU and CNN DL models and also with attention-based LSTM and attention-based GRU DL models. The results show that the hybrid CNN-LSTM outperformed all other models in terms of prediction accuracy and computation time.