Sentiment Analysis of Bangla Language Using Deep Learning Approaches

Sentiment analysis of product reviews plays a crucial role in understanding consumer feedback, improving customer experience and making informed business decisions. This paper explores the application of machine learning and deep learning algorithms to effectively classify and analyse the sentiment of product reviews. Traditional machine learning techniques, such as Naïve Bayes, Support Vector Machines (SVM) and Random Forests are employed for sentiment classification based on manually engineered features. Simultaneously, deep learning approaches like Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks are leveraged to automatically learn complex representations from raw text data. The study compares the performance of these methods in terms of accuracy, precision, recall and F1-score. Additionally, pre-trained language models such as BERT are incorporated to enhance contextual understanding. Experimental results demonstrate that deep learning models particularly LSTM and BERT, outperform traditional machine learning techniques in capturing sentiments. This analysis provides valuable insights into the effectiveness of different algorithms in sentiment analysis tasks, paving the way for more advanced applications in natural language processing and customer sentiment evaluation.

Sentiment analysis also referred to as opinion mining, plays a significant role in automating the identification of negative, positive, or neutral sentiments expressed in textual data. The proliferation of social networks, review sites, and blogs has rendered these platforms valuable resources for mining opinions. Sentiment analysis finds applications in various domains and languages, including English and Arabic. However, Arabic presents unique challenges due to its complex morphology characterized by inflectional and derivation patterns. To effectively analyze sentiment in Arabic text, sentiment analysis techniques must account for this intricacy. This paper proposes a model designed using the transformer model and deep learning (DL) techniques. The word embedding is represented by Transformer-based Model for Arabic Language Understanding (ArabBert), and then passed to the AraBERT model. The output of AraBERT is subsequently fed into a Long Short-Term Memory (LSTM) model, followed by feedforward neural networks and an output layer. AraBERT is used to capture rich contextual information and LSTM to enhance sequence modeling and retain long-term dependencies within the text data. We compared the proposed model with machine learning (ML) algorithms and DL algorithms, as well as different vectorization techniques: term frequency-inverse document frequency (TF-IDF), ArabBert, Continuous Bag-of-Words (CBOW), and skipGrams using four Arabic benchmark datasets. Through extensive experimentation and evaluation of Arabic sentiment analysis datasets, we showcase the effectiveness of our approach. The results underscore significant improvements in sentiment analysis accuracy, highlighting the potential of leveraging transformer models for Arabic Sentiment Analysis. The outcomes of this research contribute to advancing Arabic sentiment analysis, enabling more accurate and reliable sentiment analysis in Arabic text. The findings reveal that the proposed framework exhibits exceptional performance in sentiment classification, achieving an impressive accuracy rate of over 97%.

This research aims to implement deep learning techniques to determine fact and fake news in Indonesian language. The methods used are Convolutional Neural Network (CNN) and Long Short Term Memory (LSTM). The stages of the research consisted of collecting data, labeling data, preprocessing data, word embedding, splitting data, forming CNN and LSTM models, evaluating, testing new input data and comparing evaluations of the established CNN and LSTM models. The Data are collected from a fact and fake news provider site that is valid, namely TurnbackHoax.id. There are 1786 news used in this study, with 802 fact and 984 fake news. The results indicate that the CNN and LSTM methods were successfully applied to determine fact and fake news in Indonesian language properly. CNN has an accuracy test, precision and recall value of 0.88, while the LSTM model has an accuracy test and precision value of 0.84 and a recall of 0.83. In testing the new data input, all of the predictions obtained by CNN are correct, while the prediction results obtained by LSTM have 1 wrong prediction. Based on the evaluation results and the results of testing the new data input, the model produced by the CNN method is better than the model produced by the LSTM method.

Research on sentiment analysis in recent years has increased. However, in sentiment analysis research there are still few ideas about the handling of negation, one of which is in the Indonesian sentence. This results in sentences that contain elements of the word negation have not found the exact polarity.The purpose of this research is to analyze the effect of the negation word in Indonesian. Based on positive, neutral and negative classes, using attention-based Long Short Term Memory and word2vec feature extraction method with continuous bag-of-word (CBOW) architecture. The dataset used is data from Twitter. Model performance is seen in the accuracy value.The use of word2vec with CBOW architecture and the addition of layer attention to the Long Short Term Memory (LSTM) and Bidirectional Long Short Term Memory (BiLSTM) methods obtained an accuracy of 78.16% and for BiLSTM resulted in an accuracy of 79.68%. whereas in the FSW algorithm is 73.50% and FWL 73.79%. It can be concluded that attention based BiLSTM has the highest accuracy, but the addition of layer attention in the Long Short Term Memory method is not too significant for negation handling. because the addition of the attention layer cannot determine the words that you want to pay attention to.

Parts of Speech (pos) tagging corresponds to techniques of tagging accurate pos tags of each word of a sentence. It is a pivotal and indispensable part of sentiment analysis, synthesizing text to speech, analyzing textual data and many more Natural Language Processing (NLP) tasks. Though there are many researches done in the field of languages like English, Chinese etc., it is still comparatively unexplored for Bangla. An excellent pos tagger in Bangla language can accelerate NLP of Bangla textual data. In this study, we have developed a novel hybrid Deep Learning (DL) model with two parallel input networks with Convolutional Neural Network (CNN), and Bidirectional Long Short Term Memory (BiLSTM), and an output network of CNN. CNN works well regarding the local dependencies of words in sentences, and BiLSTM works well with the global dependencies of words regarding the context in a sentence. No other work has been done with local features of textual data along with long term word dependencies in Bangla pos tagging studies. The model can work with any external Word Embeddings. In this study, it is implemented with both Embedding Layer and Word2Vec layer. In the evaluation process, Mathews Correlation Coefficient (MCC), Precision-Recall curve are used along with accuracy and F1-score due to the dataset's imbalanced characteristic. Our proposed model accompanied by Word2Vec layer has outperformed Vanilla Recurrent Neural Network (RNN), Gated Recurrent Units (GRU), Long Short Term Memory (LSTM), BiLSTM networks, and also one recent study using the same dataset with the highest accuracy of 0.974, F1-score of 0.883, and MCC value of 0.936.

Online leakage current classification using convolutional neural network long short-term memory for high voltage insulators on web-based service

An analysis of machine learning models for sentiment analysis of Tamil code-mixed data

In this modern world, we are accustomed to a constant stream of data. Major social media sites like Twitter, Facebook, or Quora face a huge dilemma as a lot of these sites fall victim to spam accounts. These accounts are made to trap unsuspecting genuine users by making them click on malicious links or keep posting redundant posts by using bots. This can greatly impact the experiences that users have on these sites. A lot of time and research has gone into effective ways to detect these forms of spam. Performing sentiment analysis on these posts can help us in solving this problem effectively. The main purpose of this proposed work is to develop a system that can determine whether a tweet is “spam” or “ham” and evaluate the emotion of the tweet. The extracted features after preprocessing the tweets are classified using various classifiers, namely, decision tree, logistic regression, multinomial naïve Bayes, support vector machine, random forest, and Bernoulli naïve Bayes for spam detection. The stochastic gradient descent, support vector machine, logistic regression, random forest, naïve Bayes, and deep learning methods, namely, simple recurrent neural network (RNN) model, long short-term memory (LSTM) model, bidirectional long short-term memory (BiLSTM) model, and 1D convolutional neural network (CNN) model are used for sentiment analysis. The performance of each classifier is analyzed. The classification results showed that the features extracted from the tweets can be satisfactorily used to identify if a certain tweet is spam or not and create a learning model that will associate tweets with a particular sentiment.

Word embeddings are essential to natural language processing tasks because they contain a single word’s syntactic and semantic information. Word embeddings have been developed widely for numerous spoken languages across the globe like English. The research community needs to pay more attention to the Urdu language despite its significant number of speakers, which amounts to approximately 231.3 million individuals. Urdu is a complex language because word boundaries in Urdu are unspecified, as it does not employ delimiters between words. The compound word, a multiword expression, is a more complex word consisting of many strings or independent base words. Traditionally, compound words are identified during the word segmentation using bigram or trigram approaches. The challenge with these techniques is that they do not produce meaningful words. This study uses morphological rule-based compound words in Urdu text documents. For text representation, a self-trained morphological rule-based compound word embedding (Cword2vec) based on the word2vec model is proposed for Urdu text sentiment analysis. The performance of self-trained morphological rule-based compound word embedding was then evaluated using four well-known deep learning models, i.e., long short-term memory (LSTM), bidirectional LSTM (BiLSTM), convolutional neural networks (CNN), and convolutional LSTM (C-LSTM) for sentiment analysis. We also compare the performance of morphological rule-based compound words with traditional compound word identification techniques such as bigrams and trigrams. Regardless of the classification model, word embedding using our proposed morphological rule-based compound words outperformed in terms of precision, recall, F1 score, and accuracy than bigrams and trigrams.

Deep learning models such as Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) models have recently emerged as effective solutions to various NLP tasks with comparatively remarkable results. The CNN model efficiently extracts higher level features using convolutional layers and max-pooling layers while the LSTM model allows capturing long-term dependencies between word sequences. In this paper, we propose a hybrid CNN-LSTM model taking advantage of both models to overcome the sentiment analysis problem on Twitter data. We employ a multi-channel CNN that extracts local n-gram features in different sizes using several filters of different lengths. We also employ a weighted average word embeddings method which incorporates sentiment information in the continuous representation of words based on an adapted version of the delta TFIDF measure. These word representations will be the input for the CNN-LSTM model. Experiment results substantiate our intuition by reaching good macro average recall and accuracy scores beating several existing models as well as our same model using individual CNN and LSTM.

Platform X is widely used by students to express emotions related to academic activities, yet it has not been optimally analyzed. This study aims to classify student emotions and compare the performance of Support Vector Machine (SVM) and Long Short-Term Memory (LSTM). The method used is a computational experiment involving data crawling, preprocessing, lexicon-based labeling, and modeling using TF-IDF for SVM and word embedding for LSTM. The dataset consists of 2,914 data points. The results show that SVM achieved an accuracy of 71.18%, outperforming LSTM at 68.95%. This indicates that SVM is more stable on limited datasets, while LSTM tends to overfit. The study concludes that algorithm selection should consider data characteristics and contributes to the comparison of machine learning and deep learning methods. Keywords: LSTM, Sentiment Analysis, Social Media X, Student Emotion, SVM, TF-IDF

MLP, CNN, LSTM and Hybrid SVM for Stock Index Forecasting Task to INDU and FTSE100

The rise of social media has provided an unprecedented opportunity to analyze public opinion at scale. Sentiment analysis, a key technique in natural language processing (NLP), enables the automatic classification of opinions expressed in textual data. This study explores the effectiveness of sentiment analysis using the Sentiment140 dataset, a collection of tweets labeled as positive, negative, or neutral. We compare machine learning and deep learning models, including logistic regression, support vector machines (SVM), convolutional neural networks (CNN), and long short-term memory (LSTM) networks. Our results highlight the comparative strengths of each model in classifying sentiments with varying degrees of accuracy. This research contributes to the ongoing development of AI-powered sentiment analysis by evaluating model performance on real-world social media data.

Sentiment Analysis of Self Driving Car Dataset: A comparative study of Deep Learning approaches

Small and Medium-sized Enterprises (SMEs) in Sri Lanka are increasingly turning to social media to gain insights into consumer preferences; however, they frequently lack sophisticated analytical tools to derive actionable insights. This research introduces a hybrid deep learning framework aimed at sentiment and emotion analysis specifically for the Sri Lankan cake sector. Customer reviews and social media comments were gathered and processed through various methods including text cleaning, emoji translation, stopword elimination, tokenization, and sequence padding. Several deep learning models— Convolutional Neural Networks (CNN), Bidirectional Long Short-Term Memory (BiLSTM), and Gated Recurrent Units (GRU) were assessed, along with hybrid models that combined CNN and BiLSTM with GPT-2 embeddings. The CNN+GPT-2 model achieved the highest accuracy in sentiment classification at 96.14%, while BiLSTM performed best in emotion classification with an accuracy of 91.57%. In terms of trend forecasting, Long Short-Term Memory (LSTM) outshone both SARIMA and Prophet, yielding the lowest error metrics and the most reliable sentiment predictions. These results underscore the potential of hybrid deep learning and transformer-based models to effectively capture complex consumer sentiments and provide SMEs with practical, AI-driven insights. This study is among the first to implement such hybrid NLP models within a localized Sri Lankan context, presenting a scalable approach for business intelligence and informed decision-making.