Emotion Classification in Bangla Text Data Using Gaussian Naive Bayes Classifier: A Computational Linguistic Study

An Ensemble Technique to Classify Multi-Class Textual Emotion

Sentiment analysis plays a pivotal role in understanding the sentiments and opinions expressed in textual data, offering valuable insights into various domains, including tourism. In this study, we present a comprehensive review of sentiment analysis techniques applied to tourism reviews using machine learning algorithms. The abundance of user-generated content on tourism platforms has made sentiment analysis an indispensable tool for businesses and researchers alike. By leveraging machine learning algorithms, researchers can extract sentiments from vast amounts of textual data efficiently and accurately. This review outlines the key methodologies and approaches utilized in sentiment analysis of tourism reviews. It discusses preprocessing techniques such as text tokenization, stop-word removal, and stemming, which are crucial for preparing textual data for analysis. Furthermore, it examines various machine learning algorithms employed for sentiment classification, including Naive Bayes, Support Vector Machines, and Recurrent Neural Networks. Additionally, the review delves into feature extraction methods such as bag-of-words, TF-IDF, and word embeddings, highlighting their impact on sentiment analysis accuracy. Moreover, it explores the challenges and limitations associated with sentiment analysis in the tourism domain, such as sarcasm detection and language nuances.

The present discussion highlights the aspects of an ongoing doctoral thesis grounded on the analysis and tracking of emotions from English and Bengali texts. Development of lexical resources and corpora meets the preliminary urgencies. The research spectrum aims to identify the evaluative emotional expressions at word, phrase, sentence, and document level granularities along with their associated holders and topics. Tracking of emotions based on topic or event was carried out by employing sense based affect scoring techniques. The labeled emotion corpora are being prepared from unlabeled examples to cope with the scarcity of emotional resources, especially for the resource constraint language like Bengali. Different unsupervised, supervised and semi-supervised strategies, adopted for coloring each outline of the research spectrum produce satisfactory outcomes

Text mining is a special case of data mining which explore unstructured or semi-structured text documents, to establish valuable patterns and rules that indicate trends and significant features about specific topics. Text mining has been in pattern recognition, predictive studies, sentiment analysis and statistical theories in many areas of research, medicine, financial analysis, social life analysis, and business intelligence. Text mining uses concept of natural language processing and machine learning. Machine learning algorithms have been used and reported to give great results, but their performance of machine learning algorithms is affected by factors such as dataset domain, number of classes, length of the corpus, and feature selection techniques used. Redundant attribute affects the performance of the classification algorithm, but this can be reduced by using different feature selection techniques and dimensionality reduction techniques. Feature selection is a data preprocessing step that chooses a subset of input variable while eliminating features with little or no predictive information. Feature selection techniques are Information gain, Term Frequency, Term Frequency-Inverse document frequency, Mutual Information, and Chi-Square, which can use a filters, wrappers, or embedded approaches. To get the most value from machine learning, pairing the best algorithms with the right tools and processes is necessary. Little research has been done on the effect of feature selection techniques on classification accuracy for pairing of these algorithms with the best feature selection techniques for optimal results. In this research, a text classification experiment was conducted using incident management dataset, where incidents were classified into their resolver groups. Support vector machine (SVM), K-Nearest Neighbors (KNN), Naïve Bayes (NB) and Decision tree (DT) machine learning algorithms were examined. Filtering approach was used on the feature selection techniques, with different ranking indices applied for optimal feature set and classification accuracy results analyzed. The classification accuracy results obtained using TF were, 88% for SVM, 70% for NB, 79% for Decision tree, and KNN had 55%, while Boolean registered 90%, 83%, 82% and 75%, for SVM, NB, DT, and KNN respectively. TF-IDF, had 91%, 83%, 76%, and 56% for SVM, NB, DT, and KNN respectively. The results showed that algorithm performance is affected by feature selection technique applied. SVM performed best, followed by DT, KNN and finally NB. In conclusion, presence of noisy data leads to poor learning performance and increases the computational time. The classifiers performed differently depending on the feature selection technique applied. For optimal results, the classifier that performed best together with the feature selection technique with the best feature subset should be applied for all types of data for accurate classification performance. Keywords: Text Classification, Supervised Machine Learning, Feature Selection DOI : 10.7176/JIEA/9-3-06 Publication date :May 31 st 2019

Sentiment analysis, a crucial aspect of Natural Language Processing (NLP), plays a pivotal role in understanding public opinion, customer feedback, and user sentiments in various domains. In this study, we present a comprehensive approach to sentiment analysis that incorporates both textual and emoji data, leveraging diverse datasets from sources such as social media, customer reviews, and surveys. Our methodology consists of several key steps, including data collection, pre-processing, feature extraction, feature fusion, and feature selection. For data pre-processing, we apply techniques such as tokenization, lowercasing, stop word removal, and stemming to ensure uniform and meaningful text representation. We also extract emojis from text using regular expressions and convert them into textual representations, facilitating unified processing. Text data is transformed into feature vectors using Term frequency_ Inverse Term frequency (TF-IDF) weighting-based Bag of Words (TF-IDF_BoW) with word frequencies, pre-trained Word2Vec word embeddings, and n-grams to capture local word patterns. Emoji data, on the other hand, is processed using pre-trained emoji embeddings (Emoji2Vec) and emoji frequency counting. The Feature Fusion stage involves the combination of text and emoji features into a single feature vector, with a weighted concatenation approach. In the Feature Selection phase, introduced a Self-Improved Siberian Tiger Optimization (SI-STO), a novel feature selection technique, to identify the most relevant features for sentiment prediction. The sentiment classification model SentEmoNet combines LSTM with an Attention Mechanism and a CNN for capturing text patterns and extracting local features from text and emoji embeddings. We use standard sentiment analysis metrics to assess performance in the model evaluation phase. The proposed model has achieved an accuracy of 97.87%, which is better than the existing ones.

Emotion detection plays a vital role in understanding human sentiments and behaviors across various applications, including customer feedback analysis and mental health monitoring. This research assesses the efficiency of different algorithms for machine learning in detecting emotions in text data. A meticulously curated dataset is utilized for the study. The research compares conventional models like Logistic Regression (LR), Random Forest (RF), Support Vector Machines (SVM), and Naive Bayes (NB) with deep learning models like Long Short-Term Memory (LSTM), Convolutional Neural Networks (CNN), and Bidirectional Encoder Representations from Transformers (BERT). The performance of each algorithm is assessed using accuracy, precision, recall, and F1 score. BERT exhibits superiority over other models, achieving the maximum accuracy of 0.8867 and F1 Score of 0.8871. CNN and SVM also display commendable performance. While the traditional models perform adequately, they are surpassed by deep learning models, with Naive Bayes showing the lowest metrics. This study underscores the significance of selecting models based on specific application requirements, taking into account factors like interpretability and efficiency. Future research endeavors may explore multimodal approaches, model interpretability, bias reduction, and real-time applications, thereby contributing to the advancement of emotion detection in text.

Emotional analysis techniques for text are very useful for analyzing public opinions on social media, and user reputation and opinions about products and services on electronic commerce sites. The Chinese Emotional Word Dictionary (CEWD) was created and has a very rich vocabulary for the fine-grained (11 emotion categories) emotional analysis of Chinese text. Additionally, the Chinese Emotional Expression Analysis System (CEEAS) that uses CEWD was developed to analyze emotions in Chinese text relatively accurately and quickly. In this study, we apply CEEAS to the emotional analysis of modern Chinese literature to investigate the characteristics of the appearance of emotional categories in modern Chinese literary works. Then, we apply CEEAS to modern translations of ancient Chinese literary works to perform emotional analysis, and compare the appearance characteristics of emotional expressions with those of modern literary works. Furthermore, we report on the changes in the appearance characteristics of emotional expressions between modern Japanese novels and their Chinese translations. We are convinced that literary research using the emotional analysis techniques proposed in this study will be useful as a new digital approach to literary research.

Since the two last decades, social media networks have become a part of our daily life. Today, getting information from social media, tracking trends in social media, learning the feelings and emotions of people on social media is very essential. In this study, sentiment analysis was performed on Twitter text to learn about the subjective polarities of the writings. The polarities are positive, negative, and neutral. At the first stage of the sentiment analysis, a public data set has been obtained. Secondly, natural language processing techniques have been applied to make the data ready for machine learning training procedures. Lastly, sentiment analysis is performed by using three different machine learning algorithms. We reached 89% accuracy with Support Vector Machines, 88% accuracy with Random Forest, and 72% accuracy with Gaussian Naive Bayes classifier.

Nowadays, social media have opened a door in front of us to share individual’s expressions, emotions, and attitudes toward any incident. Sentiment analysis from different social media posts may help us to detect positive, negative, or emotional behavior toward society. Depressive text detection from social media posts is one of the most challenging parts of individual behavior or sentiment analysis. In this paper, different machine learning algorithms are used to detect depressive Bangla text from social media posts. Pre-processing steps like stemming, stop word removal, etc., are used to clean the collected data, and feature extraction techniques like count vectorization, TF-IDF, word embedding, etc., are applied to the collected dataset which consists of 6178 texts collected from social media posts. We have achieved the highest 97% classification accuracy using decision tree and 94% accuracy for bidirectional LSTM (deep learning model) to predict depressive text in Bangla language. Depressive text detection from social media posts will create an opportunity for psychologists to analyze sentiment from shared posts, reactions, and attitudes which may lessen the unwanted activities of the depressed people through diagnosis and taking them under treatment.KeywordsDepressive textBangla languageDeep learningSocial media post

Emotion is the most important gear for human textual communication with each other via social media. Nowadays, people use text for reviewing or recommending things, sharing opinions, rating their choices or unlikeness, providing feedback for different services, and so on. Bangladeshi people use Bangla to express their emotions. Current research based on sentiment analysis has got low-performance output by using several approaches on detecting sentiment polarity and emotion from Bangla texts. In this study, we have developed four models with the hybrid of Convolutional Neural Network (CNN) and Long Short Term Memory (LSTM) with various Word Embeddings including Embedding Layer, Word2Vec, Global Vectors (Glove), and Continuous Bag of Words (CBOW) to detect emotion from Bangla texts (words, sentences). Our models can define the basic three emotions; happiness, anger, and sadness. It will make interaction lively and interesting. Our comparisons are bestowed against CNN, LSTM with different Word Embeddings, and also against some previous researches with the same dataset based on classical Machine Learning techniques such as Support Vector Machine (SVM), Naïve Bayes, and K-Nearest Neighbors (K-NN). In our proposed study, we have used Facebook Bangla comments for a suitable dataset. In our study, we have tried to detect the exact emotion from the text. And in result, the best model integrating Word2Vec embedding layer with a hybrid of CNN-LSTM detected emotions from raw textual data with an accuracy of 90.49% and F1 score of 92.83%.

This study presents a comparative analysis of the classification performance of facial and emotion recognition systems using Machine Learning (ML) and Deep Learning (DL) algorithms. The primary objective of this work is to evaluate the applicability of emotion recognition in fields such as psychotherapy and crime analysis, using the FER-2013 dataset.The study was conducted with ML algorithms such as Support Vector Machines (SVM), Random Forest (RF), K-Nearest Neighbor (KNN), Decision Trees, and Gradient Boosting, as well as the DL algorithm, Convolutional Neural Network (CNN). Supported by the application of feature selection, preprocessing, and feature extraction techniques, the model’s performance was measured using standard metrics such as accuracy, precision, F1-score, and AUC-ROC.The experimental results showed that the highest classification accuracy (46.61%) was achieved with the CNN model. While the ML models generally offered lower accuracy, they provided advantages in terms of computational efficiency in specific scenarios.This study aims to contribute to the literature by providing a comparative analysis of ML and DL algorithms and by highlighting the effect of data preprocessing on performance. The findings set targets for future work, such as real-time system integration and hybrid model development.

Bengali text data present in multimedia images having multiple content forms, such as still images and text, contain information that when extracted finds a lot of applications. The images can be of different types, where objects and text may be completely separated or overlapped or embedded in each other. The Bengali text can be of different shapes and sizes. Extraction of text from these types of images becomes challenging because the textual portion has to be correctly separated from the rest of the background. The input image passes through two stages. The first step tries to locate the different components in the image using entropy filtering and the second stage distinguishes the components representing text from the non-textual components based on several features of Bengali text. The text thus obtained from the image can then be used in software such as Bengali OCR for character recognition.

This study evaluates the performance of four machine learning models: Support Vector Machine (SVM), Random Forest, K-Nearest Neighbors (KNN), and Naive Bayes in analyzing visitor reviews of the Lokawisata Baturaden tourist attraction. Using 5-fold cross-validation, the study aims to determine which machine learning model best suits sentiment analysis on the Baturaden review data. This study was conducted through several stages, including data preprocessing, feature extraction, and the data training process. Case folding, text cleaning, tokenization, stopword removal, and stemming were performed during the data preprocessing stage. The feature extraction method used was TF-IDF. SMOTE was applied to increase data variation and address the data imbalance in the dataset. The results show that SVM provides the best performance with an accuracy of 0.937, an F1-score of 0.937, a precision of 0.943, and a recall of 0.937. Random Forest also performs well with an accuracy of 0.918 and an F1-score of 0.918, though slightly below SVM. KNN shows the lowest performance with an accuracy of 0.651 and an F1-score of 0.544, while Naive Bayes performs adequately with an accuracy of 0.845 and an F1-score of 0.841. Based on this evaluation, SVM is recommended as the best model for sentiment analysis of reviews, followed by Random Forest as a good alternative. The KNN model is not recommended due to its lower performance, while Naive Bayes can be considered for its speed and simplicity, although its results are not as good as SVM and Random Forest. These conclusions guide the selection of the optimal model to enhance understanding and visitor experience at the Baturaden tourist attraction.

Sentiment analysis is the interpretation and classification of emotions conveyed by text data. While there have been many attempts to classify the sentiment of a given text, there have been few models that can do the same when provided with non-English data exhibiting sarcasm or irony. This paper aims to compare various techniques of sarcasm detection and decide which method works the best for datasets of different sizes and types. The models have been tested on datasets of three different non-English languages - Arabic, French and a Hindi-English code-mix. None of the presented models are language-specific and can be run on data of any language. A comparison between a sub-word model, the usage of Term Frequency–Inverse Document Frequency (TF-IDF) and neural networks, a Long Short-Term Memory (LSTM) model and machine learning techniques such as Nearest Neighbors, Decision Tree, Random Forest, AdaBoost, Naive Bayes (NB), Support Vector Machine (SVM) Linear, SVM radial basis function (RBF), SVM Sigmoid has been performed. The output for each language and model has been evaluated based on their F1-score, accuracy, precision, and recall.

The popularity of online games continues to increase, including Free Fire, which has gained more than one billion downloads and millions of user reviews on the Google Play Store. However, the variation and inconsistency of user comments make manual sentiment evaluation difficult. This study aims to compare the performance of Support Vector Machine (SVM) and Naïve Bayes in classifying user review sentiment on the Free Fire game. A total of 535 Indonesian-language reviews were collected using web scraping and processed through text cleaning, case folding, normalization, stopword removal, and stemming. Sentiment labels were assigned manually based on review content. The dataset was divided into training and testing using a 70:30 ratio, and feature extraction used Term Frequency–Inverse Document Frequency (TF-IDF). Two scenarios were implemented: a baseline without class balancing and a scenario using Synthetic Minority Oversampling Technique (SMOTE) to address class imbalance. Results show that SVM outperforms Naïve Bayes in both scenarios. In the baseline, SVM achieved 89.81% accuracy, while Naïve Bayes obtained 82.80%. After SMOTE, SVM improved to 91.08% accuracy and Naïve Bayes to 89.17%. These findings indicate that SVM, especially with SMOTE, provides a more effective and balanced performance for sentiment classification on Free Fire reviews. The study contributes to providing a more accurate understanding of user perception and strengthening model development for sentiment analysis on digital game applications.