Text Sentiment Analysis Based on Emotion Adjustment

Deep learning-based sentiment analysis (SA) methods have drawn more attention in recent years, which calls for more precise word embedding methods. This article proposes SentiVec, a kernel optimization function system for sentiment word embedding, which is based on two phases. The first phase is a supervised learning method, and the second phase consists of two unsupervised updating models, object-word-to-surrounding-words reward model (O2SR) and context-to-object-word reward model (C2OR). SentiVec is aimed at: 1) integrating the statistical information and sentiment orientation into sentiment word vectors and 2) propagating and updating the semantic information to all the word representations in a corpus. Extensive experimental results show that the optimal sentiment vectors successfully extract the features in terms of semantic and sentiment information, which makes it outperform the baseline methods on word similarity, word analogy, and SA tasks.

We present a case study as part of a work-in-progress project about multimodal sentiment analysis on historic German plays, taking Emilia Galotti by G. E. Lessing as our initial use case. We analyze the textual version and an audio version (audio book). We focus on ready-to-use sentiment analysis methods: For the textual component, we implement a naive lexicon-based approach and another approach that enhances the lexicon by means of several NLP methods. For the audio analysis, we use the free version of the Vokaturi tool. We compare the results of all approaches and evaluate them against the annotations of a human expert, which serves as a gold standard. For our use case, we can show that audio and text sentiment analysis behave very differently: textual sentiment analysis tends to predict sentiment as rather negative and audio sentiment as rather positive. Compared to the gold standard, the textual sentiment analysis achieves accuracies of 56% while the accuracy for audio sentiment analysis is only 32%. We discuss possible reasons for these mediocre results and give an outlook on further steps we want to pursue in the context of multimodal sentiment analysis on historic plays.

The sentiment analysis of microblog text has always been a challenging research field due to the limited and complex contextual information. However, most of the existing sentiment analysis methods for microblogs focus on classifying the polarity of emotional keywords while ignoring the transition or progressive impact of words in different positions in the Chinese syntactic structure on global sentiment, as well as the utilization of emojis. To this end, we propose the emotion-semantic-enhanced bidirectional long short-term memory (BiLSTM) network with the multi-head attention mechanism model (EBILSTM-MH) for sentiment analysis. This model uses BiLSTM to learn feature representation of input texts, given the word embedding. Subsequently, the attention mechanism is used to assign the attentive weights of each words to the sentiment analysis based on the impact of emojis. The attentive weights can be combined with the output of the hidden layer to obtain the feature representation of posts. Finally, the sentiment polarity of microblog can be obtained through the dense connection layer. The experimental results show the feasibility of our proposed model on microblog sentiment analysis when compared with other baseline models.

Word embedding vectorization is more efficient than Bag-of-Word in word vector size. Word embedding also overcomes the loss of information related to sentence context, word order, and semantic relationships between words in sentences. Several kinds of Word Embedding are often considered for sentiment analysis, such as Word2Vec and FastText. Fast Text works on N-Gram, while Word2Vec is based on the word. This research aims to compare the accuracy of the sentiment analysis model using Word2Vec and FastText. Both models are tested in the sentiment analysis of Indonesian hotel reviews using the dataset from TripAdvisor.Word2Vec and FastText use the Skip-gram model. Both methods use the same parameters: number of features, minimum word count, number of parallel threads, and the context window size. Those vectorizers are combined by ensemble learning: Random Forest, Extra Tree, and AdaBoost. The Decision Tree is used as a baseline for measuring the performance of both models. The results showed that both FastText and Word2Vec well-to-do increase accuracy on Random Forest and Extra Tree. FastText reached higher accuracy than Word2Vec when using Extra Tree and Random Forest as classifiers. FastText leverage accuracy 8% (baseline: Decision Tree 85%), it is proofed by the accuracy of 93%, with 100 estimators.

<sec> <title>BACKGROUND</title> The COVID-19 pandemic caused many changes in primary health care systems in Europe. The fast adoption of telemedicine, the shift of health care resources to COVID-19–related tasks, and the tendency of patients to cancel their nonurgent appointments are some examples of these changes. Patient satisfaction is an important outcome of health care services, and the changes caused by COVID-19 in the system may have affected it. Google Maps reviews provide an important channel for patients to communicate about their experiences regarding the primary health care system. </sec> <sec> <title>OBJECTIVE</title> Drawing from research on social media data analytics and text mining, this study set out to investigate the changes in public sentiment regarding primary health care in Finland and Andalusia (Spain) before, during, and after the COVID-19 pandemic. </sec> <sec> <title>METHODS</title> We collected 55,043 Google Maps reviews from primary health care locations in Finland and Andalusia from January 1, 2013, to May 15, 2024. There are 604 primary health care locations in Finland and 1016 in Andalusia. The total number of Google Maps reviews collected was 12,247 for Finland and 42,796 for Andalusia. First, lexicon-based sentiment analysis using the open-source software AFINN was conducted for the Finnish- and Spanish-language datasets. Thereafter, transformer-based deep learning models for sentiment analysis were applied for both languages. The numeric user ratings and the results of the sentiment analysis were then analyzed. In addition, we conducted a word frequency analysis of the reviews. </sec> <sec> <title>RESULTS</title> There were important changes in the ratings and sentiment in the data for Andalusia. The ratings shifted from median 4 (IQR 3) before the COVID-19 pandemic to median 1 (IQR 2) during and median 1 (IQR 3) after the COVID-19 pandemic, on a scale from 1 to 5. The median of the sentiment values of the review texts shifted from neutral before the COVID-19 pandemic to –2 (IQR 0.055) or –1 (IQR 1) during and after the COVID-19 pandemic, depending on which sentiment analysis method was used. Interestingly, changes in numeric ratings and sentiment of the review texts in Finland were only minor, and the median values were the same during all 3 periods. Lexical analysis revealed changes in word frequencies across the periods, reflecting shifts in primary health care experiences during the pandemic, especially among the Spanish-language reviews. </sec> <sec> <title>CONCLUSIONS</title> The change toward a more negative public discussion on primary health care in Andalusia during the COVID-19 pandemic was considerable. This can be observed both in the numeric user ratings and in the sentiment analysis of the review texts. However, the data for Finland show that the public discourse stayed mostly neutral or slightly positive. The findings have implications on the quality management procedures in primary health care and on the use of user-generated content as an additional information source. </sec>

Sentiment analysis also referred to as opinion mining, plays a significant role in automating the identification of negative, positive, or neutral sentiments expressed in textual data. The proliferation of social networks, review sites, and blogs has rendered these platforms valuable resources for mining opinions. Sentiment analysis finds applications in various domains and languages, including English and Arabic. However, Arabic presents unique challenges due to its complex morphology characterized by inflectional and derivation patterns. To effectively analyze sentiment in Arabic text, sentiment analysis techniques must account for this intricacy. This paper proposes a model designed using the transformer model and deep learning (DL) techniques. The word embedding is represented by Transformer-based Model for Arabic Language Understanding (ArabBert), and then passed to the AraBERT model. The output of AraBERT is subsequently fed into a Long Short-Term Memory (LSTM) model, followed by feedforward neural networks and an output layer. AraBERT is used to capture rich contextual information and LSTM to enhance sequence modeling and retain long-term dependencies within the text data. We compared the proposed model with machine learning (ML) algorithms and DL algorithms, as well as different vectorization techniques: term frequency-inverse document frequency (TF-IDF), ArabBert, Continuous Bag-of-Words (CBOW), and skipGrams using four Arabic benchmark datasets. Through extensive experimentation and evaluation of Arabic sentiment analysis datasets, we showcase the effectiveness of our approach. The results underscore significant improvements in sentiment analysis accuracy, highlighting the potential of leveraging transformer models for Arabic Sentiment Analysis. The outcomes of this research contribute to advancing Arabic sentiment analysis, enabling more accurate and reliable sentiment analysis in Arabic text. The findings reveal that the proposed framework exhibits exceptional performance in sentiment classification, achieving an impressive accuracy rate of over 97%.

Topic-related Chinese message sentiment analysis

At present, in the mainstream sentiment analysis methods represented by Support Vector Machine, the vocabulary and the latent semantic information contained in the text cannot be well considered, and sentiment analysis of text is overly dependent on the statistics of sentiment words. In this paper, a Fisher kernel function based on Probabilistic Latent Semantic Analysis is proposed for sentiment analysis by Support Vector Machine. The Fisher kernel function based on the model is derived by the Probabilistic Latent Semantic Analysis model. By means of this method, latent semantic information containing the probability features can be used as the classification features, the effect of classification for support vector machine can be improved, and the problem of not considering the latent semantic features in text sentiment analysis is solved. The results show that compared with the comparison method, the effect of the method proposed in this paper is obviously improved.

Text sentiment analysis is an important research topic in the field of natural language processing. Compared with coarse-grained text sentiment analysis with a single sentiment tendency based on sentences or documents, fine-grained aspect- level sentiment analysis is more suitable for practical application scenarios and becomes more difficult at the same time. In this paper, we propose a multi-task-based joint learning model for aspect-level sentiment analysis of text, using the BERT_CBiGRU composite network with stronger text semantic representation as the main learning task for aspect-level sentiment analysis, and designing an auxiliary learning task for aspect target identification. For the sample imbalance problem, we introduce the focal loss function Focal Loss. Final experiments show that our model has a certain improvement compared with previous models.

Transfer learning is an important artificial intelligence approach which extracts knowledge from source domain to solve tasks in the target domain. As a research hot topic, Generative Adversarial Networks (GAN) provides a powerful framework in constructing unsupervised models. A GAN consists of two neural networks: a discriminator to distinguish natural and generated samples, and a generator to deceive the discriminator. Generally, sentiment analysis of text is a big challenge in the Natural Language Processing (NLP). In this paper, A GAN-based transfer learning approach for sentiment analysis of cross-domain texts is presented. Experiments are performed in cross-domain e-commerce reviews. The results compiled demonstrate the effectiveness of the proposed approach.

Word embeddings are essential to natural language processing tasks because they contain a single word’s syntactic and semantic information. Word embeddings have been developed widely for numerous spoken languages across the globe like English. The research community needs to pay more attention to the Urdu language despite its significant number of speakers, which amounts to approximately 231.3 million individuals. Urdu is a complex language because word boundaries in Urdu are unspecified, as it does not employ delimiters between words. The compound word, a multiword expression, is a more complex word consisting of many strings or independent base words. Traditionally, compound words are identified during the word segmentation using bigram or trigram approaches. The challenge with these techniques is that they do not produce meaningful words. This study uses morphological rule-based compound words in Urdu text documents. For text representation, a self-trained morphological rule-based compound word embedding (Cword2vec) based on the word2vec model is proposed for Urdu text sentiment analysis. The performance of self-trained morphological rule-based compound word embedding was then evaluated using four well-known deep learning models, i.e., long short-term memory (LSTM), bidirectional LSTM (BiLSTM), convolutional neural networks (CNN), and convolutional LSTM (C-LSTM) for sentiment analysis. We also compare the performance of morphological rule-based compound words with traditional compound word identification techniques such as bigrams and trigrams. Regardless of the classification model, word embedding using our proposed morphological rule-based compound words outperformed in terms of precision, recall, F1 score, and accuracy than bigrams and trigrams.

PurposeSentiment analysis and emotion processing are attracting increasing interest in many fields. Computer and information scientists are developing automated methods for sentiment analysis of online text. Most of the studies have focused on identifying sentiment polarity or orientation – whether a document, usually a product or movie review, carries a positive or negative sentiment. It is time for researchers to address more sophisticated kinds of sentiment analysis. This paper aims to evaluate a particular linguistic framework called appraisal theory for adoption in manual as well as automatic sentiment analysis of news text.Design/methodology/approachThe appraisal theory is applied to the analysis of a sample of political news articles reporting on Iraq and the economic policies of George W. Bush and Mahmoud Ahmadinejad to assess its utility and to identify challenges in adopting this framework.FindingsThe framework was useful in uncovering various aspects of sentiment that should be useful for researchers, such as the appraisers and object of appraisal, bias of the appraisers and the author, type of attitude and manner of expressing the sentiment. Problems encountered include difficulty in identifying appraisal phrases and attitude categories because of the subtlety of expression in political news articles, lack of treatment of tense and timeframe, lack of a typology of emotions, and need to identify different types of behaviours (political, verbal and material actions) that reflect sentiment.Originality/valueThe study has identified future directions for research in automated sentiment analysis as well as sentiment analysis of online news text. It has also demonstrated how sentiment analysis of news text can be carried out.

The enormous number of user activity on online social networks results in a considerable amount of data which expresses the opinion from millions of people with diversity in their social aspects. The freedom of language usage shared through social media paves the way for the existence of code-mixed data that turns out to be more complex for mining the information out of it. Considering this, we created Kannada-English code mixed corpus by crawling Facebook comments. As of now, there is no relevant corpus as well as literature available for code-mixed Kannada-English sentiment analysis. In addition to the crawled corpus, we also used sentiment analysis code-mixed corpus provided by Sentiment Analysis for Indian Languages (SAIL)-2017 which includes Bengali-English and Hindi-English languages. This paper also addresses the performance of distributed representation methods in sentiment analysis task. We have reported comparisons among different machine learning and deep learning techniques.

Word Embeddings are low-dimensional distributed representations that encompass a set of language modeling and feature learning techniques from Natural Language Processing (NLP). Words or phrases from the vocabulary are mapped to vectors of real numbers in a low-dimensional space. In previous work, we proposed using an Extreme Learning Machine (ELM) for generating word embeddings. In this research, we apply the ELM-based Word Embeddings to the NLP task of Text Categorization, specifically Sentiment Analysis and Sequence Labeling. The ELM-based Word Embeddings utilizes a count-based approach similar to the Global Vectors (GloVe) model, where the word-context matrix is computed then matrix factorization is applied. A comparative study is done with Word2Vec and GloVe, which are the two popular state-of-the-art models. The results show that ELM-based Word Embeddings slightly outperforms the aforementioned two methods in the Sentiment Analysis and Sequence Labeling tasks.In addition, only one hyperparameter is needed using ELM whereas several are utilized for the other methods. ELM-based Word Embeddings are comparable to the state-of-the-art methods: Word2Vec and GloVe models. In addition, the count-based ELM model have word similarities to both the count-based GloVe and the predict-based Word2Vec models, with subtle differences.

Natural language processing has recently become very popular in the sociological studies due to a wide expansion of social media such as social networks, blogs, forums, etc., as well as online polls. An important direction of this area is a text sentiment analysis, used to find out people’s opinions on various actual issues. The paper deals with two methods of sentiment analysis: known support vector machine (SVM) as supervised learning and proposed lexicon-based classifier as unsupervised learning. The proposed classifier is domain-independent, does not require training data, and uses ready-made sentiment lexicons. The lexicon-based classifier is shown to exceed the SVM for small text collections. The article provides analysis of errors and offers the ways to increase classifier’s quality.