A supervised aspect level sentiment model to predict overall sentiment on tweeter documents

As the social applications are gaining the more popularity, different kinds of social media platform are ready to publish and express the emotions in the form of reviews. In which, detecting the concealed sentiment patterns and discovering knowledge in the huge user-generated inputs is a challenging task and has greater social significance value. In traditional sentiment analysis approaches, statistical correlation between words is considered. Whereas, dependency factor between aspects and the sentiment words are ignored, which has a greater impact factor on overall sentiment analysis. In this paper, we propose a new supervised topic level sentiment model (SSM), which is capable of handling overall sentiment analysis problems. Belief maximisation algorithm is used in SSM model, and Dirichlet distribution is used to estimate aspects and sentiment words. In order to prepare and modernise new documents, a hyperparameter Gibbs sampling method is used. We conducted experiments on reviews related to different products in multiple documents and the results state that the SSM model outperforms the on-hand algorithm in terms of aspect recognition and overall sentiment prediction accuracy.

Aspects extraction is the key task in the sentiment analysis problem, which includes extraction of both explicit and implicit aspects. Identifying implicit aspects is not a new task in sentiment analysis, but it still presents many challenges. Numerous studies have addressed the issue and offered different approaches, but there are still fundamental challenges as follows: solving the context word problem; the domain-specific problem; and the implicit aspects represented by sentiment words that do not appear explicitly in the text. This paper proposes a method for identifying implicit aspects of sentiment words. To address these above challenges, the system is built on the foundation of deep learning with context vectors, dependency grammar, anaphora coreference resolution, and sentiment ontology. The dependency parser and the entity coreference resolver are adopted to filter out the sentiment–aspect pairs data generated from embedding context words. Then, a fine-tuned technique is applied, and the classifier corresponding to each sentiment word is built to identify implicit aspects. This combination has produced positive results, reaching almost 90% accuracy.

The ability to identify sentiment in text, referred to as sentiment analysis, is one which is natural to adult humans. This task is, however, not one which a computer can perform by default. Identifying sentiments in an automated, algorithmic manner will be a useful capability for business and research in their search to understand what consumers think about their products or services and to understand human sociology. Here we propose two new Genetic Algorithms (GAs) for the task of automated text sentiment analysis. The GAs learn whether words occurring in a text corpus are either sentiment or amplifier words, and their corresponding magnitude. Sentiment words, such as 'horrible', add linearly to the final sentiment. Amplifier words in contrast, which are typically adjectives/adverbs like 'very', multiply the sentiment of the following word. This increases, decreases or negates the sentiment of the following word. The sentiment of the full text is then the sum of these terms. This approach grows both a sentiment and amplifier dictionary which can be reused for other purposes and fed into other machine learning algorithms. We report the results of multiple experiments conducted on large Amazon data sets. The results reveal that our proposed approach was able to outperform several public and/or commercial sentiment analysis algorithms.

The rise of social media such as blogs and social networks has fueled interest in sentiment analysis. With the proliferation of reviews, ratings, recommendations and other forms of online expression, online opinion has turned into a kind of virtual currency for businesses looking to market their products, identify new opportunities and manage their reputations, therefore many are now looking to the field of sentiment analysis. In this paper, we present a feature-based sentence level approach for Arabic sentiment analysis. Our approach is using Arabic idioms/saying phrases lexicon as a key importance for improving the detection of the sentiment polarity in Arabic sentences as well as a number of novels and rich set of linguistically motivated features contextual Intensifiers, contextual Shifter and negation handling), syntactic features for conflicting phrases which enhance the sentiment classification accuracy. Furthermore, we introduce an automatic expandable wide coverage polarity lexicon of Arabic sentiment words. The lexicon is built with gold-standard sentiment words as a seed which is manually collected and annotated and it expands and detects the sentiment orientation automatically of new sentiment words using synset aggregation technique and free online Arabic lexicons and thesauruses. Our data focus on modern standard Arabic (MSA) and Egyptian dialectal Arabic tweets and microblogs (hotel reservation, product reviews, etc.). The experimental results using our resources and techniques with SVM classifier indicate high performance levels, with accuracies of over 95%.

The existing methods for Chinese sentiment Labeling mainly relies on the artificial sentiment corpus, but a sentiment word in the corpus may not be sentiment words in different sentences. This paper proposes a new method to label the words in the sentences by combining deep convolution neural network with sequential algorithm., We first extract the aspects comprised by words vectors, part of speech vectors, dependent syntax vectors to train the deep convolution neural network, and then employ the sequential algorithm to obtain the sentiment annotation of the sentence. Experimental results verify that our method is effective for sentiment labeling. Considering that the identification of the implicit aspects can improve the completeness of sentiment analysis, we suggest to construct the tuples including aspect, sentiment shifter, sentiment intensity, sentiment words after obtaining the sentiment labels for each word in the sentence. We develop new algorithm for implicit aspect identification by taking the two key factors of the aspects as a topic and the match degree of aspects and sentiment words, and the human language habit. The experiment demonstrates that the algorithm can effectively identify the implicit aspect. In this paper, we solve the problem of sentiment labeling and implicit aspect recognition in sentiment analysis. As a new tool for sentiment analysis, our method can be applied to the enterprise management information analysis, such as product online review, product online reputation, brand image and consumer preference management, and can also be used for the sentiment analysis of large-scale text data.

Sentiment analysis is a subfield of Natural Language Processing (NLP) which tries to process a text to extract opinions or attitudes towards topics or entities. Recently, the use of deep learning methods for sentiment analysis has received noticeable attention from researchers. Generally, different deep learning methods have shown superb performance in sentiment analysis problem. However, deep learning models are different in nature and have different strengths and limitations. For example, convolutional neural networks are useful for extracting local structures from data, while recurrent models are able to learn order dependence in sequential data. In order to combine the advantages of different deep models, in this paper we have proposed a novel approach for aspect-based sentiment analysis which utilizes deep ensemble learning. In the proposed method, we first build four deep learning models, namely CNN, LSTM, BiLSTM and GRU. Then the outputs of these models are combined using stacking ensemble approach where we have used logistic regression as meta-learner. The results of applying the proposed method on the real datasets show that our method has increased the accuracy of aspect-based prediction by 5% to 20% compared to the basic deep learning methods.

In this paper, we propose a novel hierarchical supervision topic model to construct a topic-adaptive sentiment lexicon (TaSL) for higher-level classification tasks. It is widely recognized that sentiment lexicon as a useful prior knowledge is crucial in sentiment analysis or opinion mining. However, many existing sentiment lexicons are constructed ignoring the variability of the sentiment polarities of words in different topics or domains. For example, the word "amazing" can refer to causing great surprise or wonder but can also refer to very impressive and excellent. In TaSL, we solve this issue by jointly considering the topics and sentiments of words. Documents are represented by multiple pairs of topics and sentiments, where each pair is characterized by a multinomial distribution over words. Meanwhile, this generating process is supervised under hierarchical supervision information of documents and words. The main advantage of TaSL is that the sentiment polarity of each word in different topics can be sufficiently captured. This model is beneficial to construct a domain-specific sentiment lexicon and then effectively improve the performance of sentiment classification. Extensive experimental results on four publicly available datasets, MR, OMD, semEval13A, and semEval16B were presented to demonstrate the usefulness of the proposed approach. The results have shown that TaSL performs better than the existing manual sentiment lexicon (MPQA), the topic model based domain-specific lexicon (ssLDA), the expanded lexicons(Weka-ED, Weka-STS, NRC, Liu's), and deep neural network based lexicons (nnLexicon, HIT, HSSWE).

Sentiment Analysis is highly valuable in Natural Language Processing (NLP) across domains, processing and evaluating sentiment in text for emotional understanding. This technology has diverse applications, including social media monitoring, brand management, market research, and customer feedback analysis. Sentiment Analysis identifies positive, negative, or neutral sentiments, providing insights into decision-making, customer experiences, and business strategies. With advanced machine learning models like Transformers, Sentiment Analysis achieves remarkable progress in sentiment classification. These models capture nuances, context, and variations for more accurate results. In the digital age, Sentiment Analysis is indispensable for businesses, organizations, and researchers, offering deep insights into opinions, sentiments, and trends. It impacts customer service, reputation management, brand perception, market research, and social impact analysis. In the following experimental research, we will examine the Zero-Shot technique on pre-trained Transformers and observe that, depending on the Model we use, we can achieve up to 83% in terms of the model’s ability to distinguish between classes in this Sentiment Analysis problem.

The popularity of mobile commerce has offered many new challenges for investigating public sentiments. With an uncountable number of stores and products available on the marketplace, customers heavily relied on the comments or reviews posted by others to support their buying decisions. For the online retailer's side, these text reviews are valuable resources to understand the latest customer expectations and devise a better product plan for launching suitable products to customers. Sentiment analysis is then developed for the evaluation of a significant amount of text data by searching the sentiment words. Nevertheless, different writers may have different perceptions on the sentiment words, and hence, this inconsistency would be amplified. In this connection, a novel approach to obtain public sentiment by combining the topic modeling, fuzzy set, and multi-criteria decision-making approaches is proposed. The uncertainty of different perceptions on the sentiment words is remedied by fuzzy-set.

Sentiment analysis of Chinese micro-blog based on sentiment dictionary has become a challenging research subject in the field of artificial intelligence. However, due to insufficient sentiment words, Chinese micro-blog sentiment analysis is difficult to process high accuracy. Aimed at this issue, we propose a method for constructing multiple sentiment dictionaries, which mainly constructs original sentiment dictionary, emoji dictionary, and other related dictionaries. Among them, we have innovatively constructed a Chinese micro-blog new word sentiment dictionary. Multiple sentiment dictionaries increase the coverage of sentiment words. At the same time, we further analyze semantic rule sets between Chinese micro-blog texts and take the inter-sentence analysis rules and sentence pattern analysis rules into the sentiment analysis of Chinese micro-blog, which further improves the accuracy of Chinese micro-blog sentiment analysis. Finally, based on the method of multiple sentiment dictionaries and semantic rule sets, we propose an algorithm for Chinese micro-blog sentiment calculation from complex sentences to clauses and then from clauses to words, and finally combined with the emoji. This algorithm can accurately classify Chinese micro-blog into positive Chinese micro-blog, negative Chinese micro-blog, and neutral Chinese micro-blog. The experimental results show that this method has greatly improved the sentiment analysis of Chinese micro-blog.

Consensus vote models for detecting and filtering neutrality in sentiment analysis

Analyzing sentiment analysis with deep learning requires massive labeled datasets where such data is not always available. The annotation process is also time-consuming and tedious. Further, even after we train the sentiment analysis, it creates another problem. Because this model is domain-dependent, the performance in another domain estimated to perform poorly. In this paper, we present the transfer learning approach to transfer knowledge gained from the source dataset into the target dataset with the expectation to improve the target model. Multichannel Convolutional Neural Network deploys different n-grams as the input channel in a single CNN model to grasp meaningful features from the text. This method has proven to perform well in sentiment analysis problems. We train our three datasets with different domains using this method as the baseline. The largest dataset then becomes the source model for transfer learning and other datasets as the target. Fine-tuning our source model also needed when retraining it into the target dataset. From the evaluation, we show that several transfer learning strategies outperform the domain-specific model, even when the data is imbalanced. We also highlight certain failing strategies that inflict lousy results on the target model performance.

Sentiment analysis of scientific citations has received much attention in recent years because of the increased availability of scientific publications. Scholarly databases are valuable sources for publications and citation information where researchers can publish their ideas and results. Sentiment analysis of scientific citations aims to analyze the authors’ sentiments within scientific citations. During the last decade, some review papers have been published in the field of sentiment analysis. Despite the growth in the size of scholarly databases and researchers’ interests, no one as far as we know has carried out an in-depth survey in a specific area of sentiment analysis in scientific citations. This paper presents a comprehensive survey of sentiment analysis of scientific citations. In this review, the process of scientific citation sentiment analysis is introduced and recently proposed methods with the main challenges are presented, analyzed and discussed. Further, we present related fields such as citation function classification and citation recommendation that have recently gained enormous attention. Our contributions include identifying the most important challenges as well as the analysis and classification of recent methods used in scientific citation sentiment analysis. Moreover, it presents the normal process, and this includes citation context extraction, public data sources, and feature selection. We found that most of the papers use classical machine learning methods. However, due to limitations of performance and manual feature selection in machine learning, we believe that in the future hybrid and deep learning methods can possibly handle the problems of scientific citation sentiment analysis more efficiently and reliably.

The problem of deciding the overall sentiment of a user review is usually treated as a text classification problem. The simplest machine learning setup for text classification uses a unigram bag-of-words feature representation of documents, and this has been shown to work well for a number of tasks such as spam detection and topic classification. However, the problem of sentiment analysis is more complex and not as easily captured with unigram (single-word) features. Bigram and trigram features capture certain local context and short distance negations—thus outperforming unigram bag-of-words features for sentiment analysis. But higher order n-gram features are often overly specific and sparse, so they increase model complexity and do not generalize well.

Multimodal sentiment analysis has attracted increasing attention and lots of models have been proposed. However, the performance of the state-of-the-art models decreases sharply when they are deployed in the real world. We find that the main reason is that real-world applications can only access the text outputs by the automatic speech recognition (ASR) models, which may be with errors because of the limitation of model capacity. Through further analysis of the ASR outputs, we find that in some cases the sentiment words, the key sentiment elements in the textual modality, are recognized as other words, which makes the sentiment of the text change and hurts the performance of multimodal sentiment analysis models directly. To address this problem, we propose the sentiment word aware multimodal refinement model (SWRM), which can dynamically refine the erroneous sentiment words by leveraging multimodal sentiment clues. Specifically, we first use the sentiment word position detection module to obtain the most possible position of the sentiment word in the text and then utilize the multimodal sentiment word refinement module to dynamically refine the sentiment word embeddings. The refined embeddings are taken as the textual inputs of the multimodal feature fusion module to predict the sentiment labels. We conduct extensive experiments on the real-world datasets including MOSI-Speechbrain, MOSI-IBM, and MOSI-iFlytek and the results demonstrate the effectiveness of our model, which surpasses the current state-of-the-art models on three datasets. Furthermore, our approach can be adapted for other multimodal feature fusion models easily 1 .