Aspect Based Sentiment Analysis with Self-Attention and Gated Convolutional Networks

Sentiment analysis or opinion mining used to capture the community's attitude who have experienced the specific service/product. Sentiment analysis usually concentrates to classify the opinion of whole document or sentence. However, in most comments, users often express their opinions on different aspects of the mentioned entity rather than express general sentiments on entire document. In this case, using aspect-based sentiment analysis (ABSA) is a solution. ABSA emphases on extracting and synthesizing sentiments on particular aspects of entities in opinion text. The previous studies have difficulty working with aspect extraction and sentiment polarity classification in multiple domains of review. We offer an innovative deep learning approach with the integrated construction of bidirectional Long Short Term Memory (BiLSTM) and Convolutional Neural Network (CNN) for multidomain ABSA in this article. Our system finished the following tasks: domain classification, aspect extraction and opinion determination of aspect in the document. Besides applying GloVe word embedding for input sentences from mixed Laptop_Restaurant domain of the SemEval 2016 dataset, we also use the additional layer of POS to pick out the word morphological attributes before feeding to the CNN_BiLSTM architecture to enhance the flexibility and precision of our suggested model. Through experiment, we found that our proposed model has performed the above mentioned tasks of domain classification, aspect and sentiment extraction concurrently on a mixed domain dataset and achieved the positive results compared to previous models that were performed only on separated domain dataset.

With proliferation of user-generated reviews, new opportunities and challenges arise. The advance of Web technologies allows people to access a large amount of reviews of products and services online. Knowing what others like and dislike becomes increasingly important for their decision making in online shopping. The retailers also care more than ever about online reviews, because a vast pool of reviews enables them to monitor reputations and collect feedbacks efficiently. However, people often find difficult times in identifying and summarizing fine-grained sentiments buried in the opinion-rich resources. The traditional sentiment analysis, which focuses on the overall sentiments, fails to uncover the sentiments with regard to the aspects of the reviewed entities. This dissertation studied the research problem of Aspect Based Sentiment Analysis (ABSA), which is to reveal the aspect-dependent sentiment information of review text. ABSA consists of several subtasks: 1) aspect extraction, 2) aspect term extraction, 3) aspect category classification, and 4) sentiment polarity classification at aspect level. We focused on the approach of topic models and neural networks for ABSA. First, to extract the aspects from a collection of reviews and to detect the sentiment polarity regarding the aspects in each review, we proposed a few probabilistic graphical models, which can model words distribution in reviews and aspect ratings at the same time. Second, we presented a multi-task learning model based on long-short term memory and convolutional neural network for aspect category classification and aspect term extraction. Third, for aspect-level sentiment polarity classification, we developed a gated convolution neural network, which can be applied to aspect category sentiment analysis as well as aspect target sentiment analysis.

In the expanding field of sentiment analysis, the integration of personality prediction into aspect-based sentiment analysis (ABSA) represents a novel and promising approach to enhance the accuracy and depth of sentiment detection. This paper proposes a unique framework that leverages the Big Five personality traits (Openness, Conscientiousness, Extraversion, Agreeableness, and Neuroticism) alongside Long Short-Term Memory (LSTM) networks, under a multitask learning paradigm, to improve the performance of ABSA. This is, to the best of knowledge, the first work considering the use of personality traits as auxiliary tasks in order to capture the manifold subtle ways in which personality would influence the expression of sentiment towards the different aspects of products or services. And then, model uses the LSTM component to model the sequential character of the text, which makes the extraction accurate in terms of the aspect terms and sentiment polarities. The proposed model designs a multitask learning strategy simultaneously to predict sentiments and personality traits. Such joint learning will allow enhancing the model's understanding of textual context and sentiment expression. Thorough experiments on many benchmark datasets show that the proposed approach is competitive with the state of the art for the aspect-based sentiment analysis and provides some of the deepest insights into personality predictions. Model has obtained F1-scores of 79.78%, 83.67%, and 88.80 % on the Twitter, Laptop, and Restaurant datasets, respectively. These results highlight a significant improvement over existing methods in the literature. For instance, our model outperformed traditional approaches like RAM, which achieved 69.36% on the Twitter dataset, and even advanced techniques such as DualGCN+Bert, which scored 77.4% on Twitter. It can be generally concluded that this research finally opens the way to a new and meaningful opportunity for sentiment analysis applications: integrated into ABSA models, personality prediction advances applications ranging from personalized recommendation systems to the nuance market analysis tools. As far as we know this study is the first attempt to utilise personality feature to enhance sentiment prediction tasks.

The plethora of online reviews available on the internet has great insights about various products or entities. However, selecting or recommending a product by sifting through these reviews is a tedious and time consuming task. Sentiment analysis of such reviews helps understand the pros or cons of the product. In recent years researchers and industry people have leveraged such reviews to rank or recommend the products to new users. Ranking or recommending products using text reviews is a challenging task. In this study, we propose a framework to get a ranking of products using aspect-based sentiment analysis (ABSA). ABSA is a fine-grained sentiment analysis task that is useful for extracting opinions about the different aspects of a product. To facilitate automated ABSA, a novel approach for aspect sentiment classification is proposed in this study. Further to rank the products based on aspect-specific performance, a framework is developed using Multi-criteria decision-making (MCDM) techniques. A case study is performed in the automobile domain to rank various cars using the ABSA approach. To validate the effectiveness of the proposed approach, the ranking results are compared with the numeric ratings available for various aspects of the car. The experimental results show that the ranking obtained by the proposed approach matches the numerical ratings. Therefore, the car selection problem or recommendation of cars in the automobile domain can be effectively handled using the proposed framework.

Sentiment analysis is becoming rapidly important for exploring social media Bangla text. The lack of sufficient resources is considered to be an important challenge for Aspect Based Sentiment Analysis (ABSA) of the Bangla language. The ABSA is a technique that divides the text and defines its sentiment based on its aspects. In this paper, we developed a high-quality Bangla ABSA annotated dataset namely BANGLA_ABSA. The datasets are labelled with aspects category and their respective sentiment polarity to do the ABSA task in Bangla. Four open domains namely Restaurant, Movie, Mobile phone, and Car are considered to make the dataset. The datasets are called Restaurant_ABSA, Movie_ABSA, Mobile_phone_ABSA, and Car_ABSA respectively that contain 801, 800, 975, and 1149 comments. All the comments are either complex or compound sentences. We created the dataset manually and annotated the same by exerting opinions. We organized the dataset as three tuples in Excel format namely 〈Id, Comment, {Aspect category, Sentiment Polarity}〉. These data are very important that facilitate the efficient handling of sentiment for any machine learning and deep learning research, especially for Bangla text.

Artificial intelligence models have been widely applied for natural gas consumption forecasting over the past decades, especially for short-term consumption forecasting. This paper proposes a three-layer neural network forecasting model that can extract key information from input factors and improve the weight optimization mechanism of long short-term memory (LSTM) neural network to effectively forecast short-term consumption. In the proposed model, a convolutional neural network (CNN) layer is adopted to extract the features among various factors affecting natural gas consumption and improve computing efficiency. The LSTM layer is able to learn and save the long-distance state through the gating mechanism and overcomes the defects of gradient disappearance and explosion in the recurrent neural network. To solve the problem of encoding input sequences as fixed-length vectors, the layer of attention (ATT) is used to optimize the assignment of weights and highlight the key sequences. Apart from the comparisons with other popular forecasting models, the performance and robustness of the proposed model are validated on datasets with different fluctuations and complexities. Compared with traditional two-layer models (CNN-LSTM and LSTM-ATT), the mean absolute range normalized errors (MARNE) of the proposed model in Athens and Spata are improved by more than 16% and 11%, respectively. In comparison with single LSTM, back propagation neural network, support vector regression, and multiple linear regression methods, the improvement in MARNE exceeds 42% in Athens. The coefficient of determination is improved by more than 25%, even in the high-complexity dataset, Spata.

Semantics perception and refinement network for aspect-based sentiment analysis

Aspect-based sentiment analysis (ABSA) aims to analyze the sentiment polarity of an input sentence in a certain aspect. Many existing methods of ABSA employ long short-term memory (LSTM) networks and attention mechanism. However, the attention mechanism only models the local certain dependencies of the input information, which fails to capture the global dependence of the inputs. Simply improving the attention mechanism fails to solve the issue of target-sensitive sentiment expression, which has been proven to degrade the prediction effectiveness. In this work, we propose the multi-head self-attention transformation (MSAT) networks for ABSA tasks, which conducts more effective sentiment analysis with target specific self-attention and dynamic target representation. Given a set of review sentences, MSAT applies multi-head target specific self-attention to better capture the global dependence and introduces target-sensitive transformation to effectively tackle the problem of target-sensitive sentiment at first. Second, the part-of-speech (POS) features are integrated into MSAT to capture the grammatical features of sentences. A series of experiments carried on the SemEval 2014 and Twitter datasets show that the proposed model achieves better effectiveness compared with several state-of-the-art methods.

Aspect-based sentiment analysis as fine-grained sentiment analysis problem, mainly aims to clarify the sentiment of different aspect. Previous fine-grained sentiment analysis methods usually used Recurrent Neural Networks as feature extractors, and achieved good results in sentiment analysis. However, they were limited to the sequential processing of sequence by RNN. Its training and operation efficiency are relatively low and time consuming. Aiming at this problem, combining the multi-head attention mechanism in Transformer, fusion model of convolution neural network and hierarchical attention coding network is proposed, and convolution neural network is used as feature encoder to improve the efficiency of model training. At the same time, multi-head attention is used to calculate the degree of relevance between aspect words and context, thus capturing emotional elements corresponding to entity words. Experiments on the SemEval2014 dataset have improved the training and inference efficiency of aspect-based sentiment analysis.

An analysis of machine learning models for sentiment analysis of Tamil code-mixed data

Historical information in the Canadian Maritime Judiciary increases with time because of the need to archive data to be utilized in case references and for later application when determining verdicts for similar cases. However, such data are typically stored in multiple systems, making its reachability technical. Utilizing technologies like deep learning and sentiment analysis provides chances to facilitate faster access to court records. Such practice enhances impartial verdicts, minimizing workloads for court employees, and decreases the time used in legal proceedings for claims during maritime contracts such as shipping disputes between parties. This paper seeks to develop a sentiment analysis framework that uses deep learning, distributed learning, and machine learning to improve access to statutes, laws, and cases used by maritime judges in making judgments to back their claims. The suggested approach uses deep learning models, including convolutional neural networks (CNNs), deep neural networks, long short-term memory (LSTM), and recurrent neural networks. It extracts court records having crucial sentiments or statements for maritime court verdicts. The suggested approach has been used successfully during sentiment analysis by emphasizing feature selection from a legal repository. The LSTM + CNN model has shown promising results in obtaining sentiments and records from multiple devices and sufficiently proposing practical guidance to judicial personnel regarding the regulations applicable to various situations.

With the increase in E-Commerce businesses in the last decade,the sentiment analysis of product reviews has gained a lot of attention in linguistic research. In literature, the survey depicts the majority of the research done emphasizes on mere polarity identification of the reviews. The proposed system emphasized on classifying the sentiment polarity and the product aspect identification from the reviews. Proposed work experimented with traditional machine learning techniques as well as deep neural networks such as Convolutional Neural Network (CNN), Recurrent Neural Network (RNN) and Long Short Term Memory(LSTM) Networks. The proposed system gives a better understanding of these algorithms by comparing the outcomes. The Deep Learning approach in the proposed work successfully provides a mechanism which identifies the review polarity and intensity of the reviews and also analyses the short form words used by people in the reviews. The experimental results in this work, applied on amazon product dataset, shows that the LSTM model works the best for sentiment analysis and intensity of reviews with 93% accuracy. This research work also predicts polarity for short-form word reviews which is the common trend these days while writing the reviews.

Sentiment Analysis (SA) is a technique for categorizing texts based on the sentimental polarity of people’s opinions. This paper introduces a sentiment analysis (SA) model with text and emojis. The two preprocessed data’s are data with text and emojis and text without emojis. Feature extraction consists text features and text with emojis features. The text features are features like N-grams, modified Term Frequency-Inverse Document Frequency (TF-IDF), and Bag-of-Words (BoW) features extracted from the text. In classification, CNN (Conventional Neural Network) and MLP (Multi-Layer Perception) use emojis and text-based SA. The CNN weight is optimized by a new Electric fish Customized Shark Smell Optimization (ECSSO) Algorithm. Similarly, the text-based SA is carried out by hybrid Long Short-Term Memory (LSTM) and Recurrent Neural Network (RNN) classifiers. The bagged data are given as input to the classification process via RNN and LSTM. Here, the weight of LSTM is optimized by the suggested ECSSO algorithm. Then, the mean of LSTM and RNN determines the final output. The specificity of the developed scheme is 29.01%, 42.75%, 23.88%,22.07%, 25.31%, 18.42%, 5.68%, 10.34%, 6.20%, 6.64%, and 6.84% better for 70% than other models. The efficiency of the proposed scheme is computed and evaluated.

Text sentiment analysis is one of the most important tasks in the field of public opinion monitoring, service evaluation and satisfaction analysis under network environments. Compared with the traditional Natural Language Processing analysis tools, convolution neural networks can automatically learn useful features from sentences and improve the performance of the affective analysis model. However, the original convolution neural network model ignores sentence structure information which is very important for text sentiment analysis. In this paper, we add piece-wise pooling to the convolution neural network, which allows the model to obtain the sentence structure. And the main features of different sentences are extracted to analyze the emotional tendencies of the text. At the same time, the user’s feedback involves many different fields, and there is less labeled data. In order to alleviate the sparsity of the data, this paper also uses the generative adversarial network to make common feature extractions, so that the model can obtain the common features associated with emotions in different fields, and improves the model’s Generalization ability with less training data. Experiments on different datasets demonstrate the effectiveness of this method.

In the ever-expanding digital landscape, the abundance of user-generated content on consumer platforms such as Booking and TripAdvisor offers a rich source of information for both travellers and hoteliers. Sentiment analysis, a fundamental research task of natural language processing (NLP) is used for mining sentiments and opinions within this vast reservoir of text reviews. A more specific type of sentiment analysis, i.e., aspect-based sentiment analysis (ABSA), is used when processing customer reviews is required. In ABSA, we aim to capture aspect-level sentiments and intricate relationships between various aspects within reviews. This article proposes a novel approach to ABSA by introducing a novel technique of word sense disambiguation (WSD) and integrating it with the Transformer architecture bidirectional encoder representations from Transformers (BERT) and graph convolutional networks (GCNs). The proposed approach resolves the intriguing ambiguities of the words and represents the review data as a complex graph structure, facilitating the modeling of intricate relationships between different aspects. The combination of bidirectional long short-term memory (BiLSTM) and GCN proves effective in capturing inter-dependencies among various aspects, providing a nuanced understanding of customer sentiments. The experiments are conducted on the RABSA dataset (an enhanced and richer hotel review data collection), and results demonstrate that our approach outperforms previous baselines, showcasing the effectiveness of integrating WSD in ABSA. Furthermore, an ablation study confirms the significant contribution of the WSD module to the overall performance. Moreover, we explore different similarity measures and find that cosine similarity yields the best results when identifying the real sense of a word in a given sentence using WordNet. The findings of our work and future work related to our work create lots of interest for people in the tourism and hospitality industry. This research gives another boost to the concept of the potential of NLP techniques in sentiment analysis. It emphasizes that if we combine the potential of NLP techniques along with state-of-the-art machine learning frameworks, we can shape the future of this field.