Feature-based Transportation Sentiment Analysis Using Fuzzy Ontology and SentiWordNet

This thesis examines the issue of ill-formed text (microtext) and shows its impact on sentiment analysis. The source of microtext is Twitter, WhatsApp, Facebook and other social media platforms. Words or phrases not in their standard language format like “lol” (laugh out loud), “c u 2nite” (see you tonight) and “plz” (please) are called out of vocabulary (OOV) terms. On the other hand, words or phrases in their standard forms, for example, “tonight”, “love”, or “talk to you later”, are called In Vocabulary (IV) terms. The motivation behind microtext normalization is its growing presence on both online and offline platforms. Microtext might appear to be an ill-formed text, which requires find-and-replace methods. Traditionally, in a Natural Language Processing (NLP) context, microtexts such as abbreviations and length shortening or extending are normalized, but phonemic and graphemic variation is often ignored. However, the features of microtext can be traced back to social, cognitive and geographic influences. To understand social media text, it is essential to develop a microtext normalization module for traditional and modern NLP models. The first section of this thesis focuses on combining unsupervised learning methods in 2 different chapters, 4 and 5. The first method includes lexicon creation to transform the most frequent microtexts and emoticons on social media and applies them to sentiment analysis. This method shows an accuracy increase of 4% when microtext normalization is applied before sentiment analysis. This method is extended with an application to a pre-trained chatbot to improve the chatbot’s understanding of microtext (social media slangs). This method shows a mean BLEU score of 0.8 for the SMS and Tweet dataset. The second method incorporates a phonetic based approach to transform any microtext into its phonetic equivalent before 1normalizing it. This method shows an accuracy improvement of 6% for sentiment analysis on SenticNet. The second part of the unsupervised learning is in Chapter 5, introducing the IPA-based method for microtext normalization and sentiment analysis. Epitran was used to transform a word to its International Phonetic Alphabet (IPA) equivalent. The International Phonetic Alphabet (IPA) is an alphabetic system of phonetic notation based primarily on the Latin script. There is a significant improvement in microtext normalization task and sentiment analysis over Soundex. The results also show that there is very little redundancy when words are transformed to phonetics in IPA. In addition, the accuracy of polarity detection using this method has an improvement over baseline by 5%. Chapter 6 discusses a simple sequence-to-sequence based Deep Learning method. As the language is dynamic, it is not easy to maintain the lexicon. Deep Learning alleviates the static lexicon with a probabilistic model to transform microtext into its standard form. The findings suggest that a semiotic class of microtext was easy to transform, whereas the phonetic class of microtext was not handled easily. The proposed model improves the pre-trained sentiment analysis model by 4%. We also introduce a corpus for English microtext normalization. The corpus contains microtext-containing sentences along with their correctly spelt sentences and their correct polarity. This dataset can tackle two NLP problems, i.e., microtext normalization and sentiment analysis. This corpus consists of 38% positive, 39.9% negative and 22.1% neutral. A pre-trained model shows an accuracy of 46.4 % on OOV text for sentiment analysis, showing considerable room for improvement. In summary, this thesis introduces several approaches to microtext normalization analysis and focuses on sentiment analysis application. Microtext cannot be thought of as a one-dimensional problem to NLP. It encapsulates many factors like regional (geographical), ethnic (national and racial), and social (class, age, gender, socioeconomic status and education), which cannot be ignored given the growing importance of social media in our daily life.

Opinion mining based on fuzzy domain ontology and Support Vector Machine: A proposal to automate online review classification

In this paper, a hybrid feature learning approach is proposed to employ aspect sentiment analysis on sentence level through contextual discovery of unstructured text data. The proposed approach joins sentiment lexicon with pre-trained BERT (Bidirectional Encoder Representations from Transformers) word embeddings model for feature deep learning and prediction of context words. In addition, fuzzy ontology reasoning is employed for supporting more in-depth feature extraction through representing semantic knowledge by forming relationships between aspects. Subsequently, the extracted sentiment indicators in online user reviews are classified using Bi-LSTM (Bi-directional Long Short-Term Memory) deep learning model so that the context around words are learned and the corresponding meanings are captured both syntactically and semantically. According to the obtained results, the proposed approach outperforms other related feature learning approaches through improving sentence aspect sentiment analysis and accordingly boosting the overall accuracy of sentiment classification. An average accuracy of 96%, AUC score of 94.5%, and F-score of 95% are achieved by the proposed approach considering five public social media datasets of online reviews. The significance of this study is investigating enrichment of extracted features through using BERT transformer with fuzzy ontology in order to improve the performance of aspect-based sentiment analysis while adding the contextual meanings to the prediction task, and extracting the indirect relationships embedded in social data of user reviews.KeywordsSentiment analysisFeature learningBERTNatural Language ProcessingFuzzy ontology

On the Internet, online microblogging and social networks have experienced tremendous growth. Millions of individuals share opinions on social networking platforms including Twitter, Facebook, YouTube, and Microblogging sites. Millions of individuals express their thoughts on social platforms namely Twitter, Facebook, YouTube, and microblogging sites. As user‐generated content is growing to a huge extent on the internet, the analysis, extraction identification and classification of opinion and sentiment polarity of different aspects has now become a challenging issue in sentiment analysis. In sentiment analysis, aspect level opinion mining, opinion spam review detection, extraction and representation of most relevant accessed data from the user‐generated data is a difficult process. The word vector representation using existing deep learning techniques affects the performance in aspect level opinion mining. Spammers propagate false opinion for payment exchange, which leads to degradation of the financial growth, business, and fame of the organization. To overcome the limitations aspect level opinion mining is used to recognize sentiment and polarity of aspects in the specified text. This work presents various input feature vectors of deep learning approaches aiming to improve performance in aspect level opinion mining. Next, three meta‐heuristic algorithms with k‐means clustering approach for classification of opinion spam reviews on social media transit tweets is presented. The proposed approaches are evaluated and compared with other existing approaches as well as other benchmark datasets namely Restaurant and Amazon reviews.

Social media is emerging rapidly on the internet. This media knowledge helps people, company and organizations to analyze information for important decision making. Opinion mining is also called as sentiment analysis which involves in building a system to gather and examine opinions about the product made in reviews or tweets, comments, blog posts on the web. Sentiment is classified automatically for important applications such as opinion mining and summarization. To make valuable decisions in marketing analysis where implement sentiment classification efficiently. Reviews contain sentiment which is expressed in a different way in different domains and it is costly to annotate data for each new domain. The analysis of online customer reviews in which firms cannot discover what exactly people liked and did not like in document-level and sentence-level opinion mining. So, now opinion mining ongoing research is in phrase-level opinion mining. It performs finer-grained analysis and directly looks at the opinion in online reviews. The proposed system is based on phrase-level to examine customer reviews. Phrase-level opinion mining is also well-known as aspect based opinion mining. It is used to extract most important aspects of an item and to predict the orientation of each aspect from the item reviews. The projected system implements aspect extraction using frequent itemset mining in customer product reviews and mining opinions whether it is positive or negative opinion. It identifies sentiment orientation of each aspect by supervised learning algorithms in customer reviews.

On social media, the number of users are increasing exponentially. The information contents posted and tweeted by the user are also increasing exponentially. A different meaning of the sentiment is hidden inside the message. Analysing the nature of the text is still a very challenging task. The sentiment analysis is one of the emerging and challenging fields. In the proposed work, the data has been extracted from Twitter with the dataset of around 145,464 comments. In particular, the English-Punjabi dictionary has been created for opinionated word. The opinionated words are categorized into two parts as positive dictionary and negative dictionary. These are stored in gazetteer list and then a statistical technique has been applied for sentiment analysis.

Social media platforms have become indispensable channels for communication and interaction, offering a wealth of data that can provide valuable insights into public sentiments. However, analyzing sentiment on these platforms poses significant challenges due to the diverse and unstructured nature of user-generated content. Traditional Natural Language Processing (NLP) techniques struggle to accurately classify sentiments expressed through text, images, emoticons, and multimedia elements. Moreover, the informal and nuanced language used in Electronic Word of Mouth (eWOM) further complicates sentiment analysis. In response, this paper explores the role of Artificial Intelligence (AI) in improving sentiment analysis on social media. By leveraging Machine Learning (ML) algorithms trained on large datasets, AI can enhance the accuracy and efficiency of sentiment classification, providing decision-makers with actionable insights into the sentiment landscape of social media. Keywords: Social media, Sentiment analysis, Artificial Intelligence, Machine Learning, Natural Language Processing, Electronic Word of Mouth.

The use of Machine Learning (ML) and Sentiment Analysis (SA) on data from microblogging sites has become a popular method for stock market prediction. In this work, we developed a model for predicting stock movement utilizing SA on Twitter and StockTwits data. Stock movement and sentiment data were used to evaluate this approach and validate it on Microsoft stock. We gathered tweets from Twitter and StockTwits, as well as financial data from Finance Yahoo. SA was applied to tweets, and seven ML classification models were implemented: K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Logistic Regression (LR), Naïve Bayes (NB), Decision Tree (DT), Random Forest (RF) and Multilayer Perceptron (MLP). The main novelty of this work is that it integrates multiple SA and ML methods, emphasizing the retrieval of extra features from social media (i.e., public sentiment), for improving stock prediction accuracy. The best results were obtained when tweets were analyzed using Valence Aware Dictionary and sEntiment Reasoner (VADER) and SVM. The top F-score was 76.3%, while the top Area Under Curve (AUC) value was 67%.

Public health surveillance has gained more importance recently due the global COVID-19 pandemic. It is important to track public opinions and positions on social media automatically, so that this information can be used to improve public health. Sentiment analysis and stance detection are two social media analysis methods that can be applied to health-related social media posts for this purpose. In this chapter, the authors perform sentiment analysis and stance detection in Turkish tweets about COVID-19 vaccination. A sentiment- and stance-annotated Turkish tweet dataset about COVID-19 vaccination is created. Different machine learning approaches (SVM and Random Forest) are applied on this dataset, and the results are compared. Widespread COVID-19 vaccination is claimed to be useful in order to cope with this pandemic. Therefore, results of automatic sentiment and stance analysis on Twitter posts on COVID-19 vaccination can help public health professionals during their decision-making processes.

Navigating Social Media in #Ophthalmology

The data generated from online communication acts as potential gold mines for discovering knowledge for researchers. A large amount of data is also generated in the form of web documents, emails, blogs, and feedback, etc. Text analytics is being significantly employed to mine important information. Opinion mining is the process of extracting human thoughts and perceptions from unstructured texts. The showstopper for designing an opinion mining system for analyzing reviews arise from the fact that customer reviews are often noisy. These reviews are informally written. In addition, they are subjected to spelling mistakes, grammatical errors, improper punctuation and irrational capitalization. This paper focuses on analyzing the different classification and clustering algorithms aimed at extracting and consolidating opinions of customers from social media sites like Facebook, Twitter and through surveys, at multiple levels of granularity to monitor and measure customer satisfaction. Ours is an automated approach, in which the system aids in the process of knowledge assimilation for knowledge-based building and also performs the analytics. Domain experts ratify the knowledge base and also provide training datasets for the system to intuitively gather more instances for ratification. The system identifies opinion expressions as phrases containing opinion words, opinionated features and also opinion modifiers. These expressions are categorized as positive, negative or neutral. Opinion expressions are identified and categorized using localized linguistic techniques. Opinions can be congregated at any desired level of specificity i.e. feature level or product level, user level or service level, etc. We have developed a system based on this approach, which provides the user with a platform to analyze opinion expressions crawled from a set of pre-defined datasets.

The data generated from online communication acts as potential gold mines for discovering knowledge for end users. Large amount of data is also generated in the form of web documents, emails, blogs, and feedback, etc. Text analytics and opinion mining are used to extract human thoughts and perceptions from unstructured texts. This paper proposes a method that focuses on analysing different classification and clustering algorithms aimed at extracting and consolidating opinions of customers from social media sites like Facebook, Twitter and through surveys, at multiple levels of granularity to monitor and measure customer satisfaction. This is an automated approach, in which algorithms aid in the process of knowledge assimilation identification and the analytics. Domain experts ratify the knowledge base and provide training data sets for the system to intuitively gather more instances for ratification. The system identifies opinion expressions as phrases containing opinion words, opinionated features and also opinion modifiers. These expressions are categorized as positive, negative or neutral. Opinion expressions are identified and categorized using localized linguistic techniques. Opinions can be congregated at any desired level of specificity i.e. feature level or product level, user level or service level, etc. It has been found that J48 classification algorithm and simple k-means clustering algorithm are most suitable for restaurant customer reviews.

Sentiment analysis in terms of polarity classification is very important in everyday life, with the existence of polarity, many people can find out whether the respected document has positive or negative sentiment so that it can help in choosing and making decisions. Sentiment analysis usually done manually. Therefore, an automatic sentiment analysis classification process is needed. However, it is rare to find studies that discuss extraction features and which learning models are suitable for unstructured sentiment analysis types with the Amazon food review case. This research explores some extraction features such as Word Bags, TF-IDF, Word2Vector, as well as a combination of TF-IDF and Word2Vector with several machine learning models such as Random Forest, SVM, KNN and Naïve Bayes to find out a combination of feature extraction and learning models that can help add variety to the analysis of polarity sentiments. By assisting with document preparation such as html tags and punctuation and special characters, using snowball stemming, TF-IDF results obtained with SVM are suitable for obtaining a polarity classification in unstructured sentiment analysis for the case of Amazon food review with a performance result of 87,3 percent.

The contemporary speed at which opinions move on social media makes them an undeniable force in the field of opinion mining (OM). This may cause the OM challenge to become more social than technical. This is when the process can determinately represent everyone to the degree they are worth. Nevertheless, considering perspectivism can result in opinion dynamicity. Pondering the existence of opinion dynamicity and uncertainty can provide smart OM on social media. This study proposes a neutrosophic-based OM approach for Twitter that handles perspectivism, its consequences, and indeterminacy. For perspectivism, a social network analysis (SNA) was conducted using popular SNA tools (e.g., Graphistry). An influence weighting of users was performed using an artificial neural network (ANN) based on the SNA provided output and people’s reactions to the OM analyzed texts. The initiative adoption of neutrosophic logic (NL) to integrate users’ influence with their OM scores is to deal with both the opinion dynamicity and indeterminacy. Thus, it provides new uncertainty OM scores that can reflect everyone. The OM scores needed for integration were generated using TextBlob. The results show the ability of NL to improve the OM process and accurately consider the innumerable degrees. This will eventually aid in a better understanding of people’s opinions, helping OM in social media to become a real pillar of many applications, especially business marketing.

In the digital world, social media has become one of the most popular communication mediums that allow users to share their views on various topics in their social network. For example, Twitter users are allowed to share their thoughts on various topic by sending tweets with a maximum length of 140 characters. Hence, social media driven information contains opinions and sentiments on various topics of interest which are extremely useful for companies to design marketing strategies. Sentiment Analysis is widely used to assist people to understand the massive amount of data available online and identify the polarity of the topical based social media opinions. However, social media platforms’ users come from all over the world and have variation in terms of informal language and short notation used on social media platforms. Therefore, the identification on the polarity of topical social media has become more challenging and the accuracy on the polarity of topical social media opinions might be influenced. This paper investigates the effectiveness of applying different spelling correction algorithms, such as Levenshtein distance and Peter Norvig’s algorithm for spelling correction of unknown words found in social media such as Twitter, before carrying out sentiment analysis. The evaluation of spelling correction algorithms on sentiment analysis is carried out by comparing the polarities of manually annotated tweets with the polarities obtained from the sentiment analysis algorithm. Based on the results obtained, there are slight improvements in term of percentage of matched polarity, where 1.6% improvement by using the Levenshtein distance-based algorithm and 2.0% improvement by using the Peter Norvig’s algorithm.