A Reliable Technique for Sentiment Analysis on Tweets via Machine Learning and BERT

This article introduces an advanced vital sign monitoring system that seamlessly integrates sensor technology, wireless communication, and machine learning (ML) algorithms to enhance patient care. The system accurately records and interprets vital physiological metrics such as oxygen saturation (SpO2), heart rate (HR), and body temperature. The integration forms the foundation of our comprehensive approach to patient health status classification through the ML algorithm. We employed three distinct ML algorithms—K-nearest neighbors (KNNs), support vector machines (SVMs), and stochastic gradient descent (SGD) models to analyze health states, each precisely trained and validated using data collected from sensors on vital sign. This meticulous training aims to enable the models to accurately identify various patient health states, with the KNN model achieving an average accuracy of 92%, while the SVM and SGD models attained even higher accuracies of 94% and 97%, respectively. These outcomes were rigorously validated against established health scoring systems, showcasing the models’ exceptional performance in multiclass classification scenarios. This is further evidenced by their area under the receiver operating characteristic (AUROC) scores: KNN (0.9021), SVM (0.9841), and SGD (0.9933). The integration of these technologies into our health monitoring system represents a significant advancement in the continuous and comprehensive assessment of patient health, demonstrating the potential of modern technologies to revolutionize healthcare monitoring and management.

Development in the field of opinion mining and sentiment analysis has been rapid and aims to explore views or texts on various social media sites through machine-learning techniques with the sentiment, subjectivity analysis and calculations of polarity. Sentiment analysis is a natural language processing strategy used to decide if the information is positive, negative, or neutral and it is frequently performed on literature information to help organizations screen brand, item sentiment in client input, and comprehend client needs. In this paper, two strategies for sentiment analysis is proposed for word embedding and a bag of words on Urdu and English tweets. Word embedding is a notable arrangement of procedures that can remember words linguistics dependent on the spread theory which expresses that word is utilized and happens within the same settings tend to indicate comparable implications. Bag of words is an approach used in natural language processing to retrieve information and features from written documents. For the bag of words, machine learning techniques like naive bayes, decision tree, k-nearest neighbor, and support vector machine is used to enhance the accuracy. For word embedding the neural network technique is proposed by the combination of recurrent neural network (RNN) with long-short term memory (LSTM) for sentimental analysis of tweets. Datasets of Urdu and English tweets are used for negative and positive classification tweets with machine learning techniques. The contribution of this paper involves the implementation of a hybrid approach that focused on a sentiment analyzer to overcome social network challenges and also provided the comparative analysis of different machine learning algorithms. The results indicate improvement while using the combination of RNN with the help of LSTM showed accuracy 87% on the Urdu dataset and 92% on the English dataset.

Social media platforms have become indispensable channels for communication and interaction, offering a wealth of data that can provide valuable insights into public sentiments. However, analyzing sentiment on these platforms poses significant challenges due to the diverse and unstructured nature of user-generated content. Traditional Natural Language Processing (NLP) techniques struggle to accurately classify sentiments expressed through text, images, emoticons, and multimedia elements. Moreover, the informal and nuanced language used in Electronic Word of Mouth (eWOM) further complicates sentiment analysis. In response, this paper explores the role of Artificial Intelligence (AI) in improving sentiment analysis on social media. By leveraging Machine Learning (ML) algorithms trained on large datasets, AI can enhance the accuracy and efficiency of sentiment classification, providing decision-makers with actionable insights into the sentiment landscape of social media. Keywords: Social media, Sentiment analysis, Artificial Intelligence, Machine Learning, Natural Language Processing, Electronic Word of Mouth.

This thesis examines the issue of ill-formed text (microtext) and shows its impact on sentiment analysis. The source of microtext is Twitter, WhatsApp, Facebook and other social media platforms. Words or phrases not in their standard language format like “lol” (laugh out loud), “c u 2nite” (see you tonight) and “plz” (please) are called out of vocabulary (OOV) terms. On the other hand, words or phrases in their standard forms, for example, “tonight”, “love”, or “talk to you later”, are called In Vocabulary (IV) terms. The motivation behind microtext normalization is its growing presence on both online and offline platforms. Microtext might appear to be an ill-formed text, which requires find-and-replace methods. Traditionally, in a Natural Language Processing (NLP) context, microtexts such as abbreviations and length shortening or extending are normalized, but phonemic and graphemic variation is often ignored. However, the features of microtext can be traced back to social, cognitive and geographic influences. To understand social media text, it is essential to develop a microtext normalization module for traditional and modern NLP models. The first section of this thesis focuses on combining unsupervised learning methods in 2 different chapters, 4 and 5. The first method includes lexicon creation to transform the most frequent microtexts and emoticons on social media and applies them to sentiment analysis. This method shows an accuracy increase of 4% when microtext normalization is applied before sentiment analysis. This method is extended with an application to a pre-trained chatbot to improve the chatbot’s understanding of microtext (social media slangs). This method shows a mean BLEU score of 0.8 for the SMS and Tweet dataset. The second method incorporates a phonetic based approach to transform any microtext into its phonetic equivalent before 1normalizing it. This method shows an accuracy improvement of 6% for sentiment analysis on SenticNet. The second part of the unsupervised learning is in Chapter 5, introducing the IPA-based method for microtext normalization and sentiment analysis. Epitran was used to transform a word to its International Phonetic Alphabet (IPA) equivalent. The International Phonetic Alphabet (IPA) is an alphabetic system of phonetic notation based primarily on the Latin script. There is a significant improvement in microtext normalization task and sentiment analysis over Soundex. The results also show that there is very little redundancy when words are transformed to phonetics in IPA. In addition, the accuracy of polarity detection using this method has an improvement over baseline by 5%. Chapter 6 discusses a simple sequence-to-sequence based Deep Learning method. As the language is dynamic, it is not easy to maintain the lexicon. Deep Learning alleviates the static lexicon with a probabilistic model to transform microtext into its standard form. The findings suggest that a semiotic class of microtext was easy to transform, whereas the phonetic class of microtext was not handled easily. The proposed model improves the pre-trained sentiment analysis model by 4%. We also introduce a corpus for English microtext normalization. The corpus contains microtext-containing sentences along with their correctly spelt sentences and their correct polarity. This dataset can tackle two NLP problems, i.e., microtext normalization and sentiment analysis. This corpus consists of 38% positive, 39.9% negative and 22.1% neutral. A pre-trained model shows an accuracy of 46.4 % on OOV text for sentiment analysis, showing considerable room for improvement. In summary, this thesis introduces several approaches to microtext normalization analysis and focuses on sentiment analysis application. Microtext cannot be thought of as a one-dimensional problem to NLP. It encapsulates many factors like regional (geographical), ethnic (national and racial), and social (class, age, gender, socioeconomic status and education), which cannot be ignored given the growing importance of social media in our daily life.

Narcissistic tendencies are increasingly observable in online interactions, particularly on social media platforms. X (formerly Twitter) has been identified as a popular platform among individuals exhibiting narcissistic traits. Predicting these traits based on language use remains an essential area of study. This research examines narcissistic tendencies among Malaysian social media users by analysing 2,129 posts on Twitter. Utilising natural language processing (NLP) methods and machine learning algorithms, we assess linguistic patterns, sentiment, and engagement metrics to identify indicators of narcissism. Four machine learning algorithms, Support Vector Machine (SVM), Naïve Bayes, Logistic Regression, and Gradient Boosting, were assessed based on multiple performance metrics. Results indicate that SVM is the most effective model, achieving 80% accuracy with 10-fold cross-validation, demonstrating its reliability in predicting narcissistic traits. These findings contribute to computational psychology and social media analytics, offering insights into the psychological dimensions of digital self-presentation and the implications of narcissistic behaviours in online communities.

The rapid development of information technology has changed the way people interact and express their opinions on public policies, including the People's Housing Savings (Tapera) policy in Indonesia. People now primarily express their views openly on social media platforms like Twitter, generating a substantial amount of text data for analysis to understand public sentiment. However, the main challenge in this sentiment analysis is determining the most effective machine learning algorithm for classifying public opinion with high accuracy. This study aims to compare the performance of three machine learning algorithms, namely Naïve Bayes, Support Vector Machine, and Random Forest, in analyzing public sentiment towards the Tapera policy. This study analyzes public comment data obtained from Twitter. We measure the accuracy of each algorithm to determine its optimal performance in sentiment classification. The research method consists of several stages, starting with data collection, text preprocessing to clean and prepare data, and then applying the three algorithms to analyze sentiment. The results showed that Naïve Bayes had the highest accuracy of 69.17%, followed by Support Vector Machine with an accuracy of 68.42%, and Random Forest with an accuracy of 66.17%. This shows that Naïve Bayes is the most effective algorithm to use in sentiment analysis of public comments related to the Tapera policy, especially in the context of complex text data from social media. The conclusion of this study is that Naïve Bayes is superior in classifying public sentiment towards the Tapera policy compared to Support Vector Machine and Random Forest. As a result, this study makes a significant contribution to selecting the most appropriate machine learning algorithm for public sentiment analysis towards public policy, which in turn can help the government understand and respond to public perceptions more effectively.

Since the two last decades, social media networks have become a part of our daily life. Today, getting information from social media, tracking trends in social media, learning the feelings and emotions of people on social media is very essential. In this study, sentiment analysis was performed on Twitter text to learn about the subjective polarities of the writings. The polarities are positive, negative, and neutral. At the first stage of the sentiment analysis, a public data set has been obtained. Secondly, natural language processing techniques have been applied to make the data ready for machine learning training procedures. Lastly, sentiment analysis is performed by using three different machine learning algorithms. We reached 89% accuracy with Support Vector Machines, 88% accuracy with Random Forest, and 72% accuracy with Gaussian Naive Bayes classifier.

In this manuscript, the rise of misinformation and harmful behavior on social media platforms has made it crucial to develop systems that ensure the authenticity of shared content and user accounts is presented. Parsing of social media feeds for forensic investigation aims to identify fake news and detect fake social media accounts (focusing on platforms like Instagram). The main goal of parsing of social media feeds for forensic investigation is to protect users from misleading information spread by fake accounts. To achieve this, various modules are integrated into the system, including Data Collection and Pre-Processing, Fake News Detection and Account Authenticity Verification. Web scraping tools such as BeautifulSoup are used to gather real-time data, while machine learning algorithms, including Random Forest and Large Language Model (LLM) are employed to classify fake news and detect suspicious account behaviors. The system also uses NLP models to identify fake news patterns and generate comprehensive reports summarizing the findings of each module. By combining Natural Language Processing (NLP) and machine learning techniques, parsing of social media feeds for forensic investigation provides an essential platform for users to protect themselves from misleading information on social networks.

A Review on Reddit News Headlines with NLTK tool

The rapid growth of financial technology (fintech) services in Indonesia has significantly transformed digital transaction behavior, with digital wallets such as DANA becoming widely adopted. Despite high usage rates, public discourse on social media frequently highlights both positive experiences and recurring concerns related to system reliability and data security. Twitter, as a real-time public communication platform, provides a rich source of user-generated content that reflects public perception toward fintech services. This study investigates public sentiment toward DANA fintech services in Indonesia through sentiment analysis of Twitter data using machine learning approaches. Purpose:This study aims to analyze public perception of DANA fintech services based on sentiment expressed on Twitter and to compare the performance of several machine learning classification algorithms in identifying positive, neutral, and negative sentiments in Indonesian-language social media texts. Methods/Study design/approach: The study employs a quantitative descriptive approach using text mining and sentiment analysis techniques. Twitter data were collected via the Twitter API over a specified period and processed through preprocessing stages including text cleaning, tokenization, stopword removal, and stemming. Feature extraction was performed using the Term Frequency–Inverse Document Frequency (TF-IDF) method. Sentiment classification was conducted using Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Random Forest algorithms. Model performance was evaluated using accuracy, precision, recall, and F1-score metrics. Result/Findings:The results indicate that public sentiment toward DANA is predominantly positive, driven by perceptions of transaction convenience and speed, followed by neutral sentiment, while negative sentiment is mainly associated with system disruptions and data security issues. Among the evaluated algorithms, SVM achieved the highest classification accuracy (91.4%), outperforming Random Forest and KNN. These findings demonstrate that SVM is more effective for sentiment classification of short Indonesian-language texts on social media platforms. Novelty/Originality/Value:This study contributes to the growing body of sentiment analysis research in Indonesia by providing empirical evidence on public perception of fintech services using machine learning techniques. By systematically comparing multiple classification algorithms in the context of Indonesian Twitter data, the study offers methodological insights and practical implications for fintech service providers in improving service quality, communication strategies, and user trust.

Being one of the most effective spreading methods, word-of-mouth networking moved to its digital version - social media platforms. Social media represents a digital platform which allows users to interact with each other in different ways. Audio, video, image or text content are examples of such interactions. Widespread use of social media platforms brings new ways to marketing solutions in order to reach potential audience, especially thorough those users who actively interact with and have an influence on their followers. Brands which utilizes abilities of such users of social media are involved in field of influencer marketing. One of the challenges in this rapidly growing field is finding person (influencer) which will match requirements of the brand. Rising number of influencers and social media platforms leads to increasing data and difficulties in finding appropriate influencer. The purpose of this study is to provide design of an influencer identification system utilizing machine learning algorithms. Although the number of Influencers rising, they are still in minority comparing to all users of social media. Thus, focusing on solving problem of imbalanced classification, performances of Logistic Regression, Linear Discriminant Analysis, K-Nearest Neighbors, Support Vector Machines and different tree based methods were compared and Random Forest method is selected to be used in the system.

Now a days the use of social media has grown exponentially with the simultaneous growth of the internet throughout the world and it is mostly attracted by the youth. However, the enhancement of social connectivity by using this social media platform may also lead to a negative impact on society mainly cybercrime, cyberbullying, abuse, etc. This cyberbullying is a major problem in this society which leads to frequent physical and mental stress, particularly for teenagers, transgenders, and women. Cyberbullying is done by using comments on social media platforms commenting vulgar words and also due to the increase of user’s various malicious entities like increasing fake accounts increased a lot. Detection of cyberbullying and fake accounts on such large platforms is very difficult and may sometimes lead to false detection. So many incidents have recently occurred throughout the world like suicides, mental illness, etc. So our goal is to identify bullying comments and fake accounts on social media platforms like Facebook, Twitter, etc. By merging natural language processing and machine learning algorithms like xgboost(extreme gradient boosting) to detect fake accounts and logistic regression for cyberbullying. Key Words: Cyberbullying, Natural language processing, Machine learning, xgboost(extreme gradient boosting), logistic regression, Random forest, etc.

In the past decades, sentiment analysis has become one of the most active research areas in natural language processing, data mining, web mining, and information retrieval. The great demand in everyday life and the factor of novelty coupled with the availability of data from social networks have served as strong motivation for research on sentiment-analysis. A number of technical problems, most of which had not been attempted before, either in the NLP or linguistics communities have also generated strong research interests in academia. Sentiment analysis, also called opin-ion mining, is the field of study that analyzes people’s opinions, sentiments, apprais-als, attitudes, and emotions toward entities and their attributes expressed in written text. The entities can be products, services, organizations, individuals, events, issues, or topics. The field represents a large problem space. It improves not only the field of natural language processing but also management, political science, economics, and sociology because all these areas are related to the thoughts of consumers and public. User-generated content is full of opinions, because the main reason why people post messages on social media platforms is to express their views and opinions, and therefore sentiment analysis is at the centre of social media analysis. It turned out that user messages often contain plenty of sarcastic expressions and ambiguous words. Within one opinion both positive and negative sentiments can be present. This also applies to negative particles, which do not always indicate a negative tone. This article investigates four challenges faced by researchers while conducting sentiment analysis, namely: sarcasm, negation, word ambiguity, and multipolarity. These aspects significantly affect the accuracy of the results when we determine a sentiment. Modern approaches to solving the problem are also covered. These are mainly machine learning methods, such as convolutional neural networks (CNN), deep neural networks (DNN), long short-term memory (LTSM), recurrent neural network (RNN), support vector machines (SVM), etc.

In the era of artificial intelligence, machine learning methods are successfully used in various fields. Machine learning has attracted extensive attention from investors in the financial market, especially in stock price prediction. However, one argument for the machine learning methods used in stock price prediction is that they are black-box models which are difficult to interpret. In this paper, we focus on the future stock price prediction with the historical stock price by machine learning and deep learning methods, such as support vector machine (SVM), random forest (RF), Bayesian classifier (BC), decision tree (DT), multilayer perceptron (MLP), convolutional neural network (CNN), bi-directional long-short term memory (BiLSTM), the embedded CNN, and the embedded BiLSTM. Firstly, we manually design several financial time series where the future price correlates with the historical stock prices in pre-designed modes, namely the curve-shape-feature (CSF) and the non-curve-shape-feature (NCSF) modes. In the CSF mode, the future prices can be extracted from the curve shapes of the historical stock prices. Conversely, in the NCSF mode, they can’t. Secondly, we apply various algorithms to those pre-designed and real financial time series. We find that the existing machine learning and deep learning algorithms fail in stock price prediction because in the real financial time series, less information of future prices is contained in the CSF mode, and perhaps more information is contained in the NCSF. Various machine learning and deep learning algorithms are good at handling the CSF in historical data, which are successfully applied in image recognition and natural language processing. However, they are inappropriate for stock price prediction on account of the NCSF. Therefore, accurate stock price prediction is the key to successful investment, and new machine learning algorithms handling the NCSF series are needed.

Abstract—This paper presents a hybrid sentiment analysis system that integrates lexicon-based, traditional machine learning, and deep learning techniques to classify textual data into positive, negative, or neutral sentiments. The system leverages Python-based libraries such as Scikit-learn, NLTK, and Transformers to pre- process text, extract features, and apply models in- cluding Support Vector Machine (SVM), Bidirectional Encoder Representations from Transformers (BERT), Linear Regression, and Valence Aware Dictionary and sEntiment Reasoner (VADER). The framework pro- cesses customer reviews from e-commerce platforms (Amazon, Flipkart) and social media (Instagram) using web scraping and provides actionable insights through sentiment summarization and visualizations (bar and pie charts). Experimental results demonstrate BERT’s superior performance with 92.3% accuracy, followed by SVM (85.6%), Linear Regression (81.2%), and VADER (76.8%). The system addresses challenges like sarcasm, class imbalance, and scalability, offering a scalable, user-friendly solution for real-world applications in e- commerce, social media analytics, and brand reputation management. Index Terms—Sentiment Analysis, Machine Learning, Deep Learning, Natural Language Processing, BERT, SVM, VADER, Text Classification, Data Visualization.