Sentiment Analysis on Tweets for Trains Using Machine Learning

The rapid growth of financial technology (fintech) services in Indonesia has significantly transformed digital transaction behavior, with digital wallets such as DANA becoming widely adopted. Despite high usage rates, public discourse on social media frequently highlights both positive experiences and recurring concerns related to system reliability and data security. Twitter, as a real-time public communication platform, provides a rich source of user-generated content that reflects public perception toward fintech services. This study investigates public sentiment toward DANA fintech services in Indonesia through sentiment analysis of Twitter data using machine learning approaches. Purpose:This study aims to analyze public perception of DANA fintech services based on sentiment expressed on Twitter and to compare the performance of several machine learning classification algorithms in identifying positive, neutral, and negative sentiments in Indonesian-language social media texts. Methods/Study design/approach: The study employs a quantitative descriptive approach using text mining and sentiment analysis techniques. Twitter data were collected via the Twitter API over a specified period and processed through preprocessing stages including text cleaning, tokenization, stopword removal, and stemming. Feature extraction was performed using the Term Frequency–Inverse Document Frequency (TF-IDF) method. Sentiment classification was conducted using Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Random Forest algorithms. Model performance was evaluated using accuracy, precision, recall, and F1-score metrics. Result/Findings:The results indicate that public sentiment toward DANA is predominantly positive, driven by perceptions of transaction convenience and speed, followed by neutral sentiment, while negative sentiment is mainly associated with system disruptions and data security issues. Among the evaluated algorithms, SVM achieved the highest classification accuracy (91.4%), outperforming Random Forest and KNN. These findings demonstrate that SVM is more effective for sentiment classification of short Indonesian-language texts on social media platforms. Novelty/Originality/Value:This study contributes to the growing body of sentiment analysis research in Indonesia by providing empirical evidence on public perception of fintech services using machine learning techniques. By systematically comparing multiple classification algorithms in the context of Indonesian Twitter data, the study offers methodological insights and practical implications for fintech service providers in improving service quality, communication strategies, and user trust.

The rapid development of information technology has changed the way people interact and express their opinions on public policies, including the People's Housing Savings (Tapera) policy in Indonesia. People now primarily express their views openly on social media platforms like Twitter, generating a substantial amount of text data for analysis to understand public sentiment. However, the main challenge in this sentiment analysis is determining the most effective machine learning algorithm for classifying public opinion with high accuracy. This study aims to compare the performance of three machine learning algorithms, namely Naïve Bayes, Support Vector Machine, and Random Forest, in analyzing public sentiment towards the Tapera policy. This study analyzes public comment data obtained from Twitter. We measure the accuracy of each algorithm to determine its optimal performance in sentiment classification. The research method consists of several stages, starting with data collection, text preprocessing to clean and prepare data, and then applying the three algorithms to analyze sentiment. The results showed that Naïve Bayes had the highest accuracy of 69.17%, followed by Support Vector Machine with an accuracy of 68.42%, and Random Forest with an accuracy of 66.17%. This shows that Naïve Bayes is the most effective algorithm to use in sentiment analysis of public comments related to the Tapera policy, especially in the context of complex text data from social media. The conclusion of this study is that Naïve Bayes is superior in classifying public sentiment towards the Tapera policy compared to Support Vector Machine and Random Forest. As a result, this study makes a significant contribution to selecting the most appropriate machine learning algorithm for public sentiment analysis towards public policy, which in turn can help the government understand and respond to public perceptions more effectively.

2.25Cr-1Mo-0.25V steel is the main material of hydrogenation reactor due to its good high temperature properties and hydrogen embrittlement resistance. As we all know, there is a great performance gap between virgin material and actual product. Nevertheless, current design methods cannot evaluate the impact of manufacturing. In engineering practice, tensile testing is widely implemented on online surveillance samples or experimentally simulated samples to acquire the actual material characteristics. However, sampling from service hydrogenation reactor, as well as simulating actual manufacturing process, is time-consuming, labor-intensive, and difficult. To systematically analyze the effect of fabrication on 2.25Cr-1Mo-0.25V steel, a prediction method that can consider manufacturing residual effects needs to be proposed. Nowadays, many data-driven methods, such as back propagation neural network (BPNN), support vector machine (SVM) and random forest (RF), are employed in predicting material behavior during hot forming, whereas they are scarcely applied on 2.25Cr-1Mo-0.25V steel. In this work, the mentioned three machine learning procedures were constructed to simulate the behavior of actually manufactured 2.25Cr-1Mo-0.25V steel in uniaxial tensile test. Firstly, tensile samples were extracted from different locations of an actually manufactured hydrogenation reactor, and stretched at 454 °C and 482 °C. Subsequently, BPNN, SVM and RF models were developed on the obtained tensile curves, respectively. Their inputs were manufacturing parameter, sampling location, service temperature and tensile strain, whereas their output was tensile stress. Finally, the predictability of models was evaluated by test set data which were not involved in model training process. The results show that the predictions of BPNN, SVM and RF all agree well with experimental data. BPNN exhibits lowest prediction error and highest generalization power, SVM is somewhere in between, while RF is the worst. This work will contribute to the application of data-driven methods in material property prediction of 2.25Cr-1Mo-0.25V steel.

Investigation of challenges in aspect-based sentiment analysis enhanced using softmax function on twitter during the 2024 Indonesian presidential election

This study explores the role of sentiment analysis as a predictive tool for understanding and forecasting product launch success in the digital market. Sentiment analysis involves the classification of consumer sentiment expressed on social media platforms such as Twitter and Instagram, and it can significantly impact businesses by predicting consumer behavior and product performance. The research highlights the relationship between social media sentiment and product success, demonstrating that positive sentiment is strongly correlated with higher sales and consumer engagement, while negative sentiment can lead to declines. Machine learning models, including Support Vector Machines (SVM) and Random Forest, were employed to classify sentiment from large volumes of social media data and correlate it with product performance indicators such as sales volume and consumer interaction. The study found that sentiment analysis models were highly effective in predicting product success, with positive sentiment generally driving product profitability and negative sentiment posing a potential threat to brand reputation. Moreover, the analysis showed that social media sentiment provides real-time insights into consumer perceptions, enabling businesses to quickly adjust marketing strategies and product development plans. These findings underscore the importance of integrating sentiment analysis into product launch evaluations and strategic decision-making. Future research should explore the integration of sentiment analysis with other predictive market models and investigate the effects of fake reviews and post-purchase consumer behaviors on product success.

This thesis examines the issue of ill-formed text (microtext) and shows its impact on sentiment analysis. The source of microtext is Twitter, WhatsApp, Facebook and other social media platforms. Words or phrases not in their standard language format like “lol” (laugh out loud), “c u 2nite” (see you tonight) and “plz” (please) are called out of vocabulary (OOV) terms. On the other hand, words or phrases in their standard forms, for example, “tonight”, “love”, or “talk to you later”, are called In Vocabulary (IV) terms. The motivation behind microtext normalization is its growing presence on both online and offline platforms. Microtext might appear to be an ill-formed text, which requires find-and-replace methods. Traditionally, in a Natural Language Processing (NLP) context, microtexts such as abbreviations and length shortening or extending are normalized, but phonemic and graphemic variation is often ignored. However, the features of microtext can be traced back to social, cognitive and geographic influences. To understand social media text, it is essential to develop a microtext normalization module for traditional and modern NLP models. The first section of this thesis focuses on combining unsupervised learning methods in 2 different chapters, 4 and 5. The first method includes lexicon creation to transform the most frequent microtexts and emoticons on social media and applies them to sentiment analysis. This method shows an accuracy increase of 4% when microtext normalization is applied before sentiment analysis. This method is extended with an application to a pre-trained chatbot to improve the chatbot’s understanding of microtext (social media slangs). This method shows a mean BLEU score of 0.8 for the SMS and Tweet dataset. The second method incorporates a phonetic based approach to transform any microtext into its phonetic equivalent before 1normalizing it. This method shows an accuracy improvement of 6% for sentiment analysis on SenticNet. The second part of the unsupervised learning is in Chapter 5, introducing the IPA-based method for microtext normalization and sentiment analysis. Epitran was used to transform a word to its International Phonetic Alphabet (IPA) equivalent. The International Phonetic Alphabet (IPA) is an alphabetic system of phonetic notation based primarily on the Latin script. There is a significant improvement in microtext normalization task and sentiment analysis over Soundex. The results also show that there is very little redundancy when words are transformed to phonetics in IPA. In addition, the accuracy of polarity detection using this method has an improvement over baseline by 5%. Chapter 6 discusses a simple sequence-to-sequence based Deep Learning method. As the language is dynamic, it is not easy to maintain the lexicon. Deep Learning alleviates the static lexicon with a probabilistic model to transform microtext into its standard form. The findings suggest that a semiotic class of microtext was easy to transform, whereas the phonetic class of microtext was not handled easily. The proposed model improves the pre-trained sentiment analysis model by 4%. We also introduce a corpus for English microtext normalization. The corpus contains microtext-containing sentences along with their correctly spelt sentences and their correct polarity. This dataset can tackle two NLP problems, i.e., microtext normalization and sentiment analysis. This corpus consists of 38% positive, 39.9% negative and 22.1% neutral. A pre-trained model shows an accuracy of 46.4 % on OOV text for sentiment analysis, showing considerable room for improvement. In summary, this thesis introduces several approaches to microtext normalization analysis and focuses on sentiment analysis application. Microtext cannot be thought of as a one-dimensional problem to NLP. It encapsulates many factors like regional (geographical), ethnic (national and racial), and social (class, age, gender, socioeconomic status and education), which cannot be ignored given the growing importance of social media in our daily life.

Sentiment analysis has become increasingly important in understanding user perceptions of digital platforms. This study focuses on analyzing TikTok application reviews from the Google Play Store in Indonesia using machine learning techniques. The research aims to investigate sentiment distribution and compare the performance of three popular machine learning models: Random Forest, Support Vector Machine (SVM), and Naive Bayes. The study employed a comprehensive methodology involving data collection, preprocessing, feature extraction, and model evaluation. A dataset of 10,000 TikTok reviews was collected and preprocessed using techniques such as case folding, tokenization, and stopword removal. The sentiment labeling process categorizes reviews into positive, negative, and neutral sentiments based on user ratings. The TF-IDF algorithm was used for feature extraction, and the SMOTE technique addressed class imbalance. Results revealed a predominance of negative sentiment (53.5%), followed by neutral (32.1%) and positive (14.4%) sentiment. Model performance comparisons at different data sharing ratios (80/20 and 70/30) demonstrated that Random Forest and SVM consistently outperformed Naive Bayes. At the 80/20 ratio, Random Forest achieved the highest accuracy of 83.73%, highlighting its effectiveness in sentiment classification. The research contributes to the field of sentiment analysis and natural language processing by providing insights into user experiences with the TikTok application in Indonesia. The findings can guide application developers in understanding user perceptions and improving user experience.

Development in the field of opinion mining and sentiment analysis has been rapid and aims to explore views or texts on various social media sites through machine-learning techniques with the sentiment, subjectivity analysis and calculations of polarity. Sentiment analysis is a natural language processing strategy used to decide if the information is positive, negative, or neutral and it is frequently performed on literature information to help organizations screen brand, item sentiment in client input, and comprehend client needs. In this paper, two strategies for sentiment analysis is proposed for word embedding and a bag of words on Urdu and English tweets. Word embedding is a notable arrangement of procedures that can remember words linguistics dependent on the spread theory which expresses that word is utilized and happens within the same settings tend to indicate comparable implications. Bag of words is an approach used in natural language processing to retrieve information and features from written documents. For the bag of words, machine learning techniques like naive bayes, decision tree, k-nearest neighbor, and support vector machine is used to enhance the accuracy. For word embedding the neural network technique is proposed by the combination of recurrent neural network (RNN) with long-short term memory (LSTM) for sentimental analysis of tweets. Datasets of Urdu and English tweets are used for negative and positive classification tweets with machine learning techniques. The contribution of this paper involves the implementation of a hybrid approach that focused on a sentiment analyzer to overcome social network challenges and also provided the comparative analysis of different machine learning algorithms. The results indicate improvement while using the combination of RNN with the help of LSTM showed accuracy 87% on the Urdu dataset and 92% on the English dataset.

Controversies about veil and hijab are often occur in society. Especially in today’s digital era, public opinion expressed through social media can greatly influence the others opinions, regardless of whether it is positive or negative. Therefore, this research was aiming to conduct an approach through analysis sentiment of public opinion about the veil and hijab to know how much accurate the sentiment analysis predict the positive, negative, or other sentiments with using Twitter data as the research object. The algorithm used in this study is Support Vector Machine (SVM) because of its fairly good classification model though it trained using small set of data. The SVM on this research was combined with Radial Base Function (RBF) kernel because of its numerical difficulties that are fewer than linear and polynomial kernel and also because this research doesn’t have a large feature. The amount of data used is 3556 tweets data. Tweets data, which is numbered 1056, is classified manually for the learning process. The remaining 2500 data will be classified automatically with the classifier model that has been created. A total of 1056 tweets data that have been classified manually is separated into training and testing data with a ratio of 8: 2. The result of the sentiment analysis process using Support Vector Machine algorithm RBF kernel with C=1 and γ=1 has an accuracy score of 73.6% with precision to negative opinions are 62%, positive opinions are 83%, neutral opinions reach 53% and irrelevant opinions that talk about hijab and veil reach 98%. It shows that sentiment analysis can be used for predicting the negative, positive or other sentiments of a sentence based on a certain topic, in this case veil and hijab.

In the past few decades, the internet has become an inseparable part of human life. It provides ease of access and permeates almost every aspect of human existence. One of the internet platforms that is widely used by people around the world is social media. Apart from being spoiled with the convenience and efficiency offered by social media to support daily life, it has gained popularity among a wide audience. This has positive implications when utilized effectively, but it cannot be denied that there are negative consequences if not utilized properly. One such consequence is the prevalence of cyberbullying activities on social media. Cyberbullying has become a major concern for the public and social media users, prompting researchers to leverage information technology in developing technologies that can identify the elements of cyberbullying, particularly on social media platforms. Sentiment analysis has been employed by researchers to identify the components of cyberbullying in online platforms. Sentiment analysis involves the application of natural language processing techniques and text analysis to identify and extract subjective information from text. This study aims to compare the Naive Bayes algorithm and the Support Vector Machine algorithm, while utilizing feature selection, specifically chi-square, to enhance the accuracy of both algorithms in classifying Instagram comments. The experimental results indicate that the Multinomial Naive Bayes (MNB) algorithm outperforms the Support Vector Machine (SVM) algorithm, achieving an accuracy of 83.85% without feature selection and 90.77% with feature selection. Meanwhile, SVM achieves an accuracy of 82.31% without feature selection and 90% with feature selection. Evaluation through the confusion matrix and classification report reveals that MNB exhibits better precision and recall rates compared to SVM in identifying bullying and non-bullying classes. The use of feature selection enhances the performance of both algorithms in classifying Instagram comments related to cyberbullying.

In the past decades, sentiment analysis has become one of the most active research areas in natural language processing, data mining, web mining, and information retrieval. The great demand in everyday life and the factor of novelty coupled with the availability of data from social networks have served as strong motivation for research on sentiment-analysis. A number of technical problems, most of which had not been attempted before, either in the NLP or linguistics communities have also generated strong research interests in academia. Sentiment analysis, also called opin-ion mining, is the field of study that analyzes people’s opinions, sentiments, apprais-als, attitudes, and emotions toward entities and their attributes expressed in written text. The entities can be products, services, organizations, individuals, events, issues, or topics. The field represents a large problem space. It improves not only the field of natural language processing but also management, political science, economics, and sociology because all these areas are related to the thoughts of consumers and public. User-generated content is full of opinions, because the main reason why people post messages on social media platforms is to express their views and opinions, and therefore sentiment analysis is at the centre of social media analysis. It turned out that user messages often contain plenty of sarcastic expressions and ambiguous words. Within one opinion both positive and negative sentiments can be present. This also applies to negative particles, which do not always indicate a negative tone. This article investigates four challenges faced by researchers while conducting sentiment analysis, namely: sarcasm, negation, word ambiguity, and multipolarity. These aspects significantly affect the accuracy of the results when we determine a sentiment. Modern approaches to solving the problem are also covered. These are mainly machine learning methods, such as convolutional neural networks (CNN), deep neural networks (DNN), long short-term memory (LTSM), recurrent neural network (RNN), support vector machines (SVM), etc.

Abstract—Sentiment analysis is an important part of natural language processing (NLP) and has many applications in social media, e-commerce, and other fields. This study aims to provide a clear distinction between these methodologies by offering a structured overview of sentiment analysis and the variety of techniques used in its execution. The article examines different machine learning algorithms for sentiment analysis and high- lights their advantages and disadvantages by drawing on credible prior research on the subject. Additionally, the study provides a tabular comparison of different machine learning methods by selecting suitable parameters. Keywords: Decision Tree, Support Vector Machine (SVM), Random Forest, Convolution neural network (CNN), Neural network, Long Short-Term Memory Networks (LSTM), BERT

A Review on Reddit News Headlines with NLTK tool

Nowadays, with the increasing number and use of social media platforms, people now share their experiences about a product they have bought or a place they have been to on social media platforms more frequently. Considering the volume of data on social media platforms, it is considered that there is some meaningful information for institutions or companies in the reviews and experiences shared on social media platforms. As such, it is important to improve the methods of extracting meaningful information from the reviews and experiences shared on social media and to know which method is better. In this study, the classification successes of the bag of words and the fastText word representation methods, which are among the word representation methods in sentiment analysis methods mentioned above, were compared by using Turkish reviews performed for touristic places. Besides, while performing the comparison process, it was measured whether the process of separating the words into their roots and negation of the words, which is the preliminary stage of the sentiment analysis process, contributed to the classification success. In the study, both two-class (positive, negative) sentiment analysis and three-class (positive, negative, neutral) sentiment analysis were performed. Six data sets were created to carry out the mentioned comparison operations. The data sets were first classified using the Naive Bayes (NB), Multinomial Naive Bayes (MNB), k-Nearest Neighbor (k-NN) and Support Vector Machines (SVM) algorithms, which are frequently used in text mining, and based on bag of words word representation method, they were classified with WEKA program. After the test results of all data sets were obtained according to the bag of words word representation method, the tests of the fastText word representation method were carried out using the fastText library of the Python programming language. Classification procedures were carried out with 10-fold cross-validation methods, and f-score values of the classification processes were obtained. Finally, it was determined that bag of words word representation method performed a more successful classification than the fastText word representation method in two-class emotion analysis, while the fastText word representation method performed a more successful classification process than bag of words word representation method in three-class emotional analysis. It was observed that the process of separating the words into their roots and negating the words, which are the preliminary processes of sentiment analysis, did not contribute positively or negatively to the classification processes performed with the fastText word representation method. However, it was determined that it had a minor contribution to sentiment analysis processes performed by using bag of words word representation method. In the two-class sentiment analysis, the most successful classification result was achieved by using the machine learning model created with the SVM algorithm with the value of 0.91 f-score employing bag of words word representation method. In the three-class sentiment analysis, the most successful classification result was achieved with the machine learning model created using the fastText word representation method with the value of 0.78 f-score.

In recent times, when we fiddle with innovation particularly with social media, it leads to an increasing change in human conduct. The day-by-day utilization of web-based media by individuals has expanded a lot that it is gradually infusing an expression into our conduct. Particularly, Twitter is generally utilized authoritatively by numerous individuals and is one of only a handful few social media platforms where individuals search for reliable information. The intent of this work is to perform sentiment analysis of the tweets using different Machine Learning algorithms and the BERT model to prevent offensive use of words and give an insight into the emotion of the words in the tweet. The dataset utilized is obtained from Kaggle. The Machine Learning models employed are Support Vector Machine (SVM), Stochastic Gradient Descent (SGD), Logistic Regression, Decision-Tree., Random Forest Method, and XGBoost along with a deep learning architecture BERT for the analysis. A comparative analysis of all the models was carried out and it can be concluded that logistic Regression obtained the highest training and validation accuracy of 82.65% and 81.74%, respectively, and the F1 score of this model was 79.14%. BERT model has an exceptional performance in Natural Language Processing, so BERT was also implemented for the sentimental analysis of the Twitter tweets and it achieved the highest training accuracy, validation accuracy, and F1 score of 94%., 93.63%, and 92.34% respectively.