Cross Domain Sentiment Analysis Using Different Machine Learning Techniques

The Kampus Merdeka program, launched by the Indonesian Ministry of Education, Culture, Research, and Technology in 2020, aims to enhance students' skills through hands-on work experience. Considering the rising significance of social media, particularly Twitter, in gauging public opinion, this research focuses on analyzing the sentiment towards the Kampus Merdeka program. The primary objective is to classify the sentiments expressed in tweets related to the program and compare two feature extraction techniques—TF-IDF and FastText—to identify the best approach for transforming text data into numerical vectors. The sentiment classification model was built using the Support Vector Machine (SVM) algorithm, a machine learning technique known for its accuracy in text classification. A total of 16,730 tweets were collected and analyzed, yielding an accuracy of 73% for FastText and 72% for TF-IDF. Results show that FastText is more effective in capturing semantic relationships, leading to higher accuracy in sentiment classification. Findings indicate that the public sentiment towards the Kampus Merdeka program is predominantly positive (60.7%), with negative and neutral sentiments at 33.5% and 5.8%, respectively. The success of the FastText method underscores the importance of advanced feature extraction techniques in text classification. The novelty of this research lies in its use of FastText for educational policy evaluation, providing a new perspective on using sentiment analysis to assess public perception of educational programs.

The rapid growth of financial technology (fintech) services in Indonesia has significantly transformed digital transaction behavior, with digital wallets such as DANA becoming widely adopted. Despite high usage rates, public discourse on social media frequently highlights both positive experiences and recurring concerns related to system reliability and data security. Twitter, as a real-time public communication platform, provides a rich source of user-generated content that reflects public perception toward fintech services. This study investigates public sentiment toward DANA fintech services in Indonesia through sentiment analysis of Twitter data using machine learning approaches. Purpose:This study aims to analyze public perception of DANA fintech services based on sentiment expressed on Twitter and to compare the performance of several machine learning classification algorithms in identifying positive, neutral, and negative sentiments in Indonesian-language social media texts. Methods/Study design/approach: The study employs a quantitative descriptive approach using text mining and sentiment analysis techniques. Twitter data were collected via the Twitter API over a specified period and processed through preprocessing stages including text cleaning, tokenization, stopword removal, and stemming. Feature extraction was performed using the Term Frequency–Inverse Document Frequency (TF-IDF) method. Sentiment classification was conducted using Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Random Forest algorithms. Model performance was evaluated using accuracy, precision, recall, and F1-score metrics. Result/Findings:The results indicate that public sentiment toward DANA is predominantly positive, driven by perceptions of transaction convenience and speed, followed by neutral sentiment, while negative sentiment is mainly associated with system disruptions and data security issues. Among the evaluated algorithms, SVM achieved the highest classification accuracy (91.4%), outperforming Random Forest and KNN. These findings demonstrate that SVM is more effective for sentiment classification of short Indonesian-language texts on social media platforms. Novelty/Originality/Value:This study contributes to the growing body of sentiment analysis research in Indonesia by providing empirical evidence on public perception of fintech services using machine learning techniques. By systematically comparing multiple classification algorithms in the context of Indonesian Twitter data, the study offers methodological insights and practical implications for fintech service providers in improving service quality, communication strategies, and user trust.

Sentimental Analysis (SA) becomes a familiar topic among business people, which is commonly applied for the classification of sentiments from online reviews. It is generally treated as a sentiment classification (SC) problem where the online reviews are categorized into positive or negative polarities using the words that exist in the online reviews. With this motivation, this paper presents a new K-means clustering with hybrid metaheuristic algorithm (KMC-HMA) for SA and classification. The proposed KMC-HMA technique initially performs data preprocessing to remove the unwanted words from the product reviews. In addition, K-means clustering technique is used for the clustering of the massive quantity of the applied product reviews. Moreover, the clustered data are fed into the classification model based on hybrid ant colony optimization (ACO) with dragonfly algorithm (DFA). The ACO algorithm is used for the classification of product reviews and the performance of the ACO algorithm can be optimally tuned by the use of DFA. The performance validation of the KMC-HMA technique is validated using two datasets such as Canon and ipod. The experimental values pointed out the superior performance of the KMC-HMA technique over the recent state of art techniques.

The principal aim of e-commerce systems is to improve the consumer experience, with customer input being essential to this objective. This study introduces an innovative method for analysing tweet data to enhance customer happiness. Key tweet features were retrieved to capture the sentiment expressed in customer tweets by utilising a combination of n-gram models and word embeddings. The features were subsequently employed to construct classification models utilising Support Vector Machines (SVM) and Artificial Neural Networks (ANN), both of which are frequently applied in sentiment analysis. A model based on Convolutional Neural Networks (CNN) was proposed to enhance the accuracy of classifying sentiment by categorizing tweets as either positive or negative. The study's results indicated that the CNN model surpassed both the SVM and ANN models, exhibiting more accuracy in sentiment classification of tweets. In addition to its precision, the CNN model offered significant insights into the interrelations among different tweet categories, enhancing comprehension of client mood and views. This extensive study underscores the need of understanding the complexities of customer feedback to improve e-commerce strategies and consumer delight as well as the efficiency of the CNN model for sentiment categorisation. By means of exact classification and analysis of sentiment in real-time twitter data, e-commerce systems may more successfully evaluate customer impressions and react dynamically to enhance their whole experience.

ABSTRACTWith diverse online media emerging, there is a growing concern of sentiment classification problem. At present, text sentiment classification mainly utilizes supervised machine learning methods, which feature certain domain dependency. On the basis of Markov logic networks (MLNs), this study proposed a cross-domain multi-task text sentiment classification method rooted in transfer learning. Through many-to-one knowledge transfer, labeled text sentiment classification, knowledge was successfully transferred into other domains, and the precision of the sentiment classification analysis in the text tendency domain was improved. The experimental results revealed the following: (1) the model based on a MLN demonstrated higher precision than the single individual learning plan model. (2) Multi-task transfer learning based on Markov logical networks could acquire more knowledge than self-domain learning. The cross-domain text sentiment classification model could significantly improve the precision and efficiency of text sentiment classification.

Sentiment analysis is widely used today to make data-driven decisions in different industries, starting from marketing and including brand management, reputation monitoring, and customer satisfaction analysis. Its growing importance is closely linked with so-called ‘word-of-mouth’ communication, from reading online reviews to writing comments on social networks. Effective separation of sentiments ensures that companies' responses are timely and critical patterns are seen in big data sets. Statistical measures, information gain, correlation-based approaches, etc, have been employed for the feature selection. Still, the problem associated with text data mining is that they don’t convey the text's relative difficulty and additional features. To fill this gap, our research proposes a new feature selection technique through Ant Colony Optimization (ACO) and K Nearest Neighbour (KNN) performed on 28,000 customer reviews in different product categories. The results, therefore, showed an overall accuracy of 80.1%, with the Support Vector Machine (SVM) set at 80.5% on each selected feature, which was slightly higher than the Convolutional Neural Network (CNN), which scored a 78.41% accuracy. SVM remains on the mark of 83%, and for CNN, the rate achieved on the same was 80.8% when both were applied to the entire dataset. These facts rejected the infallibility of the simple and complex algorithms used singly in the sentiment classification, indicating that more sophisticated algorithms like ACO and KNN can provide business solutions to improve their service delivery based on customers’ feedback.

User reviews on gaming platforms such as Steam have become a crucial source of information for potential players before making purchasing decisions. Due to the varied nature of user opinions, sentiment analysis is essential for processing and interpreting these reviews. This study investigates the application of sentiment analysis to RPG game reviews on Steam, aiming to assist users by summarizing reviews through sentiment results and providing insights into the general perception of a game. To achieve this, the study applies sentiment analysis using Word2Vec and Support Vector Machine (SVM). It focuses on evaluating the impact of lemmatization during preprocessing and analyzing the performance of Word2Vec in sentiment classification. Word2Vec transforms review text into vector representations that capture semantic relationships, enhancing the model’s ability to understand context. Meanwhile, SVM is chosen as the classifier for its effectiveness in distinguishing between positive and negative reviews and handling high-dimensional data. The system developed uses Word2Vec with 300-dimensional vectors combined with an SVM Polynomial classifier, resulting in the best performance among the tested models. The final model achieves a macro-average F1-score of 88.6%, indicating a strong capability in accurately classifying sentiments in user reviews. These results highlight the potential of combining word embedding and machine learning techniques for analyzing sentiment in gaming platforms. Keywords: sentiment analysis, Word2Vec, SVM, Steam, RPG

Transfer learning aims to extract the knowledge from a label-rich source domain to enhance the predictive model of a target domain. Previous methods achieve knowledge transfer by detecting a shared low-dimensional feature representation from source domain to target domain. Along this line, many algorithms, e.g., dual transfer learning (DTL), triplex transfer learning (TRi-TL) etc., have been proposed and widely used for text classification. However, we argue that it is difficult for models to distinguish exactly the common concepts or identical concepts across different domains through the existing algorithms, even though source and target domains are related but different. So we propose to use the similar feature clusters as knowledge transfer, that is, we only guarantee the approximate similarity of common word clusters across different domains, rather than the exactly same. Based on the above assumption, the derived association matrices between word clusters and document classes should be slightly different to account for the word clusters variations. To take the above assumptions into account, we propose a novel Nonnegative Matrix Tri-Factorization based transfer learning by linking similar feature clusters (LSF-TL) for sentiment classification, in which an approximate constraint between similar word clusters matrices is added to allow differences while keeping the knowledge transferring function. Besides, LSF-TL also provides the same approximate constraint for the derived clusters association matrices. Then we employ an iterative updating algorithm with sound theoretical proof to find the local optimal solution. Last, we evaluate our method by conducting extensive experiments on Amazon product reviews. The results show that our approach achieves better classification accuracy than the state-of-the-art methods for both Cross-lingual sentiment classification(CLSC) and Cross-lingual cross-domain sentiment classification(CLCDSC) tasks.

Sentiment analysis of online reviews for electric vehicles using the SMAA-2 method and interval type-2 fuzzy sets

The exponential growth of social media platforms such as Twitter has led to an immense amount of user-generated data, providing valuable insights into public opinion. Sentiment analysis, a subfield of Natural Language Processing (NLP), helps categorize user sentiments as positive, negative, or neutral. However, traditional approaches often face limitations in accuracy due to inefficient feature extraction and data noise. This study proposes a hybrid optimization-based sentiment classification model that combines the Genetic Algorithm (GA) and Grey Wolf Optimizer (GWO) for efficient feature selection. The extracted features are then classified using a voting ensemble model integrating K-Nearest Neighbor (KNN), Support Vector Machine (SVM), and Decision Tree classifiers. The model is trained and tested on real-time Twitter data collected via the Twitter API, following preprocessing steps such as tokenization, stop-word removal, and lemmatization. Experimental evaluation demonstrates that the proposed hybrid model achieves a classification accuracy of approximately 99%, outperforming existing machine learning models. The results confirm that the integration of GA-GWO optimization with ensemble classification enhances sentiment detection accuracy and robustness in large-scale social media datasets.

Online social media is used to show the sentiments of different individuals about various subjects. Sentiment analysis or opinion mining has recently been considered as one of the highly dynamic research fields in natural language processing, Web mining, and machine learning. There has been a very limited amount of research that focuses on sentiment analysis in the Malay language. This study investigates how feature selection methods contribute to the improvement of Malay sentiment classification performance. Three supervised machine-learning classifiers and seven feature selection methods are used to conduct a series of experiments for the effective selection of the appropriate methods for the automatic sentiment classification of online Malay-written reviews. Findings show that the classifications of Malay sentiment improve using feature selections approaches. This work demonstrates that all feature reduction methods generally improve classifier performance. Support Vector Machine (SVM) approach provide the highest accuracy performance of features selection in order to classify Malay sentiment comparing with other classifications approaches such as PCA and CHI square. SVM records 87% as experimental accuracy result of feature selection.

Sentiment analysis is a process to determine the content of text-based datasets which are positive or negative. At present, public opinion be an important resource in the decision of a person in finding a solution. Classification algorithms such as Support Vector Machine (SVM) and K-Nearest Neighbor (K-NN) is proposed by many researchers to be used in sentiment analysis for review opinion. The problem in this research is the selection of feature selection to improve accuracy values Support Vector Machine (SVM) and K-Nearest Neighbor (K-NN) and compare the highest accuracy for sentiment analysis review public opinion about the news of forest fires. The comparison algorithms, SVM produces an accuracy of 80.83% and AUC 0.947, then compared with SVM based on PSO with an accuracy of 87.11% and AUC 0.922. The test result data for K-NN algorithm accuracy was 85.00% and the AUC 0.918, then compared for accuracy by k-NN-based PSO amounted to 73.06% and the AUC 0.500. The results of the testing of the PSO algorithm can improve the accuracy of SVM, but are not able to improve the accuracy of the algorithm K-NN. SVM algorithm based on PSO proven to provide solutions to the problems of classification review news opinion forest fires in order to more accurately and optimally.

With the rapid increase of the number of Internet users and the amount of online comment data, a large number of referable information samples are provided for data mining technology. As a technical application of data mining, text sentiment classification can be widely used in public opinion management, marketing, and other fields. In this study, a combination approach to SVM (support vector machine) and IPSO (improved particle swarm optimization) is proposed to classify sentiment by using text data. First, the text data of 30,000 goods reviews and corresponding ratings are collected through the web crawler. Then, TFIDF (term frequency-inverse document frequency) and Word2vec are used to vectorize the goods review text data. Next, the proposed classification model is trained by the SVM, and the initial parameters of the SVM are optimized by the IPSO. Finally, we applied the trained SVM-IPSO model to the test set and evaluated the performance by several measures. Our experiment results indicate that the proposed model performed the best for text data sentiment classification. Additionally, the traditional machine learning model SVM becomes very effective after parameter optimization, which demonstrates that the parameters’ optimization by IPSO has successfully improved the classification accuracy. Furthermore, our proposed model SVM-IPSO significantly outperforms other benchmark models, indicating that it could be applied to improve the accuracy and efficiency for text data sentiment classification.

Public opinion is important for decision-making on numerous occasions for national growth in democratic countries like Bangladesh, the USA, and India. Sentiment analysis is a technique used to determine the polarity of opinions expressed in a text. The more complex stage of sentiment analysis is known as Aspect-Based Sentiment Analysis (ABSA), where it is possible to ascertain both the actual topics being discussed by the speakers as well as the polarity of each opinion. Nowadays, people leave comments on a variety of websites, including social networking sites, online news sources, and even YouTube video comment sections, on a wide range of topics. ABSA can play a significant role in utilizing these comments for a variety of objectives, including academic, commercial, and socioeconomic development. In English and many other popular European languages, there are many datasets for ABSA, but the Bengali language has very few of them. As a result, ABSA research on Bengali is relatively rare. In this paper, we present a Bengali dataset that has been manually annotated with five aspects and their corresponding sentiment. A baseline evaluation was also carried out using the Bidirectional Encoder Representations from Transformers (BERT) model, with 97% aspect detection accuracy and 77% sentiment classification accuracy. For aspect detection, the F1-score was 0.97 and for sentiment classification, it was 0.77.

The rapid evolution of digital technology has significantly transformed the financial services landscape, especially in the realm of mobile banking. BCA Mobile stands among the most popular apps for digital banking in Indonesia. Despite its widespread adoption, user reviews reflect diverse viewpoints and sentiments about the app. The objective of this research is to examine the user sentiments regarding the BCA Mobile app, based on reviews sourced from the Google Play Store and App Store. Two classification models, namely Support Vector Machine (SVM) and K-Nearest Neighbour (K-NN), are used in the analysis process. The collected review data undergoes several pre-processing stages and is labeled automatically using a Lexicon-Based technique. For feature weighting, the TF-IDF (Term Frequency-Inverse Document Frequency) approach is used.. Sentiment classification is then carried out using both K-NN and SVM, with performance evaluated through a matrix of confusion based on measurements like F1-score, recall, accuracy, and precision. The findings show that the SVM algorithm outperforms K-NN in terms of performance, with an accuracy of 94%, while K-NN achieves an accuracy of 82%. This study offers valuable insights for BCA management in understanding user sentiment and enhancing service quality through the application of artificial intelligence