- Research Article
15
- 10.1016/j.procs.2021.10.008
An Ensemble Technique to Classify Multi-Class Textual Emotion
- Jan 01, 2021
- Procedia Computer Science
- Tanzia Parvin + 1 more +1
An Ensemble Technique to Classify Multi-Class Textual Emotion
Multi-class Sports News Categorization using Machine Learning Techniques: Resource Creation and Evaluation
An Ensemble Technique to Classify Multi-Class Textual Emotion
An Ensemble Technique to Classify Multi-Class Textual Emotion
Supervised Machine Learning Algorithms for Sentiment Analysis of Bangla Newspaper
We can state undoubtedly that Bangla language is rich enough to work with and implement various Natural Language Processing (NLP) tasks. Though it needs proper attention, hardly NLP field has been explored with it. In this age of digitalization, large amount of Bangla news contents are generated in online platforms. Some of the contents are inappropriate for the children or aged people. With the motivation to filter out news contents easily, the aim of this work is to perform document level sentiment analysis (SA) on Bangla online news. In this respect, the dataset is created by collecting news from online Bangla newspaper archive. Further, the documents are manually annotated into positive and negative classes. Composite process technique of “Pipeline” class including Count Vectorizer, transformer (TF-IDF) and machine learning (ML) classifiers are employed to extract features and to train the dataset. Six supervised ML classifiers (i.e. Multinomial Naive Bayes (MNB), K-Nearest Neighbor (K-NN), Random Forest (RF), (C4.5) Decision Tree (DT), Logistic Regression (LR) and Linear Support Vector Machine (LSVM)) are used to analyze the best classifier for the proposed model. There has been very few works on SA of Bangla news. So, this work is a small attempt to contribute in this field. This model showed remarkable efficiency through better results in both the validation process of percentage split method and 10-fold cross validation. Among all six classifiers, RF has outperformed others by 99% accuracy. Even though LSVM has shown lowest accuracy of 80%, it is also considered as good output. However, this work has also exhibited surpassing outcome for recent and critical Bangla news indicating proper feature extraction to build up the model.
Read moreIdentify and predict incorrect prices by Machine Learning Model
Electronic commerce (e-commerce) brings huge advantages to businesses for selling products through multiple online shops. However, companies have difficulties in supervising the prices of products set by different retail shops on e-commerce platforms. Addressing these difficulties, we suggest a method to identify and predict products that sell at incorrect prices using a machine learning model combined price analysis. The study uses four machine learning models: K-nearest Neighbor (KNN), Random Forest (RF), Support Vector Machine (SVM), and Multinomial Naive Bayes (MNB) and two text-based information extraction methods: BoW and TF-IDF to find to the best method. The research results show that the RF model and text-based information extraction method by the BoW provide more average accuracy than other specific models, when experimenting on the filter dataset the average accuracy after 10 runs are RF: 98.06%, SVM: 83.92%, MNB: 92.21%, KNN: 94.06%. Experimental results on the product dataset have an accuracy of RF: 83.02%, SVM: 55%, MNB: 79.33%, KNN: 79.36%.
Read moreA New Classification Algorithm and a New Oversampling Method of Mapping Common Data Elements to the BRIDG Model
The Common Data Elements (CDEs) standard of the International organization for Standardization (ISO) 11179 is commonly used in the field of clinical data processing. The Biomedical Research Integrated Domain Group (BRIDG) model is the framework for biomedical and clinical research. Mapping CDEs to BRIDG (also known as CDE classification) would help with interoperability and data analysis in the field of clinical research. That said, manually mapping CDEs to their corresponding BRIDG class is highly time-consuming and labor-intensive. In this paper we present a new classification algorithm along with a new oversampling method. Our algorithm uses the Term Frequency-Inverse Document Frequency (TF-IDF) as the feature representation method. By assigning different weights to various attributes, we enable more important attributes to perform more important roles during the mapping process. In addition, the oversampling method generates every new attribute in the minor class by picking the length and setting the word of the new attribute according to the existing training set. Our research outcomes demonstrate significant contributions to the field in the following ways: (1) Generation of a new CDE classification algorithm that outperforms existing algorithms in the literature, including the Random Forest Classifier, Linear Support Vector Classification (SVC), Multinomial Naive Bayes (NB), Logistic Regression, and Long Short-Term Memory (LSTM) networks, in terms of accuracy, precision, recall, and F-1 score measures. (2) Generation of a new oversampling method able to improve CDE classification accuracy for Random Forest and Multinomial NB. (3) Our classification algorithm employs two novel attributes, namely “Data Element Preferred Definition” and “Document,” which are more efficient at classifying CDEs than the six attributes traditionally selected by domain experts.
Read moreMulti-label Classification of Legislative Text into EuroVoc
In this paper we present a novel method for the automatic classification of multi-label text documents. In principle, automatic classification of text is usually tackled by supervised Machine Learning techniques like Support Vector Machines (SVM), that typically achieve state-of-the-art accuracy in several domains. Nevertheless, SVM can not handle multi-labeled documents, thus a specific preprocessing of the data is needed. In this paper we present a novel technique for the transformation of multi-label data into mono-label that is able to maintain all the information, allowing the use of standard approaches like SVM. We then evaluate our system using JRC-Acquis-it, a large dataset of italian legislation that has been manually annotated according to EuroVoc, demonstrating the potential of our approach compared to the current state of the art.
Read moreTactically Maximize Game Advantage by Predicting Football Substitutions Using Machine Learning
Football (also known as Soccer), boasts a staggering fan base of 3.5 billion individuals spread across 200 countries, making it the world’s most beloved sport. The widespread adoption of advanced technology in sports has become increasingly prominent, empowering players, coaches, and team management to enhance their performance and refine team strategies. Among these advancements, player substitution plays a crucial role in altering the dynamics of a match. However, due to the absence of proven methods or software capable of accurately predicting substitutions, these decisions are often based on instinct rather than concrete data. The purpose of this research is to explore the potential of employing machine learning algorithms to predict substitutions in Football, and how it could influence the outcome of a match. This study investigates the effect of timely and tactical substitutions in football matches and their influence on the match results. Machine learning techniques such as Logistic Regression (LR), Decision tree (DT), K-nearest Neighbor (KNN), Support Vector Machine (SVM), Multinomial Naïve Bayes (MNB), Random Forest (RF) classifiers were implemented and tested to develop models and to predict player substitutions. Relevant data was collected from the Kaggle dataset, which contains data of 51,738 substitutions from 9074 European league football matches in 5 leagues spanning 6 seasons. Machine learning models were trained and tested using an 80-20 data split and it was observed that RF model provided the best accuracy of over 70% and the best F1-score of 0.65 on the test set across all football leagues. SVM model achieved the best Precision of almost 0.8. However, the worst computation time of up to 2 min was consumed. LR showed some overfitting issues with 100% accuracy in the training set, but only 60% accuracy was obtained for the test set. To conclude, based on the time of substitution and match score-line, it was possible to predict the players who can be substituted, which can provide a match advantage. The achieved results provided an effective way to decide on player substitutions for both the team manager and coaches.
Read moreDesign and Realization of SVM Topic Crawler Based on Incremental Learning
Using information technology such as search engine for collecting and monitoring of network public opinion is a practical and effective method. This paper puts forward an improved algorithm of SVM classifier based on incremental learning online, and then implements a topic crawler system for network public opinion and to grab the public opinion.
Read moreDetection of Bangla Fake News using MNB and SVM Classifier
Fake or fraudulent news is coming into existence in large numbers for various political and commercial causes, which has become common in internet community. People can easily get tainted by any of these fraudulent news for their falsified words that have tremendous effects on the offline community. Therefore interest has increased in research on this topic. Notable work on the identification of false news in English texts as well as other languages except a few in Bangla Language has been carried out. Our work demonstrates the experimental investigation of detecting fake news from Bangla social media, as this area still requires a lot of concentrate. We have utilized two supervised machine learning techniques throughout this research study, Support Vector Machine (SVM) and Multinomial Naive Bayes (MNB) classifiers to recognize Bangla fake news. Term Frequency - Inverse Document Frequency Vectorizer and CountVectorizer has been used as feature extraction. Our suggested system recognizes fake news according to polarity of the related post. Eventually, our research suggests SVM with linear kernel gives a 96.64 percent accuracy overperforming MNB with a 93.32 percent accuracy.
Read moreArtificial intelligence for assessing player partnerships in football matches
The increasing prevalence of advanced technology in sports has empowered athletes, coaches, and team management to elevate their performance and fine-tune team tactics. Notably, player collaborations have emerged as a critical factor in reshaping the dynamics of matches, yet a lack of tools for accurate partnership analysis often leads to instinct-driven decisions rather than data-based insights. The aim of this study is to investigate the potential of harnessing machine learning algorithms to evaluate the significance of player partnerships in football and their potential impact on match out-comes. This study innovatively forecasts player partnership formations in live matches, demonstrating adept management of extensive, unstructured datasets to create a robust solution. It offers valuable insights for coaches to predict and build effective player partnerships, resulting in sustainable advantages for the team. The research utilizes machine learning techniques, including Logistic Regression (LR), Decision Tree (DT), K-nearest Neighbor (KNN), Support Vector Machine (SVM), Multinomial Naïve Bayes (MNB), and Random Forest (RF) classifiers. These models were applied and evaluated to construct models and assess player partnerships. Necessary data was sourced from the Kaggle dataset, which encompasses information on 167,798 player assists from 9,074 European league football matches spanning six seasons across five leagues. Machine learning models underwent training and evaluation through an 80 − 20 data split and further verified through cross-validation to ensure robustness across league datasets. Balanced sampling and k-fold cross-validation were used to mitigate data imbalance and validate model generalization. Notably, the SVM, DT and RF models demonstrated impressive accuracy of 99%, with the highest F1-score of 0.99, encompassing all football leagues. The SVM and RF models also achieved the highest precision, at 0.99, albeit with a relatively longer computation time of up to 60 s. Model performance varied marginally across leagues (± 0.3% standard deviation in accuracy and F1-score), indicating stable predictive behaviour across gameplay variations. Unlike prior studies that analyzed team synchronization or motion dynamics, this work uniquely models player partnerships based on assist-goal frequency patterns and forecasts their continuity across matches using machine learning classifiers. This study provides valuable insights for devising strategies that can confer a competitive edge in matches. The findings offer a practical means for team managers and coaches to make well-informed decisions regarding player partnerships.
Read moreAnalysis Of Sentiment On Twitter Social Media On Public Perception Of Dana Fintech Services In Indonesia
The rapid growth of financial technology (fintech) services in Indonesia has significantly transformed digital transaction behavior, with digital wallets such as DANA becoming widely adopted. Despite high usage rates, public discourse on social media frequently highlights both positive experiences and recurring concerns related to system reliability and data security. Twitter, as a real-time public communication platform, provides a rich source of user-generated content that reflects public perception toward fintech services. This study investigates public sentiment toward DANA fintech services in Indonesia through sentiment analysis of Twitter data using machine learning approaches. Purpose:This study aims to analyze public perception of DANA fintech services based on sentiment expressed on Twitter and to compare the performance of several machine learning classification algorithms in identifying positive, neutral, and negative sentiments in Indonesian-language social media texts. Methods/Study design/approach: The study employs a quantitative descriptive approach using text mining and sentiment analysis techniques. Twitter data were collected via the Twitter API over a specified period and processed through preprocessing stages including text cleaning, tokenization, stopword removal, and stemming. Feature extraction was performed using the Term Frequency–Inverse Document Frequency (TF-IDF) method. Sentiment classification was conducted using Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Random Forest algorithms. Model performance was evaluated using accuracy, precision, recall, and F1-score metrics. Result/Findings:The results indicate that public sentiment toward DANA is predominantly positive, driven by perceptions of transaction convenience and speed, followed by neutral sentiment, while negative sentiment is mainly associated with system disruptions and data security issues. Among the evaluated algorithms, SVM achieved the highest classification accuracy (91.4%), outperforming Random Forest and KNN. These findings demonstrate that SVM is more effective for sentiment classification of short Indonesian-language texts on social media platforms. Novelty/Originality/Value:This study contributes to the growing body of sentiment analysis research in Indonesia by providing empirical evidence on public perception of fintech services using machine learning techniques. By systematically comparing multiple classification algorithms in the context of Indonesian Twitter data, the study offers methodological insights and practical implications for fintech service providers in improving service quality, communication strategies, and user trust.
Read moreIrony Detection in Non-English Tweets
Sentiment analysis is the interpretation and classification of emotions conveyed by text data. While there have been many attempts to classify the sentiment of a given text, there have been few models that can do the same when provided with non-English data exhibiting sarcasm or irony. This paper aims to compare various techniques of sarcasm detection and decide which method works the best for datasets of different sizes and types. The models have been tested on datasets of three different non-English languages - Arabic, French and a Hindi-English code-mix. None of the presented models are language-specific and can be run on data of any language. A comparison between a sub-word model, the usage of Term Frequency–Inverse Document Frequency (TF-IDF) and neural networks, a Long Short-Term Memory (LSTM) model and machine learning techniques such as Nearest Neighbors, Decision Tree, Random Forest, AdaBoost, Naive Bayes (NB), Support Vector Machine (SVM) Linear, SVM radial basis function (RBF), SVM Sigmoid has been performed. The output for each language and model has been evaluated based on their F1-score, accuracy, precision, and recall.
Read moreMachine learning approaches to diagnosis and laterality effects in semantic dementia discourse
Machine learning approaches to diagnosis and laterality effects in semantic dementia discourse
Fake News detection Using Machine Learning
The phenomenon of Fake news is experiencing a rapid and growing progress with the evolution of the means of communication and Social media. Fake news detection is an emerging research area which is gaining big interest. It faces however some challenges due to the limited resources such as datasets and processing and analysing techniques. In this work, we propose a system for Fake news detection that uses machine learning techniques. We used term frequency-inverse document frequency (TF-IDF) of bag of words and n-grams as feature extraction technique, and Support Vector Machine (SVM) as a classifier. We propose also a dataset of fake and true news to train the proposed system. Obtained results show the efficiency of the system. In this work, we propose a system for Fake news detection that uses machine learning techniques. We used term frequency-inverse document frequency (TF-IDF) of bag of words and n-grams as feature extraction technique, and Support Vector Machine (SVM) as a classifier. We propose also a dataset of fake and true news to train the proposed system. Obtained results show the efficiency of the system.
Read moreAutomatic classification of mice vocalizations using Machine Learning techniques and Convolutional Neural Networks
Ultrasonic vocalizations (USVs) analysis is a well-recognized tool to investigate animal communication. It can be used for behavioral phenotyping of murine models of different disorders. The USVs are usually recorded with a microphone sensitive to ultrasound frequencies and they are analyzed by specific software. Different calls typologies exist, and each ultrasonic call can be manually classified, but the qualitative analysis is highly time-consuming. Considering this framework, in this work we proposed and evaluated a set of supervised learning methods for automatic USVs classification. This could represent a sustainable procedure to deeply analyze the ultrasonic communication, other than a standardized analysis. We used manually built datasets obtained by segmenting the USVs audio tracks analyzed with the Avisoft software, and then by labelling each of them into 10 representative classes. For the automatic classification task, we designed a Convolutional Neural Network that was trained receiving as input the spectrogram images associated to the segmented audio files. In addition, we also tested some other supervised learning algorithms, such as Support Vector Machine, Random Forest and Multilayer Perceptrons, exploiting informative numerical features extracted from the spectrograms. The performance showed how considering the whole time/frequency information of the spectrogram leads to significantly higher performance than considering a subset of numerical features. In the authors’ opinion, the experimental results may represent a valuable benchmark for future work in this research field.
Read moreDetermining the Geotechnical Slope Failure Factors via Ensemble and Individual Machine Learning Techniques: A Case Study in Mandi, India
Landslide disaster risk reduction necessitates the investigation of different geotechnical causal factors for slope failures. Machine learning (ML) techniques have been proposed to study causal factors across many application areas. However, the development of ensemble ML techniques for identifying the geotechnical causal factors for slope failures and their subsequent prediction has lacked in literature. The primary goal of this research is to develop and evaluate novel feature selection methods for identifying causal factors for slope failures and assess the potential of ensemble and individual ML techniques for slope failure prediction. Twenty-one geotechnical causal factors were obtained from 60 sites (both landslide and non-landslide) spread across a landslide-prone area in Mandi, India. Relevant causal factors were evaluated by developing a novel ensemble feature selection method that involved an average of different individual feature selection methods like correlation, information-gain, gain-ratio, OneR, and F-ratio. Furthermore, different ensemble ML techniques (Random Forest (RF), AdaBoost (AB), Bagging, Stacking, and Voting) and individual ML techniques (Bayesian network (BN), decision tree (DT), multilayer perceptron (MLP), and support vector machine (SVM)) were calibrated to 70% of the locations and tested on 30% of the sites. The ensemble feature selection method yielded six major contributing parameters to slope failures: relative compaction, porosity, saturated permeability, slope angle, angle of the internal friction, and in-situ moisture content. Furthermore, the ensemble RF and AB techniques performed the best compared to other ensemble and individual ML techniques on test data. The present study discusses the implications of different causal factors for slope failure prediction.
Read more