An Ensemble Technique to Classify Multi-Class Textual Emotion

Multi-class Sports News Categorization using Machine Learning Techniques: Resource Creation and Evaluation

Emotion analysis from Bengali text data is challenging due to the intricate structure of the language itself and lack of resource availability tailored to Sentiment Classification. In this paper, the authors have used machine learning algorithms, particularly Gaussian Naive Bayes and Support Vector Machine, for the classification of six emotions in Bengali text. The data is comprehensively pre-processed through segmentation, emoticon handling, removal of stop words, and stemming. It uses feature selection techniques like unigram, bi-gram, and term frequency-inverse document frequency to improve classification accuracy. The main aim of the paper is to present an in-depth analysis of emotion detection in Bengali text, which would be very helpful to scholars working on NLP problems in non-English languages. This research, hence, fills up the gap in emotion analysis research for Bengali text, which has comparatively remained underexplored compared to other languages. The methodology involves dataset preparation, extensive preprocessing, feature extraction with selection, and classification. After rigorous experimentation, the accuracy attained with the GNB classifier is 93.83%, proving the effectiveness of the proposed model in capturing subtle emotional nuances in Bengali text.

Electronic commerce (e-commerce) brings huge advantages to businesses for selling products through multiple online shops. However, companies have difficulties in supervising the prices of products set by different retail shops on e-commerce platforms. Addressing these difficulties, we suggest a method to identify and predict products that sell at incorrect prices using a machine learning model combined price analysis. The study uses four machine learning models: K-nearest Neighbor (KNN), Random Forest (RF), Support Vector Machine (SVM), and Multinomial Naive Bayes (MNB) and two text-based information extraction methods: BoW and TF-IDF to find to the best method. The research results show that the RF model and text-based information extraction method by the BoW provide more average accuracy than other specific models, when experimenting on the filter dataset the average accuracy after 10 runs are RF: 98.06%, SVM: 83.92%, MNB: 92.21%, KNN: 94.06%. Experimental results on the product dataset have an accuracy of RF: 83.02%, SVM: 55%, MNB: 79.33%, KNN: 79.36%.

Background and aimsThe birth weight of a newborn is a crucial factor that affects their overall health and future well-being. Low birth weight (LBW) is a widespread global issue, which the World Health Organization defines as weighing less than 2,500 g. LBW can have severe negative consequences on an individual’s health, including neonatal mortality and various health concerns throughout their life. To address this problem, this study has been conducted using BDHS 2017–2018 data to uncover important aspects of LBW using a variety of machine learning (ML) approaches and to determine the best feature selection technique and best predictive ML model.MethodsTo pick out the key features, the Boruta algorithm and wrapper method were used. Logistic Regression (LR) used as traditional method and several machine learning classifiers were then used, including, DT (Decision Tree), SVM (Support Vector Machine), NB (Naïve Bayes), RF (Random Forest), XGBoost (eXtreme Gradient Boosting), and AdaBoost (Adaptive Boosting), to determine the best model for predicting LBW. The model’s performance was evaluated based on the specificity, sensitivity, accuracy, F1 score and AUC value.ResultsResult shows, Boruta algorithm identifies eleven significant features including respondent’s age, highest education level, educational attainment, wealth index, age at first birth, weight, height, BMI, age at first sexual intercourse, birth order number, and whether the child is a twin. Incorporating Boruta algorithm’s significant features, the performance of traditional LR and ML methods including DT, SVM, NB, RF, XGBoost, and AB were evaluated where LR, had a specificity, sensitivity, accuracy and F1 score of 0.85, 0.5, 85.15% and 0.915. While the ML methods DT, SVM, NB, RF, XGBoost, and AB model’s respective accuracy values were 85.35%, 85.15%, 84.54%, 81.18%, and 84.41%. Based on the specificity, sensitivity, accuracy, F1 score and AUC, RF (specificity = 0.99, sensitivity = 0.58, accuracy = 85.86%, F1 score = 0.9243, AUC = 0.549) outperformed the other methods. Both the classical (LR) and machine learning (ML) models’ performance has improved dramatically when important characteristics are extracted using the wrapper method. The LR method identified five significant features with a specificity, sensitivity, accuracy and F1 score of 0.87, 0.33, 87.12% and 0.9309. The region, whether the infant is a twin, and cesarean delivery were the three key features discovered by the DT and RF models, which were implemented using the wrapper technique. All three models had the identical F1 score of 0.9318. However, “child is twin” was recognized as a significant feature by the SVM, NB, and AB models, with an F1 score of 0.9315. Ultimately, with an F1 score of 0.9315, the XGBoost model recognized “child is twin” and “age at first sex” as relevant features. Random Forest again beat the other approaches in this instance.ConclusionsThe study reveals Wrapper method as the optimal feature selection technique. The ML method outperforms traditional methods, with Random Forest (RF) being the most effective predictive model for Low-Birth-Weight prediction. The study suggests that policymakers in Bangladesh can mitigate low birth weight newborns by considering identified risk factors.

Artificial intelligence methods reliably predict crop evapotranspiration with different combinations of meteorological data for sugar beet in a semiarid area

Emotion recognition plays a pivotal role in advancing Human-Computer Interaction (HCI) by enabling systems to understand and respond to human emotional states. Among various modalities, Speech Emotion Recognition (SER) stands out as a non-invasive, cost-effective, and temporally efficient approach for detecting emotions. This study leverages the RAVDESS dataset, which provides high-quality audio recordings for emotion classification. The proposed methodology involves preprocessing audio signals to remove noise, extracting temporal and spectral features in both time and frequency domains, and implementing machine learning models for multi-class emotion classification. The study evaluates and compares the performance of several classification models, including Random Forest (RF), Multilayer Perceptron (MLP), Support Vector Machine (SVM), Convolutional Neural Networks (CNN), and Decision Trees (DT). Experimental results demonstrate promising accuracy levels, highlighting the potential of these machine learning techniques in SER. This research contributes to the integration of SER within Brain-Computer Interfaces (BCI) and other emotion-aware applications, paving the way for enhanced interactive systems. Keywords – Speech Emotion Recognition -Machine Learning - Random Forest -Multilayer Perceptron - Support Vector Machine - Convolutional Neural Networks - Decision Tree - RAVDESS Dataset

Developing effective strategies to predict areas susceptible to landslides and reducing risk is vital. This involves using ensemble methods to meet the precise prediction and addressing challenges like data limitation. Recent studies have highlighted the potential of using ensemble methods to enhance the prediction of landslide susceptibility maps (LSM). Ensemble methods present a sampling of landslides and non-landslide points from high and low susceptible areas, respectively. Extensive research has explored their application in machine learning processes, particularly in classification-related problems. This study delves into strategies of ensemble as a promising method in future landslide applications. The proposed method was tested considering Kangra district of Himachal Pradesh as study area where three datasets were prepared consisting of presence and absence points. Dataset 1 consisted of initial landslide and randomly generated non-landslide points. In dataset 2, additional landslide points obtained from the very high susceptibility of initial LSM were supplemented with initial landslide data, while the non-landslide points were generated randomly from the study area. Finally, dataset 3 was composed of the landslide points as in dataset 2, and the non-landslide points were obtained from the very low susceptible areas of initial LSM. These datasets are used with random forest (RF) and support vector machine (SVM), thereby preparing six landslide susceptibility maps. To analyze the applicability of the proposed method, we have used metrics such as AUC-ROC, precision, recall, F-score, accuracy and Mathew's correlation coefficient (MCC). The AUC for dataset 1 with SVM and RF is 0.89, which increased to 0.898 and 0.952 for datasets 2 and 3 with SVM and 0.937 and 0.954 with RF. Among all the methods, the precision and recall values were highest for dataset 3 with SVM as well as RF. Hence, based on several accuracy metrics, we conclude that when the landslides and non-landslides samples were sampled from very high and very low susceptible areas respectively, the LSM performed better than all the other methods. Sampling landslides from very high susceptible areas only (dataset 2) does not perform well thereby committing misclassification error. The study demonstrated that the landslide and non-landslide data were obtained from very high and very low susceptibility; the predictive capability of the LSM increased significantly. Thus, the results demonstrate the effectiveness of the proposed ensemble approach in providing precise delineation of landslide zones, facilitating informed decision-making for land and hazard management.

The DepSign-LT-EDI-ACL2022 shared task focuses on early prediction of severity of depression over social media posts. The BioNLP group at Department of Data Science and Engineering in Indian Institute of Science Education and Research Bhopal (IISERB) has participated in this challenge and submitted three runs based on three different text mining models. The severity of depression were categorized into three classes, viz., no depression, moderate, and severe and the data to build models were released as part of this shared task. The objective of this work is to identify relevant features from the given social media texts for effective text classification. As part of our investigation, we explored features derived from text data using document embeddings technique and simple bag of words model following different weighting schemes. Subsequently, adaptive boosting, logistic regression, random forest and support vector machine (SVM) classifiers were used to identify the scale of depression from the given texts. The experimental analysis on the given validation data show that the SVM classifier using the bag of words model following term frequency and inverse document frequency weighting scheme outperforms the other models for identifying depression. However, this framework could not achieve a place among the top ten runs of the shared task. Here we will describe the potential of the proposed framework as well as the possible reasons behind mediocre performance on the given data.

The increasing prevalence of advanced technology in sports has empowered athletes, coaches, and team management to elevate their performance and fine-tune team tactics. Notably, player collaborations have emerged as a critical factor in reshaping the dynamics of matches, yet a lack of tools for accurate partnership analysis often leads to instinct-driven decisions rather than data-based insights. The aim of this study is to investigate the potential of harnessing machine learning algorithms to evaluate the significance of player partnerships in football and their potential impact on match out-comes. This study innovatively forecasts player partnership formations in live matches, demonstrating adept management of extensive, unstructured datasets to create a robust solution. It offers valuable insights for coaches to predict and build effective player partnerships, resulting in sustainable advantages for the team. The research utilizes machine learning techniques, including Logistic Regression (LR), Decision Tree (DT), K-nearest Neighbor (KNN), Support Vector Machine (SVM), Multinomial Naïve Bayes (MNB), and Random Forest (RF) classifiers. These models were applied and evaluated to construct models and assess player partnerships. Necessary data was sourced from the Kaggle dataset, which encompasses information on 167,798 player assists from 9,074 European league football matches spanning six seasons across five leagues. Machine learning models underwent training and evaluation through an 80 − 20 data split and further verified through cross-validation to ensure robustness across league datasets. Balanced sampling and k-fold cross-validation were used to mitigate data imbalance and validate model generalization. Notably, the SVM, DT and RF models demonstrated impressive accuracy of 99%, with the highest F1-score of 0.99, encompassing all football leagues. The SVM and RF models also achieved the highest precision, at 0.99, albeit with a relatively longer computation time of up to 60 s. Model performance varied marginally across leagues (± 0.3% standard deviation in accuracy and F1-score), indicating stable predictive behaviour across gameplay variations. Unlike prior studies that analyzed team synchronization or motion dynamics, this work uniquely models player partnerships based on assist-goal frequency patterns and forecasts their continuity across matches using machine learning classifiers. This study provides valuable insights for devising strategies that can confer a competitive edge in matches. The findings offer a practical means for team managers and coaches to make well-informed decisions regarding player partnerships.

Flood susceptibility mapping using a novel ensemble weights-of-evidence and support vector machine models in GIS

In the past few decades, the internet has become an inseparable part of human life. It provides ease of access and permeates almost every aspect of human existence. One of the internet platforms that is widely used by people around the world is social media. Apart from being spoiled with the convenience and efficiency offered by social media to support daily life, it has gained popularity among a wide audience. This has positive implications when utilized effectively, but it cannot be denied that there are negative consequences if not utilized properly. One such consequence is the prevalence of cyberbullying activities on social media. Cyberbullying has become a major concern for the public and social media users, prompting researchers to leverage information technology in developing technologies that can identify the elements of cyberbullying, particularly on social media platforms. Sentiment analysis has been employed by researchers to identify the components of cyberbullying in online platforms. Sentiment analysis involves the application of natural language processing techniques and text analysis to identify and extract subjective information from text. This study aims to compare the Naive Bayes algorithm and the Support Vector Machine algorithm, while utilizing feature selection, specifically chi-square, to enhance the accuracy of both algorithms in classifying Instagram comments. The experimental results indicate that the Multinomial Naive Bayes (MNB) algorithm outperforms the Support Vector Machine (SVM) algorithm, achieving an accuracy of 83.85% without feature selection and 90.77% with feature selection. Meanwhile, SVM achieves an accuracy of 82.31% without feature selection and 90% with feature selection. Evaluation through the confusion matrix and classification report reveals that MNB exhibits better precision and recall rates compared to SVM in identifying bullying and non-bullying classes. The use of feature selection enhances the performance of both algorithms in classifying Instagram comments related to cyberbullying.

In this work, we are attempting emotion classification in view of synthesizing story speech. We are proposing emotion-specific text features (ESF) for classifying sentences from children stories into five different emotion categories: happy, sad, anger, fear and neutral. ESF is a five dimensional feature vector, where each dimension corresponds to weight of the sentence according to each emotion class. The dataset consists of 780 Hindi emotional sentences collected from children stories belonging to three genres: fable, folk-tale and legend. Part-of-speech (POS) and proposed ESF are used as features for emotion classification. Emotion classification performance is analysed using various combinations of features with three classifiers: Naive Bayes (NB), k-nearest neighbour (KNN) and support vector machine (SVM). The effectiveness of classifiers is analysed using precision, recall, F-measure and accuracy. The classification performance of 67.9% and 67.2% is achieved using POS and ESF respectively. The fusion of both features resulted an accuracy of 71.1%. Further, the importance of story genre information in emotion classification was observed from the experiments conducted on classifying emotions within story genre. An accuracy of 73.7% was observed after adding story genre information to the fusion of POS and ESF. SVM models outperformed other models in terms of classification accuracy.

We can state undoubtedly that Bangla language is rich enough to work with and implement various Natural Language Processing (NLP) tasks. Though it needs proper attention, hardly NLP field has been explored with it. In this age of digitalization, large amount of Bangla news contents are generated in online platforms. Some of the contents are inappropriate for the children or aged people. With the motivation to filter out news contents easily, the aim of this work is to perform document level sentiment analysis (SA) on Bangla online news. In this respect, the dataset is created by collecting news from online Bangla newspaper archive. Further, the documents are manually annotated into positive and negative classes. Composite process technique of “Pipeline” class including Count Vectorizer, transformer (TF-IDF) and machine learning (ML) classifiers are employed to extract features and to train the dataset. Six supervised ML classifiers (i.e. Multinomial Naive Bayes (MNB), K-Nearest Neighbor (K-NN), Random Forest (RF), (C4.5) Decision Tree (DT), Logistic Regression (LR) and Linear Support Vector Machine (LSVM)) are used to analyze the best classifier for the proposed model. There has been very few works on SA of Bangla news. So, this work is a small attempt to contribute in this field. This model showed remarkable efficiency through better results in both the validation process of percentage split method and 10-fold cross validation. Among all six classifiers, RF has outperformed others by 99% accuracy. Even though LSVM has shown lowest accuracy of 80%, it is also considered as good output. However, this work has also exhibited surpassing outcome for recent and critical Bangla news indicating proper feature extraction to build up the model.

Though large amounts of work with artificial intelligence are used in typhoon rainfall forecasting, the predictive skills of existing models are unsatisfactory. To address this problem, this study aims to propose an improved cluster‐wise typhoon rainfall forecasting model that integrates the grid‐search cross‐validation method with machine learning and deep learning (DL) models including support vector machine (SVM), random forest (RF), adaptive boosting (AdaBoost), convolutional neural network (CNN), and long short‐term memory (LSTM). Grid‐search cross‐validation is a modified parameterization technique that helps to find the best parameters for machine/DL models. In the first stage, a second‐order polynomial regression model was used to cluster the typhoon track; and in the second stage, cluster‐wise typhoon rainfall was recognized within a 500 km radius from each typhoon center. After that, a modified cluster‐wise typhoon rainfall forecasting model was proposed using cluster‐wise antecedent hourly typhoon rainfall within this distance for 1–6 hr lead time. Results show that the proposed model based on the SVM, RF, AdaBoost, CNN, and LSTM is capable of providing more accurate forecasts (the efficiency of the forecast is increased by 45%–90%) than the existing typhoon rainfall forecasting models that are based on SVM with a genetic algorithm, RF, artificial neural network, multilayer perceptron network, and deep neural network. Therefore, the current study recommends using cluster‐wise typhoon rainfall forecasting model with a grid‐search cross‐validation method for disaster prevention and mitigation.

As the Chinese population continues to age, the prevalence of gastric ulcers, a common nutrition and diet-related disorder, is rising among the elderly. Gastric ulcers pose a significant public health challenge in China, yet there is limited research to predict gastric ulcers accurately. Our study aims to employ machine learning algorithms to predict the occurrence of gastric ulcers and develop an online tool to assess the risk of gastric ulcers for elderly individuals, both currently and in the future, while identifying important predictors. We used baseline data from the Chinese Longitudinal Healthy Longevity Survey in 2011 and 2014, with a follow-up endpoint of 2018. We employed nine machine learning algorithms to construct predictive models for gastric ulcers over the next seven years (2011-2018, with 1482 samples) and the next three years (2014-2018, with 2659 samples). Additionally, we utilized cross-sectional data from 2018 (with 13,775 samples) to construct a predictive model for current gastric ulcers. Noninvasive predictors such as demographic, behavioral, nutritional, and physical examination factors were utilized to predict the current and future occurrence of gastric ulcers. In our study, Support Vector Machine (SVM), Random Forest (RF), and Light Gradient Boosting Machine (LGBM) achieved an accuracy of 0.97 for predicting gastric ulcers over seven years; Logistic Regression, Adaptive Boosting, SVM, RF, Gradient Boosting Machine, LGBM, and K-Nearest Neighbors reached 0.98 for three-year predictions; and SVM, Extreme Gradient Boosting, RF, and LGBM attained 0.95 for current gastric ulcer prediction. We developed MyGutRisk, built on optimal machine learning models, relatively accurately predicts gastric ulcer risk in elderly adults using noninvasive factors like diet and lifestyle. It supports self-assessment via a public link and clinical screening in community health settings to guide preventive measures. However, as a prototype, it requires further validation to ensure accuracy and generalizability across diverse populations and real-world applications.