• Home
  • Search
  • Towards Optimizing Performance of Machine Learning Algorithms on Unbalanced Dataset
  • Cite Icon5
  • https://doi.org/10.5121/csit.2023.131914Copy DOI Icon

Towards Optimizing Performance of Machine Learning Algorithms on Unbalanced Dataset

  • Oct 28, 2023
  • Asitha Thumpati +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Imbalanced data, a common occurrence in real-world datasets, presents a challenge for machine learning classification models. These models are typically designed with the assumption of balanced class distributions, leading to lower predictive performance when faced with imbalanced data. To address this issue, this paper employs data preprocessing techniques, including Synthetic Minority Oversampling Technique (SMOTE) for oversampling and random undersampling, on unbalanced datasets. Additionally, genetic programming is utilized for feature selection to enhance both performance and efficiency. In our experiment, we leverage an imbalanced bank marketing dataset sourced from the UCI Machine Learning Repository. To evaluate the effectiveness of our techniques, we implement it on four different classification algorithms: Decision Tree, Logistic Regression, K-Nearest Neighbors (KNN), and Support Vector Machines (SVM). We compare various evaluation metrics, such as accuracy, balanced accuracy, recall, F-score, Receiver Operating Characteristics (ROC) curve, and Precision-Recall (PR) curve, across different scenarios: unbalanced data, oversampled data, undersampled data, and data cleaned with Tomek-Links. Our findings reveal that all four algorithms demonstrate improved performance when the minority class is oversampled to half the size of the majority class and the majority class is undersampled to match the minority class. Subsequently, applying Tomek-Links on the balanced dataset further enhances performance.

Similar Papers
  • Research Article

Supervised machine learning algorithms for classifications of gender-based violence in Somalia: a comparison of oversampling techniques.

  • May 28, 2026
  • Scientific reports
  • Seyifemickael Amare Yilema +5
  • Research Article
  • Citations2

Evaluating the performance of different machine learning algorithms based on SMOTE in predicting musculoskeletal disorders in elementary school students

  • Oct 02, 2025
  • BMC Medical Research Methodology
  • Sara Manoochehri +4
  • PDF
  • Research Article
  • Citations7

Joint modeling strategy for using electronic medical records data to build machine learning models: an example of intracerebral hemorrhage

  • Oct 25, 2022
  • BMC Medical Informatics and Decision Making
  • Jianxiang Tang +9
  • Research Article

Balanced DATA by DBSCAN and Weighted Arithmetic Mean to Improve Performance of Machine Learning Algorithms

  • Dec 31, 2021
  • Bitlis Eren Üniversitesi Fen Bilimleri Dergisi
  • Serkan Güldal
  • PDF
  • Research Article
  • Citations13

Performance Evaluation of Sentiment Analysis on Balanced and Imbalanced Dataset Using Ensemble Approach

  • May 05, 2022
  • Indian Journal of Science and Technology
  • Shini George +1
  • Research Article

Resampling Techniques for Imbalanced Water Quality Classification

  • Dec 11, 2025
  • PaperASIA
  • Nur Hanisah Abdul Malek +4
  • PDF
  • Research Article
  • Citations125

Stroke Prediction with Machine Learning Methods among Older Chinese.

  • Mar 01, 2020
  • International Journal of Environmental Research and Public Health
  • Yafei Wu +1
  • PDF
  • Research Article
  • Citations138

Severely imbalanced Big Data challenges: investigating data sampling approaches

  • Nov 30, 2019
  • Journal of Big Data
  • Tawfiq Hasanin +3
  • Research Article

A Comparative Study For Imbalanced Data Techniques Of Classification Algorithms

  • Aug 26, 2025
  • Citizen : Jurnal Ilmiah Multidisiplin Indonesia
  • Dede Brahma Arianto +1
  • Research Article
  • Citations1

ENHANCING MEDICARE FRAUD DETECTION THROUGH ML: ADDRESSING CLASS IMBALANCE WITH SMOTE-ENN

  • Jan 01, 2024
  • Industrial Engineering Journal
  • O Ramyateja +3
  • Research Article
  • Citations19

Predicting asthma using imbalanced data modeling techniques: Evidence from 2019 Michigan BRFSS data.

  • Dec 07, 2023
  • PloS one
  • Nirajan Budhathoki +3
  • Research Article
  • Citations2

Resampling Imbalanced Healthcare Data for Predictive Modelling

  • Jan 01, 2025
  • International Journal of Advanced Computer Science and Applications
  • Manoj Yadav Mamilla +2
  • Research Article
  • Citations15

Impact of Data Balancing and Feature Selection on Machine Learning-based Network Intrusion Detection

  • Feb 28, 2023
  • JOIV : International Journal on Informatics Visualization
  • Azhari Shouni Barkah +3
  • Dissertation
  • Citations1

Genetic Programming for Classification with Unbalanced Data

  • Jan 01, 2012
  • Urvesh Bhowan
  • Dissertation
  • Citations1

Genetic Programming for Classification with Unbalanced Data

  • Jan 01, 2012
  • Urvesh Bhowan
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.