• Home
  • Search
  • A Method for Analyzing the Performance Impact of Imbalanced Binary Data on Machine Learning Models
  • Cite Icon39
  • https://doi.org/10.3390/axioms11110607Copy DOI Icon

A Method for Analyzing the Performance Impact of Imbalanced Binary Data on Machine Learning Models

  • Nov 1, 2022
  • Axioms
  • Ming Zheng +5 more
Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Machine learning models may not be able to effectively learn and predict from imbalanced data in the fields of machine learning and data mining. This study proposed a method for analyzing the performance impact of imbalanced binary data on machine learning models. It systematically analyzes 1. the relationship between varying performance in machine learning models and imbalance rate (IR); 2. the performance stability of machine learning models on imbalanced binary data. In the proposed method, the imbalanced data augmentation algorithms are first designed to obtain the imbalanced dataset with gradually varying IR. Then, in order to obtain more objective classification results, the evaluation metric AFG, arithmetic mean of area under the receiver operating characteristic curve (AUC), F-measure and G-mean are used to evaluate the classification performance of machine learning models. Finally, based on AFG and coefficient of variation (CV), the performance stability evaluation method of machine learning models is proposed. Experiments of eight widely used machine learning models on 48 different imbalanced datasets demonstrate that the classification performance of machine learning models decreases with the increase of IR on the same imbalanced data. Meanwhile, the classification performances of LR, DT and SVC are unstable, while GNB, BNB, KNN, RF and GBDT are relatively stable and not susceptible to imbalanced data. In particular, the BNB has the most stable classification performance. The Friedman and Nemenyi post hoc statistical tests also confirmed this result. The SMOTE method is used in oversampling-based imbalanced data augmentation, and determining whether other oversampling methods can obtain consistent results needs further research. In the future, an imbalanced data augmentation algorithm based on undersampling and hybrid sampling should be used to analyze the performance impact of imbalanced binary data on machine learning models.

Loading PDF

Similar Papers
  • PDF
  • Research Article
  • Citations35

Issue of Data Imbalance on Low Birthweight Baby Outcomes Prediction and Associated Risk Factors Identification: Establishment of Benchmarking Key Machine Learning Models With Data Rebalancing Strategies

  • May 31, 2023
  • Journal of Medical Internet Research
  • Yang Ren +4
  • Research Article
  • Citations2

Application of Machine Learning Techniques for Customer Churn Prediction in the Banking Sector

  • Jan 01, 2025
  • Interdisciplinary Journal of Information, Knowledge, and Management
  • Tam-Thanh Luong +3
  • Research Article
  • Citations46

Does Artificial Intelligence Outperform Natural Intelligence in Interpreting Musculoskeletal Radiological Studies? A Systematic Review.

  • Jul 30, 2020
  • Clinical Orthopaedics & Related Research
  • Olivier Q Groot +7
  • PDF
  • Research Article
  • Citations48

Machine Learning Models for Blood Glucose Level Prediction in Patients With Diabetes Mellitus: Systematic Review and Network Meta-Analysis.

  • Nov 20, 2023
  • JMIR Medical Informatics
  • Kui Liu +9
  • Research Article
  • Citations1

Continuous Evaluation Frameworks for Retrospective Evaluation of Clinical Machine Learning Models.

  • Feb 26, 2026
  • Critical care (London, England)
  • Annamalai Natarajan +4
  • Supplementary Content
  • Citations34

Comparison of Severity of Illness Scores and Artificial Intelligence Models That Are Predictive of Intensive Care Unit Mortality: Meta-analysis and Review of the Literature

  • May 31, 2022
  • JMIR Medical Informatics
  • Cristina Barboi +2
  • Research Article
  • Citations1

AIRA-ML: Auto Insurance Risk Assessment-Machine Learning Model using Resampling Methods

  • Jan 01, 2023
  • International Journal of Advanced Computer Science and Applications
  • Ahmed Shawky Elbhrawy +2
  • Research Article
  • Citations9

Using Machine Learning to Predict Unplanned Hospital Utilization and Chemotherapy Management From Patient-Reported Outcome Measures.

  • Apr 01, 2024
  • JCO clinical cancer informatics
  • Zuzanna Wójcik +4
  • Research Article
  • Citations19

Predicting the stages of liver fibrosis with multiphase CT radiomics based on volumetric features.

  • Mar 22, 2021
  • Abdominal Radiology
  • Enming Cui +6
  • Research Article
  • Citations33

Landslide susceptibility assessment using feature selection-based machine learning models

  • Jan 01, 2021
  • Geomechanics and Engineering
  • Leilei Liu +2
  • Research Article
  • Citations2

Evaluating dimensionality reduction of comorbidities for predictive modeling in individuals with neurofibromatosis type 1.

  • Dec 26, 2024
  • JAMIA open
  • Aditi Gupta +7
  • Research Article
  • Citations10

Prognosing post-treatment outcomes of head and neck cancer using structured data and machine learning: A systematic review.

  • Jul 24, 2024
  • PloS one
  • Mohammad Moharrami +7
  • Book Chapter
  • Citations1

A Comparative Study on the Classification Performance of Machine Learning Models for Academic Full Texts

  • Jan 01, 2020
  • Haotian Hu +3
  • Research Article

P.109 Machine learning based approach to improving the prediction of neurological deterioration in mild Degenerative Cervical Myelopathy

  • May 24, 2024
  • Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques
  • A Al-Shawwa +4
  • Research Article
  • Citations4

Data-driven evolutionary multi-task optimization for problems with complex solution spaces

  • Jan 13, 2023
  • Information Sciences
  • Chao Lyu +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.