• Home
  • Search
  • SMOTE for high-dimensional class-imbalanced data
  • Cite Icon1107
  • https://doi.org/10.1186/1471-2105-14-106Copy DOI Icon

SMOTE for high-dimensional class-imbalanced data

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

BackgroundClassification using class-imbalanced data is biased in favor of the majority class. The bias is even larger for high-dimensional data, where the number of variables greatly exceeds the number of samples. The problem can be attenuated by undersampling or oversampling, which produce class-balanced data. Generally undersampling is helpful, while random oversampling is not. Synthetic Minority Oversampling TEchnique (SMOTE) is a very popular oversampling method that was proposed to improve random oversampling but its behavior on high-dimensional data has not been thoroughly investigated. In this paper we investigate the properties of SMOTE from a theoretical and empirical point of view, using simulated and real high-dimensional data.ResultsWhile in most cases SMOTE seems beneficial with low-dimensional data, it does not attenuate the bias towards the classification in the majority class for most classifiers when data are high-dimensional, and it is less effective than random undersampling. SMOTE is beneficial for k-NN classifiers for high-dimensional data if the number of variables is reduced performing some type of variable selection; we explain why, otherwise, the k-NN classification is biased towards the minority class. Furthermore, we show that on high-dimensional data SMOTE does not change the class-specific mean values while it decreases the data variability and it introduces correlation between samples. We explain how our findings impact the class-prediction for high-dimensional data.ConclusionsIn practice, in the high-dimensional setting only k-NN classifiers based on the Euclidean distance seem to benefit substantially from the use of SMOTE, provided that variable selection is performed before using SMOTE; the benefit is larger if more neighbors are used. SMOTE for k-NN without variable selection should not be used, because it strongly biases the classification towards the minority class.

Loading PDF

Similar Papers
  • Conference Article
  • Citations103

Evaluation of SMOTE for High-Dimensional Class-Imbalanced Microarray Data

  • Dec 01, 2012
  • Rok Blagus +1
  • Conference Article
  • Citations8

Modeling of class imbalance using an empirical approach with spambase dataset and random forest classification

  • Oct 13, 2014
  • Kiranmayi Kotipalli +1
  • Book Chapter
  • Citations5

Comparative Multinomial Text Classification Analysis of Naïve Bayes and XGBoost with SMOTE on Imbalanced Dataset

  • Sep 05, 2021
  • Ashish Chaturvedi +3
  • Research Article
  • Citations116

A Novel Algorithm for Imbalance Data Classification Based on Genetic Algorithm Improved SMOTE

  • May 12, 2016
  • Arabian Journal for Science and Engineering
  • Kun Jiang +2
  • Research Article

M-Tune: imbalanced data handling in machine learning by tuning the decision threshold.

  • May 29, 2026
  • Molecular diversity
  • Tapos Dutta +2
  • PDF
  • Research Article
  • Citations336

A theoretical distribution analysis of synthetic minority oversampling technique (SMOTE) for imbalanced learning

  • Jan 05, 2023
  • Machine Learning
  • Dina Elreedy +2
  • PDF
  • Research Article
  • Citations16

Fuzzy–synthetic minority oversampling technique: Oversampling based on fuzzy set theory for Android malware detection in imbalanced datasets

  • Apr 01, 2017
  • International Journal of Distributed Sensor Networks
  • Yanping Xu +4
  • Research Article

Enhancing DDoS Detection Using SMOTE with PCA - Random Forest Feature Analysis

  • May 24, 2026
  • JOIV : International Journal on Informatics Visualization
  • Muhammad Nur Faiz +4
  • Book Chapter
  • Citations9

Addressing the Big Data Multi-class Imbalance Problem with Oversampling and Deep Learning Neural Networks

  • Jan 01, 2019
  • V M González-Barcenas +4
  • Research Article

Handling leukaemia imbalanced data using synthetic minority oversampling technique (SMOTE)

  • Jul 01, 2021
  • Journal of Physics Conference Series
  • F Y Chin +2
  • Research Article
  • Citations7

A New Oversampling Method Based on Triangulation of Sample Space

  • Feb 01, 2024
  • IEEE Transactions on Systems, Man, and Cybernetics: Systems
  • Yueqi Chen +4
  • PDF
  • Research Article
  • Citations79

A self-inspected adaptive SMOTE algorithm (SASMOTE) for highly imbalanced data classification in healthcare

  • Apr 25, 2023
  • BioData Mining
  • Tanapol Kosolwattana +5
  • Research Article
  • Citations1

A three-step combination strategy for addressing outliers and class imbalance in software defect prediction

  • Sep 01, 2024
  • IAES International Journal of Artificial Intelligence (IJ-AI)
  • Muhammad Rizky Pribadi +2
  • Research Article

Handling Class Data Imbalance in Random Forest using the SMOTE and ADASYN Methods in Identify Economic Status

  • Nov 29, 2025
  • International Journal of Mathematics And Computer Research
  • Fane Oktari +3
  • PDF
  • Research Article
  • Citations5

An Imbalanced Data Classification Algorithm of De-noising Auto-Encoder Neural Network Based on SMOTE

  • Jan 01, 2016
  • MATEC Web of Conferences
  • Chenggang Zhang +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.