• Home
  • Search
  • Feature-based ensemble modeling for addressing diabetes data imbalance using the SMOTE, RUS, and random forest methods: a prediction study.
  • Cite Icon4
  • https://doi.org/10.12771/emj.2025.00353Copy DOI Icon

Feature-based ensemble modeling for addressing diabetes data imbalance using the SMOTE, RUS, and random forest methods: a prediction study.

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

This study developed and evaluated a feature-based ensemble model integrating the synthetic minority oversampling technique (SMOTE) and random undersampling (RUS) methods with a random forest approach to address class imbalance in machine learning for early diabetes detection, aiming to improve predictive performance. Using the Scikit-learn diabetes dataset (442 samples, 10 features), we binarized the target variable (diabetes progression) at the 75th percentile and split it 80:20 using stratified sampling. The training set was balanced to a 1:2 minority-to-majority ratio via SMOTE (0.6) and RUS (0.66). A feature-based ensemble model was constructed by training random forest classifiers on 10 two-feature subsets, selected based on feature importance, and combining their outputs using soft voting. Performance was compared against 13 baseline models, using accuracy and area under the curve (AUC) as metrics on the imbalanced test set. The feature-based ensemble model and balanced random forest both achieved the highest accuracy (0.8764), followed by the fully connected neural network (0.8700). The ensemble model had an excellent AUC (0.9227), while k-nearest neighbors had the lowest accuracy (0.8427). Visualizations confirmed its superior discriminative ability, especially for the minority (high-risk) class, which is a critical factor in medical contexts. Integrating SMOTE, RUS, and feature-based ensemble learning improved classification performance in imbalanced diabetes datasets by delivering robust accuracy and high recall for the minority class. This approach outperforms traditional resampling techniques and deep learning models, offering a scalable and interpretable solution for early diabetes prediction and potentially other medical applications.

Similar Papers
  • Research Article

Supervised machine learning algorithms for classifications of gender-based violence in Somalia: a comparison of oversampling techniques.

  • May 28, 2026
  • Scientific reports
  • Seyifemickael Amare Yilema +5
  • Research Article

Applying supervised machine learning algorithms and ensemble models to enhance credit card fraud detection.

  • Jan 01, 2026
  • Frontiers in artificial intelligence
  • Abrar Al-Bulushi +2
  • Research Article
  • Citations4

Analyzing Resampling Techniques for Addressing the Class Imbalance in NIDS using SVM with Random Forest Feature Selection

  • Sep 30, 2024
  • International Journal of Experimental Research and Review
  • K Swarnalatha +3
  • Research Article

An Interpretable Stacking Ensemble Model with SHAP for Geriatric Depression Prediction: Analysis of the NHANES 2005-2023 Database<b></b>

  • Jan 28, 2026
  • EAI Endorsed Transactions on Pervasive Health and Technology
  • Manman Cui +2
  • Research Article
  • Citations2

Evaluating the performance of different machine learning algorithms based on SMOTE in predicting musculoskeletal disorders in elementary school students

  • Oct 02, 2025
  • BMC Medical Research Methodology
  • Sara Manoochehri +4
  • Research Article
  • Citations83

Structure\u2013activity relationship-based chemical classification of highly imbalanced Tox21 datasets

  • Oct 27, 2020
  • Journal of Cheminformatics
  • Gabriel Idakwo +9
  • PDF
  • Research Article
  • Citations1107

SMOTE for high-dimensional class-imbalanced data

  • Mar 22, 2013
  • BMC Bioinformatics
  • Rok Blagus +1
  • Research Article
  • Citations2

Resampling Imbalanced Healthcare Data for Predictive Modelling

  • Jan 01, 2025
  • International Journal of Advanced Computer Science and Applications
  • Manoj Yadav Mamilla +2
  • Research Article

Evaluation of the Effectiveness of SMOTE and Random Under Sampling in Emotion Classification of Tweets

  • Dec 23, 2024
  • INFORMATICS FOR EDUCATORS AND PROFESSIONAL : Journal of Informatics
  • I Komang Dharmendra +2
  • PDF
  • Research Article
  • Citations138

Severely imbalanced Big Data challenges: investigating data sampling approaches

  • Nov 30, 2019
  • Journal of Big Data
  • Tawfiq Hasanin +3
  • Research Article

IMPLEMENTASI METODE SMOTE DAN RANDOM OVER-SAMPLING PADA ALGORITMA MACHINE LEARNING UNTUK PREDIKSI CUSTOMER CHURN DI SEKTOR PERBANKAN

  • Jan 18, 2025
  • Jurnal Sistem Informasi dan Informatika (Simika)
  • Fannisa Salsabila Pratiwi +2
  • Research Article
  • Citations5

Enhancing Tumor Classification Through Machine Learning Algorithms for Breast Cancer Diagnosis

  • Jun 01, 2024
  • Computer Engineering and Intelligent Systems
  • Lawrence Agbota +7
  • Book Chapter
  • Citations9

Addressing the Big Data Multi-class Imbalance Problem with Oversampling and Deep Learning Neural Networks

  • Jan 01, 2019
  • V M González-Barcenas +4
  • Research Article

Optimization of Random Forest Algorithm with SMOTE Method to Improve the Accuracy of Early Diabetes Prediction

  • Aug 04, 2025
  • Scientific Journal of Informatics
  • Siti Khoirun Nisa +2
  • Research Article
  • Citations1

Risk prediction of multiple cardiometabolic diseases in middle-aged and older adults using lipid metabolism biomarkers and derived composite measures based on machine learning: a prospective cohort study of CHARLS

  • Dec 20, 2025
  • Lipids in Health and Disease
  • Yuan Li +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.