• Home
  • Search
  • Performance Evaluation of Multinomial Logistic Regression, Random Forest, and XGBoost Methods in Data Classification
  • https://doi.org/10.35580/jmathcos.v8i2.8459Copy DOI Icon

Performance Evaluation of Multinomial Logistic Regression, Random Forest, and XGBoost Methods in Data Classification

Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

The development of data volume and complexity in the digital era increases the need for effective classification methods to support decision-making. Decision-making in classification tasks often requires methods that are well-suited to the data, along with the ability to produce accurate and reliable predictions. As scientific knowledge continues to advance, a wide range of classification methods have been developed. This study aims to analyze the performance of three commonly used classification methods Multinomial Logistic Regression, Random Forest, and XGBoost, in handling diverse data characteristics. Ten varied public datasets were used in this research, with differences in the number of classes, features, instances, balanced and imbalanced data conditions. Evaluation was conducted based on accuracy, F1-score, precision, and recall. The analysis results show that Random Forest consistently delivers the best performance particularly on imbalanced data. XGBoost demonstrates superiority on more complex datasets, while Multinomial Logistic Regression proves more effective on relatively small datasets. This research provides valuable insights into selecting appropriate classification methods based on data characteristics and highlights the effectiveness of ensemble-based approaches in handling diverse data. Based on the findings, it is recommended that the selection of classification algorithms be tailored to the characteristics of the dataset. Random Forest is preferable for handling imbalanced data, while XGBoost is ideal for complex datasets requiring robust hyperparameter tuning. Multinomial Logistic Regression remains a viable option for simpler datasets with fewer observations and features. Future research could explore hybrid models that combine these approaches to further optimize classification performance across various domains.

Similar Papers
  • Research Article
  • Citations25

Intelligent classification of coal structure using multinomial logistic regression, random forest and fully connected neural network with multisource geophysical logging data

  • Feb 15, 2023
  • International Journal of Coal Geology
  • Zihao Wang +5
  • Research Article
  • Citations1

ANALISIS PEMBANDINGAN TEKNIK ENSEMBLE SECARA BOOSTING(XGBOOST) DAN BAGGING (RANDOMFOREST) PADA KLASIFIKASI KATEGORI SAMBATAN SEKUENS DNA

  • Oct 01, 2019
  • Jurnal Penelitian Pos dan Informatika
  • Iswaya Maalik Syahrani
  • Research Article
  • Citations3

Variation in model performance by data cleanliness and classification methods in the prediction of 30-day ICU mortality, a US nationwide retrospective cohort and simulation study

  • Dec 01, 2020
  • BMJ Open
  • Theodore J Iwashyna +5
  • Research Article
  • Citations2

Multinomial logistic regression approach for the evaluation of binary diagnostic test in medical research

  • Jun 01, 2015
  • Statistics in Transition new series
  • Alok Kumar Dwivedi +4
  • Conference Article
  • Citations48

A Comparative study of Lung Cancer detection using supervised neural network

  • Mar 01, 2019
  • Kyamelia Roy +6
  • Research Article

Risk-Sensitive Machine Learning for Financial Decision Modeling Under Imbalanced Data: Evidence from Bank Telemarketing

  • Mar 21, 2026
  • Entropy
  • Bowen Dong +8
  • Research Article
  • Citations34

Prediction of body mass index status from voice signals based on machine learning for automated medical applications

  • Feb 27, 2013
  • Artificial Intelligence in Medicine
  • Bum Ju Lee +4
  • Research Article
  • Citations31

Evaluation of supervised machine-learning methods for predicting appearance traits from DNA

  • Mar 23, 2021
  • Forensic Science International: Genetics
  • Maria-Alexandra Katsara +4
  • Research Article
  • Citations26

Classification of imbalanced data using machine learning algorithms to predict the risk of renal graft failures in Ethiopia

  • May 22, 2023
  • BMC Medical Informatics and Decision Making
  • Getahun Mulugeta +4
  • Research Article
  • Citations52

Comparison of multinomial logistic regression and logistic regression: which is more efficient in allocating land use?

  • May 05, 2014
  • Frontiers of Earth Science
  • Yingzhi Lin +3
  • Conference Article
  • Citations1

Two-Dimensional-Reduction Random Forest

  • Jun 01, 2018
  • Shuquan Ye +7
  • Conference Article
  • Citations4

Abstention-SMOTE

  • Dec 27, 2017
  • Cheng Zhang +3
  • Research Article

Multinomial Logistic Regression Analysis in Determining Factors That Affect Social Media Selection Among Students of Faculty of Mathematics and Natural Science, Universitas Brawijaya

  • Oct 29, 2024
  • Journal of Applied Statistics and Data Science
  • Sakhira Nova Aldini
  • Research Article

Optimizing Heart Disease Prediction with Random Forest and Ensemble Methods

  • Jun 30, 2025
  • CogITo Smart Journal
  • Imam Al Amin +3
  • Research Article
  • Citations73

Multi-window based ensemble learning for classification of imbalanced streaming data

  • Mar 08, 2017
  • World Wide Web
  • Hu Li +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.