• Home
  • Search
  • A Comparison of Performance Metrics with Severely Imbalanced Network Security Big Data
  • Cite Icon15
  • https://doi.org/10.1109/iri.2019.00026Copy DOI Icon

A Comparison of Performance Metrics with Severely Imbalanced Network Security Big Data

  • Jul 1, 2019
  • Tawfiq Hasanin +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Severe class imbalance between the majority and minority classes in large datasets can prejudice Machine Learning classifiers toward the majority class. Our work uniquely consolidates two case studies, each utilizing three learners implemented within an Apache Spark framework, six sampling methods, and five sampling distribution ratios to analyze the effect of severe class imbalance on big data analytics. We use three performance metrics to evaluate this study: Area Under the Receiver Operating Characteristic Curve, Area Under the Precision-Recall Curve, and Geometric Mean. In the first case study, models were trained on one dataset (POST) and tested on another (SlowlorisBig). In the second case study, the training and testing dataset roles were switched. Our comparison of performance metrics shows that Area Under the Precision-Recall Curve and Geometric Mean are sensitive to changes in the sampling distribution ratio, whereas Area Under the Receiver Operating Characteristic Curve is relatively unaffected. In addition, we demonstrate that when comparing sampling methods, borderline-SMOTE2 outperforms the other methods in the first case study, and Random Undersampling is the top performer in the second case study.

Similar Papers
  • PDF
  • Research Article
  • Citations138

Severely imbalanced Big Data challenges: investigating data sampling approaches

  • Nov 30, 2019
  • Journal of Big Data
  • Tawfiq Hasanin +3
  • PDF
  • Research Article
  • Citations21

Investigating class rarity in big data

  • Mar 16, 2020
  • Journal of Big Data
  • Tawfiq Hasanin +3
  • PDF
  • Research Article
  • Citations41

Examining characteristics of predictive models with imbalanced big data

  • Jul 31, 2019
  • Journal of Big Data
  • Tawfiq Hasanin +3
  • Dissertation
  • Citations1

Genetic Programming for Classification with Unbalanced Data

  • Jan 01, 2012
  • Urvesh Bhowan
  • Dissertation
  • Citations1

Genetic Programming for Classification with Unbalanced Data

  • Jan 01, 2012
  • Urvesh Bhowan
  • Conference Article
  • Citations3

One-Class Classifier Performance: Comparing Majority versus Minority Class Training

  • Nov 06, 2023
  • Joffrey L Leevy +3
  • Research Article
  • Citations98

Evaluating classifier performance with highly imbalanced Big Data

  • Apr 11, 2023
  • Journal of Big Data
  • John T Hancock +2
  • Research Article
  • Citations6

Application of ROC and PR curves in the evaluation of clinical diagnostic testing

  • Sep 06, 2022
  • Zhonghua yu fang yi xue za zhi [Chinese journal of preventive medicine]
  • Yuxun Zhu +6
  • Research Article
  • Citations12

The effect of resampling techniques on the performances of machine learning clinical risk prediction models in the setting of severe class imbalance: development and internal validation in a retrospective cohort

  • Nov 26, 2024
  • Discover Artificial Intelligence
  • Janny Xue Chen Ke +3
  • Research Article
  • Citations66

Class imbalance on medical image classification: towards better evaluation practices for discrimination and calibration performance.

  • Jun 11, 2024
  • European radiology
  • Candelaria Mosquera +4
  • Research Article
  • Citations13

An Empirical Investigation on Wrapper-Based Feature Selection for Predicting Software Quality

  • Feb 01, 2015
  • International Journal of Software Engineering and Knowledge Engineering
  • Huanjing Wang +2
  • PDF
  • Research Article
  • Citations82

Detecting web attacks using random undersampling and ensemble learners

  • May 27, 2021
  • Journal of Big Data
  • Richard Zuech +2
  • Research Article
  • Citations3

Improving Credit Card Fraud Detection with Data Reduction Approaches

  • May 15, 2024
  • International Journal of Reliability, Quality and Safety Engineering
  • Huanjing Wang +2
  • Research Article

Evaluating the Impact of Majority versus Minority Class Training for One-Class Classification

  • Jul 14, 2025
  • International Journal on Artificial Intelligence Tools
  • Joffrey L Leevy +3
  • Conference Article
  • Citations5

Towards Optimizing Performance of Machine Learning Algorithms on Unbalanced Dataset

  • Oct 28, 2023
  • Asitha Thumpati +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.