• Home
  • Search
  • An enhanced distributed framework for real-time performance testing of large scale IoT dataset using big data analytic tools
  • Cite Icon2
  • https://doi.org/10.32629/jai.v7i1.746Copy DOI Icon

An enhanced distributed framework for real-time performance testing of large scale IoT dataset using big data analytic tools

Show More
  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

<p>The demand for analyzing enormous IoT datasets is rising in parallel with the popularity of the IoT. There are considerable obstacles to effective processing and analysis due to the amount, velocity, and variety of IoT data. In this research, we present a distributed system that makes use of big data analytic tools like Apache Hive, Spark, and Hadoop to efficiently test the performance of massive IoT datasets. The framework addresses the lack of a comprehensive solution by providing a scalable and fault-tolerant architecture. We discuss the motivation behind real-time performance testing in the context of big data analytics for IoT datasets and highlight the need for a distributed framework. A literature review is conducted to explore existing performance testing frameworks, big data analytic tools, and approaches for performance testing big data analytics. The proposed framework’s key components, including dataset generation, test scenario specification, cluster configuration, performance metrics collection, analysis and visualization modules, and implementation details, including tool choices, are discussed. An experimental evaluation is conducted to validate the framework’s performance, and it is suggested to incorporate blockchain technology. Overall, the proposed framework offers a comprehensive solution for real-time performance testing of large-scale IoT datasets, providing organizations and researchers with a valuable tool to ensure efficient and reliable IoT data processing and analysis.</p>

Similar Papers
  • Research Article
  • Citations4

Enhancing Industrial IoT Security: Utilizing Blockchain-Assisted Deep Federated Learning for Collaborative Intrusion Detection

  • Mar 31, 2024
  • Journal of Electrical Systems
  • Anitha Govindaram, Jegatheesan A
  • Conference Article

IOT Based Clinical Data Set Formation Model for Smart Health Care Application

  • Apr 27, 2022
  • Anurag Shrivastava +5
  • Research Article

Interpretable Ensemble-Based Intrusion Detection Using Feature Selection on the ToN_IoT Dataset

  • Dec 24, 2025
  • JISA(Jurnal Informatika dan Sains)
  • Vaman Shakir Sulaiman +1
  • Research Article
  • Citations16

Intrusion Detection in IoT Using Deep Residual Networks with Attention Mechanisms

  • Jul 18, 2024
  • Future Internet
  • Bo Cui +3
  • Research Article
  • Citations2

Performance Analysis of LSTM, SVM, CNN, and CNN-LSTM Algorithms for Malware Detection in IoT Dataset

  • Apr 14, 2025
  • WSEAS TRANSACTIONS ON COMPUTER RESEARCH
  • Iliyan Barzev +1
  • Research Article
  • Citations324

Performance analysis of machine learning models for intrusion detection system using Gini Impurity-based Weighted Random Forest (GIWRF) feature selection technique

  • Jan 04, 2022
  • Cybersecurity
  • Raisa Abedin Disha +1
  • Book Chapter
  • Citations1

Visualization Tools for Big Data Analytics in Quantitative Chemical Analysis

  • Jan 01, 2018
  • Gerard G Dumancas +7
  • Conference Article
  • Citations6

Distributed SPARQL over Big RDF Data: A Comparative Analysis Using Presto and MapReduce

  • Jun 01, 2015
  • Mulugeta Mammo +1
  • Research Article
  • Citations27

New product success through big data analytics: an empirical evidence from Iran

  • Aug 19, 2021
  • Information Technology & People
  • Farid Shirazi +4
  • Research Article
  • Citations19

Big data analytics opportunities for applications in process engineering

  • Dec 27, 2021
  • Reviews in Chemical Engineering
  • Mitra Sadat Lavasani +5
  • Conference Article
  • Citations1

New authentication concept using certificates for big data analytic tools

  • Aug 27, 2018
  • Paul J E Velthuis +2
  • Research Article

Система управления бизнес-процессами торгового сетевого предприятия на основе инструментов анализа больших данных

  • Sep 27, 2024
  • Scientific Research and Development. Economics of the Firm
  • A Garnova
  • Research Article
  • Citations2

University Students’ Readiness for Job Opportunities in Big Data Analytics

  • Nov 01, 2021
  • Journal of Physics Conference Series
  • Sarah Yusoff +2
  • Conference Article
  • Citations3

Empirical Investigation of Big Data Analytical Tools: Comparative Analysis

  • Apr 01, 2019
  • Harmeet Singh +3
  • Single Report

Big Data Analytics Test Bed

  • Sep 01, 2013
  • Rachel A Doucet +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.