• Home
  • Search
  • Big Data for Real-Time Processing on Streaming Data: State-of-the-art and Future Challenges
  • Cite Icon2
  • https://doi.org/10.1109/iceccme55909.2022.9987770Copy DOI Icon

Big Data for Real-Time Processing on Streaming Data: State-of-the-art and Future Challenges

  • Nov 16, 2022
  • Sara Ashraf +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

As many commercial businesses aspire for a competitive edge, real-time analysis on streaming data employing a big data methodology has lately become widespread. The ability to efficiently arrange massive amounts of data to make a business decision empowers data warehousing. Dealing with this sort of data poses considerable obstacles; as a result, several ways of assessing data in the form of streams have been created. Many solutions for dealing with enormous volumes of data and making decisions based on off-line batch processing have been investigated. In this paper, we explore the most recent developments in big data approaches for real-time analysis on streaming data to answer four research questions related to streaming data source, stream pre-processing, types of streaming data processing, used machine learning model, in addition to the validation and evaluation criteria. The system architecture associated with the used big data tools, the architecture hardware specs as well as other current platforms appropriate for large data streaming analytics are also considered. Furthermore, we outline numerous difficulties encountered in big data stream processing. The purpose of this review is to fill a gap in the surveyed area by offering thorough evaluation of various big data frameworks, architectures, and categories for cutting-edge approaches, as well as critical analyses of their performance and discussions of their applications, trends, and future directions to serve as guides for readers in this burgeoning study area.

Similar Papers
  • Book Chapter
  • Citations9

Spatio-Temporal Data Streams and Big Data Paradigm

  • Jan 01, 2016
  • Zdravko Galić
  • Conference Article
  • Citations2

VAStream

  • Jul 28, 2019
  • Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning)
  • Satya Katragadda +9
  • Research Article
  • Citations7

Cloud computing and big data: Technologies and applications

  • May 20, 2018
  • Concurrency and Computation: Practice and Experience
  • Mostapha Zbakh +3
  • PDF
  • Research Article
  • Citations122

Beyond Batch Processing: Towards Real-Time and Streaming Big Data

  • Oct 17, 2014
  • Computers
  • Saeed Shahrivari
  • Research Article

Fractal methods in intelligent technologies for processing large data streams

  • Mar 01, 2019
  • Journal of Physics: Conference Series
  • Mikhail I Turitsyn +1
  • Conference Article
  • Citations9

A Data as a Product Model for Future Consumption of Big Stream Data in Clouds

  • Jun 01, 2015
  • Guangyan Huang +4
  • Book Chapter
  • Citations1

Big Data to Improve Public Health in Low- and Middle-Income Countries

  • Jan 01, 2021
  • Songul Cinaroglu
  • PDF
  • Research Article
  • Citations11

Analytic architecture to overcome real time traffic control as an intelligent transportation system using big data

  • Jun 01, 2018
  • International Journal of Engineering & Technology
  • Venkata Ramana N +2
  • Research Article
  • Citations3

Big Data and Java are integrated with machine learning

  • Mar 29, 2024
  • International Journal of Multidisciplinary Sciences and Arts
  • Anis Ahmed Qazi +1
  • Conference Article
  • Citations34

On clusterization of "big data" streams

  • Jan 01, 2012
  • Simon Berkovich +1
  • Conference Article
  • Citations7

A big data management approach for computer aided breast cancer diagnostic system supporting precision medicine

  • Jan 01, 2019
  • AIP conference proceedings
  • Veska Gancheva
  • Conference Article
  • Citations3

Software architecture for adaptive in silico knowledge discovery and decision making based on big genomic data analytics

  • Jan 01, 2019
  • AIP conference proceedings
  • Veska Gancheva +1
  • Conference Article
  • Citations42

Network security and anomaly detection with Big-DAMA, a big data analytics framework

  • Sep 01, 2017
  • Pedro Casas +4
  • PDF
  • Research Article
  • Citations89

A new Internet of Things architecture for real-time prediction of various diseases using machine learning on big data environment

  • Nov 27, 2019
  • Journal of Big Data
  • Abderrahmane Ed-Daoudy +1
  • Discussion
  • Citations7

Invited Commentary on Stewart and Davis " 'Big data' in mental health research-current status and emerging possibilities".

  • Oct 25, 2016
  • Social Psychiatry and Psychiatric Epidemiology
  • Jonathan D Hafferty +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.