• Home
  • Search
  • An efficient approach for low latency processing in stream data.
  • Open Access IconOpen Access
  • Cite Icon10
  • https://doi.org/10.7717/peerj-cs.426Copy DOI Icon

An efficient approach for low latency processing in stream data.

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Stream data is the data that is generated continuously from the different data sources and ideally defined as the data that has no discrete beginning or end. Processing the stream data is a part of big data analytics that aims at querying the continuously arriving data and extracting meaningful information from the stream. Although earlier processing of such stream was using batch analytics, nowadays there are applications like the stock market, patient monitoring, and traffic analysis which can cause a drastic difference in processing, if the output is generated in levels of hours and minutes. The primary goal of any real-time stream processing system is to process the stream data as soon as it arrives. Correspondingly, analytics of the stream data also needs consideration of surrounding dependent data. For example, stock market analytics results are often useless if we do not consider their associated or dependent parameters which affect the result. In a real-world application, these dependent stream data usually arrive from the distributed environment. Hence, the stream processing system has to be designed, which can deal with the delay in the arrival of such data from distributed sources. We have designed the stream processing model which can deal with all the possible latency and provide an end-to-end low latency system. We have performed the stock market prediction by considering affecting parameters, such as USD, OIL Price, and Gold Price with an equal arrival rate. We have calculated the Normalized Root Mean Square Error (NRMSE) which simplifies the comparison among models with different scales. A comparative analysis of the experiment presented in the report shows a significant improvement in the result when considering the affecting parameters. In this work, we have used the statistical approach to forecast the probability of possible data latency arrives from distributed sources. Moreover, we have performed preprocessing of stream data to ensure at-least-once delivery semantics. In the direction towards providing low latency in processing, we have also implemented exactly-once processing semantics. Extensive experiments have been performed with varying sizes of the window and data arrival rate. We have concluded that system latency can be reduced when the window size is equal to the data arrival rate.

Similar Papers
  • Research Article
  • Citations7

Investigating the Impact of the First and Second Waves of the COVID - 19 Pandemic on the Indian Stock and Commodity Markets : An ARDL Analysis of Gold, Oil, and Stock Market Prices

  • Dec 10, 2021
  • Indian Journal of Finance
  • Aamir Aijaz Syed +2
  • Research Article
  • Citations1

Impact of Gold Price and Oil Price on the Indian Stock Market : With Special Reference to the Bombay Stock Exchange Market

  • Dec 31, 2023
  • Indian Journal of Research in Capital Markets
  • Binu Joseph +1
  • Conference Article
  • Citations1

Stock Prices and Crude Oil Shocks: The Case of GCC Countries

  • Jan 01, 2016
  • Alanoud Al-Maadid +2
  • PDF
  • Research Article
  • Citations3

A Co-driven Functional Electrical Stimulation Control Strategy by Dynamic Surface Electromyography and Joint Angle

  • Jul 08, 2022
  • Frontiers in Neuroscience
  • Rui Xu +5
  • PDF
  • Research Article
  • Citations10

Monitoring Water Quality Indicators over Matagorda Bay, Texas, Using Landsat-8

  • Mar 22, 2024
  • Remote Sensing
  • Meghan Bygate +1
  • Book Chapter

Streaming Data Processing forIoT

  • Mar 06, 2020
  • The Internet of Things
  • Carolina Fortuna +1
  • Supplementary Content
  • Citations11

The impact of exchange rate, oil price and gold price on the Kuwaiti stock market: A wavelet analysis

  • Jan 01, 2020
  • European Journal of Comparative Economics
  • Ahmad Alrazni Alshammari +3
  • Conference Article
  • Citations7

High-Performance Stateful Stream Processing on Solid-State Drives

  • Aug 27, 2018
  • Gyewon Lee +4
  • Research Article
  • Citations37

A laboratory study to estimate pore geometric parameters of sandstones using complex conductivity and nuclear magnetic resonance for permeability prediction

  • Jun 01, 2016
  • Water Resources Research
  • Gordon Osterman +3
  • Research Article
  • Citations7

Global Risk Factors and Stock Returns during Bull and Bear Market Conditions: Evidence from Emerging Economies in Europe

  • Sep 03, 2019
  • Prague Economic Papers
  • Sercan Demiralay
  • Conference Article
  • Citations1

Dual-Paradigm Stream Processing

  • Aug 13, 2018
  • Song Wu +5
  • Research Article
  • Citations54

An effective method for the rapid detection of microplastics in soil

  • Oct 28, 2020
  • Chemosphere
  • Yanhui Li +4
  • Research Article

The Effects of Gold and Oil Prices on Saudi Arabia’s GDP from 2001 to 2023

  • Feb 15, 2025
  • American Journal of Economics
  • Alla Almatar +6
  • Research Article

Optimizing soil water retention predictions using a subtractive clustering-based ANFIS model

  • Jan 08, 2026
  • Cogent Food & Agriculture
  • Javad Seyedmohammadi +1
  • Research Article
  • Citations2

Kalman filter based on a fractional discrete-time stochastic augmented CoVid-19 model

  • May 14, 2024
  • Journal of Biosafety and Biosecurity
  • Mohammad Ghani +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.