• Home
  • Search
  • A Data Stream Prediction Strategy for Elastic Stream Computing Systems
  • Cite Icon3
  • https://doi.org/10.1007/978-3-030-93479-8_9Copy DOI Icon

A Data Stream Prediction Strategy for Elastic Stream Computing Systems

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Abstract In a distributed stream processing system, elastic resource provisioning/scheduling is the main factor that affects system performance and limits system applications. However, in the data stream computing platform, resource allocation is often suboptimal due to the large fluctuations of the data stream rate, which creates a performance bottleneck for the cluster. In this paper, we propose a data stream prediction strategy (Dp-Stream) for elastic computing system to mitigate the resource allocation issue. First, we establish a back propagation (BP) neural network prediction model based on genetic simulated annealing algorithm to predict the trend of the data stream rate in the next time window of the cluster; second, according to the time latency, the estimation model adjusts the resources allocated to the critical operations of the critical path in the Directed Acyclic Graph (DAG) and finally, the resource communication cost is optimized. We evaluate the prediction accuracy and system latency of the proposed scheduling strategy in Storm. The experimental results prove the feasibility and effectiveness of the proposed strategy.KeywordsData stream predictionResource schedulingStream computingBack propagation neural networkStorm

Similar Papers
  • PDF
  • Research Article
  • Citations17

Research on prediction model of thermal and moisture comfort of underwear based on principal component analysis and Genetic Algorithm–Back Propagation neural network

  • Oct 21, 2020
  • International Journal of Nonlinear Sciences and Numerical Simulation
  • Pengpeng Cheng +2
  • Supplementary Content

Efficient Distributed Stream Processing: Optimization Approaches and Applications

  • Jan 01, 2015
  • Zurich Open Repository and Archive (University of Zurich)
  • Lorenz Fischer
  • Conference Article
  • Citations3

The Research of Alphabet Identification Based on Genetic BP Neural Network

  • Aug 01, 2012
  • Lina Liu +2
  • Research Article
  • Citations8

Port Container Throughput Forecast Based on ABC Optimized BP Neural Network

  • Nov 01, 2020
  • IOP Conference Series: Earth and Environmental Science
  • Fucheng Huang +3
  • Research Article
  • Citations8

Discrete wavelet transformation and genetic algorithm – back propagation neural network applied in monitoring woodworking tool wear conditions in the milling operation spindle power signals

  • Feb 05, 2021
  • BioResources
  • Weihang Dong +4
  • PDF
  • Research Article
  • Citations15

Research on Credit Evaluation of Financial Enterprises Based on the Genetic Backpropagation Neural Network

  • Sep 02, 2021
  • Scientific Programming
  • Hua Peng
  • Research Article
  • Citations5

Log-periodic power law hybrid model based on BP neural network

  • Jan 14, 2021
  • Evolutionary Intelligence
  • Huiqing Wang +5
  • PDF
  • Research Article
  • Citations16

Prediction and Optimization of Matte Grade in ISA Furnace Based on GA-BP Neural Network

  • Mar 27, 2023
  • Applied Sciences
  • Luo Zhao +5
  • Conference Article
  • Citations1

Discrimination of liver cancer in cellular level based on backscatter micro-spectrum with PCA algorithm and BP neural network

  • Nov 09, 2016
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Jing Yang +3
  • Conference Article
  • Citations55

Adaptive Provisioning of Stream Processing Systems in the Cloud

  • Apr 01, 2012
  • Javier Cervino +3
  • Conference Article
  • Citations4

A grid-connected current control technique of single-phase voltage source inverter based on BP neural network

  • May 01, 2012
  • Gujing Han +2
  • Research Article
  • Citations19

Construction and verification of color fundus image retinal vessels segmentation algorithm under BP neural network

  • Jan 04, 2021
  • The Journal of Supercomputing
  • Zhao Liu
  • Conference Article
  • Citations2

Research on Fogdrop Diameter Based on Neural Network

  • Jan 01, 2009
  • Rui Li +1
  • PDF
  • Research Article
  • Citations22

Increasing the Accuracy of Soil Nutrient Prediction by Improving Genetic Algorithm Backpropagation Neural Networks

  • Jan 04, 2023
  • Symmetry
  • Yanqing Liu +4
  • Research Article

A Conflict Detection Method Based on Constraint Satisfaction in Collaborative Design

  • Jun 30, 2015
  • Journal of Computing Science and Engineering
  • Kangkang Yang +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.