• Home
  • Search
  • A Deep Recurrent Neural Network Based Predictive Control Framework for Reliable Distributed Stream Data Processing
  • Cite Icon4
  • https://doi.org/10.1109/ipdps.2019.00036Copy DOI Icon

A Deep Recurrent Neural Network Based Predictive Control Framework for Reliable Distributed Stream Data Processing

  • May 1, 2019
  • Jielong Xu +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In this paper, we present design, implementation and evaluation of a novel predictive control framework to enable reliable distributed stream data processing, which features a Deep Recurrent Neural Network (DRNN) model for performance prediction, and dynamic grouping for flexible control. Specifically, we present a novel DRNN model, which makes accurate performance prediction with careful consideration for interference of co-located worker processes, according to multilevel runtime statistics. Moreover, we design a new grouping method, dynamic grouping, which can distribute/re-distribute data tuples to downstream tasks according to any given split ratio on the fly. So it can be used to re-direct data tuples to bypass misbehaving workers. We implemented the proposed framework based on a widely used Distributed Stream Data Processing System (DSDPS), Storm. For validation and performance evaluation, we developed two representative stream data processing applications: Windowed URL Count and Continuous Queries. Extensive experimental results show: 1) The proposed DRNN model outperforms widely used baseline solutions, ARIMA and SVR, in terms of prediction accuracy; 2) dynamic grouping works as expected; and 3) the proposed framework enhances reliability by offering minor performance degradation with misbehaving workers.

Similar Papers
  • Research Article
  • Citations21

A Simulated Prospective Evaluation of a Deep Learning Model for Real-Time Prediction of Clinical Deterioration Among Ward Patients.

  • Mar 15, 2021
  • Critical Care Medicine
  • Parth K Shah +6
  • PDF
  • Research Article
  • Citations8

Feasibility of DRNN for Identifying Built Environment Barriers to Walkability Using Wearable Sensor Data from Pedestrians’ Gait

  • Apr 26, 2022
  • Applied Sciences
  • Hyunsoo Kim
  • Research Article
  • Citations53

An efficient strategy for predicting river dissolved oxygen concentration: application of deep recurrent neural network model.

  • Nov 13, 2021
  • Environmental Monitoring and Assessment
  • Salar Valizadeh Moghadam +5
  • Research Article
  • Citations2

Beat-to-beat continuous blood pressure estimation with optimal feature set of PPG and ECG signals using deep recurrent neural networks

  • Oct 20, 2023
  • Vessel Plus
  • Hanjie Chen +4
  • Research Article
  • Citations75

Deep Learning and Blockchain with Edge Computing for 5G-Enabled Drone Identification and Flight Mode Detection

  • Jan 01, 2021
  • IEEE Network
  • Abdu Gumaei +6
  • Research Article

Fusion of deep recurrent neural network models and fuzzy decision support system for tweet sentiment analysis and classification

  • Oct 02, 2025
  • Automatika
  • A Sherin +3
  • Conference Article
  • Citations1

A Deep Recurrent Neural Network Model for affine quasi-LPV System Identification

  • Jul 12, 2022
  • Alexander Rehmer +1
  • Research Article
  • Citations130

Daily runoff forecasting by deep recursive neural network

  • Feb 13, 2021
  • Journal of Hydrology
  • Jiangwei Zhang +7
  • Research Article
  • Citations161

Impact load identification of nonlinear structures using deep Recurrent Neural Network

  • Aug 13, 2019
  • Mechanical Systems and Signal Processing
  • Jm Zhou +3
  • Research Article
  • Citations8

Watermarking of Deep Recurrent Neural Network Using Adversarial Examples to Protect Intellectual Property

  • Dec 26, 2021
  • Applied Artificial Intelligence
  • Pulkit Rathi +2
  • Research Article
  • Citations8

Recognition of concrete microcrack images under fluorescent excitation based on attention mechanism deep recurrent neural networks

  • Apr 16, 2024
  • Case Studies in Construction Materials
  • Yukun Wang +3
  • Research Article
  • Citations3

Disease Prognosis of Fetal Heart’s Four-Chamber and Blood Vessels in Ultrasound Images Using CNN Incorporated VGG 16 and Enhanced DRNN

  • Jan 01, 2024
  • The International Arab Journal of Information Technology
  • Someshwaran Gunasekaran +1
  • PDF
  • Research Article
  • Citations134

SMOTE-DRNN: A Deep Learning Algorithm for Botnet Detection in the Internet-of-Things Networks.

  • Apr 24, 2021
  • Sensors
  • Segun I Popoola +5
  • PDF
  • Research Article
  • Citations23

Flood Prediction using Deep Learning Models

  • Jan 01, 2022
  • International Journal of Advanced Computer Science and Applications
  • Muhammad Hafizi Mohd Ali +4
  • Conference Article
  • Citations16

Measuring System Entropy with a Deep Recurrent Neural Network Model

  • Jul 01, 2019
  • Miguel Martínez-García +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.