• Home
  • Search
  • Improving Stream Load Balance through Shedding
  • Cite Icon1
  • https://doi.org/10.1109/icdew53142.2021.00028Copy DOI Icon

Improving Stream Load Balance through Shedding

  • Apr 1, 2021
  • Nikos R Katsipoulakis +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The increasing demand for real-time processing has contributed to the rapid evolution of Stream Processing Engines (SPEs). Low operational cost and timely delivery of results are important objectives, whose achievement relies on efficient load distribution. However, given the volatile nature of data, and the limitations of existing stream partitioning techniques, those objectives can not be met. In this work we investigate the combination of load shedding with partitioning to improve load balancing in SPEs. We propose a novel query and load distribution model, which trades accuracy for balance load allocation in a controlled fashion. Also, we present the design of a lightweight operator that is compatible with current SPEs' architectures and is based on our model. Our operator, named ShedPart, identifies opportunities for approximating parts of the input in order to achieve balanced allocation. Our experimental evaluation indicates that ShedPart can lead to up to an order of magnitude better performance with real-world datasets.

Similar Papers
  • Conference Article
  • Citations3

IPComp: Interpolation Based Progressive Lossy Compression for Scientific Applications

  • Jul 20, 2025
  • Zhuoxun Yang +8
  • Supplementary Content

Massively parallel stream processing with latency guarantees

  • Jan 01, 2016
  • DepositOnce
  • Björn Lohrmann
  • PDF
  • Research Article
  • Citations20

Challenges in NoSQL-Based Distributed Data Storage: A Systematic Literature Review

  • Apr 30, 2019
  • Electronics
  • Shabana Ramzan +3
  • Conference Article
  • Citations1

Application of relatively equal load distribution method in rough rolling schedule

  • Dec 01, 2012
  • Yamei Wu +1
  • Conference Article
  • Citations2

A Load Distribution Model for Double-Planet Planetary Gear Sets

  • Aug 18, 2019
  • Yong Hu +2
  • Conference Article
  • Citations2

A Load Distribution Model for Planetary Gear Sets

  • Aug 06, 2017
  • Yong Hu +2
  • Research Article
  • Citations2

An improved load distribution model for involute helical gear pairs considering an actual contact ratio

  • Mar 07, 2023
  • Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science
  • Shanran Li +3
  • PDF
  • Research Article
  • Citations4

Optimal Clustering in Stable Instances Using Combinations of Exact and Noisy Ordinal Queries

  • Feb 08, 2021
  • Algorithms
  • Enrico Bianchi +1
  • Research Article
  • Citations13

A Task-Based Load Distribution Scheme for Multi-Server-Based Distributed Virtual Environment Systems

  • Feb 01, 2009
  • Presence: Teleoperators and Virtual Environments
  • Mingyu Lim +1
  • Conference Article
  • Citations12

Efficient, proximity-aware load balancing for structured P2P systems

  • Sep 01, 2003
  • Yingwu Zhu +1
  • Research Article
  • Citations1

Lightweight Dynamic Conjunctive Keyword Searchable Encryption With Result Pattern Hiding

  • Jan 01, 2025
  • IEEE Transactions on Information Forensics and Security
  • Chenbin Zhao +5
  • Conference Article
  • Citations7

The Benefits of Estimated Global Information in DHT Load Balancing

  • May 01, 2011
  • Nico Kruber +2
  • Research Article
  • Citations30

DSMLB: Dynamic switch-migration based load balancing for software-defined IoT network

  • Jul 07, 2022
  • Computer Networks
  • Samra Zafar +4
  • Research Article
  • Citations13

Heterogenous QoS‐guaranteed load balancing in 3GPP LTE multicell fractional frequency reuse network

  • Jun 28, 2013
  • Transactions on Emerging Telecommunications Technologies
  • Zhihang Li +4
  • Conference Article
  • Citations5

A Review of Gateway Load Balancing Methods in Connecting MANET into Internet

  • Feb 13, 2022
  • Zhang Hui +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.