• Home
  • Search
  • Grizzly: Efficient Stream Processing Through Adaptive Query Compilation
  • Cite Icon38
  • https://doi.org/10.1145/3318464.3389739Copy DOI Icon

Grizzly: Efficient Stream Processing Through Adaptive Query Compilation

  • May 31, 2020
  • Philipp M Grulich +7 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Stream Processing Engines (SPEs) execute long-running queries on unbounded data streams. They follow an interpretation-based processing model and do not perform runtime optimizations. This limits the utilization of modern hardware and neglects changing data characteristics at runtime. In this paper, we present Grizzly, a novel adaptive query compilation-based SPE, to enable highly efficient query execution. We extend query compilation and task-based parallelization for the unique requirements of stream processing and apply adaptive compilation to enable runtime re-optimizations. The combination of light-weight statistic gathering with just-in-time compilation enables Grizzly to adjust to changing data-characteristics dynamically at runtime. Our experiments show that Grizzly outperforms state-of-the-art SPEs by up to an order of magnitude in throughput.

Similar Papers
  • Research Article
  • Citations303

Distributed data stream processing and edge computing: A survey on resource elasticity and future directions

  • Dec 06, 2017
  • Journal of Network and Computer Applications
  • Marcos Dias De Assunção +2
  • Conference Article
  • Citations1

Research on stream processing engine and benchmarking framework

  • Dec 15, 2022
  • Qionghua Le +2
  • Research Article
  • Citations16

Distributed Join Processing Between Streaming and Stored Big Data Under the Micro-Batch Model

  • Jan 01, 2019
  • IEEE Access
  • Young-Ho Jeon +2
  • Supplementary Content

Massively parallel stream processing with latency guarantees

  • Jan 01, 2016
  • DepositOnce
  • Björn Lohrmann
  • Conference Article
  • Citations8

A new operator for efficient stream-relation join processing in data streaming engines

  • Oct 27, 2013
  • Roozbeh Derakhshan +2
  • PDF
  • Research Article
  • Citations40

A Distributed Stream Processing Middleware Framework for Real-Time Analysis of Heterogeneous Data on Big Data Platform: Case of Environmental Monitoring

  • Jun 03, 2020
  • Sensors (Basel, Switzerland)
  • Adeyinka Akanbi +1
  • Conference Article

Aggregates are all you need (to bridge stream processing and Complex Event Recognition)

  • Jun 24, 2024
  • Vincenzo Gulisano +1
  • Research Article

Unraveling the Impact of Window Semantics: Optimizing Join Order for Efficient Stream Processing

  • Apr 01, 2025
  • Proceedings of the VLDB Endowment
  • Ariane Ziehn +3
  • Research Article
  • Citations39

Maintaining consistent results of continuous queries under diverse window specifications

  • Feb 19, 2010
  • Information Systems
  • Kostas Patroumpas +1
  • Conference Article
  • Citations48

Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines

  • May 31, 2020
  • Bonaventura Del Monte +3
  • Conference Article
  • Citations17

Concept-Driven Load Shedding: Reducing Size and Error of Voluminous and Variable Data Streams

  • Dec 01, 2018
  • Nikos R Katsipoulakis +2
  • Conference Article
  • Citations11

Real-Time Analytics for Fast Evolving Social Graphs

  • May 01, 2015
  • Charith Wickramaarachchi +4
  • Conference Article
  • Citations3

A-SAS: An Adaptive High-Availability Scheme for Distributed Stream Processing Systems

  • Jan 01, 2010
  • Hiroaki Shiokawa +2
  • Conference Article
  • Citations12

An efficient dataflow execution method for mobile context monitoring applications

  • Mar 01, 2012
  • Younghyun Ju +4
  • Conference Article
  • Citations1

Improving Stream Load Balance through Shedding

  • Apr 01, 2021
  • Nikos R Katsipoulakis +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.