• https://doi.org/10.1002/9781119545293.ch5Copy DOI Icon

Streaming Data Processing forIoT

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

The early Internet of Things stream processing platforms were mainly designed to collect and display real‐time raw sensor measurements. Data often has to go through several phases of processing to lead to actionable automatic or human decision making. This chapter discusses five main operations performed on streaming data: compression, dimensionality reduction, summarization, learning, and visualization. It distinguishes two main types of stream data processing systems. The first type, also called a data stream management system, is based on relational database principles and introduced the concept of continuous queries. The second type does not enforce a relational view and enables the creation of custom operators. Based on batch and stream processing paradigms, two data processing architectures emerged: the Lambda architecture, which enables both batch and stream processing, and the simpler Kappa architecture, which enables stream processing.

Similar Papers
  • Conference Article
  • Citations7

Cyclone: Unified Stream and Batch Processing

  • Aug 01, 2016
  • Matu Harvan +2
  • PDF
  • Research Article
  • Citations37

Hybrid Workflow Scheduling on Edge Cloud Computing Systems

  • Jan 01, 2021
  • IEEE Access
  • Raed Alsurdeh +3
  • Book Chapter
  • Citations16

Stream Processing on Demand for Lambda Architectures

  • Jan 01, 2015
  • Johannes Kroß +4
  • Conference Article
  • Citations9

Efficient support for multi-resolution queries in global sensor networks

  • Jul 04, 2011
  • Andreas Benzing +2
  • PDF
  • Research Article
  • Citations4

S2p: Provenance Research for Stream Processing System

  • Jun 15, 2021
  • Applied Sciences
  • Qian Ye +1
  • Research Article
  • Citations108

A Comprehensive Survey on Parallelization and Elasticity in Stream Processing

  • Apr 30, 2019
  • ACM Computing Surveys
  • Henriette Röger +1
  • Research Article
  • Citations2

Topology-aware task allocation for online distributed stream processing applications with latency constraints

  • Jul 24, 2019
  • Physica A: Statistical Mechanics and its Applications
  • Xiaohui Wei +2
  • Book Chapter
  • Citations12

Chapter 11 - A Taxonomy and Survey of Stream Processing Systems

  • Jan 01, 2017
  • Software Architecture for Big Data and the Cloud
  • Xinwei Zhao +3
  • Conference Article
  • Citations7

High-Performance Stateful Stream Processing on Solid-State Drives

  • Aug 27, 2018
  • Gyewon Lee +4
  • Conference Article
  • Citations50

Rule-based multi-query optimization

  • Mar 24, 2009
  • Mingsheng Hong +4
  • PDF
  • Research Article
  • Citations40

A Distributed Stream Processing Middleware Framework for Real-Time Analysis of Heterogeneous Data on Big Data Platform: Case of Environmental Monitoring

  • Jun 03, 2020
  • Sensors (Basel, Switzerland)
  • Adeyinka Akanbi +1
  • Conference Article
  • Citations26

Mobile storm: Distributed real-time stream processing for mobile clouds

  • Oct 01, 2015
  • Qian Ning +3
  • Research Article
  • Citations10

An efficient approach for low latency processing in stream data.

  • Mar 10, 2021
  • PeerJ Computer Science
  • Nirav Bhatt +1
  • Conference Article
  • Citations3

Comparative Analysis of GPU Stream Processing between Persistent and Non-persistent Kernels

  • Oct 19, 2022
  • Suhwan Kim +2
  • Conference Article
  • Citations2

VAStream

  • Jul 28, 2019
  • Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning)
  • Satya Katragadda +9
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.