• Home
  • Search
  • Incremental Parallel and Distributed Systems
  • Cite Icon20
  • https://doi.org/10.22028/d291-25419Copy DOI Icon

Incremental Parallel and Distributed Systems

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Incremental computation strives for efficient successive runs of applications by reexecuting only those parts of the computation that are affected by a given input change instead of recomputing everything from scratch. To realize the benefits of incremental computation, researchers and practitioners are developing new systems where the application programmer can provide an efficient update mechanism for changing application data. Unfortunately, most of the existing solutions are limiting because they not only depart from existing programming models, but also require programmers to devise an incremental update mechanism (or a dynamic algorithm) on a per-application basis. In this thesis, we present incremental parallel and distributed systems that enable existing real-world applications to automatically benefit from efficient incremental updates. Our approach neither requires departure from current models of programming, nor the design and implementation of dynamic algorithms. To achieve these goals, we have designed and built the following incremental systems: (i) Incoop — a system for incremental MapReduce computation; (ii) Shredder — a GPU-accelerated system for incremental storage; (iii) Slider — a stream processing platform for incremental slidingwindow analytics; and (iv) iThreads — a threading library for parallel incremental computation. Our experience with these systems shows that significant performance can be achieved for existing applications without requiring any additional effort from programmers.

Similar Papers
  • Conference Article
  • Citations48

Large-scale incremental data processing with change propagation

  • Jun 14, 2011
  • Pramod Bhatotia +4
  • Supplementary Content
  • Citations1

Programming abstractions, compilation, and execution techniques for massively parallel data analysis

  • Apr 28, 2015
  • DepositOnce
  • Stephan Ewen
  • Research Article
  • Citations2

CEIU: Consistent and Efficient Incremental Update mechanism for mobile systems on flash storage

  • May 03, 2024
  • Journal of Systems Architecture
  • Ruiqing Lei +5
  • Research Article

Parallel Numeric Algorithms On Faster Computers

  • Jan 03, 2001
  • Scalable Computing Practice and Experience
  • Roman Trobec
  • Research Article
  • Citations1

Programming Language Techniques for Incremental and Reactive Computing (Dagstuhl Seminar 16402).

  • Jan 01, 2016
  • DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
  • Camil Demetrescu +3
  • Supplementary Content

Massively parallel stream processing with latency guarantees

  • Jan 01, 2016
  • DepositOnce
  • Björn Lohrmann
  • Research Article
  • Citations7

Mobility in Distributed Systems

  • Jan 01, 2006
  • Scalable Computing Practice and Experience
  • Niranjan Suri +1
  • Research Article
  • Citations3

A portable, high-level graph analytics framework targeting distributed, heterogeneous systems

  • Nov 13, 2016
  • Robert Schleicher +2
  • Conference Article

ClusterGOP: A high-level parallel programming environment

  • Aug 15, 2004
  • Jiannong Cao
  • Conference Article
  • Citations86

Shredder: GPU-accelerated incremental storage and computation

  • Feb 14, 2012
  • Pramod Bhatotia +2
  • Conference Article
  • Citations26

AStream

  • Jun 25, 2019
  • Jeyhun Karimov +2
  • Research Article
  • Citations7

FAULT-TOLERANT AND TRANSACTIONAL MOBILE AGENT EXECUTION

  • Jan 01, 2002
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne)
  • Stefan Pleisch
  • Research Article
  • Citations656

Programming Massively Parallel Processors. A Hands-on Approach

  • Jan 01, 2010
  • Scalable Computing Practice and Experience
  • Jie Cheng
  • PDF
  • Research Article
  • Citations10

StreamingCube: Seamless Integration of Stream Processing and OLAP Analysis

  • Jan 01, 2020
  • IEEE Access
  • Salman Ahmed Shaikh +1
  • Research Article
  • Citations1

Conflict-Free 3D Path Planning for Multi-UAV Based on Jump Point Search and Incremental Update

  • Oct 04, 2025
  • Drones
  • Yuan Lu +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.