• Home
  • Search
  • Implications of Programming Language Selection for Serverless Data Processing Pipelines
  • Cite Icon19
  • https://doi.org/10.1109/dasc-picom-cbdcom-cyberscitech49142.2020.00120Copy DOI Icon

Implications of Programming Language Selection for Serverless Data Processing Pipelines

  • Aug 1, 2020
  • Robert Cordingly +7 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Serverless computing platforms have emerged offering software engineers an option for application hosting without the need to configure servers or manage scaling while guaranteeing high availability and fault tolerance. In the ideal scenario, a developer should be able to create a microservice, deploy it to a serverless platform, and never have to manage or configure anything; a truly serverless platform. The current implementation of serverless computing platforms is known as Function-as-a-Service or FaaS. Adoption of FaaS platforms, however, requires developers to address a major question- what programming language should functions be written in? To investigate this question, we implemented identical multi-function data processing pipelines in Java, Python, Go, and Node.js. Using these pipelines as a case study, we ran experiments tailored to investigate FaaS data processing performance. Specifically, we investigate data processing performance implications: for data payloads of varying size, with cold and warm serverless infrastructure, over scaling workloads, and when varying the available function memory. We found that Node.js had up to 94% slower runtime vs. Java for the same workload. In other scenarios, Java had 20% slower runtime than Go resulting from differences in how the cloud provider orchestrates infrastructure for each language with respect to the serverless freeze/thaw lifecycle. We found that no single language provided the best performance for every stage of a data processing pipeline and the fastest pipeline could be derived by combining a hybrid mix of languages to optimize performance.

Similar Papers
  • Research Article
  • Citations11

Development of Data Processing and Analysis Pipeline for the Ricochet Experiment

  • Nov 21, 2022
  • Journal of Low Temperature Physics
  • J Colas +4
  • Book Chapter
  • Citations1

Chapter 15 - A reliable blockchain and edge–cloud architecture for facilitating fault-tolerant IoT applications

  • Jan 01, 2021
  • Blockchain for Smart Cities
  • A Amuthan
  • Conference Article
  • Citations2

Methods of voxel data rendering for visualizing on multi-layer volumetric displays

  • May 16, 2018
  • Gatis Valters +7
  • Conference Article
  • Citations1

Improving Grid Scheduling of Pipelined Data Processing by Combining Heuristic Algorithms and Simulated Annealing

  • Jun 01, 2006
  • Qingjiang Wang +1
  • PDF
  • Research Article
  • Citations23

PMA: Protein Microarray Analyser, a user-friendly tool for data processing and normalization

  • Feb 27, 2018
  • BMC Research Notes
  • Jessica Da Gama Duarte +3
  • PDF
  • Research Article
  • Citations2

Comparison of sequencing methods and data processing pipelines for whole genome sequencing and minority single nucleotide variant (mSNV) analysis during an influenza A/H5N8 outbreak

  • Feb 20, 2020
  • PLoS ONE
  • Marjolein J Poen +12
  • Research Article
  • Citations216

Missing values in mass spectrometry based metabolomics: an undervalued step in the data processing pipeline

  • Oct 08, 2011
  • Metabolomics
  • Olga Hrydziuszko +1
  • Research Article
  • Citations61

Analyzing, modeling and evaluating dynamic adaptive fault tolerance strategies in cloud computing environments

  • Mar 21, 2013
  • The Journal of Supercomputing
  • Dawei Sun +3
  • Research Article

Gain efficiency with streamlined and automated data processing: Examples from high-throughput monoclonal antibody production.

  • Jul 01, 2025
  • PloS one
  • Malwina Kotowicz +16
  • Research Article

Automated structural modeling in biological small-angle X-ray scattering

  • Aug 05, 2014
  • Acta Crystallographica Section A Foundations and Advances
  • Dmitry Svergun
  • Research Article
  • Citations1

ARCHITECTURAL APPROACHES TO SCALING FINANCIAL SYSTEMS BASED ON SAP HANA

  • Sep 01, 2024
  • The American Journal of Engineering and Technology
  • Michal Gembčík
  • Conference Article
  • Citations4

Node covering, error correcting codes and multiprocessors with very high average fault tolerance

  • Jun 27, 1995
  • S Dutt +1
  • Conference Article
  • Citations15

Adaptive image focusing

  • Aug 05, 2014
  • John T Etgen +3
  • Conference Article
  • Citations4

Design of Fault Tolerant Universal Logic in QCA

  • Dec 01, 2014
  • Bibhash Sen +3
  • Preprint Article

Rescuing the Winds: Up-to-date Open Access to the Historic QBO Time Series

  • Jul 16, 2025
  • Tobias Kerzenmacher +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.