• Home
  • Search
  • Translation of array-based loops to distributed data-parallel programs
  • Cite Icon13
  • https://doi.org/10.14778/3389133.3389141Copy DOI Icon

Translation of array-based loops to distributed data-parallel programs

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Large volumes of data generated by scientific experiments and simulations come in the form of arrays, while programs that analyze these data are frequently expressed in terms of array operations in an imperative, loop-based language. But, as datasets grow larger, new frameworks in distributed Big Data analytics have become essential tools to large-scale scientific computing. Scientists, who are typically comfortable with numerical analysis tools but are not familiar with the intricacies of Big Data analytics, must now learn to convert their loop-based programs to distributed data-parallel programs. We present a novel framework for translating programs expressed as array-based loops to distributed data parallel programs that is more general and efficient than related work. We report on a prototype implementation on top of Spark and evaluate the performance of our system relative to hand-written programs.

Similar Papers
  • Conference Article

Enabling flexible power generation systems: experimental Facility and novel numerical tools for thermal field Optimization

  • Sep 06, 2025
  • Proceedings
  • Godwin Chukwuemeka Nwangele +4
  • Research Article
  • Citations2

Big data in drug design

  • Feb 01, 2015
  • Chinese Science Bulletin
  • Ling Wang +6
  • Conference Article
  • Citations1

Graphical Solution of the Transient Heat Transfer Problem

  • Jan 01, 2008
  • AIP conference proceedings
  • Resul Dilsiz +1
  • Research Article
  • Citations58

FaceBase 3: analytical tools and FAIR resources for craniofacial and dental research.

  • Sep 15, 2020
  • Development (Cambridge, England)
  • Bridget D Samuels +38
  • PDF
  • Research Article
  • Citations278

A survey of data partitioning and sampling methods to support big data analysis

  • Jun 01, 2020
  • Big Data Mining and Analytics
  • Mohammad Sultan Mahmud +4
  • Conference Article
  • Citations2

Application of Numerical Analysis Tools on the Performance Improvement of Umbilicals and Their Elements

  • Oct 29, 2013
  • OTC Brasil
  • Rene Santos Almeida +3
  • Research Article
  • Citations4

Assessment of PECM as an efficient numerical analysis tool for investigating convective heat transfer phenomena during PCM melting

  • Jun 19, 2019
  • Journal of Energy Storage
  • Mohammad Khan +2
  • Research Article
  • Citations73

Big spatial vector data management: a review

  • Jan 02, 2018
  • Big Earth Data
  • Xiaochuang Yao +1
  • Conference Article
  • Citations17

Management of Distributed Big Data for Social Networks

  • May 01, 2016
  • Carson K Leung +1
  • Research Article

Stability analysis of an abandoned deep metal mine using numerical analysis tool: A case study

  • Oct 01, 2021
  • IOP Conference Series: Earth and Environmental Science
  • Praveena Das Jennifer +3
  • Research Article
  • Citations30

An intelligent interface between symbolic and numeric analysis tools required for the development of an integrated CAD system

  • Jan 01, 1996
  • Computers & Industrial Engineering
  • Utpal Roy
  • Conference Article
  • Citations24

Power Amplifier Design Optimization with Simultaneous Cooperation of EDA Tool and Numeric Analyzer

  • Oct 01, 2018
  • Lida Kouhalvandi +2
  • Conference Article
  • Citations7

Output Thresholding for Ensemble Learners and Imbalanced Big Data

  • Nov 01, 2021
  • Justin M Johnson +1
  • Book Chapter
  • Citations1

Big Data Modelling for Predicting Side-Effects of Anticancer Drugs: A Comprehensive Approach

  • Aug 24, 2019
  • Sai Jyothi Bolla +1
  • Conference Article
  • Citations10

Retrieving Information and Discovering Knowledge from Unstructured Data Using Big Data Mining Technique: Heavy Oil Fields Example

  • Dec 10, 2014
  • Wenkuang Wu +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.