• Home
  • Search
  • CharmPy: A Python Parallel Programming Model
  • Cite Icon17
  • https://doi.org/10.1109/cluster.2018.00059Copy DOI Icon

CharmPy: A Python Parallel Programming Model

  • Sep 1, 2018
  • Juan J Galvez +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Parallel programming can be extremely challenging. Programming models have been proposed to simplify this task, but wide acceptance of these remains elusive for many reasons, including the demand for greater accessibility and productivity. In this paper, we introduce a parallel programming model and framework called CharmPy, based on the Python language. CharmPy builds on Charm++, and runs on top of its C++ runtime. It presents several unique features in the form of a simplified model and API, increased flexibility, and the ability to write everything in Python. CharmPy is a high-level model based on the paradigm of distributed migratable objects. It retains the benefits of the Charm++ runtime, including dynamic load balancing, asynchronous execution model with automatic overlap of communication and computation, high performance, and scalability from laptops to supercomputers. By being Python-based, CharmPy also benefits from modern language features, access to popular scientific computing and data science software, and interoperability with existing technologies like C, Fortran and OpenMP. To illustrate the simplicity of the model, we will show how to implement a distributed parallel map function based on the Master-Worker pattern using CharmPy, with support for asynchronous concurrent jobs. We also present performance results running stencil code and molecular dynamics mini-apps fully written in Python, on Blue Waters and Cori supercomputers. For stencil3d, we show performance similar to an equivalent MPI-based program, and significantly improved performance for imbalanced computations. Using Numba to JIT-compile the critical parts of the code, we show performance for both mini-apps similar to the equivalent C++ code.

Similar Papers
  • Research Article
  • Citations48

The NAS Parallel Benchmarks for evaluating C++ parallel programming frameworks on shared-memory architectures

  • Jul 19, 2021
  • Future Generation Computer Systems
  • Júnior Löff +6
  • Conference Article
  • Citations14

Target container: A target-centric parallel programming abstraction for video-based surveillance

  • Aug 01, 2011
  • Kirak Hong +5
  • Dissertation
  • Citations4

Optimizing programming models for massively parallel computers

  • Dec 12, 2008
  • Montse Farreras Esclusa
  • Conference Article
  • Citations7

Mapping OpenMP concepts to the stream programming model

  • Aug 01, 2010
  • Tao Tang +2
  • Research Article
  • Citations2

VORD: A Versatile On-the-fly Race Detection Tool in OpenMP Programs

  • Jul 25, 2013
  • International Journal of Parallel Programming
  • Young-Joo Kim +2
  • Research Article
  • Citations3

Hybrid-view programming of nuclear fusion simulation code in the PGAS parallel programming language XcalableMP

  • Jun 01, 2016
  • Parallel Computing
  • Keisuke Tsugane +5
  • Conference Article
  • Citations5

Hybrid-view programming of nuclear fusion simulation code in the PGAS parallel programming language XcalableMP

  • Dec 01, 2014
  • Keisuke Tsugane +6
  • Book Chapter
  • Citations1

Microtasking versus Message Passing Parallelisation of the 3D-Combustion Code AIOLOS on the NEC SX-4

  • Jan 01, 1998
  • Parallel Computational Fluid Dynamics '97
  • B Risio +3
  • Conference Article
  • Citations24

Semantics of asynchronous JavaScript

  • Oct 24, 2017
  • Matthew C Loring +2
  • Conference Article
  • Citations2

Analysis of the parallel programming models in Haskell for many-core systems

  • Apr 01, 2018
  • Xiao Liu +4
  • Book Chapter
  • Citations10

Performance issues in parallel programming

  • Jan 01, 1992
  • Gianfranco Balbo
  • Conference Article
  • Citations4

Parallel programming models and their interdependence with parallel architectures

  • Sep 20, 1993
  • W.K Giloi
  • Research Article
  • Citations9

Requirements-preserving design automation for multiprocessor embedded system applications

  • Jun 05, 2020
  • Journal of Ambient Intelligence and Humanized Computing
  • Md Al Maruf +1
  • Conference Article

Adaptive Runtime Features for Distributed Graph Algorithms

  • Dec 01, 2018
  • Jesun Sahariar Firoz +3
  • Book Chapter
  • Citations4

Dynamic Analysis to Support Program Development with the Textually Aligned Property for OpenSHMEM Collectives

  • Jan 01, 2015
  • Andreas Knüpfer +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.