• Home
  • Search
  • Programming Models for Parallel Computing
  • Cite Icon27
  • https://doi.org/10.7551/mitpress/9486.001.0001Copy DOI Icon

Programming Models for Parallel Computing

  • Nov 6, 2015
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

An overview of the most prominent contemporary parallel processing programming models, written in a unique tutorial style. With the coming of the parallel computing era, computer scientists have turned their attention to designing programming models that are suited for high-performance parallel computing and supercomputing systems. Programming parallel systems is complicated by the fact that multiple processing units are simultaneously computing and moving data. This book offers an overview of some of the most prominent parallel programming models used in high-performance computing and supercomputing systems today. The chapters describe the programming models in a unique tutorial style rather than using the formal approach taken in the research literature. The aim is to cover a wide range of parallel programming models, enabling the reader to understand what each has to offer. The book begins with a description of the Message Passing Interface (MPI), the most common parallel programming model for distributed memory computing. It goes on to cover one-sided communication models, ranging from low-level runtime libraries (GASNet, OpenSHMEM) to high-level programming models (UPC, GA, Chapel); task-oriented programming models (Charm++, ADLB, Scioto, Swift, CnC) that allow users to describe their computation and data units as tasks so that the runtime system can manage computation and data movement as necessary; and parallel programming models intended for on-node parallelism in the context of multicore architecture or attached accelerators (OpenMP, Cilk Plus, TBB, CUDA, OpenCL). The book will be a valuable resource for graduate students, researchers, and any scientist who works with data sets and large computations. Contributors Timothy Armstrong, Michael G. Burke, Ralph Butler, Bradford L. Chamberlain, Sunita Chandrasekaran, Barbara Chapman, Jeff Daily, James Dinan, Deepak Eachempati, Ian T. Foster, William D. Gropp, Paul Hargrove, Wen-mei Hwu, Nikhil Jain, Laxmikant Kale, David Kirk, Kath Knobe, Ariram Krishnamoorthy, Jeffery A. Kuehn, Alexey Kukanov, Charles E. Leiserson, Jonathan Lifflander, Ewing Lusk, Tim Mattson, Bruce Palmer, Steven C. Pieper, Stephen W. Poole, Arch D. Robison, Frank Schlimbach, Rajeev Thakur, Abhinav Vishnu, Justin M. Wozniak, Michael Wilde, Kathy Yelick, Yili Zheng

Similar Papers
  • Research Article

Programming models and applications for multicores and manycores

  • Nov 26, 2015
  • Concurrency and Computation: Practice and Experience
  • Pavan Balaji +1
  • PDF
  • Research Article
  • Citations5

Accelerating Spark‐Based Applications with MPI and OpenACC

  • Jan 01, 2021
  • Complexity
  • Saeed Alshahrani +4
  • Research Article

Foreword to the special issue of the workshop on high performance computing systems (XVIII Simpósio em Sistemas Computacionais de Alto Desempenho, WSCAD 2017)

  • May 07, 2019
  • Concurrency and Computation: Practice and Experience
  • César A F De Rose +1
  • Research Article
  • Citations18

Empirical Analysis of HPC Using Different Programming Models

  • Jun 08, 2016
  • International Journal of Modern Education and Computer Science
  • Muhammad Usman Ashraf +2
  • Research Article
  • Citations1

Recent developments in high‐performance computing and simulation: distributed systems, architectures, algorithms, and applications

  • May 25, 2015
  • Concurrency and Computation: Practice and Experience
  • Waleed W Smari +2
  • Research Article
  • Citations2

Extreme-scale computing services over MPI: Experiences, observations and features proposal for next-generation message passing interface

  • Sep 10, 2014
  • The International Journal of High Performance Computing Applications
  • Judicael A Zounmevo +3
  • Single Book
  • Citations2

Implementing Parallel and Distributed Systems

  • Feb 09, 2023
  • Alireza Poshtkohi +1
  • Book Chapter
  • Citations1

A Systematic Mapping on High-Performance Computing for Protein Structure Prediction

  • Jan 01, 2019
  • Gesiel Rios Lopes +2
  • Conference Article
  • Citations13

Design Considerations for Building and Running Containerized MPI Applications

  • Nov 01, 2020
  • Joshua Hursey
  • Dissertation
  • Citations3

Energy Demand Response for High-Performance Computing Systems

  • Jun 08, 2018
  • Kishwar Ahmed
  • Research Article
  • Citations40

CPU/GPU computing for long-wave radiation physics on large GPU clusters

  • Aug 22, 2011
  • Computers & Geosciences
  • Fengshun Lu +3
  • Conference Article
  • Citations22

Impact of parallel programming models and CPUs clock frequency on energy consumption of HPC systems

  • Dec 01, 2011
  • Javier Balladini +3
  • Dissertation
  • Citations4

Optimizing programming models for massively parallel computers

  • Dec 12, 2008
  • Montse Farreras Esclusa
  • Research Article
  • Citations18

Approaches of enhancing interoperations among high performance computing and big data analytics via augmentation

  • Aug 03, 2019
  • Cluster Computing
  • Ajeet Ram Pathak +2
  • Conference Article

Impact of Data Dependent Computation of Parallel Programming in Multiprocessor Systems

  • Jan 01, 2012
  • Abu Asaduzzaman +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.