• Cite Icon3
  • https://doi.org/10.1007/978-3-642-32129-0_4Copy DOI Icon

Parallel Computing Goes Mainstream

  • Jan 1, 2012
  • Sunil D Sherlekar
Show More
  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

For several decades now (since Gordon More conjectured his Moore’s “Law”), the computing industry has benefited from ever-increasing processor speed. Application developers, therefore, had the privilege of planning ahead for more powerful application software with the assurance that the computing power required will be available. Processor manufacturers could also plan to keep increasing processor speeds with the assurance that application developers were ready to use them. In terms of programmer productivity, the most important implication was that most programmers could write sequential code; the only exceptions being those who wrote operating systems or application software for “supercomputers”. A few years ago, this convenient symbiotic relationship began to unravel. The main “culprit” was limitations of technology. It was no longer feasible to make processors faster because it was not possible to handle the heat generated by the faster circuitry. Fortunately, Moore’s Law continues to hold, hence it is possible to keep packing an increasing number of transistors on a chip. Given the continued opportunity provided by Moore’s Law and faced with the heat dissipation problem, the industry stopped increasing the speed of processors and, instead, started designing chips with multiple processors. This meant that the industry could still bring out chips which had increasing computing power albeit with each processor “core” not getting any faster. The downside of this development is that all programmers — and not just a few select ones — need to write parallel programs to be able to actually use the computing power of multi-processor or multi-core chips. Parallel Programming has to go mainstream. There are two challenges a programmer faces when designing parallel programs: ensuring correctness and extracting the maximum possible performance. Over the last few decades, the Computer Science community has addressed the challenge of correctness fairly well. Besides developing alternative programming paradigms — shared-memory and message-passing — programming languages have been designed with appropriate constructs to help (but not necessarily ensure) absence of typical parallel-programming bugbears such as deadlocks and race conditions. What is still sorely lacking, however, is any systematic methodology to improve the performance of programs. Getting the best possible performance for a given parallel program from the underlying hardware is still an art, bordering on “black magic”. The industry is in a dire need to create such a systematic methodology. The primary obstacle to creating such a systematic methodology is that we do not yet have a programming model of hardware at the right level of abstraction. We have the ISA (Instruction Set Architecture) that is excellent for addressing functionality but has no information about hardware performance. At the other end of the spectrum, we have the RTL (Register-Transfer Level) model of hardware that provides information about hardware performance but is too detailed (not abstract enough) to be useful to programmers (at least those who are not experts). The industry today is witnessing acceleration in the rate of reduction of hardware costs, an example being the one teraflops double-precision performance of Intel’s KNC chip. This has created the exciting opportunity to bring high-performance computing into the mainstream. However, to make this happen needs a large number of engineers who can design correct and efficient parallel programs. Today we have a fairly good systematic methodology to design parallel programs that are functionally correct. Programmer productivity is being further enhanced with the development of Domain-Specific Languages (DSL’s). This needs to be urgently complemented with a systematic methodology to enhance performance on a given target hardware platform. The development of such a methodology must form one of the core themes of research for the computing community.

Similar Papers
  • Conference Article
  • Citations3

Compiler for a simplified programming language aiming on Multi Core Students' Experimental Processor

  • Dec 01, 2015
  • Y M R D Wepathana +2
  • Book Chapter

Parallel Programming: Models, Methods, and Languages

  • Jan 01, 1999
  • Luc Bougé +3
  • Conference Article
  • Citations6

Automatic lock-free parallel programming on multi-core processors

  • Jul 01, 2016
  • Gopinath Chennupati +2
  • Research Article
  • Citations73

Transactional memory support in the IBM POWER8 processor

  • Jan 01, 2015
  • IBM Journal of Research and Development
  • H Q Le +8
  • Book Chapter
  • Citations5

The use of interpreted languages for implementing parallel algorithms on distributed systems

  • Jan 01, 1996
  • Noemi Rodriguez +3
  • Conference Article
  • Citations6

Mechanisms that separate algorithms from implementations for parallel patterns

  • Mar 30, 2010
  • Christopher D Krieger +2
  • Conference Article

High level languages for efficient parallel programming

  • Jul 01, 2012
  • Sebastien Limet
  • Conference Article
  • Citations1

Metalinguistic features for formal parallel-program transformation

  • Jan 02, 2003
  • J.A Yang +1
  • Conference Article
  • Citations5

Balanced trees inhabiting functional parallel programming

  • Sep 19, 2011
  • Akimasa Morihata +1
  • Conference Article
  • Citations56

The parascope editor: an interactive parallel programming tool

  • Jan 01, 1989
  • V Balasundaram +4
  • Research Article
  • Citations4

Balanced trees inhabiting functional parallel programming

  • Sep 18, 2011
  • ACM SIGPLAN Notices
  • Akimasa Morihata +1
  • Single Report
  • Citations2

Domain Morphisms: A New Construct for Parallel Programming and Formalizing Program Optimization

  • Aug 01, 1990
  • Marina Chen +1
  • Research Article

Research of Parallel Program Performance Analysis and Optimization on Multicore Platform

  • Aug 16, 2013
  • Yingyan Teng +1
  • Research Article
  • Citations4

Automating resource allocation for multiprocessors

  • Jan 01, 1989
  • Journal of Systems and Software
  • Karsten Schwan +1
  • Research Article
  • Citations10

Verifying safety and accuracy of approximate parallel programs via canonical sequentialization

  • Oct 10, 2019
  • Proceedings of the ACM on Programming Languages
  • Vimuth Fernando +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.