• Home
  • Search
  • Scalable Parallel Computing: Technology, Architecture, Programming
  • Cite Icon13
  • https://doi.org/10.12694/scpe.v2i1.106Copy DOI Icon

Scalable Parallel Computing: Technology, Architecture, Programming

Show More
  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

Kai Hwang and Zhiwei Xu McGraw-Hill, Boston, 1998, 802 pp. ISBN 0-07-031798-4, $97.30 This text is an in depth introduction to the concepts of Parallel Computing. Designed for use in university level computer science courses, the text covers scalable architecture and parallel programming of symmetric muli-processors, clusters of workstations, massively parallel processors, and Internet-based metacomputing platforms. Hwang and Xu give an excellent overview in these topics while keeping the text easily comprehensible. The text is organized into four parts. Part I covers scalability and clustering. Part II deals with the technology used to construct a parallel system. Part III pertains to the architecture of scalable systems. Finally, Part IV presents methods of parallel programming on various platforms and languages. The first chapter presents different models on scalability as divided into resources, applications, and technology. It defines three abstract models (PRAM, BSP, and phase parallel models) and five physical models (PVP, SMP, MPP, COW, and MPP systems). Chapter 2 introduces the ideas behind parallel programming including processes, tasks, threads and environments. Chapter 3 introduces performance issues and metrics. As an introduction to Part II, Chapter 4 introduces the history of microprocessor types and their applications in the architectures of current systems. Chapter 5 deals with the issues of distributed memory. It discusses several models such as UMA, NORMA, CC-NUMA, COMA, and DSM. Chapter 6 presents gigabit networks, switched interconnects, and other various high-speed networking architectures to construct clusters. Chapter 7 discusses the overheads created by parallel computing, such as threads, synchronization, and efficient communication between nodes. Part III, Chapter 8, 9 and 11, give comparisons between various types of scalable systems (SMP, CC-NUMA, Clusters, and MPP). The comparisons are based on hardware architecture, the system software, and special features that make each system unique. Chapter 10 compares various research and commercial clusters with an in depth study of the Berkeley NOW, IBM SP2, and Digital TruCluster systems. Chapter 12 introduces the concepts of Part IV with details into parallel programming paradigms. Chapter 13 discusses communications between the processors using message passing programming (such as MPI and PVM libraries). Chapter 14 studies the data parallel approach with an emphasis in Fortran 90 and HPF. With attention to detail through examples, Hwang and Xu have created a well-written introduction to Parallel Computing. The authors are distinguished for their contributions in this field. This text is based on cutting-edge research, providing the current theories that are in use in industry today. Bin Cong, Shawn Morrison and Michael Yorg, Department of Computer Science California Polytechnic State University at San Luis Obispo

Similar Papers
  • Research Article

Structured Development of Parallel Programs

  • Jan 01, 1999
  • Scalable Computing Practice and Experience
  • Domenico Talia
  • Research Article

Optimization of recurrence computations on vector and parallel computers

  • Oct 19, 2008
  • Digital Library of the Silesian University of Technology (Silesian University of Technology)
  • Przemysław Stpiczyński
  • Research Article

Parallel Numeric Algorithms On Faster Computers

  • Jan 03, 2001
  • Scalable Computing Practice and Experience
  • Roman Trobec
  • Supplementary Content
  • Citations1

Exploring the gender inequity in tertiary computer science courses: influential factors in females’ choices in Australia and Taiwan

  • Feb 28, 2017
  • Figshare
  • Shu-Hua Chao
  • Research Article

OpenMP: Experiences, Implementations and Applications

  • Jan 01, 2002
  • Scalable Computing Practice and Experience
  • Ami Marowka
  • Research Article

Parallel Computing in Optimization.

  • Jan 01, 2000
  • Scalable Computing Practice and Experience
  • Andrzej Stachurski
  • Research Article

Parallel Numerics and Applications

  • Jan 01, 2002
  • Scalable Computing Practice and Experience
  • Roman Trobec +3
  • Research Article

Inferring Scalability from Program Pseudocode

  • Jan 01, 2014
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne)
  • Mihai Leția
  • Research Article

Methodologies for automated synthesis of memory and interconnect subsystems in parallel architectures

  • Mar 29, 2015
  • Università degli Studi di Napoli Federico II
  • Luca Gallo
  • Research Article

High-Performance Cluster Computing. Volume 1: Architecutes and Systems. Volume 2: Programming and Applications

  • Jan 01, 1999
  • Scalable Computing Practice and Experience
  • C.P Ravikumar
  • Research Article
  • Citations656

Programming Massively Parallel Processors. A Hands-on Approach

  • Jan 01, 2010
  • Scalable Computing Practice and Experience
  • Jie Cheng
  • Research Article

A New, Architectural Paradigm for High-performance Computing

  • Jan 01, 1999
  • Scalable Computing Practice and Experience
  • David A Bader
  • Conference Article

Advanced Cluster Programming with MPI

  • Oct 08, 2001
  • Bill Gropp
  • Conference Article

Scalable parallel and cluster computing

  • Jan 01, 1997
  • Kai Hwang
  • Research Article

Unconventional Parallel Architectures

  • Jan 01, 2000
  • Scalable Computing Practice and Experience
  • Yakov I Fet +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.