• Home
  • Search
  • Sequence Similarity Parallelization over Heterogeneous Computer Clusters Using Data Parallel Programming Model
  • https://doi.org/10.12694/scpe.v18i1.1233Copy DOI Icon

Sequence Similarity Parallelization over Heterogeneous Computer Clusters Using Data Parallel Programming Model

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Sequence similarity, as a special case of data intensive applications, is one of the neediest applications for parallelization. Clustered commodity computers as a cost-effective platform for distributed and parallel processing, can be leveraged to parallelize sequence similarity. However, manually designing and developing parallel programs on commodity computers is a time-consuming, complex and error-prone process. In this paper, we present a sequence similarity parallelization technique using the Apache Storm as a stream processing framework with a data parallel programming model. Storm automatically parallelizes computations via a special user-defined topology that is represented as a directed acyclic graph. The proposed technique collects streams of data from a disk and sends them sequence by sequence to clustered computers for parallel processing. We also present a dispatching policy for balancing the cluster workload and managing the cluster heterogeneity to achieve more than 99 percent parallelism. An alignment-free method, known as n-gram modeling, is used to calculate similarities between the sequences. To show the cost-performance superiority of our method on clustered commodity computers over serial processing in powerful computers, we simply use UniProtKB/SwissProt dataset for evaluation of the performance of sequence similarity as an interesting large-scale Bioinformatics application.

Similar Papers
  • Research Article
  • Citations3

HeteroPBLAS: A Set of Parallel Basic Linear Algebra Subprograms Optimized for Heterogeneous Computational Clusters

  • Jan 01, 2009
  • Scalable Computing Practice and Experience
  • Ravi Reddy +2
  • Book Chapter
  • Citations9

Load Balancing between Heterogeneous Computing Clusters

  • Jan 01, 2004
  • Siu-Cheung Chau +1
  • PDF
  • Research Article
  • Citations15

Distinguishing between parallel and serial processing in visual attention from neurobiological data.

  • Jan 01, 2020
  • Royal Society Open Science
  • Kang Li +5
  • Research Article

Mapping strategies in data parallel programming models; the projection methods

  • Jan 01, 2001
  • Scalable Computing Practice and Experience
  • Nahid Emad
  • Research Article
  • Citations1

Heterogeneous and unconventional cluster architectures and applications

  • Jul 01, 2018
  • Concurrency and Computation: Practice and Experience
  • Holger Fröning +1
  • Conference Article
  • Citations4

Parallel solvers for dense linear systems for heterogeneous computational clusters

  • May 01, 2009
  • Ravi Reddy +2
  • Research Article

Scalable and Distributed Mathematical Modeling Algorithm Design and Performance Evaluation in Heterogeneous Computing Clusters

  • Aug 01, 2024
  • Scalable Computing: Practice and Experience
  • Zhouding Liu +1
  • Research Article
  • Citations39

A Parallel Loop Self-Scheduling on Extremely Heterogeneous PC Clusters

  • Mar 01, 2004
  • Journal of Information Science and Engineering
  • Chao‐Tung Yang +1
  • Research Article

Parallel and Distributed Computing Techniques, Selection of papers from ISPDC 2008

  • Jan 01, 2009
  • Scalable Computing Practice and Experience
  • Marek Tudruj
  • Research Article
  • Citations102

Parallel versus serial processing in visual search: Further evidence from subadditive effects of visual quality.

  • Jan 01, 1991
  • Journal of Experimental Psychology: Human Perception and Performance
  • Howard E Egeth +1
  • PDF
  • Research Article
  • Citations3

Решение прикладных задач с использованием DVM-системы

  • Feb 01, 2019
  • Bulletin of the South Ural State University. Series "Computational Mathematics and Software Engineering"
  • В.А Бахтин +5
  • Conference Article
  • Citations5

Heterogeneous PBLAS: Optimization of PBLAS for Heterogeneous Computational Clusters

  • Jul 01, 2008
  • Ravi Reddy Manumachu +2
  • Research Article
  • Citations6

The experience of using DVM and SAPFOR systems in semi automatic parallelization of an application for 3D modeling in geophysics

  • Aug 27, 2018
  • The Journal of Supercomputing
  • Nikita Kataev +1
  • Book Chapter
  • Citations4

Distributed Prime Sieve in Heterogeneous Computer Clusters

  • Jan 01, 2014
  • Carlos M Costa +2
  • Research Article
  • Citations13

A hierarchical Bayesian approach to distinguishing serial and parallel processing

  • Jun 03, 2017
  • Journal of Mathematical Psychology
  • Joseph W Houpt +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.