• Home
  • Search
  • Improving Grid Scheduling of Pipelined Data Processing by Combining Heuristic Algorithms and Simulated Annealing
  • Cite Icon1
  • https://doi.org/10.1109/imsccs.2006.79Copy DOI Icon

Improving Grid Scheduling of Pipelined Data Processing by Combining Heuristic Algorithms and Simulated Annealing

  • Jun 1, 2006
  • Qingjiang Wang +1 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

To improve the performance of pipelined data processing on computational grids, the method combining simulated annealing with a set of heuristic algorithms is presented to optimize grid scheduling. Pipelined data processing is divided into multiple sub-applications, and every sub-application is supposed moldable. Thus, sub-applications should be assigned onto their appropriate grid nodes, while parallel degrees should be determined reasonably. On one grid node, sub-applications are supposed to spatially share processor resources, and a set of heuristic algorithms is presented to optimize parallel degrees for different performance parameters respectively, based on which simulated annealing is simplified for optimizing sub-application assignments. Experiments show that the throughput or latency of pipelined data processing can be efficiently improved by the optimization of grid scheduling

Similar Papers
  • Research Article
  • Citations62

Enhancing the genetic-based scheduling in computational grids by a structured hierarchical population

  • Apr 19, 2011
  • Future Generation Computer Systems
  • Joanna Kołodziej +1
  • Research Article
  • Citations11

Development of Data Processing and Analysis Pipeline for the Ricochet Experiment

  • Nov 21, 2022
  • Journal of Low Temperature Physics
  • J Colas +4
  • Research Article
  • Citations3

Colony of cooperating agents based independent job scheduling in a computation grid

  • Jun 07, 2011
  • International Journal of Intelligent Computing and Cybernetics
  • Tarek Helmy +1
  • Research Article
  • Citations11

Entropic Grid Scheduling

  • Jun 02, 2006
  • Journal of Grid Computing
  • Youcef Derbal
  • Conference Article
  • Citations19

Implications of Programming Language Selection for Serverless Data Processing Pipelines

  • Aug 01, 2020
  • Robert Cordingly +7
  • Research Article
  • Citations1

ARCHITECTURAL APPROACHES TO SCALING FINANCIAL SYSTEMS BASED ON SAP HANA

  • Sep 01, 2024
  • The American Journal of Engineering and Technology
  • Michal Gembčík
  • Conference Article
  • Citations1

Minimizing response latency via efficient virtual machine placement in cloud systems

  • Dec 01, 2015
  • Hou Deng +4
  • Conference Article
  • Citations1

Modelling of User Requirements and Behaviors in Computational Grids

  • Nov 01, 2010
  • Joanna Kolodziej +1
  • Research Article
  • Citations78

Efficient Batch Job Scheduling in Grids Using Cellular Memetic Algorithms

  • Feb 22, 2008
  • Journal of Mathematical Modelling and Algorithms
  • Fatos Xhafa +3
  • Research Article
  • Citations69

Energy efficient genetic‐based schedulers in computational grids

  • Apr 23, 2012
  • Concurrency and Computation: Practice and Experience
  • Joanna Kołodziej +3
  • Book Chapter
  • Citations10

Linguistic Geometry tools generate optimal solutions

  • Jan 01, 1996
  • Boris Stilman
  • Dissertation

The impact of local priority policies on grid scheduling performance and and adaptive policy-based grid scheduling algorithm

  • Jan 01, 2004
  • Siraprapa Wiriyaprasit
  • PDF
  • Research Article
  • Citations2

Comparison of sequencing methods and data processing pipelines for whole genome sequencing and minority single nucleotide variant (mSNV) analysis during an influenza A/H5N8 outbreak

  • Feb 20, 2020
  • PLoS ONE
  • Marjolein J Poen +12
  • Book Chapter
  • Citations17

A Cost-Based Online Scheduling Algorithm for Job Assignment on Computational Grids

  • Jan 01, 2003
  • Chuliang Weng +1
  • Conference Article

Synergy of Task Allocation Techniques for Large Computational Grids

  • Jun 01, 2009
  • Ilias K Savvas
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.