• Home
  • Search
  • Predicting queue wait time probabilities for multi-scale computing
  • Cite Icon14
  • https://doi.org/10.1098/rsta.2018.0151Copy DOI Icon

Predicting queue wait time probabilities for multi-scale computing

  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

We describe a method for queue wait time prediction in supercomputing clusters. It was designed for use as a part of multi-criteria brokering mechanisms for resource selection in a multi-site High Performance Computing environment. The aim is to incorporate the time jobs stay queued in the scheduling system into the selection criteria. Our method can also be used by the end users to estimate the time to completion of their computing jobs. It uses historical data about the particular system to make predictions. It returns a list of probability estimates of the form (ti, pi), where pi is the probability that the job will start before time ti. Times ti can be chosen more or less freely when deploying the system. Compared to regression methods that only return a single number as a queue wait time estimate (usually without error bars) our prediction system provides more useful information. The probability estimates are calculated using the Bayes theorem with the naive assumption that the attributes describing the jobs are independent. They are further calibrated to make sure they are as accurate as possible, given available data. We describe our service and its REST API and the underlying methods in detail and provide empirical evidence in support of the method's efficacy.This article is part of the theme issue ‘Multiscale modelling, simulation and computing: from the desktop to the exascale’.

Loading PDF

Similar Papers
  • Conference Article
  • Citations5

A generalized data preprocessing method for wind power prediction

  • Jan 01, 2013
  • Jiakun An +4
  • Peer Review Report
  • Citations15

Author response: Principles of self-organization and load adaptation by the actin cytoskeleton during clathrin-mediated endocytosis

  • Nov 20, 2019
  • Matthew Akamatsu +5
  • Preprint Article

Scheduling System for Remote Control of Instruments used for Atmospheric Observation

  • May 15, 2023
  • Martin Schumann +15
  • Research Article
  • Citations39

Modelling survival after treatment of intraocular melanoma using artificial neural networks and Bayes theorem

  • Dec 15, 2003
  • Physics in Medicine & Biology
  • Azzam F G Taktak +2
  • Research Article

Analysis and comparative study of architectural approaches to the development of single-page applications (SPA, SSR, SSG)

  • Apr 01, 2025
  • Программные системы и вычислительные методы
  • Mihail Aleksandrovich Romanov +3
  • PDF
  • Research Article
  • Citations26

A multiscale model via single-cell transcriptomics reveals robust patterning mechanisms during early mammalian embryo development

  • Mar 08, 2021
  • PLoS Computational Biology
  • Zixuan Cang +5
  • Research Article
  • Citations7

On the Robustness of the Velocity Anisotropy Parameter in Probing the Stellar Kinematics in Milky Way–Like Galaxies: Takeaway from TNG50 Simulation

  • Sep 01, 2022
  • The Astrophysical Journal
  • Razieh Emami +10
  • Conference Article

System of Predictive Maintenance in Palm Oil Mill

  • Aug 05, 2025
  • Nursyuhadah Saleh +3
  • Research Article
  • Citations1

INVENTORY PREDICTION SYSTEM USING THE LEAST SQUARE METHOD AT THE SERBA SERBI ONLINE SHOP TANJUNGPINANG

  • Jan 16, 2024
  • Jurnal Media Elektrik
  • Hendi Setiawan +3
  • Book Chapter
  • Citations3

A Spanning Tree-Based Human Activity Prediction System Using Life Logs from Depth Silhouette-Based Human Activity Recognition

  • Jan 01, 2011
  • Md Zia Uddin +5
  • Research Article
  • Citations2

Penerapan Algoritma Naive Bayes dan Multiple Linear Regression Untuk Prediksi Status dan Plafon Kredit (Studi Kasus: Bank ABC)

  • Dec 27, 2022
  • Journal on Education
  • Arya Prawira +2
  • PDF
  • Research Article
  • Citations31

A Systematic Review of Multi-Scale Spatio-Temporal Crime Prediction Methods

  • May 23, 2023
  • ISPRS International Journal of Geo-Information
  • Yingjie Du +1
  • Research Article

Research on Stock Price Prediction Using the BPNN Neural Network Model

  • Sep 09, 2025
  • Theoretical and Natural Science
  • Yifeng Yin
  • Research Article
  • Citations1

Extracting Acyclic Dependency Models from Quality Standards for COTS Software Evaluation

  • Jul 01, 2006
  • Journal of Aerospace Computing, Information, and Communication
  • A Terry Morris +1
  • Research Article

Профессиональный отбор кадров в ходе боевых действий (по материалам воспоминаний военачальников времен Великой Отечественной войны): социально-философский анализ

  • Jan 01, 2020
  • Socium i vlast
  • Valery Nekhamkin +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.