• Home
  • Search
  • Overcoming Challenges to Continuous Integration in HPC
  • Cite Icon8
  • https://doi.org/10.1109/mcse.2023.3263458Copy DOI Icon

Overcoming Challenges to Continuous Integration in HPC

Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Continuous integration (CI) has become a ubiquitous practice in modern software development, with major code hosting services offering free automation on popular platforms. CI offers major benefits, as it enables detecting bugs in code prior to committing changes. While high-performance computing (HPC) research relies heavily on software, HPC machines are not considered “common” platforms. This presents several challenges that hinder the adoption of CI in HPC environments, making it difficult to maintain bug-free HPC projects, and resulting in adverse effects on the research community. In this article, we explore the challenges that impede HPC CI, such as hardware diversity, security, isolation, administrative policies, and nonstandard authentication, environments, and job submission mechanisms. We propose several solutions that could enhance the quality of HPC software and the experience of developers. Implementing these solutions would require significant changes at HPC centers, but if these changes are made, it would ultimately enable faster and better science.

Loading PDF

Similar Papers
  • Conference Article
  • Citations2

Employing Augmented Reality for Cybersecurity Operations in High Performance Computing Environments

  • Jul 28, 2019
  • Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning)
  • Nitin Sukhija +2
  • Conference Article
  • Citations2

S06---Computing protection in open HPC environments

  • Jan 01, 2006
  • Stephen Q Lau +3
  • Conference Article
  • Citations3

Expressing and Managing Network Policies for Emerging HPC Systems

  • Jul 28, 2019
  • Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning)
  • Sergio Rivera +3
  • Conference Article
  • Citations29

On the Use of Containers in High Performance Computing Environments

  • Oct 01, 2020
  • Subil Abraham +3
  • Conference Article
  • Citations5

Combining cooling technology and facility design to improve HPC data center energy efficiency

  • May 01, 2016
  • Lynn A Parnell +2
  • Conference Article
  • Citations32

CATCH: A Cloud-Based Adaptive Data Transfer Service for HPC

  • May 01, 2011
  • Henry M Monti +2
  • Research Article
  • Citations35

Glider fuselage-wing junction optimization using CFD and RBF mesh morphing

  • Oct 03, 2016
  • Aircraft Engineering and Aerospace Technology
  • Marco Evangelos Biancolini +5
  • Book Chapter

A diffraction tomography method for medical imaging implemented on high performance computing environment

  • Jan 01, 1999
  • T A Maniatis +2
  • Conference Article
  • Citations10

SciDP: Support HPC and Big Data Applications via Integrated Scientific Data Processing

  • Sep 01, 2018
  • Kun Feng +3
  • Preprint Article

DePSI: An Open-Source Python Software Package for PS-InSAR Analysis

  • Mar 14, 2026
  • Ou Ku +9
  • Book Chapter
  • Citations2

Secure Usage of Containers in the HPC Environment

  • Jan 01, 2025
  • Barbara Krasovec +1
  • Conference Article
  • Citations44

Predicting the Energy-Consumption of MPI Applications at Scale Using Only a Single Node

  • Sep 01, 2017
  • Franz Christian Heinrich +7
  • Research Article
  • Citations3

Parallel Performance Modeling using a Genetic Programming-based Error Correction Procedure

  • Jul 01, 2007
  • SIMULATION
  • Kavitha Raghavachar +4
  • Conference Article
  • Citations7

An Empirical Study of the Personnel Overhead of Continuous Integration

  • May 01, 2017
  • Marco Manglaviti +3
  • Abstract

98P - Standardized and compliant bio-informatics pipeline for neoepitope analysis in oncology clinical trials

  • Dec 01, 2018
  • Annals of Oncology
  • N Masloboeva-Siwach +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.