Operational Strategies for Non-Disruptive Scheduling Transitions in Production HPC Systems

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: MacLachlan, Glen, Creech, Joseph, Iqbal, Rubeel Muhammad, Gaylord, Clark, Messick, Jake
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912987736965120
author MacLachlan, Glen
Creech, Joseph
Iqbal, Rubeel Muhammad
Gaylord, Clark
Messick, Jake
author_facet MacLachlan, Glen
Creech, Joseph
Iqbal, Rubeel Muhammad
Gaylord, Clark
Messick, Jake
contents Migrating heterogeneous high-performance computing (HPC) systems to resource-aware scheduling introduces both technical and behavioral challenges, particularly in production environments with established user workflows. This paper presents a case study of transitioning a production academic HPC cluster from node-exclusive to consumable resource scheduling mid-lifecycle, without disrupting active workloads. We describe an operational strategy combining a time-bounded compatibility layer, observability-driven feedback, and targeted user engagement to guide adoption of explicit resource declaration. This approach protected active research workflows throughout the transition, avoiding the disruption that a direct cut-over would have imposed on the user community. Following deployment, median queue wait times fell from 277 minutes to under 3 minutes for CPU workloads and from 81 minutes to 3.4 minutes for GPU workloads. Users who adopted TRES-based submission exhibited strong long-term retention. These results demonstrate that successful scheduling transitions depend not only on system configuration, but on aligning observability, user engagement, and operational design.
format Preprint
id arxiv_https___arxiv_org_abs_2603_27863
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Operational Strategies for Non-Disruptive Scheduling Transitions in Production HPC Systems
MacLachlan, Glen
Creech, Joseph
Iqbal, Rubeel Muhammad
Gaylord, Clark
Messick, Jake
Distributed, Parallel, and Cluster Computing
Performance
Migrating heterogeneous high-performance computing (HPC) systems to resource-aware scheduling introduces both technical and behavioral challenges, particularly in production environments with established user workflows. This paper presents a case study of transitioning a production academic HPC cluster from node-exclusive to consumable resource scheduling mid-lifecycle, without disrupting active workloads. We describe an operational strategy combining a time-bounded compatibility layer, observability-driven feedback, and targeted user engagement to guide adoption of explicit resource declaration. This approach protected active research workflows throughout the transition, avoiding the disruption that a direct cut-over would have imposed on the user community. Following deployment, median queue wait times fell from 277 minutes to under 3 minutes for CPU workloads and from 81 minutes to 3.4 minutes for GPU workloads. Users who adopted TRES-based submission exhibited strong long-term retention. These results demonstrate that successful scheduling transitions depend not only on system configuration, but on aligning observability, user engagement, and operational design.
title Operational Strategies for Non-Disruptive Scheduling Transitions in Production HPC Systems
topic Distributed, Parallel, and Cluster Computing
Performance
url https://arxiv.org/abs/2603.27863