Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912409534332928 |
|---|---|
| author | Etz, Brian D. Rogers, David M. Brim, Michael J. Maheshwari, Ketan Leland, Kellen Skluzacek, Tyler J. Lange, Jack Pelfrey, Daniel Webb, Jordan Widener, Patrick Adamson, Ryan Zimmer, Christopher Vergara, Veronica G. Melesse Shankar, Mallikarjun Oral, Sarp da Silva, Rafael Ferreira |
| author_facet | Etz, Brian D. Rogers, David M. Brim, Michael J. Maheshwari, Ketan Leland, Kellen Skluzacek, Tyler J. Lange, Jack Pelfrey, Daniel Webb, Jordan Widener, Patrick Adamson, Ryan Zimmer, Christopher Vergara, Veronica G. Melesse Shankar, Mallikarjun Oral, Sarp da Silva, Rafael Ferreira |
| contents | The evolving landscape of scientific computing requires seamless transitions from experimental to production HPC environments for interactive workflows. This paper presents a structured transition pathway developed at OLCF that bridges the gap between development testbeds and production systems. We address both technological and policy challenges, introducing frameworks for data streaming architectures, secure service interfaces, and adaptive resource scheduling for time-sensitive workloads and improved HPC interactivity. Our approach transforms traditional batch-oriented HPC into a more dynamic ecosystem capable of supporting modern scientific workflows that require near real-time data analysis, experimental steering, and cross-facility integration. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_01744 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows Etz, Brian D. Rogers, David M. Brim, Michael J. Maheshwari, Ketan Leland, Kellen Skluzacek, Tyler J. Lange, Jack Pelfrey, Daniel Webb, Jordan Widener, Patrick Adamson, Ryan Zimmer, Christopher Vergara, Veronica G. Melesse Shankar, Mallikarjun Oral, Sarp da Silva, Rafael Ferreira Distributed, Parallel, and Cluster Computing The evolving landscape of scientific computing requires seamless transitions from experimental to production HPC environments for interactive workflows. This paper presents a structured transition pathway developed at OLCF that bridges the gap between development testbeds and production systems. We address both technological and policy challenges, introducing frameworks for data streaming architectures, secure service interfaces, and adaptive resource scheduling for time-sensitive workloads and improved HPC interactivity. Our approach transforms traditional batch-oriented HPC into a more dynamic ecosystem capable of supporting modern scientific workflows that require near real-time data analysis, experimental steering, and cross-facility integration. |
| title | Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2506.01744 |