Cover Image

Scalable Runtime Architecture for Data-driven, Hybrid HPC and ML Workflow Applications

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Merzky, Andre, Titov, Mikhail, Turilli, Matteo, Kilic, Ozgur, Wang, Tianle, Jha, Shantenu
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Integrating and Characterizing HPC Task Runtime Systems for hybrid AI-HPC workloads
by: Merzky, Andre, et al.
Published: (2025)

Workflow Mini-Apps: Portable, Scalable, Tunable & Faithful Representations of Scientific Workflows
by: Kilic, Ozgur Ozan, et al.
Published: (2024)

RHAPSODY: Execution of Hybrid AI-HPC Workflows at Scale
by: Alsaadi, Aymen, et al.
Published: (2025)

Adaptive Protein Design Protocols and Middleware
by: Alsaadi, Aymen, et al.
Published: (2025)

Hydra: Brokering Cloud and HPC Resources to Support the Execution of Heterogeneous Workloads at Scale
by: Alsaadi, Aymen, et al.
Published: (2024)

Scaling on Frontier: Uncertainty Quantification Workflow Applications using ExaWorks to Enable Full System Utilization
by: Titov, Mikhail, et al.
Published: (2024)

ExaWorks Software Development Kit: A Robust and Scalable Collection of Interoperable Workflow Technologies
by: Turilli, Matteo, et al.
Published: (2024)

AI-coupled HPC Workflow Applications, Middleware and Performance
by: Brewer, Wes, et al.
Published: (2024)

xGFabric: Coupling Sensor Networks and HPC Facilities with Private 5G Wireless Networks for Real-Time Digital Agriculture
by: Kurafeeva, Liubov, et al.
Published: (2025)

Design and Implementation of an Analysis Pipeline for Heterogeneous Data
by: Sarker, Arup Kumar, et al.
Published: (2024)

Quantum Mini-Apps: A Framework for Developing and Benchmarking Quantum-HPC Applications
by: Saurabh, Nishant, et al.
Published: (2024)

PSI/J: A Portable Interface for Submitting, Monitoring, and Managing Jobs
by: Hategan-Marandiuc, Mihael, et al.
Published: (2023)

LLM as HPC Expert: Extending RAG Architecture for HPC Data
by: Miyashita, Yusuke, et al.
Published: (2024)

Envisioning National Resources for Artificial Intelligence Research: NSF Workshop Report
by: Jha, Shantenu, et al.
Published: (2024)

In-Transit Data Transport Strategies for Coupled AI-Simulation Workflow Patterns
by: Tummalapalli, Harikrishna, et al.
Published: (2025)

Pilot-Quantum: A Quantum-HPC Middleware for Resource, Workload and Task Management
by: Mantha, Pradeep, et al.
Published: (2024)

Towards an Adaptive Runtime System for Cloud-Native HPC
by: Bhosale, Aditya, et al.
Published: (2026)

Wilkins: HPC In Situ Workflows Made Easy
by: Yildiz, Orcun, et al.
Published: (2024)

Scalable AI-assisted Workflow Management for Detector Design Optimization Using Distributed Computing
by: Anderson, Derek, et al.
Published: (2026)

ARGO: An Auto-Tuning Runtime System for Scalable GNN Training on Multi-Core Processor
by: Lin, Yi-Chien, et al.
Published: (2024)

Compass: A Decentralized Scheduler for Latency-Sensitive ML Workflows
by: Yang, Yuting, et al.
Published: (2024)

Towards Experiment Execution in Support of Community Benchmark Workflows for HPC
by: von Laszewski, Gregor, et al.
Published: (2025)

Reinforcement Learning-driven Data-intensive Workflow Scheduling for Volunteer Edge-Cloud
by: Mounesan, Motahare, et al.
Published: (2024)

Designing FAIR Workflows at OLCF: Building Scalable and Reusable Ecosystems for HPC Science
by: Wilkinson, Sean R., et al.
Published: (2025)

Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows
by: Etz, Brian D., et al.
Published: (2025)

A Performance Analysis of Task Scheduling for UQ Workflows on HPC Systems
by: Loi, Chung Ming, et al.
Published: (2025)

GICC: A High-Performance Runtime for GPU-Initiated Communication and Coordination in Modern HPC Systems
by: Shan, Baodi, et al.
Published: (2026)

An Active Learning-Based Streaming Pipeline for Reduced Data Training of Structure Finding Models in Neutron Diffractometry
by: Wang, Tianle, et al.
Published: (2025)

Scalable Cloud-Native Architectures for Intelligent PMU Data Processing
by: Chockalingam, Nachiappan, et al.
Published: (2025)

Multi-GPU-Enabled Hybrid Quantum-Classical Workflow in Quantum-HPC Middleware: Applications in Quantum Simulations
by: Chen, Kuan-Cheng, et al.
Published: (2024)

From Edge to HPC: Investigating Cross-Facility Data Streaming Architectures
by: George, Anjus, et al.
Published: (2025)

Scalable HPC Job Scheduling and Resource Management in SST
by: Abdurahman, Abubeker, et al.
Published: (2025)

Harnessing Deep Learning and HPC Kernels via High-Level Loop and Tensor Abstractions on CPU Architectures
by: Georganas, Evangelos, et al.
Published: (2023)

DOLMA: A Data Object Level Memory Disaggregation Framework for HPC Applications
by: Zheng, Haoyu, et al.
Published: (2025)

Hybrid Quantum-HPC Middleware Systems for Adaptive Resource, Workload and Task Management
by: Mantha, Pradeep, et al.
Published: (2026)

Survey of HPC in US Research Institutions
by: Shu, Peng, et al.
Published: (2025)

An Elastic Job Scheduler for HPC Applications on the Cloud
by: Bhosale, Aditya, et al.
Published: (2025)

AAFLOW: Scalable Patterns for Agentic AI Workflows
by: Sarker, Arup Kumar, et al.
Published: (2026)

Federated Learning Framework for Scalable AI in Heterogeneous HPC and Cloud Environments
by: Ghimire, Sangam, et al.
Published: (2025)

Scaling Hybrid Quantum-HPC Applications with the Quantum Framework
by: Chundury, Srikar, et al.
Published: (2025)