Cover Image

Reducing the Impact of I/O Contention in Numerical Weather Prediction Workflows at Scale Using DAOS

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Manubens, Nicolau, Smart, Simon D., Danovaro, Emanuele, Quintino, Tiago, Jackson, Adrian
Format:	Preprint
Published:	2024
Subjects:	Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Exploring DAOS Interfaces and Performance
by: Manubens, Nicolau, et al.
Published: (2024)

Exploring Novel Data Storage Approaches for Large-Scale Numerical Weather Prediction
by: Gil, Nicolau Manubens
Published: (2026)

Low-level I/O Monitoring for Scientific Workflows
by: Witzke, Joel, et al.
Published: (2024)

OnePiece: A Large-Scale Distributed Inference System with RDMA for Complex AI-Generated Content (AIGC) Workflows
by: Chen, June, et al.
Published: (2026)

RHAPSODY: Execution of Hybrid AI-HPC Workflows at Scale
by: Alsaadi, Aymen, et al.
Published: (2025)

Parallel Reduced Order Modeling for Digital Twins using High-Performance Computing Workflows
by: de Parga, S. Ares, et al.
Published: (2024)

Predicting Dynamic Memory Requirements for Scientific Workflow Tasks
by: Bader, Jonathan, et al.
Published: (2023)

Reducing Memory Contention and I/O Congestion for Disk-based GNN Training
by: Jiang, Qisheng, et al.
Published: (2024)

Ponder: Online Prediction of Task Memory Requirements for Scientific Workflows
by: Lehmann, Fabian, et al.
Published: (2024)

KS+: Predicting Workflow Task Memory Usage Over Time
by: Bader, Jonathan, et al.
Published: (2024)

Leveraging Core and Uncore Frequency Scaling for Power-Efficient Serverless Workflows
by: Tzenetopoulos, Achilleas, et al.
Published: (2024)

Steering a Fleet: Adaptation for Large-Scale, Workflow-Based Experiments
by: Pruyne, Jim, et al.
Published: (2024)

Augur: Pre-Execution Energy Prediction for Workflow Tasks in Heterogeneous Clusters
by: West, Kathleen, et al.
Published: (2026)

Softening the Impact of Collisions in Contention Resolution
by: Biswas, Umesh, et al.
Published: (2024)

Predicting the Performance of Scientific Workflow Tasks for Cluster Resource Management: An Overview of the State of the Art
by: Bader, Jonathan, et al.
Published: (2025)

Workflows Community Summit 2024: Future Trends and Challenges in Scientific Workflows
by: da Silva, Rafael Ferreira, et al.
Published: (2024)

Workflow Mini-Apps: Portable, Scalable, Tunable & Faithful Representations of Scientific Workflows
by: Kilic, Ozgur Ozan, et al.
Published: (2024)

WOW: Workflow-Aware Data Movement and Task Scheduling for Dynamic Scientific Workflows
by: Lehmann, Fabian, et al.
Published: (2025)

Scaling on Frontier: Uncertainty Quantification Workflow Applications using ExaWorks to Enable Full System Utilization
by: Titov, Mikhail, et al.
Published: (2024)

OpenCUBE: Building an Open Source Cloud Blueprint with EPI Systems
by: Peng, Ivy, et al.
Published: (2024)

Strategies to Measure Energy Consumption Using RAPL During Workflow Execution on Commodity Clusters
by: Thamm, Philipp, et al.
Published: (2025)

Towards Advancing Research with Workflows: A perspective from the Workflows Community Summit -- Amsterdam, 2025
by: Bonati, Irene, et al.
Published: (2026)

Capturing Periodic I/O Using Frequency Techniques
by: Tarraf, Ahmad, et al.
Published: (2023)

A Terminology for Scientific Workflow Systems
by: Suter, Frédéric, et al.
Published: (2025)

An Ecosystem of Services for FAIR Computational Workflows
by: Wilkinson, Sean R., et al.
Published: (2025)

MIDAS: Adaptive Proxy Middleware for Mitigating Metadata Hotspots in HPC I/O at Scale
by: Ghimire, Sangam, et al.
Published: (2025)

EMLIO: Minimizing I/O Latency and Energy Consumption for Large-Scale AI Training
by: Jamil, Hasibul, et al.
Published: (2025)

Wilkins: HPC In Situ Workflows Made Easy
by: Yildiz, Orcun, et al.
Published: (2024)

Efficient Probabilistic Workflow Scheduling for IaaS Clouds
by: Russo, Gabriele Russo, et al.
Published: (2024)

Adaptive Resource Allocation for Workflow Containerization on Kubernetes
by: Shan, Chenggang, et al.
Published: (2023)

WORKSWORLD: A Domain for Integrated Numeric Planning and Scheduling of Distributed Pipelined Workflows
by: Paul, Taylor, et al.
Published: (2026)

ML-based Modeling to Predict I/O Performance on Different Storage Sub-systems
by: Xu, Yiheng, et al.
Published: (2023)

Automatic Metadata Capture and Processing for High-Performance Workflows
by: Shpilker, Polina, et al.
Published: (2025)

Optimizing FaaS Platforms for MCP-enabled Agentic Workflows
by: Kulkarni, Varad, et al.
Published: (2026)

Sizey: Memory-Efficient Execution of Scientific Workflow Tasks
by: Bader, Jonathan, et al.
Published: (2024)

AI-coupled HPC Workflow Applications, Middleware and Performance
by: Brewer, Wes, et al.
Published: (2024)

Carbon-Aware Mapping and Scheduling for Deadline-Constrained Workflows
by: Schweisgut, Dominik, et al.
Published: (2026)

A Fault Tolerance Mechanism for Hybrid Scientific Workflows
by: Mulone, Alberto, et al.
Published: (2024)

Advancing Anomaly Detection in Computational Workflows with Active Learning
by: Raghavan, Krishnan, et al.
Published: (2024)

Ichnos: A Carbon Footprint Estimator for Scientific Workflows
by: West, Kathleen, et al.
Published: (2024)