Cover Image

Predicting the Performance of Scientific Workflow Tasks for Cluster Resource Management: An Overview of the State of the Art

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bader, Jonathan, West, Kathleen, Becker, Soeren, Kulagina, Svetlana, Lehmann, Fabian, Thamsen, Lauritz, Meyerhenke, Henning, Kao, Odej
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Predicting Dynamic Memory Requirements for Scientific Workflow Tasks
by: Bader, Jonathan, et al.
Published: (2023)

Sizey: Memory-Efficient Execution of Scientific Workflow Tasks
by: Bader, Jonathan, et al.
Published: (2024)

Memory-aware Adaptive Scheduling of Scientific Workflows on Heterogeneous Architectures
by: Kulagina, Svetlana, et al.
Published: (2025)

Flora: Efficient Cloud Resource Selection for Big Data Processing via Job Classification
by: Will, Jonathan, et al.
Published: (2025)

KS+: Predicting Workflow Task Memory Usage Over Time
by: Bader, Jonathan, et al.
Published: (2024)

WOW: Workflow-Aware Data Movement and Task Scheduling for Dynamic Scientific Workflows
by: Lehmann, Fabian, et al.
Published: (2025)

Mapping Large Memory-constrained Workflows onto Heterogeneous Platforms
by: Kulagina, Svetlana, et al.
Published: (2024)

Exploring the Potential of Carbon-Aware Execution for Scientific Workflows
by: West, Kathleen, et al.
Published: (2025)

Ichnos: A Carbon Footprint Estimator for Scientific Workflows
by: West, Kathleen, et al.
Published: (2024)

A Systematic Evaluation of the Potential of Carbon-Aware Execution for Scientific Workflows
by: West, Kathleen, et al.
Published: (2025)

Demeter: Resource-Efficient Distributed Stream Processing under Dynamic Loads with Multi-Configuration Optimization
by: Geldenhuys, Morgan, et al.
Published: (2024)

Ponder: Online Prediction of Task Memory Requirements for Scientific Workflows
by: Lehmann, Fabian, et al.
Published: (2024)

Augur: Pre-Execution Energy Prediction for Workflow Tasks in Heterogeneous Clusters
by: West, Kathleen, et al.
Published: (2026)

HyProv: Hybrid Provenance Management for Scientific Workflows
by: Bountris, Vasilis, et al.
Published: (2025)

Energy-Aware Workflow Execution: An Overview of Techniques for Saving Energy and Emissions in Scientific Compute Clusters
by: Thamsen, Lauritz, et al.
Published: (2025)

Towards a Peer-to-Peer Data Distribution Layer for Efficient and Collaborative Resource Optimization of Distributed Dataflow Applications
by: Scheinert, Dominik, et al.
Published: (2023)

Experimentally Evaluating the Resource Efficiency of Big Data Autoscaling
by: Will, Jonathan, et al.
Published: (2025)

FedZero: Leveraging Renewable Excess Energy in Federated Learning
by: Wiesner, Philipp, et al.
Published: (2023)

Carbon-Aware Mapping and Scheduling for Deadline-Constrained Workflows
by: Schweisgut, Dominik, et al.
Published: (2026)

Carbon-Aware Workflow Scheduling with Fixed Mapping and Deadline Constraint
by: Schweisgut, Dominik, et al.
Published: (2025)

Proceedings of the 1st International Workshop on Low Carbon Computing (LOCO 2024)
by: Vanderbauwhede, Wim, et al.
Published: (2026)

Distributed LLM Pretraining During Renewable Curtailment Windows: A Feasibility Study
by: Wiesner, Philipp, et al.
Published: (2026)

Spatio-Temporal Shifting to Reduce Carbon, Water, and Land-Use Footprints of Cloud Workloads
by: Attenni, Giulio, et al.
Published: (2025)

Distributed Low-Communication Training with Decoupled Momentum Optimization
by: Nedelkoski, Sasho, et al.
Published: (2025)

Optimizing Memory Allocation in Distributed Clusters with Predictive Modeling
by: Bader, Jonathan, et al.
Published: (2026)

Optimizing Microgrid Composition for Sustainable Data Centers
by: Irion, Julius, et al.
Published: (2025)

Beyond Microservices: Testing Web-Scale RCA Methods on GPU-Driven LLM Workloads
by: Scheinert, Dominik, et al.
Published: (2026)

Choosing the Right Battery Model for Data Center Simulations
by: Kilian, Paul, et al.
Published: (2025)

QONNECT: A QoS-Aware Orchestration System for Distributed Kubernetes Clusters
by: Aslan, Haci Ismail, et al.
Published: (2025)

Privacy-Preserving Sharing of Data Analytics Runtime Metrics for Performance Modeling
by: Will, Jonathan, et al.
Published: (2024)

Daedalus: Self-Adaptive Horizontal Autoscaling for Resource Efficiency of Distributed Stream Processing Systems
by: Pfister, Benjamin J. J., et al.
Published: (2024)

What happens when nanochat meets DiLoCo?
by: Acker, Alexander, et al.
Published: (2025)

Learning Process Energy Profiles from Node-Level Power Data
by: Bader, Jonathan, et al.
Published: (2025)

Quantifying the Energy Consumption and Carbon Emissions of LLM Inference via Simulations
by: Özcan, Miray, et al.
Published: (2025)

On Software Ageing Indicators in OpenStack
by: Yazvinskyi, Yevhen, et al.
Published: (2024)

Workflows Community Summit 2024: Future Trends and Challenges in Scientific Workflows
by: da Silva, Rafael Ferreira, et al.
Published: (2024)

A Terminology for Scientific Workflow Systems
by: Suter, Frédéric, et al.
Published: (2025)

Workflow Mini-Apps: Portable, Scalable, Tunable & Faithful Representations of Scientific Workflows
by: Kilic, Ozgur Ozan, et al.
Published: (2024)

A Fault Tolerance Mechanism for Hybrid Scientific Workflows
by: Mulone, Alberto, et al.
Published: (2024)

Low-level I/O Monitoring for Scientific Workflows
by: Witzke, Joel, et al.
Published: (2024)