Cover Image

Simulating LLM training workloads for heterogeneous compute and network infrastructure

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kumar, Sumit, Temura, Arjun, Sharma, Naman, Singh, Ramanjeet, Dadhania, Meet, Tammana, Praveen, Burla, Satananda, Kamaluddin, Abed Mohammad, Shah, Rinku
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Combining GPU and CPU for accelerating evolutionary computing workloads
by: Eynaliyev, Rustam, et al.
Published: (2025)

Lifting to tensors when compiling scientific computing workloads for AI Engines
by: Brown, Nick, et al.
Published: (2026)

Cloud abstractions for AI workloads
by: Canini, Marco, et al.
Published: (2025)

FLStore: Efficient Federated Learning Storage for non-training workloads
by: Khan, Ahmad Faraz, et al.
Published: (2025)

Intelligent resource prediction for SAP HANA continuous integration build workloads
by: Mandel, Torsten, et al.
Published: (2026)

Integrating and Characterizing HPC Task Runtime Systems for hybrid AI-HPC workloads
by: Merzky, Andre, et al.
Published: (2025)

ATLAS: Efficient Out-of-Core Inference for Billion-Scale Graph Neural Networks
by: Naman, Pranjal, et al.
Published: (2026)

OptimES: Optimizing Federated Learning Using Remote Embeddings for Graph Neural Networks
by: Naman, Pranjal, et al.
Published: (2025)

Ripple: Scalable Incremental GNN Inferencing on Large Streaming Graphs
by: Naman, Pranjal, et al.
Published: (2025)

HeLoCo: Efficient asynchronous low-communication training under data and device heterogeneity
by: Asif, Abdullah Al, et al.
Published: (2026)

Distributed network for measuring climatic parameters in heterogeneous environments: Application in a greenhouse
by: López-Martínez, Javier, et al.
Published: (2024)

Alps, a versatile research infrastructure
by: Martinasso, Maxime, et al.
Published: (2025)

What can be computed in average anonymous networks?
by: Rybicki, Joel, et al.
Published: (2026)

Evaluation Framework for Centralized and Decentralized Aggregation Algorithm in Federated Systems
by: Chongder, Sumit
Published: (2025)

Evolving HPC services to enable ML workloads on HPE Cray EX
by: Schuppli, Stefano, et al.
Published: (2025)

Investigations of multi-socket high core count RISC-V for HPC workloads
by: Brown, Nick, et al.
Published: (2025)

RIPPLE++: An Incremental Framework for Efficient GNN Inference on Evolving Graphs
by: Naman, Pranjal, et al.
Published: (2026)

Optimizing Federated Learning using Remote Embeddings for Graph Neural Networks
by: Naman, Pranjal, et al.
Published: (2025)

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO
by: Svedas, Jonas, et al.
Published: (2025)

Multi-objective application placement in fog computing using graph neural network-based reinforcement learning
by: Lera, Isaac, et al.
Published: (2026)

Optimizing the Variant Calling Pipeline Execution on Human Genomes Using GPU-Enabled Machines
by: Kumar, Ajay, et al.
Published: (2025)

Introducing MareNostrum5: A European pre-exascale energy-efficient system designed to serve a broad spectrum of scientific workloads
by: Banchelli, Fabio, et al.
Published: (2025)

Portable, heterogeneous ensemble workflows at scale using libEnsemble
by: Hudson, Stephen, et al.
Published: (2024)

Fix: externalizing network I/O in serverless computing
by: Deng, Yuhan, et al.
Published: (2025)

The infrastructure powering IBM's Gen AI model development
by: Gershon, Talia, et al.
Published: (2024)

PCCL: Photonic circuit-switched collective communication for distributed ML
by: Kumar, Abhishek Vijaya, et al.
Published: (2025)

Static task mapping for heterogeneous systems based on series-parallel decompositions
by: Wilhelm, Martin, et al.
Published: (2025)

Adaptive Asynchronous Work-Stealing for distributed load-balancing in heterogeneous systems
by: Fernandes, João B., et al.
Published: (2024)

Regent based parallel meshfree LSKUM solver for heterogenous HPC platforms
by: Salil, Sanath, et al.
Published: (2024)

A Survey on Model-heterogeneous Federated Learning: Problems, Methods, and Prospects
by: Fan, Boyu, et al.
Published: (2023)

Failures of public key infrastructure: 53 year survey
by: Dumitrescu, Adrian-Tudor, et al.
Published: (2024)

Constructive community race: full-density spiking neural network model drives neuromorphic computing
by: Senk, Johanna, et al.
Published: (2025)

A retrospective on DISPEED -- Leveraging heterogeneity in a drone swarm for IDS execution
by: Lannurien, Vincent, et al.
Published: (2025)

Dual-pronged deep learning preprocessing on heterogeneous platforms with CPU, Accelerator and CSD
by: Wei, Jia, et al.
Published: (2024)

Flotilla: A scalable, modular and resilient federated learning framework for heterogeneous resources
by: Banerjee, Roopkatha, et al.
Published: (2025)

The integration of heterogeneous resources in the CMS Submission Infrastructure for the LHC Run 3 and beyond
by: Yzquierdo, Antonio Perez-Calero, et al.
Published: (2024)

Distributed genetic algorithm for application placement in the compute continuum leveraging infrastructure nodes for optimization
by: Guerrero, Carlos, et al.
Published: (2024)

Stably computable relations and predicates
by: Aspnes, James
Published: (2024)

Scaling Real-Time Traffic Analytics on Edge-Cloud Fabrics for City-Scale Camera Networks
by: Sharma, Akash, et al.
Published: (2026)

A Conflict-Aware Resource Management Framework for the Computing Continuum
by: Popescu-Vifor, Vlad, et al.
Published: (2025)