Cover Image

Toward Co-adapting Machine Learning Job Shape and Cluster Topology

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Shawn Shuoshuo, Arfeen, Daiyaan, Yu, Minlan, Steenkiste, Peter, Seshan, Srinivasan
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing Networking and Internet Architecture
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ECCO: Leveraging Cross-Camera Correlations for Efficient Live Video Continuous Learning
by: He, Yuze, et al.
Published: (2025)

Design and Operation of Shared Machine Learning Clusters on Campus
by: Xu, Kaiqiang, et al.
Published: (2021)

Towards Easy and Realistic Network Infrastructure Testing for Large-scale Machine Learning
by: Yoo, Jinsun, et al.
Published: (2025)

Q-adaptive: A Multi-Agent Reinforcement Learning Based Routing on Dragonfly Network
by: Kang, Yao, et al.
Published: (2024)

Strategies for Tracking Individual IP Packets Towards DDoS
by: Hillmann, Peter, et al.
Published: (2024)

Towards Practical Overlay Networks for Decentralized Federated Learning
by: Hua, Yifan, et al.
Published: (2024)

Revolutionizing Datacenter Networks via Reconfigurable Topologies
by: Avin, Chen, et al.
Published: (2025)

Topological Analysis for Identifying Anomalies in Serverless Platforms
by: Reali, Gianluca, et al.
Published: (2026)

Fast Multichannel Topology Discovery in Cognitive Radio Networks
by: Wang, Yung-Li, et al.
Published: (2025)

A New Broadcast Model for Several Network Topologies
by: Lu, Hongbo, et al.
Published: (2025)

Legible Consensus: Topology-Aware Quorum Geometry for Asymmetric Networks
by: Mason, Tony
Published: (2026)

Efficient All-to-All Collective Communication Schedules for Direct-Connect Topologies
by: Basu, Prithwish, et al.
Published: (2023)

Decentralized Network Topology Design for Task Offloading in Mobile Edge Computing
by: Ma, Ke, et al.
Published: (2024)

Topology-aware Microservice Architecture in Edge Networks: Deployment Optimization and Implementation
by: Chen, Yuang, et al.
Published: (2025)

Real-Time In-Network Machine Learning on P4-Programmable FPGA SmartNICs with Fixed-Point Arithmetic and Taylor
by: Sada, Mohammad Firas, et al.
Published: (2025)

YUHENG-OS: A Cloud-Native Space Cluster Operating System
by: Zhang, Jin, et al.
Published: (2026)

ClusterSlice: A Zero-touch Deployment Platform for the Edge Cloud Continuum
by: Mamatas, Lefteris, et al.
Published: (2024)

LIDC: A Location Independent Multi-Cluster Computing Framework for Data Intensive Science
by: Timilsina, Sankalpa, et al.
Published: (2025)

A New Classification of Clustering-based for Different Problems in Different Wireless Ad-hoc Networks
by: Boualem, Adda, et al.
Published: (2024)

FlowTracer: A Tool for Uncovering Network Path Usage Imbalance in AI Training Clusters
by: Jamil, Hasibul, et al.
Published: (2024)

A Combined Environmental Monitoring Framework based on WSN Clustering and VANET Edge Computation Offloading
by: Mamalis, Basilis, et al.
Published: (2024)

Toward Edge General Intelligence with Multiple-Large Language Model (Multi-LLM): Architecture, Trust, and Orchestration
by: Luo, Haoxiang, et al.
Published: (2025)

From Skew to Symmetry: Node-Interconnect Multi-Path Balancing with Execution-time Planning for Modern GPU Clusters
by: Yao, Jinghan, et al.
Published: (2026)

Performance and Stability of Barrier Mode Parallel Systems with Heterogeneous and Redundant Jobs
by: Walker, Brenton, et al.
Published: (2025)

Towards Timely Video Analytics Services at the Network Edge
by: Li, Xishuo, et al.
Published: (2024)

Temporal-Aware GPU Resource Allocation for Distributed LLM Inference via Reinforcement Learning
by: Du, Chengze, et al.
Published: (2025)

To Stream or Not to Stream: Towards A Quantitative Model for Remote HPC Processing Decisions
by: Castro, Flavio, et al.
Published: (2025)

1.5 Million Messages Per Second on 3 Machines: Benchmarking and Latency Optimization of Apache Pulsar at Enterprise Scale
by: Mukkolakkal, Muhamed Ramees Cheriya
Published: (2026)

BlockSDN: Towards a High-Performance Blockchain via Software-Defined Cross Networking optimization
by: Jia, Wenyang, et al.
Published: (2025)

Towards Integrated Energy-Communication-Transportation Hub: A Base-Station-Centric Design in 5G and Beyond
by: Shen, Linfeng, et al.
Published: (2025)

Cluster Topology-Driven Placement of Experts Reduces Network Traffic in MoE Inference
by: Sivtsov, Danil, et al.
Published: (2025)

AllReduce Scheduling with Hierarchical Deep Reinforcement Learning
by: Wei, Yufan, et al.
Published: (2025)

Surviving the Edge: Federated Learning under Networking and Resource Constraints
by: Mwanje, Mike, et al.
Published: (2026)

Federated Learning and Evolutionary Game Model for Fog Federation Formation
by: Yasser, Zyad, et al.
Published: (2024)

Accelerating Time-to-Science by Streaming Detector Data Directly into Perlmutter Compute Nodes
by: Welborn, Samuel S., et al.
Published: (2024)

POSMAC: Powering Up In-Network AR/CG Traffic Classification with Online Learning
by: Shirmarz, Alireza, et al.
Published: (2025)

OptiReduce: Resilient and Tail-Optimal AllReduce for Distributed Deep Learning in the Cloud
by: Warraich, Ertza, et al.
Published: (2023)

EdgeTimer: Adaptive Multi-Timescale Scheduling in Mobile Edge Computing with Deep Reinforcement Learning
by: Hao, Yijun, et al.
Published: (2024)

The AutoSPADA Platform: User-Friendly Edge Computing for Distributed Learning and Data Analytics in Connected Vehicles
by: Nilsson, Adrian, et al.
Published: (2023)

Channel Access Methods for RF-Powered IoT Networks: A Survey
by: Yu, Hang, et al.
Published: (2024)