Copertina

Distributed Training under Packet Loss

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Weintraub, Erez, Banner, Ron, Orda, Ariel
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Distributed, Parallel, and Cluster Computing Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Echo: Simulating Distributed Training At Scale
di: Feng, Yicheng, et al.
Pubblicazione: (2024)

Empowering Distributed Training with Sparsity-driven Data Synchronization
di: Wang, Zhuang, et al.
Pubblicazione: (2023)

Communication Optimization for Distributed Training: Architecture, Advances, and Opportunities
di: Wei, Yunze, et al.
Pubblicazione: (2024)

Efficient Parallelization Layouts for Large-Scale Distributed Model Training
di: Hagemann, Johannes, et al.
Pubblicazione: (2023)

Distributed Convolutional Neural Network Training on Mobile and Edge Clusters
di: Rama, Pranav, et al.
Pubblicazione: (2024)

Hybrid Dual-Batch and Cyclic Progressive Learning for Efficient Distributed Training
di: Lu, Kuan-Wei, et al.
Pubblicazione: (2025)

Characterizing the Efficiency of Distributed Training: A Power, Performance, and Thermal Perspective
di: Go, Seokjin, et al.
Pubblicazione: (2025)

Minder: Faulty Machine Detection for Large-scale Distributed Model Training
di: Deng, Yangtao, et al.
Pubblicazione: (2024)

QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices
di: Zhao, Juntao, et al.
Pubblicazione: (2024)

Fully Distributed Online Training of Graph Neural Networks in Networked Systems
di: Olshevskyi, Rostyslav, et al.
Pubblicazione: (2024)

Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training
di: Fernandez, Jared, et al.
Pubblicazione: (2024)

Robust Fully-Asynchronous Methods for Distributed Training over General Architecture
di: Zhu, Zehan, et al.
Pubblicazione: (2023)

An Experimental Comparison of Partitioning Strategies for Distributed Graph Neural Network Training
di: Merkel, Nikolai, et al.
Pubblicazione: (2023)

SparDL: Distributed Deep Learning Training with Efficient Sparse Communication
di: Zhao, Minjun, et al.
Pubblicazione: (2023)

Leiden-Fusion Partitioning Method for Effective Distributed Training of Graph Embeddings
di: Bai, Yuhe, et al.
Pubblicazione: (2024)

Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning
di: Dimlioglu, Tolga, et al.
Pubblicazione: (2025)

Armada: Memory-Efficient Distributed Training of Large-Scale Graph Neural Networks
di: Waleffe, Roger, et al.
Pubblicazione: (2025)

Towards a Flexible and High-Fidelity Approach to Distributed DNN Training Emulation
di: Liu, Banruo, et al.
Pubblicazione: (2024)

SDT-GNN: Streaming-based Distributed Training Framework for Graph Neural Networks
di: Huang, Xin, et al.
Pubblicazione: (2024)

A Readiness-Driven Runtime for Pipeline-Parallel Training under Runtime Variability
di: Liu, Ruitao, et al.
Pubblicazione: (2026)

AntDT: A Self-Adaptive Distributed Training Framework for Leader and Straggler Nodes
di: Xiao, Youshao, et al.
Pubblicazione: (2024)

Spindle: Efficient Distributed Training of Multi-Task Large Models via Wavefront Scheduling
di: Wang, Yujie, et al.
Pubblicazione: (2024)

GraNNDis: Efficient Unified Distributed Training Framework for Deep GNNs on Large Clusters
di: Song, Jaeyong, et al.
Pubblicazione: (2023)

Dynamic Byzantine-Robust Learning: Adapting to Switching Byzantine Workers
di: Dorfman, Ron, et al.
Pubblicazione: (2024)

HelixPipe: Efficient Distributed Training of Long Sequence Transformers with Attention Parallel Pipeline Parallelism
di: Zhang, Geng, et al.
Pubblicazione: (2025)

OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
di: Jaghouar, Sami, et al.
Pubblicazione: (2024)

MiCRO: Near-Zero Cost Gradient Sparsification for Scaling and Accelerating Distributed DNN Training
di: Yoon, Daegun, et al.
Pubblicazione: (2023)

LIBRA: Enabling Workload-aware Multi-dimensional Network Topology Optimization for Distributed Training of Large AI Models
di: Won, William, et al.
Pubblicazione: (2021)

Universal Checkpointing: A Flexible and Efficient Distributed Checkpointing System for Large-Scale DNN Training with Reconfigurable Parallelis
di: Lian, Xinyu, et al.
Pubblicazione: (2024)

CDFGNN: a Systematic Design of Cache-based Distributed Full-Batch Graph Neural Network Training with Communication Reduction
di: Zhang, Shuai, et al.
Pubblicazione: (2024)

Benchmarking Mutual Information-based Loss Functions in Federated Learning
di: S, Sarang, et al.
Pubblicazione: (2025)

Edge-Parallel Graph Encoder Embedding
di: Lubonja, Ariel, et al.
Pubblicazione: (2024)

Distributed Matrix-Based Sampling for Graph Neural Network Training
di: Tripathy, Alok, et al.
Pubblicazione: (2023)

DynaTrain: Fast Online Parallelism Switching for Elastic LLM Training
di: Wang, Yuanqing, et al.
Pubblicazione: (2026)

Loss- and Reward-Weighting for Efficient Distributed Reinforcement Learning
di: Holen, Martin, et al.
Pubblicazione: (2023)

MassiveGNN: Efficient Training via Prefetching for Massively Connected Distributed Graphs
di: Sarkar, Aishwarya, et al.
Pubblicazione: (2024)

Photon: Federated LLM Pre-Training
di: Sani, Lorenzo, et al.
Pubblicazione: (2024)

Orbax: Distributed Checkpointing with JAX
di: Gaffney, Colin, et al.
Pubblicazione: (2026)

Understanding Silent Data Corruption in LLM Training
di: Ma, Jeffrey, et al.
Pubblicazione: (2025)

FedAST: Federated Asynchronous Simultaneous Training
di: Askin, Baris, et al.
Pubblicazione: (2024)