Image de couverture de livre

Optimizing Distributed Training Approaches for Scaling Neural Networks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Baligodugula, Vishnu Vardhan, Amsaad, Fathi
Format:	Preprint
Publié:	2025
Sujets:	Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

RapidGNN: Communication Efficient Large-Scale Distributed Training of Graph Neural Networks
par: Niam, Arefin, et autres
Publié: (2025)

Heta: Distributed Training of Heterogeneous Graph Neural Networks
par: Zhong, Yuchen, et autres
Publié: (2024)

LuWu: An End-to-End In-Network Out-of-Core Optimizer for 100B-Scale Model-in-Network Data-Parallel Training on Distributed GPUs
par: Sun, Mo, et autres
Publié: (2024)

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training
par: Tanaka, Masahiro, et autres
Publié: (2025)

Armada: Memory-Efficient Distributed Training of Large-Scale Graph Neural Networks
par: Waleffe, Roger, et autres
Publié: (2025)

BANG: Billion-Scale Approximate Nearest Neighbor Search using a Single GPU
par: V., Karthik, et autres
Publié: (2024)

MalleTrain: Deep Neural Network Training on Unfillable Supercomputer Nodes
par: Ma, Xiaolong, et autres
Publié: (2024)

Poplar: Efficient Scaling of Distributed DNN Training on Heterogeneous GPU Clusters
par: Zhang, WenZheng, et autres
Publié: (2024)

CaPGNN: Optimizing Parallel Graph Neural Network Training with Joint Caching and Resource-Aware Graph Partitioning
par: Song, Xianfeng, et autres
Publié: (2025)

PRISM: Probabilistic Runtime Insights and Scalable Performance Modeling for Large-Scale Distributed Training
par: Golden, Alicia, et autres
Publié: (2025)

Optimizing Frequent Checkpointing via Low-Cost Differential for Distributed Training Systems
par: Yao, Chenxuan, et autres
Publié: (2025)

Nezha: Breaking Multi-Rail Network Barriers for Distributed DNN Training
par: Yu, Enda, et autres
Publié: (2024)

Effectiveness of Distributed Gradient Descent with Local Steps for Overparameterized Models
par: Zhu, Heng, et autres
Publié: (2024)

Optimizing High-Throughput Distributed Data Pipelines for Reproducible Deep Learning at Scale
par: Mittal, Kashish, et autres
Publié: (2026)

Distributed Generative Inference of LLM at Internet Scales with Multi-Dimensional Communication Optimization
par: Chen, Jiu, et autres
Publié: (2026)

Multi-Resolution Model Fusion for Accelerating the Convolutional Neural Network Training
par: Wang, Kewei, et autres
Publié: (2025)

Fully Distributed Online Training of Graph Neural Networks in Networked Systems
par: Olshevskyi, Rostyslav, et autres
Publié: (2024)

Embedded Distributed Inference of Deep Neural Networks: A Systematic Review
par: Peccia, Federico Nicolás, et autres
Publié: (2024)

Diagonal Scaling: A Multi-Dimensional Resource Model and Optimization Framework for Distributed Databases
par: Abdullah, Shahir, et autres
Publié: (2025)

ReInc: Scaling Training of Dynamic Graph Neural Networks
par: Guan, Mingyu, et autres
Publié: (2025)

Distributed Convolutional Neural Network Training on Mobile and Edge Clusters
par: Rama, Pranav, et autres
Publié: (2024)

ACE-Sync: An Adaptive Cloud-Edge Synchronization Framework for Communication-Efficient Large-Scale Distributed Model Training
par: Yang, Yi, et autres
Publié: (2025)

ATLAS: Efficient Out-of-Core Inference for Billion-Scale Graph Neural Networks
par: Naman, Pranjal, et autres
Publié: (2026)

Spatiotemporal Traffic Prediction in Distributed Backend Systems via Graph Neural Networks
par: Qiu, Zhimin, et autres
Publié: (2025)

A Distributed Approach for Persistent Homology Computation on a Large Scale
par: Ceccaroni, Riccardo, et autres
Publié: (2024)

Efficient Distributed MLLM Training with Cornstarch
par: Jang, Insu, et autres
Publié: (2025)

An Experimental Comparison of Partitioning Strategies for Distributed Graph Neural Network Training
par: Merkel, Nikolai, et autres
Publié: (2023)

NEST: Network- and Memory-Aware Device Placement For Distributed Deep Learning
par: Wang, Irene, et autres
Publié: (2026)

Distributed Constrained Combinatorial Optimization leveraging Hypergraph Neural Networks
par: Heydaribeni, Nasimeh, et autres
Publié: (2023)

Echo: Simulating Distributed Training At Scale
par: Feng, Yicheng, et autres
Publié: (2024)

Stable-MoE: Lyapunov-based Token Routing for Distributed Mixture-of-Experts Training over Edge Networks
par: Shi, Long, et autres
Publié: (2025)

OptimES: Optimizing Federated Learning Using Remote Embeddings for Graph Neural Networks
par: Naman, Pranjal, et autres
Publié: (2025)

SDT-GNN: Streaming-based Distributed Training Framework for Graph Neural Networks
par: Huang, Xin, et autres
Publié: (2024)

Galvatron: Automatic Distributed Training for Large Transformer Models
par: Gumaan, Esmail
Publié: (2025)

Addressing Variable Heterogeneity in Distributed Multimodal Training with Entrain
par: Jang, Insu, et autres
Publié: (2026)

Accelerating Distributed MoE Training and Inference with Lina
par: Li, Jiamin, et autres
Publié: (2022)

Collaborative UAVs Multi-task Video Processing Optimization Based on Enhanced Distributed Actor-Critic Networks
par: Rong, Ziqi, et autres
Publié: (2024)

GSplit: Scaling Graph Neural Network Training on Large Graphs via Split-Parallelism
par: Polisetty, Sandeep, et autres
Publié: (2023)

Federated Neural Radiance Field for Distributed Intelligence
par: Zhang, Yintian, et autres
Publié: (2024)

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training
par: Zhao, Bohan, et autres
Publié: (2025)