Copertina

Grappa: Gradient-Only Communication for Scalable Graph Neural Network Training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Xu, Chongyang, Siebenbrunner, Christoph, Bindschaedler, Laurent
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Distributed, Parallel, and Cluster Computing Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

EmbedPart: Embedding-Driven Graph Partitioning for Scalable Graph Neural Network Training
di: Merkel, Nikolai, et al.
Pubblicazione: (2026)

Fully Distributed Online Training of Graph Neural Networks in Networked Systems
di: Olshevskyi, Rostyslav, et al.
Pubblicazione: (2024)

ReInc: Scaling Training of Dynamic Graph Neural Networks
di: Guan, Mingyu, et al.
Pubblicazione: (2025)

CDFGNN: a Systematic Design of Cache-based Distributed Full-Batch Graph Neural Network Training with Communication Reduction
di: Zhang, Shuai, et al.
Pubblicazione: (2024)

GSplit: Scaling Graph Neural Network Training on Large Graphs via Split-Parallelism
di: Polisetty, Sandeep, et al.
Pubblicazione: (2023)

An Experimental Comparison of Partitioning Strategies for Distributed Graph Neural Network Training
di: Merkel, Nikolai, et al.
Pubblicazione: (2023)

Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch
di: Bajaj, Saurabh, et al.
Pubblicazione: (2024)

Armada: Memory-Efficient Distributed Training of Large-Scale Graph Neural Networks
di: Waleffe, Roger, et al.
Pubblicazione: (2025)

SDT-GNN: Streaming-based Distributed Training Framework for Graph Neural Networks
di: Huang, Xin, et al.
Pubblicazione: (2024)

Distributed Matrix-Based Sampling for Graph Neural Network Training
di: Tripathy, Alok, et al.
Pubblicazione: (2023)

Graph Neural Networks Gone Hogwild
di: Solodova, Olga, et al.
Pubblicazione: (2024)

Cooperative Minibatching in Graph Neural Networks
di: Balin, Muhammed Fatih, et al.
Pubblicazione: (2023)

Graph Neural Networks as Ordering Heuristics for Parallel Graph Coloring
di: Langedal, Kenneth, et al.
Pubblicazione: (2024)

Distributed Convolutional Neural Network Training on Mobile and Edge Clusters
di: Rama, Pranav, et al.
Pubblicazione: (2024)

Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping
di: Jiang, Chenyu, et al.
Pubblicazione: (2024)

Scalable and Consistent Graph Neural Networks for Distributed Mesh-based Data-driven Modeling
di: Barwey, Shivam, et al.
Pubblicazione: (2024)

BLoad: Enhancing Neural Network Training with Efficient Sequential Data Handling
di: Ruschel, Raphael, et al.
Pubblicazione: (2023)

Preserving Near-Optimal Gradient Sparsification Cost for Scalable Distributed Deep Learning
di: Yoon, Daegun, et al.
Pubblicazione: (2024)

Optimizing Federated Learning using Remote Embeddings for Graph Neural Networks
di: Naman, Pranjal, et al.
Pubblicazione: (2025)

Federated Incomplete Multi-View Clustering with Heterogeneous Graph Neural Networks
di: Yan, Xueming, et al.
Pubblicazione: (2024)

Graph Neural Networks and Reinforcement Learning for Proactive Application Image Placement
di: Makris, Antonios, et al.
Pubblicazione: (2024)

Runtime-Orchestrated Second-Order Optimization for Scalable LLM Training
di: Lu, Yishun, et al.
Pubblicazione: (2026)

Scalable and Adaptive Parallel Training of Graph Transformer on Large Graphs
di: Lin, Jun-Liang, et al.
Pubblicazione: (2026)

High Order Collaboration-Oriented Federated Graph Neural Network for Accurate QoS Prediction
di: Chen, Zehuan, et al.
Pubblicazione: (2025)

Mycroft: Tracing Dependencies in Collective Communication Towards Reliable LLM Training
di: Deng, Yangtao, et al.
Pubblicazione: (2025)

DORA: A Scalable Asynchronous Reinforcement Learning System for Language Model Training
di: Hu, Tianhao, et al.
Pubblicazione: (2026)

GeoT: Tensor Centric Library for Graph Neural Network via Efficient Segment Reduction on GPU
di: Yu, Zhongming, et al.
Pubblicazione: (2024)

AsyncHZP: Hierarchical ZeRO Parallelism with Asynchronous Scheduling for Scalable LLM Training
di: Bai, Huawei, et al.
Pubblicazione: (2025)

BOOST: BOttleneck-Optimized Scalable Training Framework for Low-Rank Large Language Models
di: Wang, Zhengyang, et al.
Pubblicazione: (2025)

High-Dimensional Distributed Sparse Classification with Scalable Communication-Efficient Global Updates
di: Lu, Fred, et al.
Pubblicazione: (2024)

GraphPipe: Improving Performance and Scalability of DNN Training with Graph Pipeline Parallelism
di: Jeon, Byungsoo, et al.
Pubblicazione: (2024)

FedOBD: Opportunistic Block Dropout for Efficiently Training Large-scale Neural Networks through Federated Learning
di: Chen, Yuanyuan, et al.
Pubblicazione: (2022)

Mask-Encoded Sparsification: Mitigating Biased Gradients in Communication-Efficient Split Learning
di: Zhou, Wenxuan, et al.
Pubblicazione: (2024)

Communication Optimization for Distributed Training: Architecture, Advances, and Opportunities
di: Wei, Yunze, et al.
Pubblicazione: (2024)

MiCRO: Near-Zero Cost Gradient Sparsification for Scaling and Accelerating Distributed DNN Training
di: Yoon, Daegun, et al.
Pubblicazione: (2023)

Semi-decentralized Training of Spatio-Temporal Graph Neural Networks for Traffic Prediction
di: Kralj, Ivan, et al.
Pubblicazione: (2024)

Enhancing Physics-Informed Neural Networks with a Hybrid Parallel Kolmogorov-Arnold and MLP Architecture
di: Xu, Zuyu, et al.
Pubblicazione: (2025)

SparDL: Distributed Deep Learning Training with Efficient Sparse Communication
di: Zhao, Minjun, et al.
Pubblicazione: (2023)

Leiden-Fusion Partitioning Method for Effective Distributed Training of Graph Embeddings
di: Bai, Yuhe, et al.
Pubblicazione: (2024)

Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks
di: Wang, Shuai, et al.
Pubblicazione: (2025)