Image de couverture de livre

FUSCO: High-Performance Distributed Data Shuffling via Transformation-Communication Fusion

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhu, Zhuoran, Zhu, Chunyang, Lin, Hao, Fu, Xu, Zhou, Yiming, Zhang, Quanlu, Li, Zhenhua, Qian, Feng, Yu, Chao, Li, Boxun, Dai, Guohao, Wang, Yu
Format:	Preprint
Publié:	2025
Sujets:	Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

DynaTrain: Fast Online Parallelism Switching for Elastic LLM Training
par: Wang, Yuanqing, et autres
Publié: (2026)

STAlloc: Enhancing Memory Efficiency in Large-Scale Model Training with Spatio-Temporal Planning
par: Huang, Zixiao, et autres
Publié: (2025)

FuxiShuffle: An Adaptive and Resilient Shuffle Service for Distributed Data Processing on Alibaba Cloud
par: Lin, Yuhao, et autres
Publié: (2026)

RLinf: Flexible and Efficient Large-scale Reinforcement Learning via Macro-to-Micro Flow Transformation
par: Yu, Chao, et autres
Publié: (2025)

HETHUB: A Distributed Training System with Heterogeneous Cluster for Large-Scale Models
par: Xu, Si, et autres
Publié: (2024)

ClusterFusion++: Expanding Cluster-Level Fusion to Full Transformer-Block Decoding
par: Jin, ChiHeng, et autres
Publié: (2026)

On the Performance and Memory Footprint of Distributed Training: An Empirical Study on Transformers
par: Lu, Zhengxian, et autres
Publié: (2024)

Hyperion: Low-Latency Ultra-HD Video Analytics via Collaborative Vision Transformer Inference
par: Jiang, Linyi, et autres
Publié: (2025)

Rate-limited Shuffling for Distributed Computing
par: Sasi, Shanuja, et autres
Publié: (2024)

CondenseGraph: Communication-Efficient Distributed GNN Training via On-the-Fly Graph Condensation
par: Zhang, Zizhao, et autres
Publié: (2026)

Distributed Inference Performance Optimization for LLMs on CPUs
par: He, Pujiang, et autres
Publié: (2024)

ShuffleBench: A Benchmark for Large-Scale Data Shuffling Operations with Distributed Stream Processing Frameworks
par: Henning, Sören, et autres
Publié: (2024)

Will LLMs Scaling Hit the Wall? Breaking Barriers via Distributed Resources on Massive Edge Devices
par: Shen, Tao, et autres
Publié: (2025)

Efficient and Adaptable Overlapping for Computation and Communication via Signaling and Reordering
par: Hong, Ke, et autres
Publié: (2025)

Amoeba: Runtime Tensor Parallel Transformation for LLM Inference Services
par: Chen, Haoyu, et autres
Publié: (2025)

CoCoDiff: Optimizing Collective Communications for Distributed Diffusion Transformer Inference Under Ulysses Sequence Parallelism
par: Ma, Bin, et autres
Publié: (2026)

Training DNN Models over Heterogeneous Clusters with Optimal Performance
par: Nie, Chengyi, et autres
Publié: (2024)

NeutronTP: Load-Balanced Distributed Full-Graph GNN Training with Tensor Parallelism
par: Ai, Xin, et autres
Publié: (2024)

EARL: Efficient Agentic Reinforcement Learning Systems for Large Language Models
par: Tan, Zheyue, et autres
Publié: (2025)

D-CAST: Distributed Consensus Switch in Wireless Trustworthy Autonomous System
par: Yu, Dachao, et autres
Publié: (2024)

Communication-Efficient Distributed Learning with Local Immediate Error Compensation
par: Cheng, Yifei, et autres
Publié: (2024)

Accelerating Distributed MoE Training and Inference with Lina
par: Li, Jiamin, et autres
Publié: (2022)

Lagom: Unleashing the Power of Communication and Computation Overlapping for Distributed LLM Training
par: Xu, Guanbin, et autres
Publié: (2026)

Barycentric Coded Distributed Computing with Flexible Recovery Threshold for Collaborative Mobile Edge Computing
par: Qiu, Houming, et autres
Publié: (2025)

LSH-MoE: Communication-efficient MoE Training via Locality-Sensitive Hashing
par: Nie, Xiaonan, et autres
Publié: (2024)

TASP: Topology-aware Sequence Parallelism
par: Wang, Yida, et autres
Publié: (2025)

Communication-and-Computation Efficient Split Federated Learning: Gradient Aggregation and Resource Management
par: Liang, Yipeng, et autres
Publié: (2025)

Communication-Efficient Distributed Learning via Sparse and Adaptive Stochastic Gradient
par: Deng, Xiaoge, et autres
Publié: (2021)

Exploiting Stragglers in Distributed Computing Systems with Task Grouping
par: Adikari, Tharindu, et autres
Publié: (2024)

Characterizing Compute-Communication Overlap in GPU-Accelerated Distributed Deep Learning: Performance and Power Implications
par: Lee, Seonho, et autres
Publié: (2025)

Composing Distributed Computations Through Task and Kernel Fusion
par: Yadav, Rohan, et autres
Publié: (2024)

GRACE-MoE: Grouping and Replication with Locality-Aware Routing for Efficient Distributed MoE Inference
par: Han, Yu, et autres
Publié: (2025)

Janus: Collaborative Vision Transformer Under Dynamic Network Environment
par: Jiang, Linyi, et autres
Publié: (2025)

Task Scheduling in Geo-Distributed Computing: A Survey
par: Wu, Yujian, et autres
Publié: (2025)

BOA Constrictor: Squeezing Performance out of GPUs in the Cloud via Budget-Optimal Allocation
par: Li, Zhouzi, et autres
Publié: (2026)

TENT: A Declarative Slice Spraying Engine for Performant and Resilient Data Movement in Disaggregated LLM Serving
par: Ren, Feng, et autres
Publié: (2026)

TurboFNO: High-Performance Fourier Neural Operator with Fused FFT-GEMM-iFFT on GPU
par: Wu, Shixun, et autres
Publié: (2025)

Exploiting Multicast for Accelerating Collective Communication
par: Xu, Chao, et autres
Publié: (2026)

BeACONS: A Blockchain-enabled Authentication and Communications Network for Scalable IoV
par: Shi, Qi, et autres
Publié: (2024)

Distributed Consensus Network: A Modularized Communication Framework and Reliability Probabilistic Analysis
par: Li, Yuetai, et autres
Publié: (2025)