Copertina

Rina: Enhancing Ring-AllReduce with In-network Aggregation in Distributed Model Training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chen, Zixuan, Liu, Xuandong, Li, Minglin, Hu, Yinfan, Mei, Hao, Xing, Huifeng, Wang, Hao, Shi, Wanxin, Liu, Sen, Xu, Yang
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Networking and Internet Architecture Artificial Intelligence Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Short-circuiting Rings for Low-Latency AllReduce
di: Hammer, Sarah-Michelle, et al.
Pubblicazione: (2025)

AllReduce Scheduling with Hierarchical Deep Reinforcement Learning
di: Wei, Yufan, et al.
Pubblicazione: (2025)

OptiReduce: Resilient and Tail-Optimal AllReduce for Distributed Deep Learning in the Cloud
di: Warraich, Ertza, et al.
Pubblicazione: (2023)

Trivance: Latency-Optimal AllReduce by Shortcutting Multiport Networks
di: Juerss, Anton, et al.
Pubblicazione: (2026)

Don't Let a Few Network Failures Slow the Entire AllReduce
di: Chen, Peiqing, et al.
Pubblicazione: (2026)

RailS: Load Balancing for All-to-All Communication in Distributed Mixture-of-Experts Training
di: Xu, Heng, et al.
Pubblicazione: (2025)

Ethereal: Divide and Conquer Network Load Balancing in Large-Scale Distributed Training
di: Addanki, Vamsi, et al.
Pubblicazione: (2024)

FAST: An Efficient Scheduler for All-to-All GPU Communication
di: Lei, Yiran, et al.
Pubblicazione: (2025)

Efficient All-to-All Collective Communication Schedules for Direct-Connect Topologies
di: Basu, Prithwish, et al.
Pubblicazione: (2023)

Revisiting Bruck: Phase-Efficient All-to-All Communication in Reconfigurable Networks
di: Juerss, Anton, et al.
Pubblicazione: (2026)

Dynamic Hierarchical Birkhoff-von Neumann Decomposition for All-to-All GPU Communication
di: Wu, Yen-Chieh, et al.
Pubblicazione: (2026)

Graph neural network for in-network placement of real-time metaverse tasks in next-generation network
di: Rashid, Sulaiman Muhammad, et al.
Pubblicazione: (2024)

A Mathematical Theory of Hyper-simplex Fractal Network for Blockchain: Part I
di: Yang, Kaiwen, et al.
Pubblicazione: (2024)

AirChain: A Novel Blockchain Framework and Low-Cost Device for Democratized Air Quality Data Aggregation
di: Stankiewicz, Samuel
Pubblicazione: (2024)

A Distributed Efficient Blockchain Oracle Scheme for Internet of Things
di: Xian, Youquan, et al.
Pubblicazione: (2023)

EdgeTimer: Adaptive Multi-Timescale Scheduling in Mobile Edge Computing with Deep Reinforcement Learning
di: Hao, Yijun, et al.
Pubblicazione: (2024)

Priority based inter-twin communication in vehicular digital twin networks
di: Zia, Qasim, et al.
Pubblicazione: (2024)

Network Anomaly Detection in Distributed Edge Computing Infrastructure
di: Marfo, William, et al.
Pubblicazione: (2025)

A Uniqueness Theorem for Distributed Computation under Physical Constraint
di: Ren, Zhiyuan, et al.
Pubblicazione: (2025)

Policy Design in Zero-Trust Distributed Networks: Challenges and Solutions
di: Sandjaja, Fannya R., et al.
Pubblicazione: (2025)

Multi-stage Flow Scheduling for LLM Serving
di: Sun, Yijun, et al.
Pubblicazione: (2026)

DistriFS: A Platform and User Agnostic Approach to File Distribution
di: Boesch, Julian
Pubblicazione: (2024)

FODT: Fast, Online, Distributed and Temporary Failure Recovery Approach for MEC
di: Yuan, Xin, et al.
Pubblicazione: (2023)

Fast Prototyping of Distributed Stream Processing Applications with stream2gym
di: Ifath, Md. Monzurul Amin, et al.
Pubblicazione: (2024)

A Multi-Layered Distributed Computing Framework for Enhanced Edge Computing
di: Ma, Ke, et al.
Pubblicazione: (2024)

Joint wireless and computing resource management with optimal slice selection in in-network-edge metaverse system
di: Rashid, Sulaiman Muhammad, et al.
Pubblicazione: (2024)

FlowTracer: A Tool for Uncovering Network Path Usage Imbalance in AI Training Clusters
di: Jamil, Hasibul, et al.
Pubblicazione: (2024)

Design and Operation of Shared Machine Learning Clusters on Campus
di: Xu, Kaiqiang, et al.
Pubblicazione: (2021)

Edge-assisted Parallel Uncertain Skyline Processing for Low-latency IoE Analysis
di: Lai, Chuan-Chi, et al.
Pubblicazione: (2025)

OptiNIC: A Resilient and Tail-Optimal RDMA NIC for Distributed ML Workloads
di: Warraich, Ertza, et al.
Pubblicazione: (2025)

Temporal-Aware GPU Resource Allocation for Distributed LLM Inference via Reinforcement Learning
di: Du, Chengze, et al.
Pubblicazione: (2025)

Heterogeneity-aware P2P Wireless Energy Transfer for Balanced Energy Distribution
di: Ojha, Tamoghna, et al.
Pubblicazione: (2022)

D-LoRa: a Distributed Parameter Adaptation Scheme for LoRa Network
di: Wang, Ruiqi, et al.
Pubblicazione: (2025)

SANSee: A Physical-layer Semantic-aware Networking Framework for Distributed Wireless Sensing
di: Zhu, Huixiang, et al.
Pubblicazione: (2024)

Contention-Aware Microservice Deployment in Collaborative Mobile Edge Networks
di: Ge, Xinlei, et al.
Pubblicazione: (2024)

Analysing Mechanisms for Virtual Channel Management in Low-Diameter networks
di: Cano, Alejandro, et al.
Pubblicazione: (2023)

A Density-Delay Law for Stable Event-Driven State Progression in Open Distributed Systems
di: Chen, Bin, et al.
Pubblicazione: (2026)

Distributed Simulation for Digital Twins of Large-Scale Real-World DiffServ-Based Networks
di: Huang, Zhuoyao, et al.
Pubblicazione: (2024)

EdgeLoc: A Communication-Adaptive Parallel System for Real-Time Localization in Infrastructure-Assisted Autonomous Driving
di: Liu, Boyi, et al.
Pubblicazione: (2024)

The AutoSPADA Platform: User-Friendly Edge Computing for Distributed Learning and Data Analytics in Connected Vehicles
di: Nilsson, Adrian, et al.
Pubblicazione: (2023)