Cover Image

An Efficient, Reliable and Observable Collective Communication Library in Large-scale GPU Training Clusters

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Mingjun, Hu, Xiaohe, Zhang, Menghao, Chen, Ziteng, Jia, Yanmin, Zhang, Yan, Liu, Da, Chen, Qing, Jiao, Fangzheng, Chen, Jun, Liu, He, Zeng, Aohan, Duan, Shuaixing, Gu, Ruya, Jing, Yang, Han, Bowen, Chen, Wei, Xie, Wenqi, Hou, Jinlong, Cheng, Yuan, Zhang, Hongzhou, Xu, Bohua, Xu, Mingwei, Hu, Chunming
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PlexRL: Cluster-Level Orchestration of Serviceized LLM Execution for RLVR
by: Zhang, Yiqi, et al.
Published: (2026)

SurveyEval: Towards Comprehensive Evaluation of LLM-Generated Academic Surveys
by: Zhao, Jiahao, et al.
Published: (2025)

Partially‐Observable Sequential Change‐Point Detection for Autocorrelated Data via Adaptive Upper Confidence Region
by: Haijie Xu, et al.
Published: (2026)

Implicit Word Reordering with Knowledge Distillation for Cross-Lingual Dependency Parsing
by: Li, Zhuoran, et al.
Published: (2025)

Partially-Observable Sequential Change-Point Detection for Autocorrelated Data via Upper Confidence Region
by: Xu, Haijie, et al.
Published: (2024)

Dual-functional microwave photonic system for concurrent radar and secure communication via radar signal masking
by: Shi, Taixia, et al.
Published: (2024)

FusionRCG: Orchestrating Recursive Computation Graphs across GPU Memory Hierarchies
by: Zhang, Yihong, et al.
Published: (2026)

Regulating Water Adsorption Sites of Keto‐Enamine COF by Base Exfoliation and Deprotonation for Enhanced Humidity Response
by: Aohan Mei, et al.
Published: (2024)

Adaptive Learning of Consistency and Inconsistency Information for Fake News Detection
by: Li, Aohan, et al.
Published: (2024)

Strichartz estimates for orthonormal systems on compact manifolds: the non-sharp region
by: Ji, Hongzhou, et al.
Published: (2026)

SEATrack: Simple, Efficient, and Adaptive Multimodal Tracker
by: Su, Junbin, et al.
Published: (2026)

Improving Zero-Shot Cross-Lingual Transfer via Progressive Code-Switching
by: Li, Zhuoran, et al.
Published: (2024)

Single‐Crystalline LiMg Alloy Anode for Deep Cycling All Solid State Lithium Metal Batteries
by: Linxue Zhang, et al.
Published: (2024)

VulnResolver: A Hybrid Agent Framework for LLM-Based Automated Vulnerability Issue Resolution
by: Zhang, Mingming, et al.
Published: (2026)

Learning to Wait: Synchronizing Agents with the Physical World
by: She, Yifei, et al.
Published: (2025)

Advanced Zero-Shot Text-to-Speech for Background Removal and Preservation with Controllable Masked Speech Prediction
by: Zhang, Leying, et al.
Published: (2025)

Expert-as-a-Service: Towards Efficient, Scalable, and Robust Large-scale MoE Serving
by: Liu, Ziming, et al.
Published: (2025)

Radio Map-Enabled 3D Trajectory and Communication Optimization for Low-Altitude Air-Ground Cooperation
by: Hu, Menghao, et al.
Published: (2025)

Fiber neural networks for the intelligent optical fiber communications
by: Zang, Yubin, et al.
Published: (2024)

Learning Dynamic Collaborative Network for Semi-supervised 3D Vessel Segmentation
by: Xu, Jiao, et al.
Published: (2026)

MAESTRO: Multi-Agent Evaluation Suite for Testing, Reliability, and Observability
by: Ma, Tie, et al.
Published: (2026)

Who still suffers? Effects of COVID‐19 stressful experiences on somatic symptoms and anxious mood moderated by diurnal cortisol: A daily diary study
by: Bowen Chen, et al.
Published: (2024)

Boosting LLM Serving through Spatial-Temporal GPU Resource Sharing
by: Lin, Zejia, et al.
Published: (2025)

Draft-Refine-Optimize: Self-Evolved Learning for Natural Language to MongoDB Query Generation
by: Ye, Mingwei, et al.
Published: (2026)

Instance Communication System for Intelligent Connected Vehicles: Bridging the Gap from Semantic to Instance-Level Transmission
by: Zhang, Daiqi, et al.
Published: (2025)

Spatial-Aware Self-Supervision for Medical 3D Imaging with Multi-Granularity Observable Tasks
by: Zhang, Yiqin, et al.
Published: (2025)

APAR: LLMs Can Do Auto-Parallel Auto-Regressive Decoding
by: Liu, Mingdao, et al.
Published: (2024)

On the psychological effects of child‐like space design on preschoolers under anesthesia: A qualitative study
by: Zhiguo Zhou, et al.
Published: (2024)

Long-Range Dipole-Dipole Interactions Enabled with Guided Plasmons of Matched Nanoparticle-on-Mirror Antenna Pairs
by: Kang, Bowen, et al.
Published: (2024)

Review on Catalytic Meinwald Rearrangement of Epoxides
by: Yulong Zhang, et al.
Published: (2024)

Coping With Chronic Obstructive Pulmonary Disease Together: A Dyadic Study of Self‐Care and Quality of Life in Patients and Their Caregivers
by: Yingying Cai, et al.
Published: (2025)

Analysis of Electromagnetic Performance of a New Dual‐Rotor Hybrid Excitation Generator
by: Mingjun Xu, et al.
Published: (2025)

In Situ Alkali‐Induced Surface Modification of Basalt Fibers for Improved Interfacial Bonding in Geopolymer Composites
by: Shuaibin Wang, et al.
Published: (2026)

Synergistic Effects of Dual‐Doping with Ni and Ru in Monolayer VS2 Nanosheet: Unleashing Enhanced Performance for Acidic HER through Defects and Strain
by: Ruonan Wang, et al.
Published: (2024)

Testicular fibrosis pathology, diagnosis, pathogenesis, and treatment: A perspective on related diseases
by: Ying Xu, et al.
Published: (2024)

Deep But Reliable: Advancing Multi-turn Reasoning for Thinking with Images
by: Yang, Wenhao, et al.
Published: (2025)

Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Framework
by: Zhang, Zeyu, et al.
Published: (2025)

HAPS: Hierarchical LLM Routing with Joint Architecture and Parameter Search
by: Tian, Zihang, et al.
Published: (2026)

Higher-Order Entrywise Eigenvectors Analysis of Low-Rank Random Matrices: Bias Correction, Edgeworth Expansion, and Bootstrap
by: Xie, Fangzheng, et al.
Published: (2024)

Efficient Semantic-aware Encryption for Secure Communications in Intelligent Connected Vehicles
by: Wang, Bizhu, et al.
Published: (2025)