Image de couverture de livre

An Efficient, Reliable and Observable Collective Communication Library in Large-scale GPU Training Clusters

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Mingjun, Hu, Xiaohe, Zhang, Menghao, Chen, Ziteng, Jia, Yanmin, Zhang, Yan, Liu, Da, Chen, Qing, Jiao, Fangzheng, Chen, Jun, Liu, He, Zeng, Aohan, Duan, Shuaixing, Gu, Ruya, Jing, Yang, Han, Bowen, Chen, Wei, Xie, Wenqi, Hou, Jinlong, Cheng, Yuan, Zhang, Hongzhou, Xu, Bohua, Xu, Mingwei, Hu, Chunming
Format:	Preprint
Publié:	2025
Sujets:	Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

PlexRL: Cluster-Level Orchestration of Serviceized LLM Execution for RLVR
par: Zhang, Yiqi, et autres
Publié: (2026)

SurveyEval: Towards Comprehensive Evaluation of LLM-Generated Academic Surveys
par: Zhao, Jiahao, et autres
Publié: (2025)

Partially‐Observable Sequential Change‐Point Detection for Autocorrelated Data via Adaptive Upper Confidence Region
par: Haijie Xu, et autres
Publié: (2026)

Implicit Word Reordering with Knowledge Distillation for Cross-Lingual Dependency Parsing
par: Li, Zhuoran, et autres
Publié: (2025)

Partially-Observable Sequential Change-Point Detection for Autocorrelated Data via Upper Confidence Region
par: Xu, Haijie, et autres
Publié: (2024)

Dual-functional microwave photonic system for concurrent radar and secure communication via radar signal masking
par: Shi, Taixia, et autres
Publié: (2024)

FusionRCG: Orchestrating Recursive Computation Graphs across GPU Memory Hierarchies
par: Zhang, Yihong, et autres
Publié: (2026)

Regulating Water Adsorption Sites of Keto‐Enamine COF by Base Exfoliation and Deprotonation for Enhanced Humidity Response
par: Aohan Mei, et autres
Publié: (2024)

Adaptive Learning of Consistency and Inconsistency Information for Fake News Detection
par: Li, Aohan, et autres
Publié: (2024)

Strichartz estimates for orthonormal systems on compact manifolds: the non-sharp region
par: Ji, Hongzhou, et autres
Publié: (2026)

SEATrack: Simple, Efficient, and Adaptive Multimodal Tracker
par: Su, Junbin, et autres
Publié: (2026)

Improving Zero-Shot Cross-Lingual Transfer via Progressive Code-Switching
par: Li, Zhuoran, et autres
Publié: (2024)

Single‐Crystalline LiMg Alloy Anode for Deep Cycling All Solid State Lithium Metal Batteries
par: Linxue Zhang, et autres
Publié: (2024)

VulnResolver: A Hybrid Agent Framework for LLM-Based Automated Vulnerability Issue Resolution
par: Zhang, Mingming, et autres
Publié: (2026)

Learning to Wait: Synchronizing Agents with the Physical World
par: She, Yifei, et autres
Publié: (2025)

Advanced Zero-Shot Text-to-Speech for Background Removal and Preservation with Controllable Masked Speech Prediction
par: Zhang, Leying, et autres
Publié: (2025)

Expert-as-a-Service: Towards Efficient, Scalable, and Robust Large-scale MoE Serving
par: Liu, Ziming, et autres
Publié: (2025)

Radio Map-Enabled 3D Trajectory and Communication Optimization for Low-Altitude Air-Ground Cooperation
par: Hu, Menghao, et autres
Publié: (2025)

Fiber neural networks for the intelligent optical fiber communications
par: Zang, Yubin, et autres
Publié: (2024)

Learning Dynamic Collaborative Network for Semi-supervised 3D Vessel Segmentation
par: Xu, Jiao, et autres
Publié: (2026)

MAESTRO: Multi-Agent Evaluation Suite for Testing, Reliability, and Observability
par: Ma, Tie, et autres
Publié: (2026)

Who still suffers? Effects of COVID‐19 stressful experiences on somatic symptoms and anxious mood moderated by diurnal cortisol: A daily diary study
par: Bowen Chen, et autres
Publié: (2024)

Boosting LLM Serving through Spatial-Temporal GPU Resource Sharing
par: Lin, Zejia, et autres
Publié: (2025)

Draft-Refine-Optimize: Self-Evolved Learning for Natural Language to MongoDB Query Generation
par: Ye, Mingwei, et autres
Publié: (2026)

Instance Communication System for Intelligent Connected Vehicles: Bridging the Gap from Semantic to Instance-Level Transmission
par: Zhang, Daiqi, et autres
Publié: (2025)

Spatial-Aware Self-Supervision for Medical 3D Imaging with Multi-Granularity Observable Tasks
par: Zhang, Yiqin, et autres
Publié: (2025)

APAR: LLMs Can Do Auto-Parallel Auto-Regressive Decoding
par: Liu, Mingdao, et autres
Publié: (2024)

On the psychological effects of child‐like space design on preschoolers under anesthesia: A qualitative study
par: Zhiguo Zhou, et autres
Publié: (2024)

Long-Range Dipole-Dipole Interactions Enabled with Guided Plasmons of Matched Nanoparticle-on-Mirror Antenna Pairs
par: Kang, Bowen, et autres
Publié: (2024)

Review on Catalytic Meinwald Rearrangement of Epoxides
par: Yulong Zhang, et autres
Publié: (2024)

Coping With Chronic Obstructive Pulmonary Disease Together: A Dyadic Study of Self‐Care and Quality of Life in Patients and Their Caregivers
par: Yingying Cai, et autres
Publié: (2025)

Analysis of Electromagnetic Performance of a New Dual‐Rotor Hybrid Excitation Generator
par: Mingjun Xu, et autres
Publié: (2025)

In Situ Alkali‐Induced Surface Modification of Basalt Fibers for Improved Interfacial Bonding in Geopolymer Composites
par: Shuaibin Wang, et autres
Publié: (2026)

Synergistic Effects of Dual‐Doping with Ni and Ru in Monolayer VS2 Nanosheet: Unleashing Enhanced Performance for Acidic HER through Defects and Strain
par: Ruonan Wang, et autres
Publié: (2024)

Testicular fibrosis pathology, diagnosis, pathogenesis, and treatment: A perspective on related diseases
par: Ying Xu, et autres
Publié: (2024)

Deep But Reliable: Advancing Multi-turn Reasoning for Thinking with Images
par: Yang, Wenhao, et autres
Publié: (2025)

Learn to Memorize: Optimizing LLM-based Agents with Adaptive Memory Framework
par: Zhang, Zeyu, et autres
Publié: (2025)

HAPS: Hierarchical LLM Routing with Joint Architecture and Parameter Search
par: Tian, Zihang, et autres
Publié: (2026)

Higher-Order Entrywise Eigenvectors Analysis of Low-Rank Random Matrices: Bias Correction, Edgeworth Expansion, and Bootstrap
par: Xie, Fangzheng, et autres
Publié: (2024)

Efficient Semantic-aware Encryption for Secure Communications in Intelligent Connected Vehicles
par: Wang, Bizhu, et autres
Publié: (2025)