Efficient Pre-Training of LLMs via Topology-Aware Communication Alignment on More Than 9600 GPUs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: He, Guoliang, Jiang, Youhe, Xiao, Wencong, Jiang, Kaihua, Wang, Shuguang, Wang, Jun, Du, Zixian, Jiang, Zhuo, Zhang, Xinlei, Yuan, Binhang, Yoneki, Eiko
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!