ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nabli, Adel, Fournier, Louis, Erbacher, Pierre, Serrano, Louis, Belilovsky, Eugene, Oyallon, Edouard
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!