Decoupled DiLoCo for Resilient Distributed Pre-training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Douillard, Arthur, Rush, Keith, Donchev, Yani, Charles, Zachary, Fallen, Nova, Dubey, Ayush, Gog, Ionel, Dean, Josef, Woodworth, Blake, Garrett, Zachary, Keating, Nate, Bishop, Jenny, Prior, Henry, Yvinec, Edouard, Szlam, Arthur, Ranzato, Marc'Aurelio, Dean, Jeff
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2604.21428