DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Iacob, Alex, Sani, Lorenzo, Safaryan, Mher, Giampouras, Paris, Horváth, Samuel, Jovanovic, Andrej, Kurmanji, Meghdad, Aleksandrov, Preslav, Shen, William F., Qiu, Xinchi, Lane, Nicholas D.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!