Fault-Tolerant Hybrid-Parallel Training at Scale with Reliable and Efficient In-memory Checkpointing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Yuxin, Kang, Xueze, Shi, Shaohuai, He, Xin, Tang, Zhenheng, Pan, Xinglin, Zheng, Yang, Wu, Xiaoyu, Zhou, Amelie Chi, He, Bingsheng, Chu, Xiaowen
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!