ByteCheckpoint: A Unified Checkpointing System for Large Foundation Model Development
Fuente:
arXiv
Guardado en:
| Autores principales: | Wan, Borui, Han, Mingji, Sheng, Yiyao, Peng, Yanghua, Lin, Haibin, Zhang, Mofan, Lai, Zhichao, Yu, Menghan, Zhang, Junda, Song, Zuquan, Liu, Xin, Wu, Chuan |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization
por: Zhao, Juntao, et al.
Publicado: (2024)
por: Zhao, Juntao, et al.
Publicado: (2024)
Robust LLM Training Infrastructure at ByteDance
por: Wan, Borui, et al.
Publicado: (2025)
por: Wan, Borui, et al.
Publicado: (2025)
QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices
por: Zhao, Juntao, et al.
Publicado: (2024)
por: Zhao, Juntao, et al.
Publicado: (2024)
MegaScale-Data: Scaling Dataloader for Multisource Large Foundation Model Training
por: Zhao, Juntao, et al.
Publicado: (2025)
por: Zhao, Juntao, et al.
Publicado: (2025)
Application of Immune Checkpoint Inhibitors in Cancer
por: Zhijun Chen, et al.
Publicado: (2025)
por: Zhijun Chen, et al.
Publicado: (2025)
Universal Checkpointing: A Flexible and Efficient Distributed Checkpointing System for Large-Scale DNN Training with Reconfigurable Parallelis
por: Lian, Xinyu, et al.
Publicado: (2024)
por: Lian, Xinyu, et al.
Publicado: (2024)
Architectural Foundations for Checkpointing and Restoration in Quantum HPC Systems
por: Guan, Qiang, et al.
Publicado: (2026)
por: Guan, Qiang, et al.
Publicado: (2026)
Scrutinizing Variables for Checkpoint Using Automatic Differentiation
por: Huang, Xin, et al.
Publicado: (2026)
por: Huang, Xin, et al.
Publicado: (2026)
Laminar: A Scalable Asynchronous RL Post-Training Framework
por: Sheng, Guangming, et al.
Publicado: (2025)
por: Sheng, Guangming, et al.
Publicado: (2025)
Pharmacovigilance Insights Into Immune Checkpoint Inhibitor‐Induced Risk of Paraneoplastic Syndrome: A Large‐Scale Real World Study
por: Bufu Tang, et al.
Publicado: (2026)
por: Bufu Tang, et al.
Publicado: (2026)
EvoSynth: Checkpoints
por: Viet Thanh Duy Nguyen
Publicado: (2025)
por: Viet Thanh Duy Nguyen
Publicado: (2025)
SONK ‐Like Subchondral Osteonecrosis Associated With Immune Checkpoint Inhibition
por: Wan‐Hao Tsai, et al.
Publicado: (2025)
por: Wan‐Hao Tsai, et al.
Publicado: (2025)
Large-scale Evaluation of Notebook Checkpointing with AI Agents
por: Fang, Hanxi, et al.
Publicado: (2025)
por: Fang, Hanxi, et al.
Publicado: (2025)
Anonymous Submission Model Checkpoints
por: Anonymous
Publicado: (2025)
por: Anonymous
Publicado: (2025)
Orbax: Distributed Checkpointing with JAX
por: Gaffney, Colin, et al.
Publicado: (2026)
por: Gaffney, Colin, et al.
Publicado: (2026)
AutoCheck: Automatically Identifying Variables for Checkpointing by Data Dependency Analysis
por: Fu, Xiang, et al.
Publicado: (2024)
por: Fu, Xiang, et al.
Publicado: (2024)
Progressed Atrioventricular Block in Immune Checkpoint Inhibitor Induced Myocarditis: A Case Report
por: Dongmei Xie, et al.
Publicado: (2025)
por: Dongmei Xie, et al.
Publicado: (2025)
Aptamer‐based Immune Checkpoint Inhibition for Cancer Immunotherapy
por: Yihao Huang, et al.
Publicado: (2024)
por: Yihao Huang, et al.
Publicado: (2024)
TierCheck: Tiered Checkpointing for Fault Tolerance in Large Language Model Training
por: Han, Shujie, et al.
Publicado: (2026)
por: Han, Shujie, et al.
Publicado: (2026)
BitSnap: Checkpoint Sparsification and Quantization in LLM Training
por: Peng, Yanxin, et al.
Publicado: (2025)
por: Peng, Yanxin, et al.
Publicado: (2025)
LLMTailor: A Layer-wise Tailoring Tool for Efficient Checkpointing of Large Language Models
por: Sun, Minqiu, et al.
Publicado: (2026)
por: Sun, Minqiu, et al.
Publicado: (2026)
Asynchronous Checkpoint for Eventually Consistent Databases
por: Ravishankar, Raaghav, et al.
Publicado: (2025)
por: Ravishankar, Raaghav, et al.
Publicado: (2025)
Rethinking Immune Checkpoint Inhibition in Cancer
por: Tibor Bakacs, et al.
Publicado: (2026)
por: Tibor Bakacs, et al.
Publicado: (2026)
Targeting HIF as a Promising Approach to Synergize With Immune Checkpoint Inhibitors
por: Shuai Li, et al.
Publicado: (2026)
por: Shuai Li, et al.
Publicado: (2026)
Boosting Checkpoint Immunotherapy with Biomimetic Nanodrug Delivery Systems
por: Wenjing Chen, et al.
Publicado: (2024)
por: Wenjing Chen, et al.
Publicado: (2024)
ACRFence: Preventing Semantic Rollback Attacks in Agent Checkpoint-Restore
por: Zheng, Yusheng, et al.
Publicado: (2026)
por: Zheng, Yusheng, et al.
Publicado: (2026)
Testicular Function After Immune‐Checkpoint Inhibitors Treatment
por: Andrea Boutros, et al.
Publicado: (2025)
por: Andrea Boutros, et al.
Publicado: (2025)
HybridFlow: A Flexible and Efficient RLHF Framework
por: Sheng, Guangming, et al.
Publicado: (2024)
por: Sheng, Guangming, et al.
Publicado: (2024)
DataStates-LLM: Lazy Asynchronous Checkpointing for Large Language Models
por: Maurya, Avinash, et al.
Publicado: (2024)
por: Maurya, Avinash, et al.
Publicado: (2024)
Uncertainty-Guided Checkpoint Selection for Reinforcement Finetuning of Large Language Models
por: Nguyen, Manh, et al.
Publicado: (2025)
por: Nguyen, Manh, et al.
Publicado: (2025)
Recycling Scraps: Improving Private Learning by Leveraging Intermediate Checkpoints
por: Shejwalkar, Virat, et al.
Publicado: (2022)
por: Shejwalkar, Virat, et al.
Publicado: (2022)
MicroDiffuse3D Checkpoints - Pretrain
por: Li, Yongkang
Publicado: (2026)
por: Li, Yongkang
Publicado: (2026)
MicroDiffuse3D Checkpoints - Pretrain
por: Li, Yongkang
Publicado: (2026)
por: Li, Yongkang
Publicado: (2026)
Improving Hyperparameter Optimization with Checkpointed Model Weights
por: Mehta, Nikhil, et al.
Publicado: (2024)
por: Mehta, Nikhil, et al.
Publicado: (2024)
Super Apriel: One Checkpoint, Many Speeds
por: Labs, SLAM, et al.
Publicado: (2026)
por: Labs, SLAM, et al.
Publicado: (2026)
CRIUgpu: Transparent Checkpointing of GPU-Accelerated Workloads
por: Stoyanov, Radostin, et al.
Publicado: (2025)
por: Stoyanov, Radostin, et al.
Publicado: (2025)
All is Not Lost: LLM Recovery without Checkpoints
por: Blagoev, Nikolay, et al.
Publicado: (2025)
por: Blagoev, Nikolay, et al.
Publicado: (2025)
Optimal Checkpoint Interval with Availability as an Objective Function
por: Saxena, Nirmal Raj, et al.
Publicado: (2024)
por: Saxena, Nirmal Raj, et al.
Publicado: (2024)
Emerging Noninvasive Biomolecular Checkpoints for Healthy Microbiomes
por: A. Dahl, et al.
Publicado: (2025)
por: A. Dahl, et al.
Publicado: (2025)
Immune Checkpoint Inhibitor–Associated Inflammatory Arthritis
por: Sang T. Kim, et al.
Publicado: (2026)
por: Sang T. Kim, et al.
Publicado: (2026)
Ejemplares similares
-
LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization
por: Zhao, Juntao, et al.
Publicado: (2024) -
Robust LLM Training Infrastructure at ByteDance
por: Wan, Borui, et al.
Publicado: (2025) -
QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices
por: Zhao, Juntao, et al.
Publicado: (2024) -
MegaScale-Data: Scaling Dataloader for Multisource Large Foundation Model Training
por: Zhao, Juntao, et al.
Publicado: (2025) -
Application of Immune Checkpoint Inhibitors in Cancer
por: Zhijun Chen, et al.
Publicado: (2025)