Cover Image

Role-Based Fault Tolerance System for LLM RL Post-Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Zhenqian, Zhong, Baoquan, Li, Xiang, Dai, Qing, Zhao, Xinkui, Ye, Miao, Cheng, Ren, Zhang, Lufei, Yin, Jianwei
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Next-Gen Computing Systems with Compute Express Link: a Comprehensive Survey
by: Chen, Chen, et al.
Published: (2024)

MeCeFO: Enhancing LLM Training Robustness via Fault-Tolerant Optimization
by: Hu, Rizhen, et al.
Published: (2025)

TensorHub: Scalable and Elastic Weight Transfer for LLM RL Training
by: Ye, Chenhao, et al.
Published: (2026)

DistFlow: A Fully Distributed RL Framework for Scalable and Efficient LLM Post-Training
by: Wang, Zhixin, et al.
Published: (2025)

AME: An Efficient Heterogeneous Agentic Memory Engine for Smartphones
by: Zhao, Xinkui, et al.
Published: (2025)

Beyond Optimal Fault Tolerance
by: Lewis-Pye, Andrew, et al.
Published: (2025)

On Fault Tolerance of Data Storage Systems: A Holistic Perspective
by: Zheng, Mai, et al.
Published: (2025)

Chameleon: Adaptive Fault Tolerance for Distributed Training via Real-time Policy Selection
by: Zhou, Yuhang, et al.
Published: (2025)

Asynchronous Fault-Tolerant Language Decidability for Runtime Verification of Distributed Systems
by: Castañeda, Armando, et al.
Published: (2025)

Byzantine Fault Tolerant Causal Ordering
by: Misra, Anshuman, et al.
Published: (2021)

RollMux: Phase-Level Multiplexing for Disaggregated RL Post-Training
by: Wu, Tianyuan, et al.
Published: (2025)

ReCoVer: Resilient LLM Pre-Training System via Fault-Tolerant Collective and Versatile Workload
by: Liu, Ziyue, et al.
Published: (2026)

FTI-TMR: A Fault Tolerance and Isolation Algorithm for Interconnected Multicore Systems
by: Hu, Yiming
Published: (2025)

Byzantine Fault-Tolerant Min-Max Optimization
by: Liu, Shuo, et al.
Published: (2022)

Approximate Byzantine Fault-Tolerance in Distributed Optimization
by: Liu, Shuo, et al.
Published: (2021)

Optimal Fault-Tolerant Dispersion on Oriented Grids
by: Banerjee, Rik, et al.
Published: (2024)

Probabilistic Byzantine Fault Tolerance (Extended Version)
by: Avelãs, Diogo, et al.
Published: (2024)

Schedule-Level Shared-Prefix Reuse for LLM RL Training
by: Li, Pengbo, et al.
Published: (2026)

TurboFFT: A High-Performance Fast Fourier Transform with Fault Tolerance on GPU
by: Wu, Shixun, et al.
Published: (2024)

Unleashing Efficient Asynchronous RL Post-Training via Staleness-Constrained Rollout Coordination
by: Li, Haoyang, et al.
Published: (2026)

Optimizing Robot Dispersion on Grids: with and without Fault Tolerance
by: Banerjee, Rik, et al.
Published: (2024)

VBFT: Veloce Byzantine Fault Tolerant Consensus for Blockchains
by: Jalalzai, Mohammad M., et al.
Published: (2023)

A Fault Tolerance Mechanism for Hybrid Scientific Workflows
by: Mulone, Alberto, et al.
Published: (2024)

Asynchronous Fault-Tolerant Distributed Proper Coloring of Graphs
by: Balliu, Alkida, et al.
Published: (2024)

Arma: Byzantine Fault Tolerant Consensus with Horizontal Scalability
by: Manevich, Yacov, et al.
Published: (2024)

The Case for ABI Interoperability in a Fault Tolerant MPI
by: Xu, Yao, et al.
Published: (2025)

Fault-Tolerant Hybrid-Parallel Training at Scale with Reliable and Efficient In-memory Checkpointing
by: Wang, Yuxin, et al.
Published: (2023)

Stabl: Blockchain Fault Tolerance
by: Gramoli, Vincent, et al.
Published: (2024)

TurboFFT: Co-Designed High-Performance and Fault-Tolerant Fast Fourier Transform on GPUs
by: Wu, Shixun, et al.
Published: (2024)

LEFT-RS: A Lock-Free Fault-Tolerant Resource Sharing Protocol for Multicore Real-Time Systems
by: Chen, Nan, et al.
Published: (2025)

MoC-System: Efficient Fault Tolerance for Sparse Mixture-of-Experts Model Training
by: Cai, Weilin, et al.
Published: (2024)

A Byzantine Fault Tolerance Approach towards AI Safety
by: deVadoss, John, et al.
Published: (2025)

Optimizing View Change for Byzantine Fault Tolerance in Parallel Consensus
by: Xie, Yifei, et al.
Published: (2026)

Hamster: A Fast Synchronous Byzantine Fault Tolerance Protocol
by: Fu, Ximing, et al.
Published: (2024)

Training LLMs with Fault Tolerant HSDP on 100,000 GPUs
by: Salpekar, Omkar, et al.
Published: (2026)

Fast LLM Post-training via Decoupled and Fastest-of-N Speculation
by: Cheng, Rongxin, et al.
Published: (2025)

Imitater: An Efficient Shared Mempool Protocol with Application to Byzantine Fault Tolerance
by: Zeng, Qingming, et al.
Published: (2024)

Fault-Tolerant Decentralized Distributed Asynchronous Federated Learning with Adaptive Termination Detection
by: Akkinepally, Phani Sahasra, et al.
Published: (2025)

Achieving High-Performance Fault-Tolerant Routing in HyperX Interconnection Networks
by: Camarero, Cristóbal, et al.
Published: (2024)

Process-Commutative Distributed Objects: From Cryptocurrencies to Byzantine-Fault-Tolerant CRDTs
by: Frey, Davide, et al.
Published: (2023)