Saved in:
Bibliographic Details
Main Authors: Qiu, Zhaopeng, Yu, Shuang, Zhang, Jingqi, Zhang, Shuai, Huang, Xue, Yang, Jingyi, Lai, Junjie
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.18150
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914463778603008
author Qiu, Zhaopeng
Yu, Shuang
Zhang, Jingqi
Zhang, Shuai
Huang, Xue
Yang, Jingyi
Lai, Junjie
author_facet Qiu, Zhaopeng
Yu, Shuang
Zhang, Jingqi
Zhang, Shuai
Huang, Xue
Yang, Jingyi
Lai, Junjie
contents Reinforcement learning (RL) for large language models (LLMs) is increasingly bottlenecked by rollout (generation), where long output sequence lengths make attention and KV-cache memory dominate end-to-end step time. FP8 offers an attractive lever for accelerating RL by reducing compute cost and memory traffic during rollout, but applying FP8 in RL introduces unique engineering and algorithmic challenges: policy weights change every step (requiring repeated quantization and weight synchronization into the inference engine) and low-precision rollouts can deviate from the higher-precision policy assumed by the trainer, causing train-inference mismatch and potential instability. This report presents a practical FP8 rollout stack for LLM RL, implemented in the veRL ecosystem with support for common training backends (e.g., FSDP/Megatron-LM) and inference engines (e.g., vLLM/SGLang). We (i) enable FP8 W8A8 linear-layer rollout using blockwise FP8 quantization, (ii) extend FP8 to KV-cache to remove long-context memory bottlenecks via per-step QKV scale recalibration, and (iii) mitigate mismatch using importance-sampling-based rollout correction (token-level TIS/MIS variants). Across dense and MoE models, these techniques deliver up to 44% rollout throughput gains while preserving learning behavior comparable to BF16 baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2601_18150
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle FP8-RL: A Practical and Stable Low-Precision Stack for LLM Reinforcement Learning
Qiu, Zhaopeng
Yu, Shuang
Zhang, Jingqi
Zhang, Shuai
Huang, Xue
Yang, Jingyi
Lai, Junjie
Machine Learning
Computation and Language
Reinforcement learning (RL) for large language models (LLMs) is increasingly bottlenecked by rollout (generation), where long output sequence lengths make attention and KV-cache memory dominate end-to-end step time. FP8 offers an attractive lever for accelerating RL by reducing compute cost and memory traffic during rollout, but applying FP8 in RL introduces unique engineering and algorithmic challenges: policy weights change every step (requiring repeated quantization and weight synchronization into the inference engine) and low-precision rollouts can deviate from the higher-precision policy assumed by the trainer, causing train-inference mismatch and potential instability. This report presents a practical FP8 rollout stack for LLM RL, implemented in the veRL ecosystem with support for common training backends (e.g., FSDP/Megatron-LM) and inference engines (e.g., vLLM/SGLang). We (i) enable FP8 W8A8 linear-layer rollout using blockwise FP8 quantization, (ii) extend FP8 to KV-cache to remove long-context memory bottlenecks via per-step QKV scale recalibration, and (iii) mitigate mismatch using importance-sampling-based rollout correction (token-level TIS/MIS variants). Across dense and MoE models, these techniques deliver up to 44% rollout throughput gains while preserving learning behavior comparable to BF16 baselines.
title FP8-RL: A Practical and Stable Low-Precision Stack for LLM Reinforcement Learning
topic Machine Learning
Computation and Language
url https://arxiv.org/abs/2601.18150