Cover Image

Joint Training of Multi-Token Prediction in Reinforcement Learning via Optimal Coefficient Calibration

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Zili, Chai, Jiajun, Chen, Lin, Wang, Xiaohan, Xiang, Shiming, Yin, Guojun
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ResRL: Boosting LLM Reasoning via Negative Sample Projection Residual Reinforcement Learning
by: Lin, Zihan, et al.
Published: (2026)

When Self-Belief Misleads: Active Label Acquisition for Reinforcement Learning with Verifiable Rewards
by: Wang, Li, et al.
Published: (2026)

Contextual Rollout Bandits for Reinforcement Learning with Verifiable Rewards
by: Lu, Xiaodong, et al.
Published: (2026)

RLFactory: A Plug-and-Play Reinforcement Learning Post-Training Framework for LLM Multi-Turn Tool-Use
by: Chai, Jiajun, et al.
Published: (2025)

RLAE: Reinforcement Learning-Assisted Ensemble for LLMs
by: Fu, Yuqian, et al.
Published: (2025)

$π$-Play: Multi-Agent Self-Play via Privileged Self-Distillation without External Data
by: Zhang, Yaocheng, et al.
Published: (2026)

JTok: On Token Embedding as another Axis of Scaling Law via Joint Token Self-modulation
by: Yang, Yebin, et al.
Published: (2026)

Calibrated One Round Federated Learning with Bayesian Inference in the Predictive Space
by: Hasan, Mohsin, et al.
Published: (2023)

CDRRM: Contrast-Driven Rubric Generation for Reliable and Interpretable Reward Modeling
by: Liu, Dengcan, et al.
Published: (2026)

Enhanced Graph Transformer with Serialized Graph Tokens
by: Wang, Ruixiang, et al.
Published: (2026)

SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning
by: Fu, Yuqian, et al.
Published: (2025)

Your Group-Relative Advantage Is Biased
by: Yang, Fengkai, et al.
Published: (2026)

Rule-Bottleneck Reinforcement Learning: Joint Explanation and Decision Optimization for Resource Allocation with Language Agents
by: Tec, Mauricio, et al.
Published: (2025)

SAE as a Crystal Ball: Interpretable Features Predict Cross-domain Transferability of LLMs without Training
by: Zhang, Qi, et al.
Published: (2026)

Training Multi-Image Vision Agents via End2End Reinforcement Learning
by: Dong, Chengqi, et al.
Published: (2025)

Provably Efficient Reinforcement Learning for Adversarial Restless Multi-Armed Bandits with Unknown Transitions and Bandit Feedback
by: Xiong, Guojun, et al.
Published: (2024)

Trained on Tokens, Calibrated on Concepts: The Emergence of Semantic Calibration in LLMs
by: Nakkiran, Preetum, et al.
Published: (2025)

MeTok: An Efficient Meteorological Tokenization with Hyper-Aligned Group Learning for Precipitation Nowcasting
by: Jin, Qizhao, et al.
Published: (2026)

Learning with Geometry: Including Riemannian Geometric Features in Coefficient of Pressure Prediction on Aircraft Wings
by: Hu, Liwei, et al.
Published: (2023)

Multi-Token Residual Prediction
by: Xu, Yufeng, et al.
Published: (2026)

ResT: Reshaping Token-Level Policy Gradients for Tool-Use Large Language Models
by: Lin, Zihan, et al.
Published: (2025)

Making Bias Non-Predictive: Training Robust LLM Reasoning via Reinforcement Learning
by: Wang, Qian, et al.
Published: (2026)

Multi-Agent Reinforcement Learning for Joint Police Patrol and Dispatch
by: Repasky, Matthew, et al.
Published: (2024)

CoVeR: Conformal Calibration for Versatile and Reliable Autoregressive Next-Token Prediction
by: Chen, Yuzhu, et al.
Published: (2025)

On the Linear Speedup of Personalized Federated Reinforcement Learning with Shared Representations
by: Xiong, Guojun, et al.
Published: (2024)

Composite Flow Matching for Reinforcement Learning with Shifted-Dynamics Data
by: Kong, Lingkai, et al.
Published: (2025)

How Reinforcement Learning After Next-Token Prediction Facilitates Learning
by: Tsilivis, Nikolaos, et al.
Published: (2025)

Reasoning Bias of Next Token Prediction Training
by: Lin, Pengxiao, et al.
Published: (2025)

Multi-Agent Model-Based Reinforcement Learning with Joint State-Action Learned Embeddings
by: Wang, Zhizun, et al.
Published: (2026)

How Transformers Learn to Plan via Multi-Token Prediction
by: Huang, Jianhao, et al.
Published: (2026)

On the Statistical Complexity for Offline and Low-Adaptive Reinforcement Learning with Structures
by: Yin, Ming, et al.
Published: (2025)

Transfer Learning for Classification under Decision Rule Drift with Application to Optimal Individualized Treatment Rule Estimation
by: Wang, Xiaohan, et al.
Published: (2025)

Transformers Learn the Optimal DDPM Denoiser for Multi-Token GMMs
by: Li, Hongkang, et al.
Published: (2026)

Accelerating 3D Molecule Generation via Jointly Geometric Optimal Transport
by: Hong, Haokai, et al.
Published: (2024)

POWQMIX: Weighted Value Factorization with Potentially Optimal Joint Actions Recognition for Cooperative Multi-Agent Reinforcement Learning
by: Huang, Chang, et al.
Published: (2024)

Understanding and Enhancing the Planning Capability of Language Models via Multi-Token Prediction
by: Zhong, Qimin, et al.
Published: (2025)

Learning Universal Multi-level Market Irrationality Factors to Improve Stock Return Forecasting
by: Yang, Chen, et al.
Published: (2025)

Structured Reinforcement Learning for Delay-Optimal Data Transmission in Dense mmWave Networks
by: Wang, Shufan, et al.
Published: (2024)

A Joint Approach to Local Updating and Gradient Compression for Efficient Asynchronous Federated Learning
by: Song, Jiajun, et al.
Published: (2024)

Near-Optimal Reinforcement Learning with Self-Play under Adaptivity Constraints
by: Qiao, Dan, et al.
Published: (2024)