Image de couverture de livre

Reciprocal Co-Training (RCT): Coupling Gradient-Based and Non-Differentiable Models via Reinforcement Learning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Tian, Yunshuo, Kitessa, Akayou, Chitnis, Tanuja, Zhao, Yijun
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Alternating Reinforcement Learning for Rubric-Based Reward Modeling in Non-Verifiable LLM Post-Training
par: Xu, Ran, et autres
Publié: (2026)

Training Dynamics of Transformers to Recognize Word Co-occurrence via Gradient Flow Analysis
par: Yang, Hongru, et autres
Publié: (2024)

Off-Policy Value-Based Reinforcement Learning for Large Language Models
par: Wang, Peng-Yuan, et autres
Publié: (2026)

Synthetic Text Generation for Training Large Language Models via Gradient Matching
par: Nguyen, Dang, et autres
Publié: (2025)

RadPhi-3: Small Language Models for Radiology
par: Ranjit, Mercy, et autres
Publié: (2024)

CE-GPPO: Coordinating Entropy via Gradient-Preserving Clipping Policy Optimization in Reinforcement Learning
par: Su, Zhenpeng, et autres
Publié: (2025)

Can we Soft Prompt LLMs for Graph Learning Tasks?
par: Liu, Zheyuan, et autres
Publié: (2024)

Sequential Decision-Making for Inline Text Autocomplete
par: Chitnis, Rohan, et autres
Publié: (2024)

Joint Selection for Large-Scale Pre-Training Data via Policy Gradient-based Mask Learning
par: Fan, Ziqing, et autres
Publié: (2025)

d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning
par: Zhao, Siyan, et autres
Publié: (2025)

NOVER: Incentive Training for Language Models via Verifier-Free Reinforcement Learning
par: Liu, Wei, et autres
Publié: (2025)

Efficient Reinforcement Finetuning via Adaptive Curriculum Learning
par: Shi, Taiwei, et autres
Publié: (2025)

RCT Rejection Sampling for Causal Estimation Evaluation
par: Keith, Katherine A., et autres
Publié: (2023)

Efficient Differentially Private Fine-Tuning of LLMs via Reinforcement Learning
par: Khadangi, Afshin, et autres
Publié: (2025)

Rationalizing Transformer Predictions via End-To-End Differentiable Self-Training
par: Brinner, Marc, et autres
Publié: (2025)

Machine Learning Systems are Bloated and Vulnerable
par: Zhang, Huaifeng, et autres
Publié: (2022)

Safe Reinforcement Learning with Free-form Natural Language Constraints and Pre-Trained Language Models
par: Lou, Xingzhou, et autres
Publié: (2024)

PEARL: Training Socratic Tutors with Pedagogically Aligned Reinforcement Learning
par: Chang, Qikai, et autres
Publié: (2026)

AGGC: Adaptive Group Gradient Clipping for Stabilizing Large Language Model Training
par: Li, Zhiyuan, et autres
Publié: (2026)

WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning
par: Wei, Zhepei, et autres
Publié: (2025)

Vanishing Gradients in Reinforcement Finetuning of Language Models
par: Razin, Noam, et autres
Publié: (2023)

The Fine-Grained Complexity of Gradient Computation for Training Large Language Models
par: Alman, Josh, et autres
Publié: (2024)

MARS: Co-evolving Dual-System Deep Research via Multi-Agent Reinforcement Learning
par: Chen, Guoxin, et autres
Publié: (2025)

Jet-RL: Enabling On-Policy FP8 Reinforcement Learning with Unified Training and Rollout Precision Flow
par: Xi, Haocheng, et autres
Publié: (2026)

Reinforcement Learning on Pre-Training Data
par: Li, Siheng, et autres
Publié: (2025)

DiLoCo: Distributed Low-Communication Training of Language Models
par: Douillard, Arthur, et autres
Publié: (2023)

UserRL: Training Interactive User-Centric Agent via Reinforcement Learning
par: Qian, Cheng, et autres
Publié: (2025)

Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training
par: Wang, Yixuan, et autres
Publié: (2024)

Reinforcement Learning for Reasoning in Large Language Models with One Training Example
par: Wang, Yiping, et autres
Publié: (2025)

Breaking Training Bottlenecks: Effective and Stable Reinforcement Learning for Coding Models
par: Li, Zongqian, et autres
Publié: (2026)

CAST: Continuous and Differentiable Semi-Structured Sparsity-Aware Training for Large Language Models
par: Huang, Weiyu, et autres
Publié: (2025)

On the Effect of Negative Gradient in Group Relative Deep Reinforcement Optimization
par: Deng, Wenlong, et autres
Publié: (2025)

Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routers
par: Ma, Wenhan, et autres
Publié: (2025)

HierRouter: Coordinated Routing of Specialized Large Language Models via Reinforcement Learning
par: Gupta, Nikunj, et autres
Publié: (2025)

Structural Abstraction as an Inductive Bias for Non-Stationary Language Model Training
par: Rahmati, Elnaz, et autres
Publié: (2026)

Measuring Non-Adversarial Reproduction of Training Data in Large Language Models
par: Aerni, Michael, et autres
Publié: (2024)

KDRL: Post-Training Reasoning LLMs via Unified Knowledge Distillation and Reinforcement Learning
par: Xu, Hongling, et autres
Publié: (2025)

xRouter: Training Cost-Aware LLMs Orchestration System via Reinforcement Learning
par: Qian, Cheng, et autres
Publié: (2025)

Balancing the Reasoning Load: Difficulty-Differentiated Policy Optimization with Length Redistribution for Efficient and Robust Reinforcement Learning
par: Xia, Yinan, et autres
Publié: (2026)

How Off-Policy Can GRPO Be? Mu-GRPO for Efficient LLM Reinforcement Learning
par: Tian, Minghao, et autres
Publié: (2026)