Imagen de Portada

The Art of Scaling Reinforcement Learning Compute for LLMs

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Khatri, Devvrit, Madaan, Lovish, Tiwari, Rishabh, Bansal, Rachit, Duvvuri, Sai Surya, Zaheer, Manzil, Dhillon, Inderjit S., Brandfonbrener, David, Agarwal, Rishabh
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Interleaved Head Attention
por: Duvvuri, Sai Surya, et al.
Publicado: (2026)

Let's (not) just put things in Context: Test-Time Training for Long-Context LLMs
por: Bansal, Rachit, et al.
Publicado: (2025)

Learning, Fast and Slow: Towards LLMs That Adapt Continually
por: Tiwari, Rishabh, et al.
Publicado: (2026)

LASER: Attention with Exponential Transformation
por: Duvvuri, Sai Surya, et al.
Publicado: (2024)

LUCID: Attention with Preconditioned Representations
por: Duvvuri, Sai Surya, et al.
Publicado: (2026)

Rethinking Thinking Tokens: LLMs as Improvement Operators
por: Madaan, Lovish, et al.
Publicado: (2025)

Fast and Simplex: 2-Simplicial Attention in Triton
por: Roy, Aurko, et al.
Publicado: (2025)

Dual-Encoders for Extreme Multi-Label Classification
por: Gupta, Nilesh, et al.
Publicado: (2023)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
por: Yen, Jui-Nan, et al.
Publicado: (2024)

Deep Reinforcement Learning for Sequential Combinatorial Auctions
por: Ravindranath, Sai Srivatsa, et al.
Publicado: (2024)

Smaller, Weaker, Yet Better: Training LLM Reasoners via Compute-Optimal Sampling
por: Bansal, Hritik, et al.
Publicado: (2024)

Compressing Many-Shots in In-Context Learning
por: Khatri, Devvrit, et al.
Publicado: (2025)

Beyond Verifiable Rewards: Scaling Reinforcement Learning for Language Models to Unverifiable Data
por: Tang, Yunhao, et al.
Publicado: (2025)

Abstract Art Interpretation Using ControlNet
por: Srivastava, Rishabh, et al.
Publicado: (2024)

Differentially Private Model Merging
por: Yin, Qichuan, et al.
Publicado: (2026)

Adaptive Few-Shot Learning (AFSL): Tackling Data Scarcity with Stability, Robustness, and Versatility
por: Agrawal, Rishabh
Publicado: (2025)

A Statistical Framework for Data-dependent Retrieval-Augmented Models
por: Basu, Soumya, et al.
Publicado: (2024)

ODRPO: Ordinal Decompositions of Discrete Rewards for Robust Policy Optimization
por: Patel, Nirmal, et al.
Publicado: (2026)

Geometric Median (GM) Matching for Robust Data Pruning
por: Acharya, Anish, et al.
Publicado: (2024)

Runtime Evaluation of Procedural Content Generation in an Endless Runner Game Using Autonomous Agents
por: Kar, Rishabh
Publicado: (2026)

Federation over Text: Insight Sharing for Multi-Agent Reasoning
por: Yao, Dixi, et al.
Publicado: (2026)

Complement Submodular Information Measures for Balanced and Robust Data Selection
por: Iyer, Rishabh
Publicado: (2026)

SiT: Symmetry-Invariant Transformers for Generalisation in Reinforcement Learning
por: Weissenbacher, Matthias, et al.
Publicado: (2024)

Scalable Reinforcement Post-Training Beyond Static Human Prompts: Evolving Alignment via Asymmetric Self-Play
por: Ye, Ziyu, et al.
Publicado: (2024)

Putting the Value Back in RL: Better Test-Time Scaling by Unifying LLM Reasoners With Verifiers
por: Sareen, Kusha, et al.
Publicado: (2025)

Using text embedding models as text classifiers with medical data
por: Goel, Rishabh
Publicado: (2024)

Cite Pretrain: Retrieval-Free Knowledge Attribution for Large Language Models
por: Huang, Yukun, et al.
Publicado: (2025)

Using Early Readouts to Mediate Featural Bias in Distillation
por: Tiwari, Rishabh, et al.
Publicado: (2023)

An Evaluation of Context Length Extrapolation in Long Code via Positional Embeddings and Efficient Attention
por: Ghosh, Madhusudan, et al.
Publicado: (2026)

Enhancing Cache-Augmented Generation (CAG) with Adaptive Contextual Compression for Scalable Knowledge Integration
por: Agrawal, Rishabh, et al.
Publicado: (2025)

SecurePose: Automated Face Blurring and Human Movement Kinematics Extraction from Videos Recorded in Clinical Settings
por: Bajpai, Rishabh, et al.
Publicado: (2024)

When Dynamics Shift, Robust Task Inference Wins: Offline Imitation Learning with Behavior Foundation Models Revisited
por: Agrawal, Rishabh, et al.
Publicado: (2026)

Towards Quantifying the Preconditioning Effect of Adam
por: Das, Rudrajit, et al.
Publicado: (2024)

Positive Unlabeled Contrastive Learning
por: Acharya, Anish, et al.
Publicado: (2022)

Loss-to-Loss Prediction: Scaling Laws for All Datasets
por: Brandfonbrener, David, et al.
Publicado: (2024)

Domain-driven Metrics for Reinforcement Learning: A Case Study on Epidemic Control using Agent-based Simulation
por: Gaur, Rishabh, et al.
Publicado: (2025)

Towards Compute-Optimal Many-Shot In-Context Learning
por: Golchin, Shahriar, et al.
Publicado: (2025)

LLM-Guided Monte Carlo Tree Search over Knowledge Graphs: Composing Mechanistic Explanations for Drug-Disease Pairs
por: Jakhar, Rishabh, et al.
Publicado: (2026)

Scaling Test-Time Compute for Agentic Coding
por: Kim, Joongwon, et al.
Publicado: (2026)

Balance Equation-based Distributionally Robust Offline Imitation Learning
por: Agrawal, Rishabh, et al.
Publicado: (2025)