Copertina

How Reinforcement Learning After Next-Token Prediction Facilitates Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Tsilivis, Nikolaos, Malach, Eran, Ullrich, Karen, Kempe, Julia
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Auto-Regressive Next-Token Predictors are Universal Learners
di: Malach, Eran
Pubblicazione: (2023)

The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains
di: Edelman, Benjamin L., et al.
Pubblicazione: (2024)

Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks
di: Tsilivis, Nikolaos, et al.
Pubblicazione: (2024)

The Price of Implicit Bias in Adversarially Robust Generalization
di: Tsilivis, Nikolaos, et al.
Pubblicazione: (2024)

On the Robustness of Neural Collapse and the Neural Collapse of Robustness
di: Su, Jingtong, et al.
Pubblicazione: (2023)

On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds
di: Vilucchio, Matteo, et al.
Pubblicazione: (2024)

Attacking Bayes: On the Adversarial Robustness of Bayesian Neural Networks
di: Feng, Yunzhen, et al.
Pubblicazione: (2024)

From Concepts to Components: Concept-Agnostic Attention Module Discovery in Transformers
di: Su, Jingtong, et al.
Pubblicazione: (2025)

Mission Impossible: A Statistical Perspective on Jailbreaking LLMs
di: Su, Jingtong, et al.
Pubblicazione: (2024)

The Power of Random Features and the Limits of Distribution-Free Gradient Descent
di: Karchmer, Ari, et al.
Pubblicazione: (2025)

Repeat After Me: Transformers are Better than State Space Models at Copying
di: Jelassi, Samy, et al.
Pubblicazione: (2024)

Learning to Think from Multiple Thinkers
di: Joshi, Nirmit, et al.
Pubblicazione: (2026)

LLM Priors for ERM over Programs
di: Singhal, Shivam, et al.
Pubblicazione: (2025)

Loss-to-Loss Prediction: Scaling Laws for All Datasets
di: Brandfonbrener, David, et al.
Pubblicazione: (2024)

To Backtrack or Not to Backtrack: When Sequential Search Limits Model Reasoning
di: Qin, Tian, et al.
Pubblicazione: (2025)

Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining
di: Zhao, Rosie, et al.
Pubblicazione: (2025)

Universal Length Generalization with Turing Programs
di: Hou, Kaiying, et al.
Pubblicazione: (2024)

Cross-Tokenizer Likelihood Scoring Algorithms for Language Model Distillation
di: Phan, Buu, et al.
Pubblicazione: (2025)

Asymmetric REINFORCE for off-Policy Reinforcement Learning: Balancing positive and negative rewards
di: Arnal, Charles, et al.
Pubblicazione: (2025)

Soft Tokens, Hard Truths
di: Butt, Natasha, et al.
Pubblicazione: (2025)

Don't Stop Me Now: Embedding Based Scheduling for LLMs
di: Shahout, Rana, et al.
Pubblicazione: (2024)

Next-Token Prediction Should be Ambiguity-Sensitive: A Meta-Learning Perspective
di: Gagnon, Leo, et al.
Pubblicazione: (2025)

Understanding and Mitigating Tokenization Bias in Language Models
di: Phan, Buu, et al.
Pubblicazione: (2024)

Emergent properties with repeated examples
di: Charton, François, et al.
Pubblicazione: (2024)

Towards Auto-Regressive Next-Token Prediction: In-Context Learning Emerges from Generalization
di: Gong, Zixuan, et al.
Pubblicazione: (2025)

Cautious Next Token Prediction
di: Wang, Yizhou, et al.
Pubblicazione: (2025)

Trajeglish: Traffic Modeling as Next-Token Prediction
di: Philion, Jonah, et al.
Pubblicazione: (2023)

On Next-Token Prediction in LLMs: How End Goals Determine the Consistency of Decoding Algorithms
di: Trauger, Jacob, et al.
Pubblicazione: (2025)

Generative Verifiers: Reward Modeling as Next-Token Prediction
di: Zhang, Lunjun, et al.
Pubblicazione: (2024)

Towards Understanding the Universality of Transformers for Next-Token Prediction
di: Sander, Michael E., et al.
Pubblicazione: (2024)

How Transformers Learn to Plan via Multi-Token Prediction
di: Huang, Jianhao, et al.
Pubblicazione: (2026)

A New Perspective on Shampoo's Preconditioner
di: Morwani, Depen, et al.
Pubblicazione: (2024)

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
di: Prabhakar, Akshara, et al.
Pubblicazione: (2024)

Transfer Learning Study of Motion Transformer-based Trajectory Predictions
di: Ullrich, Lars, et al.
Pubblicazione: (2024)

A Comprehensive Machine Learning Framework for Micromobility Demand Prediction
di: Porat, Omri, et al.
Pubblicazione: (2025)

Contextual Intelligence The Next Leap for Reinforcement Learning
di: Biedenkapp, André
Pubblicazione: (2026)

Let Me Think! A Long Chain-of-Thought Can Be Worth Exponentially Many Short Ones
di: Mirtaheri, Parsa, et al.
Pubblicazione: (2025)

The Role of Sparsity for Length Generalization in Transformers
di: Golowich, Noah, et al.
Pubblicazione: (2025)

Reasoning Bias of Next Token Prediction Training
di: Lin, Pengxiao, et al.
Pubblicazione: (2025)

ENTP: Encoder-only Next Token Prediction
di: Ewer, Ethan, et al.
Pubblicazione: (2024)