Cover Image

Latent State Models of Training Dynamics

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hu, Michael Y., Chen, Angelica, Saphra, Naomi, Cho, Kyunghyun
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Hidden Breakthroughs in Language Model Training
by: Kangaslahti, Sara, et al.
Published: (2025)

Fast Forwarding Low-Rank Training
by: Rahamim, Adir, et al.
Published: (2024)

Mechanistic?
by: Saphra, Naomi, et al.
Published: (2024)

Training Dynamics of Learning 3D-Rotational Equivariance
by: Shen, Max W., et al.
Published: (2025)

Scaling Laws Are Unreliable for Downstream Tasks: A Reality Check
by: Lourie, Nicholas, et al.
Published: (2025)

A Brief Introduction to Causal Inference in Machine Learning
by: Cho, Kyunghyun
Published: (2024)

Machine Learning: a Lecture Note
by: Cho, Kyunghyun
Published: (2025)

Characterizing the Predictive Impact of Modalities with Supervised Latent-Variable Modeling
by: Madaan, Divyam, et al.
Published: (2026)

Why Knowledge Distillation Works in Generative Models: A Minimal Working Explanation
by: Cha, Sungmin, et al.
Published: (2025)

Sometimes I am a Tree: Data Drives Unstable Hierarchical Generalization
by: Qin, Tian, et al.
Published: (2024)

First Tragedy, then Parse: History Repeats Itself in the New Era of Large Language Models
by: Saphra, Naomi, et al.
Published: (2023)

Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Models
by: Sobal, Vlad, et al.
Published: (2025)

Training Language Models with Language Feedback at Scale
by: Scheurer, Jérémy, et al.
Published: (2023)

TRAM: Bridging Trust Regions and Sharpness Aware Minimization
by: Sherborne, Tom, et al.
Published: (2023)

Aioli: A Unified Optimization Framework for Language Model Data Mixing
by: Chen, Mayee F., et al.
Published: (2024)

Why Alignment Must Precede Distillation: A Minimal Working Explanation
by: Cha, Sungmin, et al.
Published: (2025)

Training Greedy Policy for Proposal Batch Selection in Expensive Multi-Objective Combinatorial Optimization
by: Lee, Deokjae, et al.
Published: (2024)

Transcendence: Generative Models Can Outperform The Experts That Train Them
by: Zhang, Edwin, et al.
Published: (2024)

PolyPythias: Stability and Outliers across Fifty Language Model Pre-Training Runs
by: van der Wal, Oskar, et al.
Published: (2025)

Active and Passive Causal Inference Learning
by: Im, Daniel Jiwoong, et al.
Published: (2023)

Non-convolutional Graph Neural Networks
by: Wang, Yuanqing, et al.
Published: (2024)

Meta-Statistical Learning: Supervised Learning of Statistical Estimators
by: Peyrard, Maxime, et al.
Published: (2025)

Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs
by: Chen, Angelica, et al.
Published: (2023)

Neural Neural Scaling Laws
by: Hu, Michael Y., et al.
Published: (2026)

Always Learning, Always Mixing: Efficient and Simple Data Mixing All The Time
by: Hu, Michael Y., et al.
Published: (2026)

Regularizing with Pseudo-Negatives for Continual Self-Supervised Learning
by: Cha, Sungmin, et al.
Published: (2023)

Hyperparameters in Continual Learning: A Reality Check
by: Cha, Sungmin, et al.
Published: (2024)

None To Optima in Few Shots: Bayesian Optimization with MDP Priors
by: Li, Diantong, et al.
Published: (2025)

MIST: Mutual Information Estimation Via Supervised Training
by: Gritsai, German, et al.
Published: (2025)

Deep Autoregressive Models as Causal Inference Engines
by: Im, Daniel Jiwoong, et al.
Published: (2024)

Random Scaling of Emergent Capabilities
by: Zhao, Rosie, et al.
Published: (2025)

Semiparametric conformal prediction
by: Park, Ji Won, et al.
Published: (2024)

Language Models as Causal Effect Generators
by: Bynum, Lucius E. J., et al.
Published: (2024)

Show Your Work with Confidence: Confidence Bands for Tuning Curves
by: Lourie, Nicholas, et al.
Published: (2023)

Efficient semantic uncertainty quantification in language models via diversity-steered sampling
by: Park, Ji Won, et al.
Published: (2025)

Hyperparameter Loss Surfaces Are Simple Near their Optima
by: Lourie, Nicholas, et al.
Published: (2025)

Training Latent Diffusion Models with Interacting Particle Algorithms
by: Wang, Tim Y. J., et al.
Published: (2025)

Implicitly Guided Design with PropEn: Match your Data to Follow the Gradient
by: Tagasovska, Nataša, et al.
Published: (2024)

Generalizing to any diverse distribution: uniformity, gentle finetuning and rebalancing
by: Loukas, Andreas, et al.
Published: (2024)

Do Activation Verbalization Methods Convey Privileged Information?
by: Li, Millicent, et al.
Published: (2025)