The Mechanism of Weak-to-Strong Generalization: Feature Elicitation from Latent Knowledge

Ähnliche Einträge

• Transformers Learn Nonlinear Features In Context: Nonconvex Mean-field Dynamics on the Attention Landscape
  von: Kim, Juno, et al.
  Veröffentlicht: (2024)
• In-Context Learning Is Provably Bayesian Inference: A Generalization Theory for Meta-Learning
  von: Wakayama, Tomoya, et al.
  Veröffentlicht: (2025)
• Degrees of Freedom for Linear Attention: Distilling Softmax Attention with Optimal Feature Efficiency
  von: Nishikawa, Naoki, et al.
  Veröffentlicht: (2025)
• Mamba Can Learn Low-Dimensional Targets In-Context via Test-Time Feature Learning
  von: Oh, Junsoo, et al.
  Veröffentlicht: (2025)
• Weak-to-Strong Generalization with Failure Trajectories: A Tree-based Approach to Elicit Optimal Policy in Strong Models
  von: Ye, Ruimeng, et al.
  Veröffentlicht: (2025)