Learning Beyond the Gaussian Data: Learning Dynamics of Neural Networks on an Expressive and Cumulant-Controllable Data Model

Ähnliche Einträge

• Asymptotic Analysis of Two-Layer Neural Networks after One Gradient Step under Gaussian Mixtures Data with Structure
  von: Demir, Samet, et al.
  Veröffentlicht: (2025)
• How Data Mixing Shapes In-Context Learning: Asymptotic Equivalence for Transformers with MLPs
  von: Demir, Samet, et al.
  Veröffentlicht: (2025)
• Asymptotic Study of In-context Learning with Random Transformers through Equivalent Models
  von: Demir, Samet, et al.
  Veröffentlicht: (2025)
• Optimal Attention Temperature Improves the Robustness of In-Context Learning under Distribution Shift in High Dimensions
  von: Demir, Samet, et al.
  Veröffentlicht: (2025)
• Implicitly Normalized Online PCA: A Regularized Algorithm with Exact High-Dimensional Dynamics
  von: Demir, Samet, et al.
  Veröffentlicht: (2025)