A Theoretical Analysis of Mamba's Training Dynamics: Filtering Relevant Features for Generalization in State Space Models

Documenti analoghi

• Can Mamba Learn In Context with Outliers? A Theoretical Generalization Analysis
  di: Li, Hongkang, et al.
  Pubblicazione: (2025)
• Theoretical Analysis of Contrastive Learning under Imbalanced Data: From Training Dynamics to a Pruning Solution
  di: Liao, Haixu, et al.
  Pubblicazione: (2026)
• Training Nonlinear Transformers for Chain-of-Thought Inference: A Theoretical Generalization Analysis
  di: Li, Hongkang, et al.
  Pubblicazione: (2024)
• When is Task Vector Provably Effective for Model Editing? A Generalization Analysis of Nonlinear Transformers
  di: Li, Hongkang, et al.
  Pubblicazione: (2025)
• Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis
  di: Li, Hongkang, et al.
  Pubblicazione: (2024)