Larger Datasets Can Be Repeated More: A Theoretical Analysis of Multi-Epoch Scaling in Linear Regression

Documenti analoghi

• A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules
  di: Luo, Kairong, et al.
  Pubblicazione: (2025)
• How Learning Rate Decay Wastes Your Best Data in Curriculum-Based LLM Pretraining
  di: Luo, Kairong, et al.
  Pubblicazione: (2025)
• Adam Reduces a Unique Form of Sharpness: Theoretical Insights Near the Minimizer Manifold
  di: Li, Xinghan, et al.
  Pubblicazione: (2025)
• Feature Averaging: An Implicit Bias of Gradient Descent Leading to Non-Robustness in Neural Networks
  di: Li, Binghui, et al.
  Pubblicazione: (2024)
• Adversarial Training Can Provably Improve Robustness: Theoretical Analysis of Feature Learning Process Under Structured Data
  di: Li, Binghui, et al.
  Pubblicazione: (2024)