No learning rates needed: Introducing SALSA -- Stable Armijo Line Search Adaptation

Documenti analoghi

• Improving Line Search Methods for Large Scale Neural Network Training
  di: Kenneweg, Philip, et al.
  Pubblicazione: (2024)
• Faster Convergence for Transformer Fine-tuning with Line Search Methods
  di: Kenneweg, Philip, et al.
  Pubblicazione: (2024)
• Intelligent Learning Rate Distribution to reduce Catastrophic Forgetting in Transformers
  di: Kenneweg, Philip, et al.
  Pubblicazione: (2024)
• Neural Architecture Search for Sentence Classification with BERT
  di: Kenneweg, Philip, et al.
  Pubblicazione: (2024)
• Retrieval Augmented Generation Systems: Automatic Dataset Creation, Evaluation and Boolean Agent Setup
  di: Kenneweg, Tristan, et al.
  Pubblicazione: (2024)