Demystifying Language Model Forgetting with Low-rank Example Associations

Documenti analoghi

• What Will My Model Forget? Forecasting Forgotten Examples in Language Model Refinement
  di: Jin, Xisen, et al.
  Pubblicazione: (2024)
• Dataless Knowledge Fusion by Merging Weights of Language Models
  di: Jin, Xisen, et al.
  Pubblicazione: (2022)
• Learning and Forgetting Unsafe Examples in Large Language Models
  di: Zhao, Jiachen, et al.
  Pubblicazione: (2023)
• Demystifying Verbatim Memorization in Large Language Models
  di: Huang, Jing, et al.
  Pubblicazione: (2024)
• Demystifying Low-Rank Knowledge Distillation in Large Language Models: Convergence, Generalization, and Information-Theoretic Guarantees
  di: Soarez, Alberlucia Rafael, et al.
  Pubblicazione: (2026)