Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Models

Documenti analoghi

• Addressing Hallucinations in Language Models with Knowledge Graph Embeddings as an Additional Modality
  di: Chekalina, Viktoriia, et al.
  Pubblicazione: (2024)
• DyKAF: Dynamical Kronecker Approximation of the Fisher Information Matrix for Gradient Preconditioning
  di: Yudin, Nikolay, et al.
  Pubblicazione: (2025)
• ERC-SVD: Error-Controlled SVD for Large Language Model Compression
  di: Bai, Haolei, et al.
  Pubblicazione: (2025)
• LoTR: Low Tensor Rank Weight Adaptation
  di: Bershatsky, Daniel, et al.
  Pubblicazione: (2024)
• Knowledge Graph Completion with Mixed Geometry Tensor Factorization
  di: Yusupov, Viacheslav, et al.
  Pubblicazione: (2025)