HD-PiSSA: High-Rank Distributed Orthogonal Adaptation

Documenti analoghi

• PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models
  di: Meng, Fanxu, et al.
  Pubblicazione: (2024)
• Knowledge is Not Enough: Injecting RL Skills for Continual Adaptation
  di: Tang, Pingzhi, et al.
  Pubblicazione: (2026)
• CLOVER: Cross-Layer Orthogonal Vectors Pruning and Fine-Tuning
  di: Meng, Fanxu, et al.
  Pubblicazione: (2024)
• Breaking the Blocks: Continuous Low-Rank Decomposed Scaling for Unified LLM Quantization and Adaptation
  di: Tang, Pingzhi, et al.
  Pubblicazione: (2026)
• TransMLA: Multi-Head Latent Attention Is All You Need
  di: Meng, Fanxu, et al.
  Pubblicazione: (2025)