Breaking the Frozen Subspace: Importance Sampling for Low-Rank Optimization in LLM Pretraining

Documenti analoghi

• CoVE: Compressed Vocabulary Expansion Makes Better LLM-based Recommender Systems
  di: Zhang, Haochen, et al.
  Pubblicazione: (2025)
• LeanQuant: Accurate and Scalable Large Language Model Quantization with Loss-error-aware Grid
  di: Zhang, Tianyi, et al.
  Pubblicazione: (2024)
• Support Basis: Fast Attention Beyond Bounded Entries
  di: Aliakbarpour, Maryam, et al.
  Pubblicazione: (2025)
• KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization
  di: Zhang, Tianyi, et al.
  Pubblicazione: (2024)
• IDentity with Locality: An ideal hash for gene sequence search
  di: Desai, Aditya, et al.
  Pubblicazione: (2024)