Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMs

Documenti analoghi

• BTC-LLM: Efficient Sub-1-Bit LLM Quantization via Learnable Transformation and Binary Codebook
  di: Gu, Hao, et al.
  Pubblicazione: (2025)
• IndexMem: Learned KV-Cache Eviction with Latent Memory for Long-Context LLM Inference
  di: Yang, Xintong, et al.
  Pubblicazione: (2026)
• QaRL: Rollout-Aligned Quantization-Aware RL for Fast and Stable Training under Training--Inference Mismatch
  di: Gu, Hao, et al.
  Pubblicazione: (2026)
• Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging
  di: Li, Lujun, et al.
  Pubblicazione: (2025)
• 1-Bit Wonder: Improving QAT Performance in the Low-Bit Regime through K-Means Quantization
  di: Maskey, Sohir, et al.
  Pubblicazione: (2026)