MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization

Documenti analoghi

• The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm
  di: Chen, Jiale, et al.
  Pubblicazione: (2025)
• RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation
  di: Nikdan, Mahdi, et al.
  Pubblicazione: (2024)
• GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling
  di: Dadgarnia, Alireza, et al.
  Pubblicazione: (2026)
• MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning
  di: Modoranu, Ionut-Vlad, et al.
  Pubblicazione: (2026)
• CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training
  di: Tabesh, Soroush, et al.
  Pubblicazione: (2025)