Taming Sensitive Weights : Noise Perturbation Fine-tuning for Robust LLM Quantization

Documenti analoghi

• MoBiQuant: Mixture-of-Bits Quantization for Token-Adaptive Any-Precision LLM
  di: Wang, Dongwei, et al.
  Pubblicazione: (2026)
• RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
  di: Huang, Xijie, et al.
  Pubblicazione: (2024)
• AMAQ: Adaptive Mixed-bit Activation Quantization for Collaborative Parameter Efficient Fine-tuning
  di: Song, Yurun, et al.
  Pubblicazione: (2025)
• GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning
  di: Zhou, Sifan, et al.
  Pubblicazione: (2025)
• Outlier-weighed Layerwise Sampling for LLM Fine-tuning
  di: Li, Pengxiang, et al.
  Pubblicazione: (2024)