Evaluating the Generalization Ability of Quantized LLMs: Benchmark, Analysis, and Toolbox

Documenti analoghi

• TMPQ-DM: Joint Timestep Reduction and Quantization Precision Selection for Efficient Diffusion Models
  di: Sun, Haojun, et al.
  Pubblicazione: (2024)
• Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers
  di: Chen, Lei, et al.
  Pubblicazione: (2024)
• Retraining-free Model Quantization via One-Shot Weight-Coupling Learning
  di: Tang, Chen, et al.
  Pubblicazione: (2024)
• Post-training Quantization for Text-to-Image Diffusion Models with Progressive Calibration and Activation Relaxing
  di: Tang, Siao, et al.
  Pubblicazione: (2023)
• PRANCE: Joint Token-Optimization and Structural Channel-Pruning for Adaptive ViT Inference
  di: Li, Ye, et al.
  Pubblicazione: (2024)