RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization

Documenti analoghi

• LLM-FP4: 4-Bit Floating-Point Quantized Transformers
  di: Liu, Shih-yang, et al.
  Pubblicazione: (2023)
• Efficient and Robust Quantization-aware Training via Adaptive Coreset Selection
  di: Huang, Xijie, et al.
  Pubblicazione: (2023)
• EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation
  di: Liu, Shih-Yang, et al.
  Pubblicazione: (2024)
• Activated LoRA: Fine-tuned LLMs for Intrinsics
  di: Greenewald, Kristjan, et al.
  Pubblicazione: (2025)
• LoRA-Leak: Membership Inference Attacks Against LoRA Fine-tuned Language Models
  di: Ran, Delong, et al.
  Pubblicazione: (2025)