ModuLoRA: Finetuning 2-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers

Documenti analoghi

• QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks
  di: Tseng, Albert, et al.
  Pubblicazione: (2024)
• QuIP: 2-Bit Quantization of Large Language Models With Guarantees
  di: Chee, Jerry, et al.
  Pubblicazione: (2023)
• SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs
  di: Song, Jaewoo, et al.
  Pubblicazione: (2025)
• Profiling LoRA/QLoRA Fine-Tuning Efficiency on Consumer GPUs: An RTX 4060 Case Study
  di: Avinash, MSR
  Pubblicazione: (2025)
• Robust Federated Finetuning of LLMs via Alternating Optimization of LoRA
  di: Chen, Shuangyi, et al.
  Pubblicazione: (2025)