LoRS: Efficient Low-Rank Adaptation for Sparse Large Language Model

Documenti analoghi

• Streamlining Redundant Layers to Compress Large Language Models
  di: Chen, Xiaodong, et al.
  Pubblicazione: (2024)
• QUAD: Quantization and Parameter-Efficient Tuning of LLM with Activation Decomposition
  di: Hu, Yuxuan, et al.
  Pubblicazione: (2025)
• $\rm SP^3$: Enhancing Structured Pruning via PCA Projection
  di: Hu, Yuxuan, et al.
  Pubblicazione: (2023)
• SECURA: Sigmoid-Enhanced CUR Decomposition with Uninterrupted Retention and Low-Rank Adaptation in Large Language Models
  di: Zhang, Yuxuan
  Pubblicazione: (2025)
• SAM Decoding: Speculative Decoding via Suffix Automaton
  di: Hu, Yuxuan, et al.
  Pubblicazione: (2024)