Pivoting Factorization: A Compact Meta Low-Rank Representation of Sparsity for Efficient Inference in Large Language Models

Documents similaires

• Sparse Spectral Training and Inference on Euclidean and Hyperbolic Neural Networks
  par: Zhao, Jialin, et autres
  Publié: (2024)
• Brain network science modelling of sparse neural networks enables Transformers and LLMs to perform as fully connected
  par: Zhang, Yingtao, et autres
  Publié: (2025)
• Sparsity-Aware Low-Rank Representation for Efficient Fine-Tuning of Large Language Models
  par: Zhang, Longteng, et autres
  Publié: (2026)
• Efficient Low Rank Attention for Long-Context Inference in Large Language Models
  par: Li, Tenghui, et autres
  Publié: (2025)
• R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference
  par: Zhang, Zhenyu, et autres
  Publié: (2025)