FLAT-LLM: Fine-grained Low-rank Activation Space Transformation for Large Language Model Compression

Documenti analoghi

• Activation-Informed Pareto-Guided Low-Rank Compression for Efficient LLM/VLM
  di: Solgi, Ryan, et al.
  Pubblicazione: (2025)
• Ultra Memory-Efficient On-FPGA Training of Transformers via Tensor-Compressed Optimization
  di: Tian, Jiayi, et al.
  Pubblicazione: (2025)
• Saten: Sparse Augmented Tensor Networks for Post-Training Compression of Large Language Models
  di: Solgi, Ryan, et al.
  Pubblicazione: (2025)
• FLAT: Formal Languages as Types
  di: Zhu, Fengmin, et al.
  Pubblicazione: (2025)
• LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
  di: Yang, Yifan, et al.
  Pubblicazione: (2024)