CoMERA: Computing- and Memory-Efficient Training via Rank-Adaptive Tensor Optimization

Documenti analoghi

• Quantization-Aware and Tensor-Compressed Training of Transformers for Natural Language Understanding
  di: Yang, Zi, et al.
  Pubblicazione: (2023)
• CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation
  di: Liu, Ziyue, et al.
  Pubblicazione: (2025)
• Saten: Sparse Augmented Tensor Networks for Post-Training Compression of Large Language Models
  di: Solgi, Ryan, et al.
  Pubblicazione: (2025)
• Ultra Memory-Efficient On-FPGA Training of Transformers via Tensor-Compressed Optimization
  di: Tian, Jiayi, et al.
  Pubblicazione: (2025)
• LaX: Boosting Low-Rank Training of Foundation Models via Latent Crossing
  di: Zhang, Ruijie, et al.
  Pubblicazione: (2025)