A Survey on Memory-Efficient Transformer-Based Model Training in AI for Science

Documenti analoghi

• Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inference
  di: Liu, Baihui, et al.
  Pubblicazione: (2026)
• GRASS: Gradient-based Adaptive Layer-wise Importance Sampling for Memory-efficient Large Language Model Fine-tuning
  di: Tian, Kaiyuan, et al.
  Pubblicazione: (2026)
• ParaDySe: A Parallel-Strategy Switching Framework for Dynamic Sequence Lengths in Transformer
  di: Ou, Zhixin, et al.
  Pubblicazione: (2025)
• FOAM: Blocked State Folding for Memory-Efficient LLM Training
  di: Wen, Ziqing, et al.
  Pubblicazione: (2025)
• Explanation-Guided Adversarial Training for Robust and Interpretable Models
  di: Chen, Chao, et al.
  Pubblicazione: (2026)