Scaling State-Space Models on Multiple GPUs with Tensor Parallelism

Documenti analoghi

• Fine-Grained Energy Prediction For Parallellized LLM Inference With PIE-P
  di: Dutt, Anurag, et al.
  Pubblicazione: (2025)
• Parallelizing Large-Scale Tensor Network Contraction on Multiple GPUs
  di: Pan, Feng, et al.
  Pubblicazione: (2026)
• Nonuniform-Tensor-Parallelism: Mitigating GPU failure impact for Scaled-up LLM Training
  di: Arfeen, Daiyaan, et al.
  Pubblicazione: (2025)
• MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs
  di: Jiang, Ziheng, et al.
  Pubblicazione: (2024)
• AMPED: Accelerating MTTKRP for Billion-Scale Sparse Tensor Decomposition on Multiple GPUs
  di: Wijeratne, Sasindu, et al.
  Pubblicazione: (2025)