veScale: Consistent and Efficient Tensor Programming with Eager-Mode SPMD

Documenti analoghi

• veScale-FSDP: Flexible and High-Performance FSDP at Scale
  di: Wang, Zezhou, et al.
  Pubblicazione: (2026)
• HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis
  di: Zhang, Shiwei, et al.
  Pubblicazione: (2024)
• VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
  di: Ma, Qianli, et al.
  Pubblicazione: (2025)
• LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization
  di: Zhao, Juntao, et al.
  Pubblicazione: (2024)
• QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices
  di: Zhao, Juntao, et al.
  Pubblicazione: (2024)