RAPID-LLM: Resilience-Aware Performance analysis of Infrastructure for Distributed LLM Training and Inference

Documenti analoghi

• LMDeploy Accelerates Mixed-Precision LLM Inference with TurboMind
  di: Zhang, Li, et al.
  Pubblicazione: (2025)
• Fine-Grained Energy Prediction For Parallellized LLM Inference With PIE-P
  di: Dutt, Anurag, et al.
  Pubblicazione: (2025)
• HybridGen: Efficient LLM Generative Inference via CPU-GPU Hybrid Computing
  di: Lin, Mao, et al.
  Pubblicazione: (2026)
• Opt4GPTQ: Co-Optimizing Memory and Computation for 4-bit GPTQ Quantized LLM Inference on Heterogeneous Platforms
  di: Zhang, Yaozheng, et al.
  Pubblicazione: (2025)
• KVPR: Efficient LLM Inference with I/O-Aware KV Cache Partial Recomputation
  di: Jiang, Chaoyi, et al.
  Pubblicazione: (2024)