SpecInF: Exploiting Idle GPU Resources in Distributed DL Training via Speculative Inference Filling

Documenti analoghi

• Dilu: Enabling GPU Resourcing-on-Demand for Serverless DL Serving via Introspective Elasticity
  di: Lv, Cunchi, et al.
  Pubblicazione: (2025)
• Cloudless-Training: A Framework to Improve Efficiency of Geo-Distributed ML Training
  di: Tan, Wenting, et al.
  Pubblicazione: (2023)
• The Energy Cost of Execution-Idle in GPU Clusters
  di: Lei, Yiran, et al.
  Pubblicazione: (2026)
• FlowSpec: Continuous Pipelined Speculative Decoding for Efficient Distributed LLM Inference
  di: Liu, Xing, et al.
  Pubblicazione: (2025)
• SpecFed: Accelerating Federated LLM Inference with Speculative Decoding and Compressed Transmission
  di: Zheng, Ce, et al.
  Pubblicazione: (2026)