FSD-Inference: Fully Serverless Distributed Inference with Scalable Cloud Communication

Documenti analoghi

• SQUASH: Serverless and Distributed Quantization-based Attributed Vector Similarity Search
  di: Oakley, Joe, et al.
  Pubblicazione: (2025)
• D3-GNN: Dynamic Distributed Dataflow for Streaming Graph Neural Networks
  di: Guliyev, Rustam, et al.
  Pubblicazione: (2024)
• Distributed Inference on Mobile Edge and Cloud: An Early Exit based Clustering Approach
  di: Bajpai, Divya Jyoti, et al.
  Pubblicazione: (2024)
• Context Parallelism for Scalable Million-Token Inference
  di: Yang, Amy, et al.
  Pubblicazione: (2024)
• Enabling Efficient Serverless Inference Serving for LLM (Large Language Model) in the Cloud
  di: Ghosh, Himel
  Pubblicazione: (2024)