VibeServe: Can AI Agents Build Bespoke LLM Serving Systems?

Documenti analoghi

• VoxServe: Streaming-Centric Serving System for Speech Language Models
  di: Kamahori, Keisuke, et al.
  Pubblicazione: (2026)
• Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models
  di: Kamahori, Keisuke, et al.
  Pubblicazione: (2024)
• ConsumerBench: Benchmarking Generative AI Applications on End-User Devices
  di: Gu, Yile, et al.
  Pubblicazione: (2025)
• FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
  di: Ye, Zihao, et al.
  Pubblicazione: (2025)
• TinyServe: Query-Aware Cache Selection for Efficient LLM Serving
  di: Liu, Dong, et al.
  Pubblicazione: (2025)