GORGO: Maximizing KV-Cache Reuse While Minimizing Network Latency in Cross-Region LLM Load Balancing

Documenti analoghi

• Deduplicator: When Computation Reuse Meets Load Balancing at the Network Edge
  di: Azad, Md Washik Al, et al.
  Pubblicazione: (2024)
• Local Rendezvous Hashing: Bounded Loads and Minimal Churn via Cache-Local Candidates
  di: Guan, Yongjie
  Pubblicazione: (2025)
• Adaptive KV Cache Reuse for Fast Long-Context LLM Serving
  di: li, Fei, et al.
  Pubblicazione: (2026)
• KVServe: Service-Aware KV Cache Compression for Communication-Efficient Disaggregated LLM Serving
  di: Liu, Zedong, et al.
  Pubblicazione: (2026)
• Optimal Oblivious Load-Balancing for Sparse Traffic in Large-Scale Satellite Networks
  di: Ramakanth, Rudrapatna Vallabh, et al.
  Pubblicazione: (2026)