GORGO: Maximizing KV-Cache Reuse While Minimizing Network Latency in Cross-Region LLM Load Balancing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Toniolo, Alessio Ricci, Dinesh, Abinaya, Thorstenson, Rome
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!