Beluga: A CXL-Based Memory Architecture for Scalable and Efficient LLM KVCache Management

Documenti analoghi

• PolarStore: High-Performance Data Compression for Large-Scale Cloud-Native Databases
  di: Hu, Qingda, et al.
  Pubblicazione: (2025)
• CXL Shared Memory Programming: Barely Distributed and Almost Persistent
  di: Xu, Yi, et al.
  Pubblicazione: (2024)
• Prefill-as-a-Service: KVCache of Next-Generation Models Could Go Cross-Datacenter
  di: Qin, Ruoyu, et al.
  Pubblicazione: (2026)
• Self-Evolving Distributed Memory Architecture for Scalable AI Systems
  di: Li, Zixuan, et al.
  Pubblicazione: (2026)
• KVCache Cache in the Wild: Characterizing and Optimizing KVCache Cache at a Large Cloud Provider
  di: Wang, Jiahao, et al.
  Pubblicazione: (2025)