SmartQuant: CXL-based AI Model Store in Support of Runtime Configurable Weight Quantization

Documenti analoghi

• Breaking the HBM Bit Cost Barrier: Domain-Specific ECC for AI Inference Infrastructure
  di: Xie, Rui, et al.
  Pubblicazione: (2025)
• Making Strong Error-Correcting Codes Work Effectively for HBM in AI Inference
  di: Xie, Rui, et al.
  Pubblicazione: (2025)
• TRACE: Unlocking Effective CXL Bandwidth via Lossless Compression and Precision Scaling
  di: Xie, Rui, et al.
  Pubblicazione: (2025)
• Reimagining Memory Access for LLM Inference: Compression-Aware Memory Controller Design
  di: Xie, Rui, et al.
  Pubblicazione: (2025)
• Accelerating LLM Inference via Dynamic KV Cache Placement in Heterogeneous Memory System
  di: Fang, Yunhua, et al.
  Pubblicazione: (2025)