InstInfer: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference

Documenti analoghi

• A Cost-Effective Near-Storage Processing Solution for Offline Inference of Long-Context LLMs
  di: Jang, Hongsun, et al.
  Pubblicazione: (2025)
• HillInfer: Efficient Long-Context LLM Inference on the Edge with Hierarchical KV Eviction using SmartSSD
  di: Sun, He, et al.
  Pubblicazione: (2026)
• GPU Acceleration of TFHE-Based High-Precision Nonlinear Layers for Encrypted LLM Inference
  di: Chen, Guoci, et al.
  Pubblicazione: (2026)
• LLMulator: Generalizable Cost Modeling for Dataflow Accelerators with Input-Adaptive Control Flow
  di: Chang, Kaiyan, et al.
  Pubblicazione: (2025)
• FAST-Prefill: FPGA Accelerated Sparse Attention for Long Context LLM Prefill
  di: Jayanth, Rakshith, et al.
  Pubblicazione: (2026)