Documenti analoghi

• Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization
  di: Li, Jinhao, et al.
  Pubblicazione: (2023)
• Collaborative Inference for Large Models with Task Offloading and Early Exiting
  di: Xie, Zuan, et al.
  Pubblicazione: (2024)
• SPIN: Accelerating Large Language Model Inference with Heterogeneous Speculative Models
  di: Chen, Fahao, et al.
  Pubblicazione: (2025)
• SpecFed: Accelerating Federated LLM Inference with Speculative Decoding and Compressed Transmission
  di: Zheng, Ce, et al.
  Pubblicazione: (2026)
• Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution
  di: Wang, Siqi, et al.
  Pubblicazione: (2024)