Accelerating OpenPangu Inference on NPU via Speculative Decoding

Documenti analoghi

• Accelerating Mixture-of-Experts Inference by Hiding Offloading Latency with Speculative Decoding
  di: Wang, Zhibin, et al.
  Pubblicazione: (2025)
• SP-MoE: Speculative Decoding and Prefetching for Accelerating MoE-based Model Inference
  di: Chen, Liangkun, et al.
  Pubblicazione: (2025)
• SPIN: Accelerating Large Language Model Inference with Heterogeneous Speculative Models
  di: Chen, Fahao, et al.
  Pubblicazione: (2025)
• Minions: Accelerating Large Language Model Inference with Aggregated Speculative Execution
  di: Wang, Siqi, et al.
  Pubblicazione: (2024)
• SpecFed: Accelerating Federated LLM Inference with Speculative Decoding and Compressed Transmission
  di: Zheng, Ce, et al.
  Pubblicazione: (2026)