Parallel Decoding via Hidden Transfer for Lossless Large Language Model Acceleration

Documenti analoghi

• FIRP: Faster LLM inference via future intermediate representation prediction
  di: Wu, Pengfei, et al.
  Pubblicazione: (2024)
• Graph-Structured Speculative Decoding
  di: Gong, Zhuocheng, et al.
  Pubblicazione: (2024)
• Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism
  di: Liu, Jiahao, et al.
  Pubblicazione: (2024)
• What Makes Quantization for Large Language Models Hard? An Empirical Study from the Lens of Perturbation
  di: Gong, Zhuocheng, et al.
  Pubblicazione: (2024)
• Dynamic Fisher-weighted Model Merging via Bayesian Optimization
  di: Lee, Sanwoo, et al.
  Pubblicazione: (2025)