Amphista: Bi-directional Multi-head Decoding for Accelerating LLM Inference

Documenti analoghi

• Týr-the-Pruner: Structural Pruning LLMs via Global Sparsity Distribution Optimization
  di: Li, Guanchen, et al.
  Pubblicazione: (2025)
• PARD: Accelerating LLM Inference with Low-Cost PARallel Draft Model Adaptation
  di: An, Zihao, et al.
  Pubblicazione: (2025)
• Enhancing One-shot Pruned Pre-trained Language Models through Sparse-Dense-Sparse Mechanism
  di: Li, Guanchen, et al.
  Pubblicazione: (2024)
• Fast Occupancy Network
  di: Lu, Mingjie, et al.
  Pubblicazione: (2024)
• LADDER: An Efficient Framework for Video Frame Interpolation
  di: Shen, Tong, et al.
  Pubblicazione: (2024)