HiRE: High Recall Approximate Top-$k$ Estimation for Efficient LLM Inference

Documenti analoghi

• A Faster Generalized Two-Stage Approximate Top-K
  di: Samaga, Yashas, et al.
  Pubblicazione: (2025)
• Tandem Transformers for Inference Efficient LLMs
  di: S, Aishwarya P, et al.
  Pubblicazione: (2024)
• Mimetic Initialization Helps State Space Models Learn to Recall
  di: Trockman, Asher, et al.
  Pubblicazione: (2024)
• Scalable In-context Ranking with Generative Models
  di: Gupta, Nilesh, et al.
  Pubblicazione: (2025)
• On student-teacher deviations in distillation: does it pay to disobey?
  di: Nagarajan, Vaishnavh, et al.
  Pubblicazione: (2023)