Documenti analoghi

• Superposition Prompting: Improving and Accelerating Retrieval-Augmented Generation
  di: Merth, Thomas, et al.
  Pubblicazione: (2024)
• Speculative Streaming: Fast LLM Inference without Auxiliary Models
  di: Bhendawade, Nikhil, et al.
  Pubblicazione: (2024)
• Efficient Vision-Language Models by Summarizing Visual Tokens into Compact Registers
  di: Wen, Yuxin, et al.
  Pubblicazione: (2024)
• KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation
  di: Cho, Minsik, et al.
  Pubblicazione: (2024)
• Do Compressed LLMs Forget Knowledge? An Experimental Study with Practical Implications
  di: Hoang, Duc N. M, et al.
  Pubblicazione: (2023)