RelayAttention for Efficient Large Language Model Serving with Long System Prompts

Documenti analoghi

• Revisiting the Integration of Convolution and Attention for Vision Backbone
  di: Zhu, Lei, et al.
  Pubblicazione: (2024)
• Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention
  di: Gao, Bin, et al.
  Pubblicazione: (2024)
• Efficient Prompting Methods for Large Language Models: A Survey
  di: Chang, Kaiyan, et al.
  Pubblicazione: (2024)
• Relay Decoding: Concatenating Large Language Models for Machine Translation
  di: Fu, Chengpeng, et al.
  Pubblicazione: (2024)
• EPIC: Efficient Position-Independent Caching for Serving Large Language Models
  di: Hu, Junhao, et al.
  Pubblicazione: (2024)