Reducing Transformer Key-Value Cache Size with Cross-Layer Attention

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Brandon, William, Mishra, Mayank, Nrusimha, Aniruddha, Panda, Rameswar, Kelly, Jonathan Ragan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!