Cover Image

MoSKA: Mixture of Shared KV Attention for Efficient Long-Sequence LLM Inference

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Rhee, Myunghyun, Choi, Sookyung, Kim, Euiseok, Sim, Joonseop, Joo, Youngpyo, Kim, Hoshik
Format: Preprint
Published: 2025
Subjects:
Machine Learning
Artificial Intelligence
Distributed, Parallel, and Cluster Computing
Online Access:
Acceder al recurso
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Description not available.

Similar Items