Cover Image

HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Luo, Cheng, Cai, Zefan, Sun, Hanshi, Xiao, Jinqi, Yuan, Bo, Xiao, Wen, Hu, Junjie, Zhao, Jiawei, Chen, Beidi, Anandkumar, Anima
Format: Preprint
Published: 2025
Subjects:
Machine Learning
Artificial Intelligence
Online Access:
Acceder al recurso
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Description not available.

Similar Items