Cover Image

DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yao, Jinwei, Chen, Kaiqi, Zhang, Kexun, You, Jiaxuan, Yuan, Binhang, Wang, Zeke, Lin, Tao
Format: Preprint
Published: 2024
Subjects:
Computation and Language
Artificial Intelligence
Online Access:
Acceder al recurso
Tags: Add Tag
No Tags, Be the first to tag this record!
Be the first to leave a comment!
You must be logged in first

Similar Items