FastQuery: Communication-efficient Embedding Table Query for Private LLM Inference

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lin, Chenqi, Xu, Tianshi, Yang, Zebin, Wang, Runsheng, Huang, Ru, Li, Meng
Format:	Preprint
Published:	2024
Subjects:	Cryptography and Security Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2405.16241