I-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hu, Xing, Cheng, Yuan, Yang, Dawei, Yuan, Zhihang, Yu, Jiangyong, Xu, Chen, Zhou, Sifan
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2405.17849