GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dadgarnia, Alireza, Tabesh, Soroush, Nikdan, Mahdi, Helcig, Michael, Kurtic, Eldar, Kleinegger, Maximilian, Alistarh, Dan
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!