Image de couverture de livre

CLAQ: Pushing the Limits of Low-Bit Post-Training Quantization for LLMs

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Haoyu, Liu, Bei, Shao, Hang, Xiao, Bo, Zeng, Ke, Wan, Guanglu, Qian, Yanmin
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

SKIM: Any-bit Quantization Pushing The Limits of Post-Training Quantization
par: Bai, Runsheng, et autres
Publié: (2024)

BiLLM: Pushing the Limit of Post-Training Quantization for LLMs
par: Huang, Wei, et autres
Publié: (2024)

HBVLA: Pushing 1-Bit Post-Training Quantization for Vision-Language-Action Models
par: Yan, Xin, et autres
Publié: (2026)

PTQ1.61: Push the Real Limit of Extremely Low-Bit Post-Training Quantization Methods for Large Language Models
par: Zhao, Jiaqi, et autres
Publié: (2025)

DenoiseRotator: Enhance Pruning Robustness for LLMs via Importance Concentration
par: Gu, Tianteng, et autres
Publié: (2025)

One-Shot Sensitivity-Aware Mixed Sparsity Pruning for Large Language Models
par: Shao, Hang, et autres
Publié: (2023)

Pushing the Limits of Block Rotations in Post-Training Quantization
par: Sanjeet, Sai, et autres
Publié: (2026)

1-Bit FQT: Pushing the Limit of Fully Quantized Training to 1-bit
par: Gao, Chang, et autres
Publié: (2024)

Pushing the Limits of Low-Bit Optimizers: A Focus on EMA Dynamics
par: Xu, Cong, et autres
Publié: (2025)

Understanding the Difficulty of Low-Precision Post-Training Quantization for LLMs
par: Xu, Zifei, et autres
Publié: (2024)

Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens
par: Ouyang, Xu, et autres
Publié: (2024)

TesseraQ: Ultra Low-Bit LLM Post-Training Quantization with Block Reconstruction
par: Li, Yuhang, et autres
Publié: (2024)

Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMs
par: Xu, Binxing, et autres
Publié: (2026)

Robust Ultra Low-Bit Post-Training Quantization via Stable Diagonal Curvature Estimate
par: Kim, Jaemin, et autres
Publié: (2026)

HESTIA: A Hessian-Guided Differentiable Quantization-Aware Training Framework for Extremely Low-Bit LLMs
par: Wang, Guoan, et autres
Publié: (2026)

MARR: Module-Adaptive Residual Reconstruction for Low-Bit Post-Training Quantization
par: Su, Le, et autres
Publié: (2026)

Quant-dLLM: Post-Training Extreme Low-Bit Quantization for Diffusion Large Language Models
par: Zhang, Tianao, et autres
Publié: (2025)

Bits for Privacy: Evaluating Post-Training Quantization via Membership Inference
par: Zhang, Chenxiang, et autres
Publié: (2025)

SpecQuant: Spectral Decomposition and Adaptive Truncation for Ultra-Low-Bit LLMs Quantization
par: Zhao, Zhixiong, et autres
Publié: (2025)

FrameQuant: Flexible Low-Bit Quantization for Transformers
par: Adepu, Harshavardhan, et autres
Publié: (2024)

Quantization Meets Reasoning: Exploring and Mitigating Degradation of Low-Bit LLMs in Mathematical Reasoning
par: Li, Zhen, et autres
Publié: (2025)

BitSnap: Checkpoint Sparsification and Quantization in LLM Training
par: Peng, Yanxin, et autres
Publié: (2025)

Shedding the Bits: Pushing the Boundaries of Quantization with Minifloats on FPGAs
par: Aggarwal, Shivam, et autres
Publié: (2023)

What Makes Low-Bit Quantization-Aware Training Work for Reasoning LLMs? A Systematic Study
par: Lv, Keyu, et autres
Publié: (2026)

InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization
par: Li, Ke, et autres
Publié: (2026)

FineQ: Software-Hardware Co-Design for Low-Bit Fine-Grained Mixed-Precision Quantization of LLMs
par: Xie, Xilong, et autres
Publié: (2025)

Towards Lightweight Speaker Verification via Adaptive Neural Network Quantization
par: Liu, Bei, et autres
Publié: (2024)

D$^2$Quant: Accurate Low-bit Post-Training Weight Quantization for LLMs
par: Yan, Xianglong, et autres
Publié: (2026)

From Bits to Chips: An LLM-based Hardware-Aware Quantization Agent for Streamlined Deployment of LLMs
par: Deng, Kaiyuan, et autres
Publié: (2026)

Pushing the Limits of Large Language Model Quantization via the Linearity Theorem
par: Malinovskii, Vladimir, et autres
Publié: (2024)

Achieving binary weight and activation for LLMs using Post-Training Quantization
par: Song, Siqing, et autres
Publié: (2025)

SplitQuantV2: Enhancing Low-Bit Quantization of LLMs Without GPUs
par: Song, Jaewoo, et autres
Publié: (2025)

Qronos: Correcting the Past by Shaping the Future... in Post-Training Quantization
par: Zhang, Shihao, et autres
Publié: (2025)

Benchmarking Post-Training Quantization in LLMs: Comprehensive Taxonomy, Unified Evaluation, and Comparative Analysis
par: Zhao, Jiaqi, et autres
Publié: (2025)

Pushing the Limits of Inverse Lithography with Generative Reinforcement Learning
par: Yang, Haoyu, et autres
Publié: (2026)

LittleBit: Ultra Low-Bit Quantization via Latent Factorization
par: Lee, Banseok, et autres
Publié: (2025)

1-Bit Wonder: Improving QAT Performance in the Low-Bit Regime through K-Means Quantization
par: Maskey, Sohir, et autres
Publié: (2026)

pQuant: Towards Effective Low-Bit Language Models via Decoupled Linear Quantization-Aware Training
par: Zhang, Wenzheng, et autres
Publié: (2026)

Low-Rank Quantization-Aware Training for LLMs
par: Bondarenko, Yelysei, et autres
Publié: (2024)

ABQ-LLM: Arbitrary-Bit Quantized Inference Acceleration for Large Language Models
par: Zeng, Chao, et autres
Publié: (2024)