Copertina

Revisiting Adaptive Rounding with Vectorized Reparameterization for LLM Quantization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhou, Yuli, Chen, Qingxuan, Benini, Luca, Sun, Guolei, Li, Yawei
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
di: Huang, Wei, et al.
Pubblicazione: (2024)

Optimal Brain Restoration for Joint Quantization and Sparsification of LLMs
di: Guo, Hang, et al.
Pubblicazione: (2025)

Direct Quantized Training of Language Models with Stochastic Rounding
di: Zhao, Kaiyan, et al.
Pubblicazione: (2024)

Reparameterized LLM Training via Orthogonal Equivalence Transformation
di: Qiu, Zeju, et al.
Pubblicazione: (2025)

Robust Training of Vector Quantized Bottleneck Models
di: Łańcucki, Adrian, et al.
Pubblicazione: (2020)

ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
di: You, Haoran, et al.
Pubblicazione: (2024)

A Reparameterized Discrete Diffusion Model for Text Generation
di: Zheng, Lin, et al.
Pubblicazione: (2023)

CamSAM2: Segment Anything Accurately in Camouflaged Videos
di: Zhou, Yuli, et al.
Pubblicazione: (2025)

AAAC: Activation-Aware Adaptive Codebooks for 4-bit LLM Weight Quantization
di: IslamBouli, Beshr, et al.
Pubblicazione: (2026)

End-to-End Training for Back-Translation with Categorical Reparameterization Trick
di: Heo, DongNyeong, et al.
Pubblicazione: (2022)

FlatQuant: Flatness Matters for LLM Quantization
di: Sun, Yuxuan, et al.
Pubblicazione: (2024)

Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
di: Cheng, Wenhua, et al.
Pubblicazione: (2023)

CRVQ: Channel-Relaxed Vector Quantization for Extreme Compression of LLMs
di: Xu, Yuzhuang, et al.
Pubblicazione: (2024)

SqueezeLLM: Dense-and-Sparse Quantization
di: Kim, Sehoon, et al.
Pubblicazione: (2023)

RDKV: Rate-Distortion Bit Allocation for Joint Eviction and Quantization of the KV Cache
di: Zhang, Junkai, et al.
Pubblicazione: (2026)

Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptation
di: Sengupta, Ayan, et al.
Pubblicazione: (2024)

RSAVQ: Riemannian Sensitivity-Aware Vector Quantization for Large Language Models
di: Xu, Zukang, et al.
Pubblicazione: (2025)

Revisiting Entropy Regularization: Adaptive Coefficient Unlocks Its Potential for LLM Reinforcement Learning
di: Zhang, Xiaoyun, et al.
Pubblicazione: (2025)

When SAM2 Meets Video Camouflaged Object Segmentation: A Comprehensive Evaluation and Adaptation
di: Zhou, Yuli, et al.
Pubblicazione: (2024)

GPTVQ: The Blessing of Dimensionality for LLM Quantization
di: van Baalen, Mart, et al.
Pubblicazione: (2024)

Round and Round We Go! What makes Rotary Positional Encodings useful?
di: Barbero, Federico, et al.
Pubblicazione: (2024)

MoBiQuant: Mixture-of-Bits Quantization for Token-Adaptive Any-Precision LLM
di: Wang, Dongwei, et al.
Pubblicazione: (2026)

DartQuant: Efficient Rotational Distribution Calibration for LLM Quantization
di: Shao, Yuantian, et al.
Pubblicazione: (2025)

Vector Quantized Latent Concepts: A Scalable Alternative to Clustering-Based Concept Discovery
di: Yu, Xuemin, et al.
Pubblicazione: (2026)

Adaptive Task Vectors for Large Language Models
di: Kang, Joonseong, et al.
Pubblicazione: (2025)

Technical Report: Activation Residual Hessian Quantization (ARHQ) for Low-Bit LLM Quantization
di: Wang, YiFeng, et al.
Pubblicazione: (2026)

Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
di: Zhang, Yihua, et al.
Pubblicazione: (2024)

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
di: Liu, Di, et al.
Pubblicazione: (2024)

QUAD: Quantization and Parameter-Efficient Tuning of LLM with Activation Decomposition
di: Hu, Yuxuan, et al.
Pubblicazione: (2025)

Evaluation Hallucination in Multi-Round Incomplete Information Lateral-Driven Reasoning Tasks
di: Dong, Wenhan, et al.
Pubblicazione: (2025)

Back to Basics: Revisiting Exploration in Reinforcement Learning for LLM Reasoning via Generative Probabilities
di: Li, Pengyi, et al.
Pubblicazione: (2026)

Scaling Law for Quantization-Aware Training
di: Chen, Mengzhao, et al.
Pubblicazione: (2025)

BEATS: Optimizing LLM Mathematical Capabilities with BackVerify and Adaptive Disambiguate based Efficient Tree Search
di: Sun, Linzhuang, et al.
Pubblicazione: (2024)

Trust in One Round: Confidence Estimation for Large Language Models via Structural Signals
di: Yang, Pengyue, et al.
Pubblicazione: (2026)

DiVeQ: Differentiable Vector Quantization Using the Reparameterization Trick
di: Vali, Mohammad Hassan, et al.
Pubblicazione: (2025)

Transformer-VQ: Linear-Time Transformers via Vector Quantization
di: Lingle, Lucas D.
Pubblicazione: (2023)

Initialisation Determines the Basin: Efficient Codebook Optimisation for Extreme LLM Quantization
di: Kennedy, Ian W., et al.
Pubblicazione: (2026)

QET: Enhancing Quantized LLM Parameters and KV cache Compression through Element Substitution and Residual Clustering
di: Wang, Yanshu, et al.
Pubblicazione: (2024)

A Framework for Cost-Effective and Self-Adaptive LLM Shaking and Recovery Mechanism
di: Chen, Zhiyu, et al.
Pubblicazione: (2024)

From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization
di: Zhou, Chenxi, et al.
Pubblicazione: (2026)