Image de couverture de livre

SBVR: Summation of BitVector Representation for Efficient LLM Quantization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Bang, Wonjun, Park, Jongseok, Yu, Hongseung, Bin, Kyungmin, Lee, Kyunghan
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Q-Palette: Fractional-Bit Quantizers Toward Optimal Bit Allocation for Efficient LLM Deployment
par: Lee, Deokjae, et autres
Publié: (2025)

DecDEC: A Systems Approach to Advancing Low-Bit LLM Quantization
par: Park, Yeonhong, et autres
Publié: (2024)

Learning Grouped Lattice Vector Quantizers for Low-Bit LLM Compression
par: Zhang, Xi, et autres
Publié: (2025)

BitSnap: Checkpoint Sparsification and Quantization in LLM Training
par: Peng, Yanxin, et autres
Publié: (2025)

Leech Lattice Vector Quantization for Efficient LLM Compression
par: van der Ouderaa, Tycho F. A., et autres
Publié: (2026)

BitsMoE: Efficient Spectral Energy-Guided Bit Allocation for MoE LLM Quantization
par: Zhao, Jiayu, et autres
Publié: (2026)

MSQ: Memory-Efficient Bit Sparsification Quantization
par: Han, Seokho, et autres
Publié: (2025)

FireQ: Fast INT4-FP8 Kernel and RoPE-aware Quantization for LLM Inference Acceleration
par: Baek, Daehyeon, et autres
Publié: (2025)

DyBit: Dynamic Bit-Precision Numbers for Efficient Quantized Neural Network Inference
par: Zhou, Jiajun, et autres
Publié: (2023)

Task Vector Quantization for Memory-Efficient Model Merging
par: Kim, Youngeun, et autres
Publié: (2025)

Efficient Generative Modeling with Residual Vector Quantization-Based Tokens
par: Kim, Jaehyeon, et autres
Publié: (2024)

Representation Collapsing Problems in Vector Quantization
par: Zhao, Wenhao, et autres
Publié: (2024)

ResBit: Residual Bit Vector for Categorical Values
par: Fuchi, Masane, et autres
Publié: (2023)

EVA: Accelerating LLM Decoding via an Efficient Vector Quantization Architecture
par: Duan, Bowen, et autres
Publié: (2026)

I-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models
par: Hu, Xing, et autres
Publié: (2024)

Uncovering Intra-expert Activation Sparsity for Efficient Mixture-of-Expert Model Execution
par: Park, Jongseok, et autres
Publié: (2026)

ABQ-LLM: Arbitrary-Bit Quantized Inference Acceleration for Large Language Models
par: Zeng, Chao, et autres
Publié: (2024)

PrismQuant: Rate-Distortion-Optimal Vector Quantization for Gaussian-Mixture Sources
par: Park, Bumsu, et autres
Publié: (2026)

LittleBit: Ultra Low-Bit Quantization via Latent Factorization
par: Lee, Banseok, et autres
Publié: (2025)

BAQ: Efficient Bit Allocation Quantization for Large Language Models
par: Zhang, Chao, et autres
Publié: (2025)

Why Do Some Inputs Break Low-Bit LLM Quantization?
par: Chang, Ting-Yun, et autres
Publié: (2025)

NanoQuant: Efficient Sub-1-Bit Quantization of Large Language Models
par: Chong, Hyochan, et autres
Publié: (2026)

InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization
par: Li, Ke, et autres
Publié: (2026)

TesseraQ: Ultra Low-Bit LLM Post-Training Quantization with Block Reconstruction
par: Li, Yuhang, et autres
Publié: (2024)

TruncQuant: Truncation-Ready Quantization for DNNs with Flexible Weight Bit Precision
par: Kim, Jinhee, et autres
Publié: (2025)

Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models
par: Park, Jungwoo, et autres
Publié: (2025)

BTC-LLM: Efficient Sub-1-Bit LLM Quantization via Learnable Transformation and Binary Codebook
par: Gu, Hao, et autres
Publié: (2025)

NSNQuant: A Double Normalization Approach for Calibration-Free Low-Bit Vector Quantization of KV Cache
par: Son, Donghyun, et autres
Publié: (2025)

One-Bit Quantization for Random Features Models
par: Akhtiamov, Danil, et autres
Publié: (2025)

Multi-output Classification for Compound Fault Diagnosis in Motor under Partially Labeled Target Domain
par: Yi, Wonjun, et autres
Publié: (2025)

Multi-output Classification Framework and Frequency Layer Normalization for Compound Fault Diagnosis in Motor
par: Yi, Wonjun, et autres
Publié: (2025)

From Bits to Chips: An LLM-based Hardware-Aware Quantization Agent for Streamlined Deployment of LLMs
par: Deng, Kaiyuan, et autres
Publié: (2026)

QQQ: Quality Quattuor-Bit Quantization for Large Language Models
par: Zhang, Ying, et autres
Publié: (2024)

Reliability-Aware Adaptive Self-Consistency for Efficient Sampling in LLM Reasoning
par: Kim, Junseok, et autres
Publié: (2026)

Revisiting Adaptive Rounding with Vectorized Reparameterization for LLM Quantization
par: Zhou, Yuli, et autres
Publié: (2026)

Sherry: Hardware-Efficient 1.25-Bit Ternary Quantization via Fine-grained Sparsification
par: Huang, Hong, et autres
Publié: (2026)

Technical Report: Activation Residual Hessian Quantization (ARHQ) for Low-Bit LLM Quantization
par: Wang, YiFeng, et autres
Publié: (2026)

Where and How to Enhance: Discovering Bit-Width Contribution for Mixed Precision Quantization
par: Kang, Haidong, et autres
Publié: (2025)

Online Conformal Prediction with Adversarial Semi-bandit Feedback via Regret Minimization
par: Yang, Junyoung, et autres
Publié: (2026)

AsymKV: Enabling 1-Bit Quantization of KV Cache with Layer-Wise Asymmetric Quantization Configurations
par: Tao, Qian, et autres
Publié: (2024)