Image de couverture de livre

Exploring Layer-wise Information Effectiveness for Post-Training Quantization in Small Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Xiao, He, Yang, Qingyao, Xie, Dirui, Xu, Wendong, Su, Zunhai, yang, Runming, Zhou, Wenyong, Liu, Haobo, Liu, Zhengwu, Wong, Ngai
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

PTQTP: Post-Training Quantization to Trit-Planes for Large Language Models
par: Xiao, He, et autres
Publié: (2025)

Binary Weight Multi-Bit Activation Quantization for Compute-in-Memory CNN Accelerators
par: Zhou, Wenyong, et autres
Publié: (2025)

Beyond Outliers: A Data-Free Layer-wise Mixed-Precision Quantization Approach Driven by Numerical and Structural Dual-Sensitivity
par: Zhang, Hengyuan, et autres
Publié: (2026)

Distribution-Aware Hadamard Quantization for Hardware-Efficient Implicit Neural Representations
par: Zhou, Wenyong, et autres
Publié: (2025)

Can We Trust LLMs on Memristors? Diving into Reasoning Ability under Non-Ideality
par: Wu, Taiqiang, et autres
Publié: (2026)

Quantization Meets Reasoning: Exploring LLM Low-Bit Quantization Degradation for Mathematical Reasoning
par: Li, Zhen, et autres
Publié: (2025)

XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression
par: Su, Zunhai, et autres
Publié: (2026)

XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression
par: Su, Zunhai, et autres
Publié: (2026)

Enhancing Robustness of Implicit Neural Representations Against Weight Perturbations
par: Zhou, Wenyong, et autres
Publié: (2025)

MINR: Efficient Implicit Neural Representations for Multi-Image Encoding
par: Zhou, Wenyong, et autres
Publié: (2025)

Timber: Training-free Instruct Model Refining with Base via Effective Rank
par: Wu, Taiqiang, et autres
Publié: (2025)

Decomposing Densification in Gaussian Splatting for Faster 3D Scene Reconstruction
par: Huang, Binxiao, et autres
Publié: (2025)

ROMER: Expert Replacement and Router Calibration for Robust MoE LLMs on Analog Compute-in-Memory Systems
par: Zhou, Wenyong, et autres
Publié: (2026)

HPD: Hybrid Projection Decomposition for Robust State Space Models on Analog CIM Hardware
par: Feng, Yuannuo, et autres
Publié: (2025)

Quantization Meets Reasoning: Exploring and Mitigating Degradation of Low-Bit LLMs in Mathematical Reasoning
par: Li, Zhen, et autres
Publié: (2025)

HaLoRA: Hardware-aware Low-Rank Adaptation for Large Language Models Based on Hybrid Compute-in-Memory Architecture
par: Wu, Taiqiang, et autres
Publié: (2025)

Extending Straight-Through Estimation for Robust Neural Networks on Analog CIM Hardware
par: Feng, Yuannuo, et autres
Publié: (2025)

Re-Activating Frozen Primitives for 3D Gaussian Splatting
par: Cheng, Yuxin, et autres
Publié: (2025)

QuadINR: Hardware-Efficient Implicit Neural Representations Through Quadratic Activation
par: Zhou, Wenyong, et autres
Publié: (2025)

KVSink: Understanding and Enhancing the Preservation of Attention Sinks in KV Cache Quantization for LLMs
par: Su, Zunhai, et autres
Publié: (2025)

APTQ: Attention-aware Post-Training Mixed-Precision Quantization for Large Language Models
par: Guan, Ziyi, et autres
Publié: (2024)

CktFormalizer: Autoformalization of Natural Language into Circuit Representations
par: Xiong, Jing, et autres
Publié: (2026)

Perspective-aware 3D Gaussian Inpainting with Multi-view Consistency
par: Cheng, Yuxin, et autres
Publié: (2025)

Revisiting Model Interpolation for Efficient Reasoning
par: Wu, Taiqiang, et autres
Publié: (2025)

Comparing point‐wise and pair‐wise relevance judgment with brain signals
par: Shuqi Zhu, et autres
Publié: (2024)

P$^2$-ViT: Power-of-Two Post-Training Quantization and Acceleration for Fully Quantized Vision Transformer
par: Shi, Huihong, et autres
Publié: (2024)

DoPE: Denoising Rotary Position Embedding
par: Xiong, Jing, et autres
Publié: (2025)

Trio-ViT: Post-Training Quantization and Acceleration for Softmax-Free Efficient Vision Transformer
par: Shi, Huihong, et autres
Publié: (2024)

Weight Group-wise Post-Training Quantization for Medical Foundation Model
par: Chen, Yineng, et autres
Publié: (2026)

Shadow-FT: Tuning Instruct Model via Training on Paired Base Model
par: Wu, Taiqiang, et autres
Publié: (2025)

Layer-wise Quantization for Quantized Optimistic Dual Averaging
par: Nguyen, Anh Duc, et autres
Publié: (2025)

Nonparametric Teaching for Graph Property Learners
par: Zhang, Chen, et autres
Publié: (2025)

AnchorTP: Resilient LLM Inference with State-Preserving Elastic Tensor Parallelism
par: Xu, Wendong, et autres
Publié: (2025)

Quantization Error Propagation: Revisiting Layer-Wise Post-Training Quantization
par: Arai, Yamato, et autres
Publié: (2025)

A Time- and Energy-Efficient CNN with Dense Connections on Memristor-Based Chips
par: Zhou, Wenyong, et autres
Publié: (2025)

Unveiling Super Experts in Mixture-of-Experts Large Language Models
par: Su, Zunhai, et autres
Publié: (2025)

FlexRound: Learnable Rounding based on Element-wise Division for Post-Training Quantization
par: Lee, Jung Hyun, et autres
Publié: (2023)

EPTQ: Enhanced Post-Training Quantization via Hessian-guided Network-wise Optimization
par: Gordon, Ofir, et autres
Publié: (2023)

SKIM: Any-bit Quantization Pushing The Limits of Post-Training Quantization
par: Bai, Runsheng, et autres
Publié: (2024)

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
par: Wu, Taiqiang, et autres
Publié: (2024)