Image de couverture de livre

Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Cui, Wanyun, Wang, Qianle
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Ada-Instruct: Adapting Instruction Generators for Complex Reasoning
par: Cui, Wanyun, et autres
Publié: (2023)

Homogeneous Keys, Heterogeneous Values: Exploiting Local KV Cache Asymmetry for Long-Context LLMs
par: Cui, Wanyun, et autres
Publié: (2025)

Leveraging Logical Rules in Knowledge Editing: A Cherry on the Top
par: Cheng, Keyuan, et autres
Publié: (2024)

Chameleon: A Flexible Data-mixing Framework for Language Model Pretraining and Finetuning
par: Xie, Wanyun, et autres
Publié: (2025)

QWHA: Quantization-Aware Walsh-Hadamard Adaptation for Parameter-Efficient Fine-Tuning on Large Language Models
par: Jeon, Hyesung, et autres
Publié: (2025)

Evaluating Quantized Large Language Models
par: Li, Shiyao, et autres
Publié: (2024)

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models
par: Huang, Siming, et autres
Publié: (2024)

L4Q: Parameter Efficient Quantization-Aware Fine-Tuning on Large Language Models
par: Jeon, Hyesung, et autres
Publié: (2024)

The Mercurial Top-Level Ontology of Large Language Models
par: Köhler, Nele, et autres
Publié: (2024)

TopK Language Models
par: Takahashi, Ryosuke, et autres
Publié: (2025)

OutlierTune: Efficient Channel-Wise Quantization for Large Language Models
par: Wang, Jinguang, et autres
Publié: (2024)

On the Compressibility of Quantized Large Language Models
par: Mao, Yu, et autres
Publié: (2024)

Distribution-Aware Companding Quantization of Large Language Models
par: Radhakrishnan, Athul, et autres
Publié: (2026)

MoA: Heterogeneous Mixture of Adapters for Parameter-Efficient Fine-Tuning of Large Language Models
par: Cao, Jie, et autres
Publié: (2025)

LSAQ: Layer-Specific Adaptive Quantization for Large Language Model Deployment
par: Zeng, Binrui, et autres
Publié: (2024)

CBQ: Cross-Block Quantization for Large Language Models
par: Ding, Xin, et autres
Publié: (2023)

Quantization of Large Language Models with an Overdetermined Basis
par: Merkulov, Daniil, et autres
Publié: (2024)

Fair-GPTQ: Bias-Aware Quantization for Large Language Models
par: Proskurina, Irina, et autres
Publié: (2025)

BAQ: Efficient Bit Allocation Quantization for Large Language Models
par: Zhang, Chao, et autres
Publié: (2025)

On Context-aware Detection of Cherry-picking in News Reporting
par: Jaradat, Israa, et autres
Publié: (2024)

Self-Updatable Large Language Models by Integrating Context into Model Parameters
par: Wang, Yu, et autres
Publié: (2024)

Scaling Laws for Post Training Quantized Large Language Models
par: Xu, Zifei, et autres
Publié: (2024)

Advantageous Parameter Expansion Training Makes Better Large Language Models
par: Gu, Naibin, et autres
Publié: (2025)

A Comprehensive Evaluation of Quantization Strategies for Large Language Models
par: Jin, Renren, et autres
Publié: (2024)

Heterogeneous Value Alignment Evaluation for Large Language Models
par: Zhang, Zhaowei, et autres
Publié: (2023)

Uncertainty Drives Social Bias Changes in Quantized Large Language Models
par: Hua, Stanley Z., et autres
Publié: (2026)

1bit-Merging: Dynamic Quantized Merging for Large Language Models
par: Liu, Shuqi, et autres
Publié: (2025)

Ensemble Learning for Heterogeneous Large Language Models with Deep Parallel Collaboration
par: Huang, Yichong, et autres
Publié: (2024)

Precise In-Parameter Concept Erasure in Large Language Models
par: Gur-Arieh, Yoav, et autres
Publié: (2025)

Using Large Language Models to Construct Virtual Top Managers: A Method for Organizational Research
par: Garzon-Vico, Antonio, et autres
Publié: (2026)

Quantized Large Language Models in Biomedical Natural Language Processing: Evaluation and Recommendation
par: Zhan, Zaifu, et autres
Publié: (2025)

When Quantization Affects Confidence of Large Language Models?
par: Proskurina, Irina, et autres
Publié: (2024)

FBQuant: FeedBack Quantization for Large Language Models
par: Liu, Yijiang, et autres
Publié: (2025)

DLLMQuant: Quantizing Diffusion-based Large Language Models
par: Xu, Chen, et autres
Publié: (2025)

How Quantization Shapes Bias in Large Language Models
par: Marcuzzi, Federico, et autres
Publié: (2025)

Determine-Then-Ensemble: Necessity of Top-k Union for Large Language Model Ensembling
par: Yao, Yuxuan, et autres
Publié: (2024)

RUQuant: Towards Refining Uniform Quantization for Large Language Models
par: Liu, Han, et autres
Publié: (2026)

Optimizing Large Language Model Training Using FP4 Quantization
par: Wang, Ruizhe, et autres
Publié: (2025)

Mixed-Precision Graph Neural Quantization for Low Bit Large Language Models
par: Liu, Wanlong, et autres
Publié: (2025)

Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization
par: Lee, Janghwan, et autres
Publié: (2023)