Copertina

Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sun, Chuan, Yu, Han, Cui, Lizhen, Li, Xiaoxiao
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Explaining Large Language Models Decisions Using Shapley Values
di: Mohammadi, Behnam
Pubblicazione: (2024)

Shapley Value-based Contrastive Alignment for Multimodal Information Extraction
di: Luo, Wen, et al.
Pubblicazione: (2024)

Adaptive Pruning for Large Language Models with Structural Importance Awareness
di: Zheng, Haotian, et al.
Pubblicazione: (2024)

DLP: Dynamic Layerwise Pruning in Large Language Models
di: Chen, Yuli, et al.
Pubblicazione: (2025)

Entropy-Based Block Pruning for Efficient Large Language Models
di: Yang, Liangwei, et al.
Pubblicazione: (2025)

Prompt-based Depth Pruning of Large Language Models
di: Wee, Juyun, et al.
Pubblicazione: (2025)

ALPS: Attention Localization and Pruning Strategy for Efficient Alignment of Large Language Models
di: Chen, Hao, et al.
Pubblicazione: (2025)

Understanding Performance Collapse in Layer-Pruned Large Language Models via Decision Representation Transitions
di: Shi, Boyu, et al.
Pubblicazione: (2026)

Revisiting Large Language Model Pruning using Neuron Semantic Attribution
di: Ding, Yizhuo, et al.
Pubblicazione: (2025)

FedCoT: Communication-Efficient Federated Reasoning Enhancement for Large Language Models
di: Li, Chuan, et al.
Pubblicazione: (2025)

MaskPrune: Mask-based LLM Pruning for Layer-wise Uniform Structures
di: Qin, Jiayu, et al.
Pubblicazione: (2025)

BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation
di: Xu, Peng, et al.
Pubblicazione: (2024)

Large Language Model Pruning
di: Huang, Hanjuan, et al.
Pubblicazione: (2024)

Pruning General Large Language Models into Customized Expert Models
di: Zhao, Yirao, et al.
Pubblicazione: (2025)

DPPA: Pruning Method for Large Language Model to Model Merging
di: Zhu, Yaochen, et al.
Pubblicazione: (2024)

Sparsity Induction for Accurate Post-Training Pruning of Large Language Models
di: Jiang, Minhao, et al.
Pubblicazione: (2026)

SDMPrune: Self-Distillation MLP Pruning for Efficient Large Language Models
di: Zhu, Hourun, et al.
Pubblicazione: (2025)

SEM: Reinforcement Learning for Search-Efficient Large Language Models
di: Sha, Zeyang, et al.
Pubblicazione: (2025)

Saliency-driven Dynamic Token Pruning for Large Language Models
di: Tao, Yao, et al.
Pubblicazione: (2025)

Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization
di: Chrysostomou, George, et al.
Pubblicazione: (2023)

A Simple and Effective Pruning Approach for Large Language Models
di: Sun, Mingjie, et al.
Pubblicazione: (2023)

Pruning as a Cooperative Game: Surrogate-Assisted Layer Contribution Estimation for Large Language Models
di: Ding, Xuan, et al.
Pubblicazione: (2026)

Beware of Calibration Data for Pruning Large Language Models
di: Ji, Yixin, et al.
Pubblicazione: (2024)

Towards Robust Pruning: An Adaptive Knowledge-Retention Pruning Strategy for Language Models
di: Li, Jianwei, et al.
Pubblicazione: (2023)

Pruning Large Language Models by Identifying and Preserving Functional Networks
di: Liu, Yiheng, et al.
Pubblicazione: (2025)

Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models
di: Feng, Wenfeng, et al.
Pubblicazione: (2024)

LaCo: Large Language Model Pruning via Layer Collapse
di: Yang, Yifei, et al.
Pubblicazione: (2024)

Pruning Large Language Models with Semi-Structural Adaptive Sparse Training
di: Huang, Weiyu, et al.
Pubblicazione: (2024)

PAT: Pruning-Aware Tuning for Large Language Models
di: Liu, Yijiang, et al.
Pubblicazione: (2024)

Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
di: Lu, Xudong, et al.
Pubblicazione: (2024)

Benchmarking Multi-National Value Alignment for Large Language Models
di: Shi, Weijie, et al.
Pubblicazione: (2025)

Assistive Large Language Model Agents for Socially-Aware Negotiation Dialogues
di: Hua, Yuncheng, et al.
Pubblicazione: (2024)

VALUEFLOW: Toward Pluralistic and Steerable Value-based Alignment in Large Language Models
di: Kim, Woojin, et al.
Pubblicazione: (2026)

POP: Prefill-Only Pruning for Efficient Large Model Inference
di: He, Junhui, et al.
Pubblicazione: (2026)

Systematic Weight Evaluation for Pruning Large Language Models: Enhancing Performance and Sustainability
di: Islam, Ashhadul, et al.
Pubblicazione: (2025)

One-Shot Sensitivity-Aware Mixed Sparsity Pruning for Large Language Models
di: Shao, Hang, et al.
Pubblicazione: (2023)

Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models
di: Das, Rocktim Jyoti, et al.
Pubblicazione: (2023)

Text Quality-Based Pruning for Efficient Training of Language Models
di: Sharma, Vasu, et al.
Pubblicazione: (2024)

Efficient Attention Mechanisms for Large Language Models: A Survey
di: Sun, Yutao, et al.
Pubblicazione: (2025)

DARE the Extreme: Revisiting Delta-Parameter Pruning For Fine-Tuned Models
di: Deng, Wenlong, et al.
Pubblicazione: (2024)