Imagen de Portada

Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Sun, Chuan, Yu, Han, Cui, Lizhen, Li, Xiaoxiao
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Explaining Large Language Models Decisions Using Shapley Values
por: Mohammadi, Behnam
Publicado: (2024)

Shapley Value-based Contrastive Alignment for Multimodal Information Extraction
por: Luo, Wen, et al.
Publicado: (2024)

Adaptive Pruning for Large Language Models with Structural Importance Awareness
por: Zheng, Haotian, et al.
Publicado: (2024)

DLP: Dynamic Layerwise Pruning in Large Language Models
por: Chen, Yuli, et al.
Publicado: (2025)

Entropy-Based Block Pruning for Efficient Large Language Models
por: Yang, Liangwei, et al.
Publicado: (2025)

Prompt-based Depth Pruning of Large Language Models
por: Wee, Juyun, et al.
Publicado: (2025)

ALPS: Attention Localization and Pruning Strategy for Efficient Alignment of Large Language Models
por: Chen, Hao, et al.
Publicado: (2025)

Understanding Performance Collapse in Layer-Pruned Large Language Models via Decision Representation Transitions
por: Shi, Boyu, et al.
Publicado: (2026)

Revisiting Large Language Model Pruning using Neuron Semantic Attribution
por: Ding, Yizhuo, et al.
Publicado: (2025)

FedCoT: Communication-Efficient Federated Reasoning Enhancement for Large Language Models
por: Li, Chuan, et al.
Publicado: (2025)

MaskPrune: Mask-based LLM Pruning for Layer-wise Uniform Structures
por: Qin, Jiayu, et al.
Publicado: (2025)

BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation
por: Xu, Peng, et al.
Publicado: (2024)

Large Language Model Pruning
por: Huang, Hanjuan, et al.
Publicado: (2024)

Pruning General Large Language Models into Customized Expert Models
por: Zhao, Yirao, et al.
Publicado: (2025)

DPPA: Pruning Method for Large Language Model to Model Merging
por: Zhu, Yaochen, et al.
Publicado: (2024)

Sparsity Induction for Accurate Post-Training Pruning of Large Language Models
por: Jiang, Minhao, et al.
Publicado: (2026)

SDMPrune: Self-Distillation MLP Pruning for Efficient Large Language Models
por: Zhu, Hourun, et al.
Publicado: (2025)

SEM: Reinforcement Learning for Search-Efficient Large Language Models
por: Sha, Zeyang, et al.
Publicado: (2025)

Saliency-driven Dynamic Token Pruning for Large Language Models
por: Tao, Yao, et al.
Publicado: (2025)

Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization
por: Chrysostomou, George, et al.
Publicado: (2023)

A Simple and Effective Pruning Approach for Large Language Models
por: Sun, Mingjie, et al.
Publicado: (2023)

Pruning as a Cooperative Game: Surrogate-Assisted Layer Contribution Estimation for Large Language Models
por: Ding, Xuan, et al.
Publicado: (2026)

Beware of Calibration Data for Pruning Large Language Models
por: Ji, Yixin, et al.
Publicado: (2024)

Towards Robust Pruning: An Adaptive Knowledge-Retention Pruning Strategy for Language Models
por: Li, Jianwei, et al.
Publicado: (2023)

Pruning Large Language Models by Identifying and Preserving Functional Networks
por: Liu, Yiheng, et al.
Publicado: (2025)

Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models
por: Feng, Wenfeng, et al.
Publicado: (2024)

LaCo: Large Language Model Pruning via Layer Collapse
por: Yang, Yifei, et al.
Publicado: (2024)

Pruning Large Language Models with Semi-Structural Adaptive Sparse Training
por: Huang, Weiyu, et al.
Publicado: (2024)

PAT: Pruning-Aware Tuning for Large Language Models
por: Liu, Yijiang, et al.
Publicado: (2024)

Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
por: Lu, Xudong, et al.
Publicado: (2024)

Benchmarking Multi-National Value Alignment for Large Language Models
por: Shi, Weijie, et al.
Publicado: (2025)

Assistive Large Language Model Agents for Socially-Aware Negotiation Dialogues
por: Hua, Yuncheng, et al.
Publicado: (2024)

VALUEFLOW: Toward Pluralistic and Steerable Value-based Alignment in Large Language Models
por: Kim, Woojin, et al.
Publicado: (2026)

POP: Prefill-Only Pruning for Efficient Large Model Inference
por: He, Junhui, et al.
Publicado: (2026)

Systematic Weight Evaluation for Pruning Large Language Models: Enhancing Performance and Sustainability
por: Islam, Ashhadul, et al.
Publicado: (2025)

One-Shot Sensitivity-Aware Mixed Sparsity Pruning for Large Language Models
por: Shao, Hang, et al.
Publicado: (2023)

Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models
por: Das, Rocktim Jyoti, et al.
Publicado: (2023)

Text Quality-Based Pruning for Efficient Training of Language Models
por: Sharma, Vasu, et al.
Publicado: (2024)

Efficient Attention Mechanisms for Large Language Models: A Survey
por: Sun, Yutao, et al.
Publicado: (2025)

DARE the Extreme: Revisiting Delta-Parameter Pruning For Fine-Tuned Models
por: Deng, Wenlong, et al.
Publicado: (2024)