Imagen de Portada

Selection Plateau and a Sparsity-Dependent Hierarchy of Pruning Features

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Guangqi, Li, Yongxin
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

LLM Sparsity Prior for Robust Feature Selection
por: Skinner, Caleb, et al.
Publicado: (2026)

Týr-the-Pruner: Structural Pruning LLMs via Global Sparsity Distribution Optimization
por: Li, Guanchen, et al.
Publicado: (2025)

Enhancing Unsupervised Feature Selection via Double Sparsity Constrained Optimization
por: Xiu, Xianchao, et al.
Publicado: (2025)

Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity
por: Yin, Lu, et al.
Publicado: (2023)

Demystifying When Pruning Works via Representation Hierarchies
por: He, Shwai, et al.
Publicado: (2026)

DuoGPT: Training-free Dual Sparsity through Activation-aware Pruning in LLMs
por: Yin, Ruokai, et al.
Publicado: (2025)

Beyond One-Way Pruning: Bidirectional Pruning-Regrowth for Extreme Accuracy-Sparsity Tradeoff
por: Liu, Junchen, et al.
Publicado: (2025)

Mustafar: Promoting Unstructured Sparsity for KV Cache Pruning in LLM Inference
por: Joo, Donghyeon, et al.
Publicado: (2025)

Rethinking Pruning for Vision-Language Models: Strategies for Effective Sparsity and Performance Restoration
por: He, Shwai, et al.
Publicado: (2024)

EntryPrune: Neural Network Feature Selection using First Impressions
por: Zimmer, Felix, et al.
Publicado: (2024)

Twilight: Adaptive Attention Sparsity with Hierarchical Top-$p$ Pruning
por: Lin, Chaofan, et al.
Publicado: (2025)

Structured Sparsity and Weight-adaptive Pruning for Memory and Compute efficient Whisper models
por: Mudi, Prasenjit K, et al.
Publicado: (2025)

POCKET: Pruning Random Convolution Kernels for Time Series Classification from a Feature Selection Perspective
por: Chen, Shaowu, et al.
Publicado: (2023)

SparK: Query-Aware Unstructured Sparsity with Recoverable KV Cache Channel Pruning
por: Liao, Huanxuan, et al.
Publicado: (2025)

Weight Concentration Regularization for Improving Pruning Robustness Under High Sparsity
por: Yun, Vincent-Daniel, et al.
Publicado: (2025)

Scaling Attention via Feature Sparsity
por: Xie, Yan, et al.
Publicado: (2026)

Maximum Redundancy Pruning: A Principle-Driven Layerwise Sparsity Allocation for LLMs
por: Gao, Chang, et al.
Publicado: (2025)

On the Limitation of Kernel Dependence Maximization for Feature Selection
por: Liu, Keli, et al.
Publicado: (2024)

OMH: Structured Sparsity via Optimally Matched Hierarchy for Unsupervised Semantic Segmentation
por: Ozaydin, Baran, et al.
Publicado: (2024)

Feature Selection Based on Wasserstein Distance
por: Li, Fuwei
Publicado: (2024)

FedPaI: Achieving Extreme Sparsity in Federated Learning via Pruning at Initialization
por: Wang, Haonan, et al.
Publicado: (2025)

Multi-View Graph Feature Propagation for Privacy Preservation and Feature Sparsity
por: Harari, Etzion, et al.
Publicado: (2025)

CRISP: Hybrid Structured Sparsity for Class-aware Model Pruning
por: Aggarwal, Shivam, et al.
Publicado: (2023)

Tree-Wasserstein Distance for High Dimensional Data with a Latent Feature Hierarchy
por: Lin, Ya-Wei Eileen, et al.
Publicado: (2024)

BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation
por: Xu, Peng, et al.
Publicado: (2024)

LOTUS: Improving Transformer Efficiency with Sparsity Pruning and Data Lottery Tickets
por: Upadhyay, Ojasw
Publicado: (2024)

Sparsity Forcing: Reinforcing Token Sparsity of MLLMs
por: Chen, Feng, et al.
Publicado: (2025)

Pruning is Optimal for Learning Sparse Features in High-Dimensions
por: Vural, Nuri Mert, et al.
Publicado: (2024)

Adversarial Feature Map Pruning for Backdoor
por: Huang, Dong, et al.
Publicado: (2023)

Uncovering Layer-Dependent Activation Sparsity Patterns in ReLU Transformers
por: Wild, Cody, et al.
Publicado: (2024)

VLM-Pruner: Buffering for Spatial Sparsity in an Efficient VLM Centrifugal Token Pruning Paradigm
por: Wu, Zhenkai, et al.
Publicado: (2025)

Sparsity and Out-of-Distribution Generalization
por: Aaronson, Scott, et al.
Publicado: (2026)

Activity Sparsity Complements Weight Sparsity for Efficient RNN Inference
por: Mukherji, Rishav, et al.
Publicado: (2023)

Learnable Permutation for Structured Sparsity on Transformer Models
por: Li, Zekai, et al.
Publicado: (2026)

Federated Learning via Variational Bayesian Inference: Personalization, Sparsity and Clustering
por: Zhang, Xu, et al.
Publicado: (2023)

Conditional Dependence via U-Statistics Pruning
por: de Cabrera, Ferran, et al.
Publicado: (2024)

LLM4FS: Leveraging Large Language Models for Feature Selection
por: Li, Jianhao, et al.
Publicado: (2025)

Prune-OPD: Efficient and Reliable On-Policy Distillation for Long-Horizon Reasoning
por: Yang, Zhicheng, et al.
Publicado: (2026)

Pruning Weights but Not Truth: Safeguarding Truthfulness While Pruning LLMs
por: Fu, Yao, et al.
Publicado: (2025)

Online Continual Learning with Dynamic Label Hierarchies
por: Wang, Xinrui, et al.
Publicado: (2026)