Cover Image

Sparsest Models Elude Pruning: An Exposé of Pruning's Current Capabilities

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Stephen, Papyan, Vardan
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

OATS: Outlier-Aware Pruning Through Sparse and Low Rank Decomposition
by: Zhang, Stephen, et al.
Published: (2024)

Attention Sinks: A 'Catch, Tag, Release' Mechanism for Embeddings
by: Zhang, Stephen, et al.
Published: (2025)

Transformer Block Coupling and its Correlation with Generalization in LLMs
by: Aubry, Murdock, et al.
Published: (2024)

Uncovering Capabilities of Model Pruning in Graph Contrastive Learning
by: Wu, Junran, et al.
Published: (2024)

SwiftPrune: Hessian-Free Weight Pruning for Large Language Models
by: Kang, Yuhan, et al.
Published: (2025)

Mosaic Pruning: A Hierarchical Framework for Generalizable Pruning of Mixture-of-Experts Models
by: Hu, Wentao, et al.
Published: (2025)

Laplacian Heads Improve Transformers by Smoothing Token Representations
by: Zhang, Yuchong, et al.
Published: (2026)

PrunePEFT: Iterative Hybrid Pruning for Parameter-Efficient Fine-tuning of LLMs
by: Yu, Tongzhou, et al.
Published: (2025)

Numerical Pruning for Efficient Autoregressive Models
by: Shen, Xuan, et al.
Published: (2024)

Symmetric Pruning of Large Language Models
by: Yi, Kai, et al.
Published: (2025)

IPPRO: Importance-based Pruning with PRojective Offset for Magnitude-indifferent Structural Pruning
by: Jung, Jaeheun, et al.
Published: (2025)

TopoPrune: Robust Data Pruning via Unified Latent Space Topology
by: Roy, Arjun, et al.
Published: (2026)

Residual Alignment: Uncovering the Mechanisms of Residual Networks
by: Li, Jianing, et al.
Published: (2024)

On the Importance of Gaussianizing Representations
by: Eftekhari, Daniel, et al.
Published: (2025)

Exploring Federated Pruning for Large Language Models
by: Guo, Pengxin, et al.
Published: (2025)

PruneSymNet: A Symbolic Neural Network and Pruning Algorithm for Symbolic Regression
by: Wu, Min, et al.
Published: (2024)

Beyond One-Way Pruning: Bidirectional Pruning-Regrowth for Extreme Accuracy-Sparsity Tradeoff
by: Liu, Junchen, et al.
Published: (2025)

IDEA Prune: An Integrated Enlarge-and-Prune Pipeline in Generative Language Model Pretraining
by: Li, Yixiao, et al.
Published: (2025)

Probe Pruning: Accelerating LLMs through Dynamic Pruning via Model-Probing
by: Le, Qi, et al.
Published: (2025)

Large Language Model Pruning
by: Huang, Hanjuan, et al.
Published: (2024)

The Neural Pruning Law Hypothesis
by: Barbulescu, Eugen, et al.
Published: (2025)

StructPrune: Structured Global Pruning asymptotics with $\mathcal{O}(\sqrt{N})$ GPU Memory
by: Song, Xinyuan, et al.
Published: (2025)

Safe Pruning LoRA: Robust Distance-Guided Pruning for Safety Alignment in Adaptation of LLMs
by: Ao, Shuang, et al.
Published: (2025)

Think Before You Prune: Self-Reflective Structured Pruning for Reasoning Language Models
by: Wang, Ziyan, et al.
Published: (2025)

MaskPrune: Mask-based LLM Pruning for Layer-wise Uniform Structures
by: Qin, Jiayu, et al.
Published: (2025)

Neural-Symbolic Message Passing with Dynamic Pruning
by: Zhang, Chongzhi, et al.
Published: (2025)

The Impact of Quantization and Pruning on Deep Reinforcement Learning Models
by: Lu, Heng, et al.
Published: (2024)

DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Models
by: Alvar, Saeed Ranjbar, et al.
Published: (2025)

FedPaI: Achieving Extreme Sparsity in Federated Learning via Pruning at Initialization
by: Wang, Haonan, et al.
Published: (2025)

EMP: Enhance Memory in Data Pruning
by: Xiao, Jinying, et al.
Published: (2024)

Influence Functions for Preference Dataset Pruning
by: Fein, Daniel, et al.
Published: (2025)

Severing Spurious Correlations with Data Pruning
by: Mulchandani, Varun, et al.
Published: (2025)

Resource-Constrained Affect Modelling via Variance Regularisation Pruning
by: Pinitas, Kosmas, et al.
Published: (2026)

The Right to be Forgotten in Pruning: Unveil Machine Unlearning on Sparse Models
by: Xiao, Yang, et al.
Published: (2025)

On the Limits of Layer Pruning for Generative Reasoning in Large Language Models
by: Shrestha, Safal, et al.
Published: (2026)

Max-Affine Spline Insights Into Deep Network Pruning
by: You, Haoran, et al.
Published: (2021)

PAT: Pruning-Aware Tuning for Large Language Models
by: Liu, Yijiang, et al.
Published: (2024)

Layer Collapse Can be Induced by Unstructured Pruning
by: Liao, Zhu, et al.
Published: (2024)

Graph Pruning for Enumeration of Minimal Unsatisfiable Subsets
by: Lymperopoulos, Panagiotis, et al.
Published: (2024)

ConceptPrune: Concept Editing in Diffusion Models via Skilled Neuron Pruning
by: Chavhan, Ruchika, et al.
Published: (2024)