Image de couverture de livre

No Free Prune: Information-Theoretic Barriers to Pruning at Initialization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Kumar, Tanishq, Luo, Kevin, Sellke, Mark
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

On Size-Independent Sample Complexity of ReLU Networks
par: Sellke, Mark
Publié: (2023)

An Effective Information Theoretic Framework for Channel Pruning
par: Chen, Yihao, et autres
Publié: (2024)

Inference-Time Chain-of-Thought Pruning with Latent Informativeness Signals
par: Li, Sophie, et autres
Publié: (2025)

Pruning at Initialization -- A Sketching Perspective
par: Bar, Noga, et autres
Publié: (2023)

SwiftPrune: Hessian-Free Weight Pruning for Large Language Models
par: Kang, Yuhan, et autres
Publié: (2025)

Incentivizing Exploration with Linear Contexts and Combinatorial Actions
par: Sellke, Mark
Publié: (2023)

Theoretical and Empirical Advances in Forest Pruning
par: Dorador, Albert
Publié: (2024)

What Scalable Second-Order Information Knows for Pruning at Initialization
par: Navarrete, Ivo Gollini, et autres
Publié: (2025)

Rapid Deployment of DNNs for Edge Computing via Structured Pruning at Initialization
par: Eccles, Bailey J., et autres
Publié: (2024)

On Learning-Curve Monotonicity for Maximum Likelihood Estimators
par: Sellke, Mark, et autres
Publié: (2025)

Nonparametric MLE for Gaussian Location Mixtures: Certified Computation and Generic Behavior
par: Polyanskiy, Yury, et autres
Publié: (2025)

Mutual Information Preserving Neural Network Pruning
par: Westphal, Charles, et autres
Publié: (2024)

AIMER: Calibration-Free Task-Agnostic MoE Pruning
par: Liu, Zongfang, et autres
Publié: (2026)

Prune, Update and Trim: Robust Structured Pruning for Large Language Models
par: Mecke, Diego Coello de Portugal, et autres
Publié: (2026)

To Bag is to Prune
par: Coulombe, Philippe Goulet
Publié: (2020)

Data-Free Pruning of Self-Attention Layers in LLMs
par: Saikumar, Dhananjay, et autres
Publié: (2025)

Non-transferable Pruning
par: Ding, Ruyi, et autres
Publié: (2024)

Training-Free Dataset Pruning for Instance Segmentation
par: Dai, Yalun, et autres
Publié: (2025)

Sparsest Models Elude Pruning: An Exposé of Pruning's Current Capabilities
par: Zhang, Stephen, et autres
Publié: (2024)

STUN: Structured-Then-Unstructured Pruning for Scalable MoE Pruning
par: Lee, Jaeseong, et autres
Publié: (2024)

Pruning Weights but Not Truth: Safeguarding Truthfulness While Pruning LLMs
par: Fu, Yao, et autres
Publié: (2025)

Geometry Meets Incentives: Sample-Efficient Incentivized Exploration with Linear Contexts
par: Schiffer, Benjamin, et autres
Publié: (2025)

Theoretically Grounded Pruning of Large Ground Sets for Constrained, Discrete Optimization
par: Nath, Ankur, et autres
Publié: (2024)

FedPaI: Achieving Extreme Sparsity in Federated Learning via Pruning at Initialization
par: Wang, Haonan, et autres
Publié: (2025)

LLM-Rank: A Graph Theoretical Approach to Pruning Large Language Models
par: Hoffmann, David, et autres
Publié: (2024)

Quantization vs Pruning: Insights from the Strong Lottery Ticket Hypothesis
par: Kumar, Aakash, et autres
Publié: (2025)

Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes
par: Kolawole, Steven, et autres
Publié: (2024)

QAdaPrune: Adaptive Parameter Pruning For Training Variational Quantum Circuits
par: Kulshrestha, Ankit, et autres
Publié: (2024)

Holistic Adversarially Robust Pruning
par: Zhao, Qi, et autres
Publié: (2024)

Pruning and Malicious Injection: A Retraining-Free Backdoor Attack on Transformer Models
par: Zhao, Taibiao, et autres
Publié: (2025)

Training-Free Restoration of Pruned Neural Networks
par: Lee, Keonho, et autres
Publié: (2025)

Towards Sobolev Pruning
par: Kichler, Neil, et autres
Publié: (2023)

Lightweight Edge Learning via Dataset Pruning
par: Ale, Laha, et autres
Publié: (2026)

PrunePEFT: Iterative Hybrid Pruning for Parameter-Efficient Fine-tuning of LLMs
par: Yu, Tongzhou, et autres
Publié: (2025)

IPPRO: Importance-based Pruning with PRojective Offset for Magnitude-indifferent Structural Pruning
par: Jung, Jaeheun, et autres
Publié: (2025)

TopoPrune: Robust Data Pruning via Unified Latent Space Topology
par: Roy, Arjun, et autres
Publié: (2026)

Mosaic Pruning: A Hierarchical Framework for Generalizable Pruning of Mixture-of-Experts Models
par: Hu, Wentao, et autres
Publié: (2025)

Beyond Manually Designed Pruning Policies with Second-Level Performance Prediction: A Pruning Framework for LLMs
par: Ma, Zuxin, et autres
Publié: (2025)

ResPrune: Text-Conditioned Subspace Reconstruction for Visual Token Pruning in Large Vision-Language Models
par: Li, Xu, et autres
Publié: (2026)

TT-Prune: Joint Model Pruning and Resource Allocation for Communication-efficient Time-triggered Federated Learning
par: Zhang, Xinlu, et autres
Publié: (2025)