Cover Image

The Neural Pruning Law Hypothesis

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Barbulescu, Eugen, Alexoaie, Antonio, Busoniu, Lucian
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

To Each (Textual Sequence) Its Own: Improving Memorized-Data Unlearning in Large Language Models
by: Barbulescu, George-Octavian, et al.
Published: (2024)

Fast Neural-Network Approximation of Active Target Search Under Uncertainty
by: Yousuf, Bilal, et al.
Published: (2026)

The Graphon Limit Hypothesis: Understanding Neural Network Pruning via Infinite Width Analysis
by: Pham, Hoang, et al.
Published: (2025)

Scaling Law Hypothesis for Multimodal Model
by: Sun, Qingyun, et al.
Published: (2024)

PruneSymNet: A Symbolic Neural Network and Pruning Algorithm for Symbolic Regression
by: Wu, Min, et al.
Published: (2024)

Junk DNA Hypothesis: Pruning Small Pre-Trained Weights Irreversibly and Monotonically Impairs "Difficult" Downstream Tasks in LLMs
by: Yin, Lu, et al.
Published: (2023)

Neural-Symbolic Message Passing with Dynamic Pruning
by: Zhang, Chongzhi, et al.
Published: (2025)

P$^2$ Law: Scaling Law for Post-Training After Model Pruning
by: Chen, Xiaodong, et al.
Published: (2024)

Hypothesis Testing the Circuit Hypothesis in LLMs
by: Shi, Claudia, et al.
Published: (2024)

Towards Neural Scaling Laws on Graphs
by: Liu, Jingzhe, et al.
Published: (2024)

On the Optimizer Dependence of Neural Scaling Laws
by: Ramani, Vansh, et al.
Published: (2026)

Spectral Theory for Edge Pruning in Asynchronous Recurrent Graph Neural Networks
by: Bessone, Nicolas
Published: (2025)

Budgeted Broadcast: An Activity-Dependent Pruning Rule for Neural Network Efficiency
by: Meirovitch, Yaron, et al.
Published: (2025)

Hierarchical Attention-based Graph Neural Network with Relevance-driven Pruning
by: Kum, Seungwoo
Published: (2026)

Exchangeability in Neural Network and its Application to Dynamic Pruning
by: Pu, et al.
Published: (2025)

Purity Law for Generalizable Neural TSP Solvers
by: Liu, Wenzhao, et al.
Published: (2025)

Information-Theoretic Foundations for Neural Scaling Laws
by: Jeon, Hong Jun, et al.
Published: (2024)

Resource-Aware Neural Network Pruning Using Graph-based Reinforcement Learning
by: Balemans, Dieter, et al.
Published: (2025)

MPruner: Optimizing Neural Network Size with CKA-Based Mutual Information Pruning
by: Hu, Seungbeom, et al.
Published: (2024)

UnIT: Scalable Unstructured Inference-Time Pruning for MAC-efficient Neural Inference on MCUs
by: Neth, Ashe, et al.
Published: (2025)

A Dynamical Systems-Inspired Pruning Strategy for Addressing Oversmoothing in Graph Neural Networks
by: Chakraborty, Biswadeep, et al.
Published: (2024)

Sparsest Models Elude Pruning: An Exposé of Pruning's Current Capabilities
by: Zhang, Stephen, et al.
Published: (2024)

SwiftPrune: Hessian-Free Weight Pruning for Large Language Models
by: Kang, Yuhan, et al.
Published: (2025)

PQS (Prune, Quantize, and Sort): Low-Bitwidth Accumulation of Dot Products in Neural Network Computations
by: Natesh, Vikas, et al.
Published: (2025)

Enhanced Pruning Strategy for Multi-Component Neural Architectures Using Component-Aware Graph Analysis
by: Sundaram, Ganesh, et al.
Published: (2025)

Simulation-Free Differential Dynamics through Neural Conservation Laws
by: Hua, Mengjian, et al.
Published: (2025)

Deriving Neural Scaling Laws from the statistics of natural language
by: Cagnetta, Francesco, et al.
Published: (2026)

Towards Neural Scaling Laws for Time Series Foundation Models
by: Yao, Qingren, et al.
Published: (2024)

PrunePEFT: Iterative Hybrid Pruning for Parameter-Efficient Fine-tuning of LLMs
by: Yu, Tongzhou, et al.
Published: (2025)

IPPRO: Importance-based Pruning with PRojective Offset for Magnitude-indifferent Structural Pruning
by: Jung, Jaeheun, et al.
Published: (2025)

Mosaic Pruning: A Hierarchical Framework for Generalizable Pruning of Mixture-of-Experts Models
by: Hu, Wentao, et al.
Published: (2025)

TopoPrune: Robust Data Pruning via Unified Latent Space Topology
by: Roy, Arjun, et al.
Published: (2026)

On the Sparsity of the Strong Lottery Ticket Hypothesis
by: Natale, Emanuele, et al.
Published: (2024)

Size-adaptive Hypothesis Testing for Fairness
by: Ferrara, Antonio, et al.
Published: (2025)

Beyond One-Way Pruning: Bidirectional Pruning-Regrowth for Extreme Accuracy-Sparsity Tradeoff
by: Liu, Junchen, et al.
Published: (2025)

Bayesian Neural Scaling Law Extrapolation with Prior-Data Fitted Networks
by: Lee, Dongwoo, et al.
Published: (2025)

Automated Discovery of Conservation Laws via Hybrid Neural ODE-Transformers
by: Doshi, Vivan
Published: (2025)

Müntz-Szász Networks: Neural Architectures with Learnable Power-Law Bases
by: N'guessan, Gnankan Landry Regis
Published: (2025)

Do Neural Scaling Laws Exist on Graph Self-Supervised Learning?
by: Ma, Qian, et al.
Published: (2024)

Application-Specific Component-Aware Structured Pruning of Deep Neural Networks in Control via Soft Coefficient Optimization
by: Sundaram, Ganesh, et al.
Published: (2025)