Cover Image

On How Iterative Magnitude Pruning Discovers Local Receptive Fields in Fully Connected Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Redman, William T., Wang, Zhangyang, Ingrosso, Alessandro, Goldt, Sebastian
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Why Neural Network Can Discover Symbolic Structures with Gradient-based Training: An Algebraic and Geometric Foundation for Neurosymbolic Reasoning
by: Wang, Peihao, et al.
Published: (2025)

Insights into the Lottery Ticket Hypothesis and Iterative Magnitude Pruning
by: Saleem, Tausifa Jan, et al.
Published: (2024)

Sparse Weight Averaging with Multiple Particles for Iterative Magnitude Pruning
by: Choi, Moonseok, et al.
Published: (2023)

Improving the Effective Receptive Field of Message-Passing Neural Networks
by: Finder, Shahaf E., et al.
Published: (2025)

Is Complexity Required for Neural Network Pruning? A Case Study on Global Magnitude Pruning
by: Gupta, Manas, et al.
Published: (2022)

FedMap: Iterative Magnitude-Based Pruning for Communication-Efficient Federated Learning
by: Herzog, Alexander, et al.
Published: (2024)

Spiking Layer-Adaptive Magnitude-based Pruning
by: Wang, Junqiao, et al.
Published: (2026)

Advancing IIoT with Over-the-Air Federated Learning: The Role of Iterative Magnitude Pruning
by: Khan, Fazal Muhammad Ali, et al.
Published: (2024)

Sliding down the stairs: how correlated latent variables accelerate learning with neural networks
by: Bardone, Lorenzo, et al.
Published: (2024)

Two failure modes of deep transformers and how to avoid them: a unified theory of signal propagation at initialisation
by: Giorlandino, Alessio, et al.
Published: (2025)

Generalization Dynamics of Linear Diffusion Models
by: Merger, Claudia, et al.
Published: (2025)

Memorisation, convergence and generalisation in generative models
by: Maillard, Antoine, et al.
Published: (2026)

ICE-Pruning: An Iterative Cost-Efficient Pruning Pipeline for Deep Neural Networks
by: Hu, Wenhao, et al.
Published: (2025)

From Weight Perturbation to Feature Attribution for Explaining Fully Connected Neural Networks
by: Lymperopoulos, Thodoris, et al.
Published: (2026)

Mapping of attention mechanisms to a generalized Potts model
by: Rende, Riccardo, et al.
Published: (2023)

Matrix Completion via Nonsmooth Regularization of Fully Connected Neural Networks
by: Faramarzi, Sajad, et al.
Published: (2024)

IPPRO: Importance-based Pruning with PRojective Offset for Magnitude-indifferent Structural Pruning
by: Jung, Jaeheun, et al.
Published: (2025)

New Approximation Results and Optimal Estimation for Fully Connected Deep Neural Networks
by: Tang, Zhaoji
Published: (2025)

Depth Degeneracy in Neural Networks: Vanishing Angles in Fully Connected ReLU Networks on Initialization
by: Jakub, Cameron, et al.
Published: (2023)

Factual recall in linear associative memories: sharp asymptotics and mechanistic insights
by: Giorlandino, Alessio, et al.
Published: (2026)

Magnitude-based Neuron Pruning for Backdoor Defens
by: Li, Nan, et al.
Published: (2024)

AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Models
by: Lu, Haiquan, et al.
Published: (2024)

Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks
by: Székely, Eszter, et al.
Published: (2023)

Combining Relevance and Magnitude for Resource-Aware DNN Pruning
by: Chiasserini, Carla Fabiana, et al.
Published: (2024)

A Fourier perspective on the learning dynamics of neural networks: from sample complexities to mechanistic insights
by: Ricci, Fabiola, et al.
Published: (2026)

Feature learning from non-Gaussian inputs: the case of Independent Component Analysis in high dimensions
by: Ricci, Fabiola, et al.
Published: (2025)

LoopBench: Discovering Emergent Symmetry Breaking Strategies with LLM Swarms
by: Parsaee, Ali, et al.
Published: (2025)

Magnitude Pruning of Large Pretrained Transformer Models with a Mixture Gaussian Prior
by: Zhang, Mingxuan, et al.
Published: (2024)

Iterative Inference in a Chess-Playing Neural Network
by: Sandmann, Elias, et al.
Published: (2025)

Synthesizing real-world distributions from high-dimensional Gaussian Noise with Fully Connected Neural Network
by: Komorniczak, Joanna
Published: (2026)

RAPNet: A Receptive-Field Adaptive Convolutional Neural Network for Pansharpening
by: Tang, Tao, et al.
Published: (2025)

Training Fully Connected Neural Networks is $\exists\mathbb{R}$-Complete
by: Bertschinger, Daniel, et al.
Published: (2022)

Spectral Pruning for Recurrent Neural Networks
by: Furuya, Takashi, et al.
Published: (2021)

Shortcut Solutions Learned by Transformers Impair Continual Compositional Reasoning
by: Redman, William T., et al.
Published: (2026)

Connecting Parameter Magnitudes and Hessian Eigenspaces at Scale using Sketched Methods
by: Fernandez, Andres, et al.
Published: (2025)

Neural Networks with Sparse Activation Induced by Large Bias: Tighter Analysis with Bias-Generalized NTK
by: Yang, Hongru, et al.
Published: (2023)

Mutual Information Preserving Neural Network Pruning
by: Westphal, Charles, et al.
Published: (2024)

Pruning and Quantization Impact on Graph Neural Networks
by: Khedri, Khatoon, et al.
Published: (2025)

Exploring Vision Neural Network Pruning via Screening Methodology
by: Wang, Mingyuan, et al.
Published: (2025)

Discovering the Representation Bottleneck of Graph Neural Networks
by: Wu, Fang, et al.
Published: (2022)