Information Consistent Pruning: How to Efficiently Search for Sparse Networks?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gharatappeh, Soheil, Sekeh, Salimeh Yasaei
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Information Theory Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FogGuard: guarding YOLO against fog using perceptual loss
by: Gharatappeh, Soheil, et al.
Published: (2024)

The Effect of Label Noise on the Information Content of Neural Representations
by: Umar, Ali Hussaini, et al.
Published: (2025)

Learning Discretized Neural Networks under Ricci Flow
by: Chen, Jun, et al.
Published: (2023)

Neuromorphic Wireless Device-Edge Co-Inference via the Directed Information Bottleneck
by: Ke, Yuzhen, et al.
Published: (2024)

A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functions
by: Makkeh, Abdullah, et al.
Published: (2023)

Convergence Analysis for Deep Sparse Coding via Convolutional Neural Networks
by: Li, Jianfei, et al.
Published: (2024)

On the Feasibility of Fidelity$^-$ for Graph Pruning
by: Shin, Yong-Min, et al.
Published: (2024)

Neuromorphic Wireless Split Computing with Resonate-and-Fire Neurons
by: Wu, Dengyu, et al.
Published: (2025)

Modern Neuromorphic AI: From Intra-Token to Inter-Token Processing
by: Simeone, Osvaldo
Published: (2026)

Neuromorphic Wireless Split Computing with Multi-Level Spikes
by: Wu, Dengyu, et al.
Published: (2024)

What should a neuron aim for? Designing local objective functions based on information theory
by: Schneider, Andreas C., et al.
Published: (2024)

Correlative Information Maximization: A Biologically Plausible Approach to Supervised Deep Neural Networks without Weight Symmetry
by: Bozkurt, Bariscan, et al.
Published: (2023)

EQNN: Enhanced Quantum Neural Network
by: Chen, Abel C. H.
Published: (2024)

Spectral-Stimulus Information for Self-Supervised Stimulus Encoding
by: Deighton, Jared, et al.
Published: (2024)

Scaling Laws and Tradeoffs in Recurrent Networks of Expressive Neurons
by: Spieler, Aaron, et al.
Published: (2026)

Measuring and Controlling Solution Degeneracy across Task-Trained Recurrent Neural Networks
by: Huang, Ann, et al.
Published: (2024)

Redundancy Maximization as a Principle of Associative Memory Learning
by: Blümel, Mark, et al.
Published: (2025)

Ghost-Connect Net: A Generalization-Enhanced Guidance For Sparse Deep Networks Under Distribution Shifts
by: Wisell, Mary Isabelle, et al.
Published: (2024)

Decomposer Networks: Deep Component Analysis and Synthesis
by: Joneidi, Mohsen
Published: (2025)

Fast Fourier Transform-Based Spectral and Temporal Gradient Filtering for Differential Privacy
by: Shin, Hyeju, et al.
Published: (2025)

Supercharging Simulation-Based Inference for Bayesian Optimal Experimental Design
by: Klein, Samuel, et al.
Published: (2026)

LASER: Linear Compression in Wireless Distributed Optimization
by: Makkuva, Ashok Vardhan, et al.
Published: (2023)

Small Contributions, Small Networks: Efficient Neural Network Pruning Based on Relative Importance
by: Hussien, Mostafa, et al.
Published: (2024)

Efficient Multi-Objective Neural Architecture Search via Pareto Dominance-based Novelty Search
by: Vo, An, et al.
Published: (2024)

PAGE: Prototype-Based Model-Level Explanations for Graph Neural Networks
by: Shin, Yong-Min, et al.
Published: (2022)

Pruning Increases Orderedness in Recurrent Computation
by: Song, Yiding
Published: (2025)

IM-META: Influence Maximization Using Node Metadata in Networks With Unknown Topology
by: Tran, Cong, et al.
Published: (2021)

FGATT: A Robust Framework for Wireless Data Imputation Using Fuzzy Graph Attention Networks and Transformer Encoders
by: Xing, Jinming, et al.
Published: (2024)

Faithful and Accurate Self-Attention Attribution for Message Passing Neural Networks via the Computation Tree Viewpoint
by: Shin, Yong-Min, et al.
Published: (2024)

Heterogeneous Connectivity in Sparse Networks: Fan-in Profiles, Gradient Hierarchy, and Topological Equilibria
by: Tomczak, Nikodem
Published: (2026)

Combining Relevance and Magnitude for Resource-Aware DNN Pruning
by: Chiasserini, Carla Fabiana, et al.
Published: (2024)

Unsupervised Sparse Coding-based Spiking Neural Network for Real-time Spike Sorting
by: Melot, Alexis, et al.
Published: (2025)

Sequencing the Neurome: Towards Scalable Exact Parameter Reconstruction of Black-Box Neural Networks
by: Goldfeder, Judah, et al.
Published: (2024)

D-Score: A Synapse-Inspired Approach for Filter Pruning
by: Park, Doyoung, et al.
Published: (2023)

Self-Supervised Neural Architecture Search for Multimodal Deep Neural Networks
by: Suzuki, Shota, et al.
Published: (2025)

Multi-Objective Evolutionary Neural Architecture Search for Recurrent Neural Networks
by: Booysen, Reinhard, et al.
Published: (2024)

How Much is Unseen Depends Chiefly on Information About the Seen
by: Lee, Seongmin, et al.
Published: (2024)

Spiking Heterogeneous Graph Attention Networks
by: Cao, Buqing, et al.
Published: (2025)

Deep Intrinsic Surprise-Regularized Control (DISRC): A Biologically Inspired Mechanism for Efficient Deep Q-Learning in Sparse Environments
by: Kini, Yash, et al.
Published: (2026)

Hidden Activations Are Not Enough: A General Approach to Neural Network Predictions
by: Leblanc, Samuel, et al.
Published: (2024)