Cover Image

Neural Weight Norm = Kolmogorov Complexity

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Musat, Tiberiu
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Geometry of Grokking: Norm Minimization on the Zero-Loss Manifold
by: Musat, Tiberiu
Published: (2025)

Clustering and Alignment: Understanding the Training Dynamics in Modular Addition
by: Musat, Tiberiu
Published: (2024)

Mechanism and Emergence of Stacked Attention Heads in Multi-Layer Transformers
by: Musat, Tiberiu
Published: (2024)

Towards A Unified PAC-Bayesian Framework for Norm-based Generalization Bounds
by: Yi, Xinping, et al.
Published: (2026)

The Geometric Cost of Normalization: Affine Bounds on the Bayesian Complexity of Neural Networks
by: Chun, Sungbae
Published: (2026)

Batches Stabilize the Minimum Norm Risk in High Dimensional Overparameterized Linear Regression
by: Ioushua, Shahar Stein, et al.
Published: (2023)

A Parameter-Free Two-Bit Covariance Estimator with Improved Operator Norm Error Rate
by: Chen, Junren, et al.
Published: (2023)

Testing Dependency of Weighted Random Graphs
by: Oren, Mor, et al.
Published: (2024)

Theory of Minimal Weight Perturbations in Deep Networks and its Applications for Low-Rank Activated Backdoor Attacks
by: Evans, Bethan, et al.
Published: (2026)

Neural Minimum Weight Perfect Matching for Quantum Error Codes
by: Peled, Yotam, et al.
Published: (2026)

Unified Error Correction Code Transformer with Low Complexity
by: Yan, Yongli, et al.
Published: (2024)

Clustering Change Sign Detection by Fusing Mixture Complexity
by: Urano, Kento, et al.
Published: (2024)

Measuring the Predictability of Recommender Systems using Structural Complexity Metrics
by: Abeliuk, Andrés, et al.
Published: (2024)

Neural Distributed Source Coding
by: Whang, Jay, et al.
Published: (2021)

Frame Quantization of Neural Networks
by: Czaja, Wojciech, et al.
Published: (2024)

On the Sample Complexity of Robust Binary Hypothesis Testing
by: Vallinayagam, Shankar, et al.
Published: (2026)

The Sample Complexity of Simple Binary Hypothesis Testing
by: Pensia, Ankit, et al.
Published: (2024)

Complexity as Advantage: A Regret-Based Perspective on Emergent Structure
by: Naparstek, Oshri
Published: (2025)

Topological Neural Networks over the Air
by: Fiorellino, Simone, et al.
Published: (2025)

Klein Model for Hyperbolic Neural Networks
by: Mao, Yidan, et al.
Published: (2024)

Sign-Aware Multistate Jaccard Kernels and Geometry for Real and Complex-Valued Signals
by: Yadav, Vineet
Published: (2025)

Neural Window Decoder for SC-LDPC Codes
by: Yun, Dae-Young, et al.
Published: (2024)

Transfer Entropy in Graph Convolutional Neural Networks
by: Moldovan, Adrian, et al.
Published: (2024)

Generalization Bounds for Neural Belief Propagation Decoders
by: Adiga, Sudarshan, et al.
Published: (2023)

Neural Polar Decoders for DNA Data Storage
by: Aharoni, Ziv, et al.
Published: (2025)

Statistical Complexity and Optimal Algorithms for Non-linear Ridge Bandits
by: Rajaraman, Nived, et al.
Published: (2023)

A Neural Difference-of-Entropies Estimator for Mutual Information
by: Ni, Haoran, et al.
Published: (2025)

Information-Theoretic Generalization Bounds for Deep Neural Networks
by: He, Haiyun, et al.
Published: (2024)

On the Theory of Continual Learning with Gradient Descent for Neural Networks
by: Taheri, Hossein, et al.
Published: (2025)

Code Rate Optimization via Neural Polar Decoders
by: Aharoni, Ziv, et al.
Published: (2025)

Optimal Neural Compressors for the Rate-Distortion-Perception Tradeoff
by: Lei, Eric, et al.
Published: (2025)

Log-Concave Coupling for Sampling Neural Net Posteriors
by: McDonald, Curtis, et al.
Published: (2024)

Sequential 1-bit Mean Estimation with Near-Optimal Sample Complexity
by: Lau, Ivan, et al.
Published: (2025)

Scaled Gradient Descent for Ill-Conditioned Low-Rank Matrix Recovery with Optimal Sampling Complexity
by: Li, Zhenxuan, et al.
Published: (2026)

Optimal Compression of Unit Norm Vectors in the High Distortion Regime
by: Zhu, Heng, et al.
Published: (2023)

Leveraging Code Automorphisms for Improved Syndrome-Based Neural Decoding
by: Bidan, Raphaël Le, et al.
Published: (2026)

Implicit Hypothesis Testing and Divergence Preservation in Neural Network Representations
by: Aksoy, Kadircan, et al.
Published: (2026)

Theoretical Guarantees for Low-Rank Compression of Deep Neural Networks
by: Zhang, Shihao, et al.
Published: (2025)

Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods
by: Taheri, Hossein, et al.
Published: (2024)

Generalization Error of Graph Neural Networks in the Mean-field Regime
by: Aminian, Gholamali, et al.
Published: (2024)